[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:16:25.005849 17138 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.188.190:40953
I20260709 13:16:25.007462 17138 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:16:25.008538 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:25.027011 17145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:25.027060 17147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:25.028632 17138 server_base.cc:1061] running on GCE node
W20260709 13:16:25.027408 17144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:26.243213 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:26.243472 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:26.243718 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783602986243690 us; error 0 us; skew 500 ppm
I20260709 13:16:26.244750 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:26.251008 17138 webserver.cc:533] Webserver started at http://127.16.188.190:41981/ using document root <none> and password file <none>
I20260709 13:16:26.251951 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:26.252185 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:26.252754 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:26.258958 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/master-0-root/instance:
uuid: "662bd8cff35c476a8ce0656f43777494"
format_stamp: "Formatted at 2026-07-09 13:16:26 on dist-test-slave-2hqk"
I20260709 13:16:26.267722 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:16:26.273401 17153 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:26.274734 17138 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:16:26.275141 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/master-0-root
uuid: "662bd8cff35c476a8ce0656f43777494"
format_stamp: "Formatted at 2026-07-09 13:16:26 on dist-test-slave-2hqk"
I20260709 13:16:26.275522 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:26.343873 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:26.345929 17138 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:16:26.346632 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:26.435465 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.190:40953
I20260709 13:16:26.435557 17204 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.190:40953 every 8 connection(s)
I20260709 13:16:26.444249 17205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:26.465626 17205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494: Bootstrap starting.
I20260709 13:16:26.471448 17205 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:26.473721 17205 log.cc:826] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494: Log is configured to *not* fsync() on all Append() calls
I20260709 13:16:26.478613 17205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494: No bootstrap required, opened a new log
I20260709 13:16:26.498849 17205 raft_consensus.cc:359] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662bd8cff35c476a8ce0656f43777494" member_type: VOTER }
I20260709 13:16:26.499378 17205 raft_consensus.cc:385] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:26.499687 17205 raft_consensus.cc:740] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 662bd8cff35c476a8ce0656f43777494, State: Initialized, Role: FOLLOWER
I20260709 13:16:26.500705 17205 consensus_queue.cc:260] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662bd8cff35c476a8ce0656f43777494" member_type: VOTER }
I20260709 13:16:26.501230 17205 raft_consensus.cc:399] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:26.501528 17205 raft_consensus.cc:493] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:26.501900 17205 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:26.506016 17205 raft_consensus.cc:515] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662bd8cff35c476a8ce0656f43777494" member_type: VOTER }
I20260709 13:16:26.506733 17205 leader_election.cc:304] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 662bd8cff35c476a8ce0656f43777494; no voters: 
I20260709 13:16:26.508641 17205 leader_election.cc:290] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:26.509238 17208 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:26.512080 17208 raft_consensus.cc:697] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [term 1 LEADER]: Becoming Leader. State: Replica: 662bd8cff35c476a8ce0656f43777494, State: Running, Role: LEADER
I20260709 13:16:26.513167 17208 consensus_queue.cc:237] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662bd8cff35c476a8ce0656f43777494" member_type: VOTER }
I20260709 13:16:26.514067 17205 sys_catalog.cc:565] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:26.528035 17210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 662bd8cff35c476a8ce0656f43777494. Latest consensus state: current_term: 1 leader_uuid: "662bd8cff35c476a8ce0656f43777494" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662bd8cff35c476a8ce0656f43777494" member_type: VOTER } }
I20260709 13:16:26.528175 17209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "662bd8cff35c476a8ce0656f43777494" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662bd8cff35c476a8ce0656f43777494" member_type: VOTER } }
I20260709 13:16:26.528954 17210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:26.529019 17209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:26.531940 17218 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:26.547019 17218 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:26.549638 17138 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:26.565843 17218 catalog_manager.cc:1383] Generated new cluster ID: 76f3adfec73f40cabc19a26910966d8e
I20260709 13:16:26.566244 17218 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:26.586653 17218 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:26.588253 17218 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:26.602120 17218 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494: Generated new TSK 0
I20260709 13:16:26.603176 17218 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:26.617470 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:26.628741 17227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:26.630296 17228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:26.634298 17138 server_base.cc:1061] running on GCE node
W20260709 13:16:26.634963 17230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:26.635947 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:26.636142 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:26.636376 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783602986636341 us; error 0 us; skew 500 ppm
I20260709 13:16:26.637084 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:26.641754 17138 webserver.cc:533] Webserver started at http://127.16.188.129:35525/ using document root <none> and password file <none>
I20260709 13:16:26.642307 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:26.642508 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:26.642825 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:26.643978 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/ts-0-root/instance:
uuid: "f459de5cbbd24f6da91c65e002246f37"
format_stamp: "Formatted at 2026-07-09 13:16:26 on dist-test-slave-2hqk"
I20260709 13:16:26.649780 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:16:26.654361 17235 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:26.655370 17138 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:16:26.655817 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/ts-0-root
uuid: "f459de5cbbd24f6da91c65e002246f37"
format_stamp: "Formatted at 2026-07-09 13:16:26 on dist-test-slave-2hqk"
I20260709 13:16:26.656289 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:26.682192 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:26.684216 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:26.687336 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:26.693470 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:26.693799 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:26.694139 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:26.694388 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:26.802407 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.129:44927
I20260709 13:16:26.802461 17297 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.129:44927 every 8 connection(s)
I20260709 13:16:26.811513 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:26.826187 17302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:26.831939 17303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:26.837034 17305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:26.842623 17138 server_base.cc:1061] running on GCE node
I20260709 13:16:26.842907 17298 heartbeater.cc:344] Connected to a master server at 127.16.188.190:40953
I20260709 13:16:26.843508 17298 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:26.843586 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:26.843954 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:26.844146 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783602986844126 us; error 0 us; skew 500 ppm
I20260709 13:16:26.844843 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:26.844942 17298 heartbeater.cc:507] Master 127.16.188.190:40953 requested a full tablet report, sending...
I20260709 13:16:26.849223 17170 ts_manager.cc:194] Registered new tserver with Master: f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927)
I20260709 13:16:26.852703 17170 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36654
I20260709 13:16:26.853220 17138 webserver.cc:533] Webserver started at http://127.16.188.130:44261/ using document root <none> and password file <none>
I20260709 13:16:26.853813 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:26.854043 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:26.854343 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:26.855875 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/ts-1-root/instance:
uuid: "c336c970057e412db6c05a6a2516cfab"
format_stamp: "Formatted at 2026-07-09 13:16:26 on dist-test-slave-2hqk"
I20260709 13:16:26.861958 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:16:26.866650 17310 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:26.867581 17138 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:16:26.867947 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/ts-1-root
uuid: "c336c970057e412db6c05a6a2516cfab"
format_stamp: "Formatted at 2026-07-09 13:16:26 on dist-test-slave-2hqk"
I20260709 13:16:26.868242 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:26.887266 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:26.888505 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:26.890663 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:26.893566 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:26.893859 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:26.894101 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:26.894272 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:26.991184 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.130:46069
I20260709 13:16:26.991631 17372 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.130:46069 every 8 connection(s)
I20260709 13:16:26.998538 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:27.009370 17376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:27.013787 17373 heartbeater.cc:344] Connected to a master server at 127.16.188.190:40953
I20260709 13:16:27.014389 17373 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:27.015743 17373 heartbeater.cc:507] Master 127.16.188.190:40953 requested a full tablet report, sending...
W20260709 13:16:27.015671 17377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:27.017635 17379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:27.018326 17170 ts_manager.cc:194] Registered new tserver with Master: c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069)
I20260709 13:16:27.020221 17170 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36670
I20260709 13:16:27.023025 17138 server_base.cc:1061] running on GCE node
I20260709 13:16:27.023983 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:27.024231 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:27.024444 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783602987024424 us; error 0 us; skew 500 ppm
I20260709 13:16:27.025208 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:27.028095 17138 webserver.cc:533] Webserver started at http://127.16.188.131:38039/ using document root <none> and password file <none>
I20260709 13:16:27.028657 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:27.028882 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:27.029165 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:27.030341 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/ts-2-root/instance:
uuid: "bb67dab9a7854783b5d47a1c08141ec7"
format_stamp: "Formatted at 2026-07-09 13:16:27 on dist-test-slave-2hqk"
I20260709 13:16:27.035415 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:16:27.038810 17384 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:27.039752 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:27.040078 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/ts-2-root
uuid: "bb67dab9a7854783b5d47a1c08141ec7"
format_stamp: "Formatted at 2026-07-09 13:16:27 on dist-test-slave-2hqk"
I20260709 13:16:27.040380 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602984839783-17138-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:27.060599 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:27.061820 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:27.063270 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:27.066702 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:27.066924 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:27.067162 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:27.067332 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:27.163311 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.131:45429
I20260709 13:16:27.163928 17446 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.131:45429 every 8 connection(s)
I20260709 13:16:27.182102 17447 heartbeater.cc:344] Connected to a master server at 127.16.188.190:40953
I20260709 13:16:27.182562 17447 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:27.183323 17447 heartbeater.cc:507] Master 127.16.188.190:40953 requested a full tablet report, sending...
I20260709 13:16:27.185369 17170 ts_manager.cc:194] Registered new tserver with Master: bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:27.185902 17138 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014492038s
I20260709 13:16:27.187081 17170 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36676
I20260709 13:16:27.238317 17170 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36682:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:27.241804 17170 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:27.351852 17412 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc07ad9bd714d4e859aceea970f8191 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:27.353493 17411 tablet_service.cc:1511] Processing CreateTablet for tablet 408d415cca0242f2bd1a949d7a783b8f (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:27.354558 17412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc07ad9bd714d4e859aceea970f8191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.351925 17410 tablet_service.cc:1511] Processing CreateTablet for tablet 20497ae36d814dae907bc3b7a1cd13eb (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:27.360342 17411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 408d415cca0242f2bd1a949d7a783b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.367470 17410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20497ae36d814dae907bc3b7a1cd13eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.371065 17335 tablet_service.cc:1511] Processing CreateTablet for tablet 9deacc3fd54645b3b2ef76e85648c3ce (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:27.369117 17338 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc07ad9bd714d4e859aceea970f8191 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:27.371305 17336 tablet_service.cc:1511] Processing CreateTablet for tablet 20497ae36d814dae907bc3b7a1cd13eb (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:27.372651 17337 tablet_service.cc:1511] Processing CreateTablet for tablet 408d415cca0242f2bd1a949d7a783b8f (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:27.368999 17409 tablet_service.cc:1511] Processing CreateTablet for tablet 9deacc3fd54645b3b2ef76e85648c3ce (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:27.375556 17335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9deacc3fd54645b3b2ef76e85648c3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.375852 17409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9deacc3fd54645b3b2ef76e85648c3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.379639 17338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc07ad9bd714d4e859aceea970f8191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.384929 17336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20497ae36d814dae907bc3b7a1cd13eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.385807 17334 tablet_service.cc:1511] Processing CreateTablet for tablet 0a81d7a76f54402193f7961a6d357a27 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:27.392470 17337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 408d415cca0242f2bd1a949d7a783b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.396770 17334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a81d7a76f54402193f7961a6d357a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.399302 17408 tablet_service.cc:1511] Processing CreateTablet for tablet 0a81d7a76f54402193f7961a6d357a27 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:27.404064 17408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a81d7a76f54402193f7961a6d357a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.423187 17262 tablet_service.cc:1511] Processing CreateTablet for tablet 408d415cca0242f2bd1a949d7a783b8f (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:27.425122 17263 tablet_service.cc:1511] Processing CreateTablet for tablet 0fc07ad9bd714d4e859aceea970f8191 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:27.425191 17262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 408d415cca0242f2bd1a949d7a783b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.434511 17261 tablet_service.cc:1511] Processing CreateTablet for tablet 20497ae36d814dae907bc3b7a1cd13eb (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:27.443302 17263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fc07ad9bd714d4e859aceea970f8191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.441358 17333 tablet_service.cc:1511] Processing CreateTablet for tablet 0c9a5135c61a46b99b3fc1add6f1efc2 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:27.450465 17259 tablet_service.cc:1511] Processing CreateTablet for tablet 0a81d7a76f54402193f7961a6d357a27 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:27.454759 17258 tablet_service.cc:1511] Processing CreateTablet for tablet 0c9a5135c61a46b99b3fc1add6f1efc2 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:27.456703 17333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c9a5135c61a46b99b3fc1add6f1efc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.458343 17261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20497ae36d814dae907bc3b7a1cd13eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.456571 17407 tablet_service.cc:1511] Processing CreateTablet for tablet 0c9a5135c61a46b99b3fc1add6f1efc2 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:27.454900 17260 tablet_service.cc:1511] Processing CreateTablet for tablet 9deacc3fd54645b3b2ef76e85648c3ce (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:27.463390 17407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c9a5135c61a46b99b3fc1add6f1efc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.475898 17259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a81d7a76f54402193f7961a6d357a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.484380 17258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c9a5135c61a46b99b3fc1add6f1efc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.493265 17260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9deacc3fd54645b3b2ef76e85648c3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.491530 17257 tablet_service.cc:1511] Processing CreateTablet for tablet c9f80a1f3d6849abadfabae77b3f76f0 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:27.504745 17257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f80a1f3d6849abadfabae77b3f76f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.501267 17332 tablet_service.cc:1511] Processing CreateTablet for tablet c9f80a1f3d6849abadfabae77b3f76f0 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:27.506789 17406 tablet_service.cc:1511] Processing CreateTablet for tablet c9f80a1f3d6849abadfabae77b3f76f0 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:27.509001 17332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f80a1f3d6849abadfabae77b3f76f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.513226 17406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f80a1f3d6849abadfabae77b3f76f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:27.537230 17217 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:27.566524 17405 tablet_service.cc:1511] Processing CreateTablet for tablet 7be27b8136364b749f7ebf6f6ca0efe1 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:27.562793 17331 tablet_service.cc:1511] Processing CreateTablet for tablet 7be27b8136364b749f7ebf6f6ca0efe1 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:27.569994 17405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be27b8136364b749f7ebf6f6ca0efe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.566617 17256 tablet_service.cc:1511] Processing CreateTablet for tablet 7be27b8136364b749f7ebf6f6ca0efe1 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:27.575803 17256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be27b8136364b749f7ebf6f6ca0efe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.577666 17331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be27b8136364b749f7ebf6f6ca0efe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.586404 17466 tablet_bootstrap.cc:492] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7: Bootstrap starting.
I20260709 13:16:27.594624 17465 tablet_bootstrap.cc:492] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab: Bootstrap starting.
I20260709 13:16:27.603360 17410 tablet_service.cc:1511] Processing CreateTablet for tablet cd0030d950894d17ba45d6fc425c8f15 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:27.605549 17337 tablet_service.cc:1511] Processing CreateTablet for tablet cd0030d950894d17ba45d6fc425c8f15 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:27.615238 17337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0030d950894d17ba45d6fc425c8f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.616855 17467 tablet_bootstrap.cc:492] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37: Bootstrap starting.
I20260709 13:16:27.619410 17410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0030d950894d17ba45d6fc425c8f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.619992 17263 tablet_service.cc:1511] Processing CreateTablet for tablet cd0030d950894d17ba45d6fc425c8f15 (DEFAULT_TABLE table=test-workload [id=9027723a65be4e078945f656e3fa366f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:27.652688 17263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0030d950894d17ba45d6fc425c8f15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:27.679484 17465 tablet_bootstrap.cc:654] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.686439 17466 tablet_bootstrap.cc:654] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.694341 17467 tablet_bootstrap.cc:654] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.701709 17465 tablet_bootstrap.cc:492] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab: No bootstrap required, opened a new log
I20260709 13:16:27.702255 17465 ts_tablet_manager.cc:1403] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab: Time spent bootstrapping tablet: real 0.134s	user 0.010s	sys 0.007s
I20260709 13:16:27.705986 17465 raft_consensus.cc:359] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.706773 17465 raft_consensus.cc:385] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.707831 17465 raft_consensus.cc:740] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.711341 17466 tablet_bootstrap.cc:492] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7: No bootstrap required, opened a new log
I20260709 13:16:27.711987 17466 ts_tablet_manager.cc:1403] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7: Time spent bootstrapping tablet: real 0.145s	user 0.011s	sys 0.023s
I20260709 13:16:27.715051 17466 raft_consensus.cc:359] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.715936 17466 raft_consensus.cc:385] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.716279 17466 raft_consensus.cc:740] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.709048 17465 consensus_queue.cc:260] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.717221 17466 consensus_queue.cc:260] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.725136 17472 raft_consensus.cc:493] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.725826 17472 raft_consensus.cc:515] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.730273 17465 ts_tablet_manager.cc:1434] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.008s
I20260709 13:16:27.731510 17373 heartbeater.cc:499] Master 127.16.188.190:40953 was elected leader, sending a full tablet report...
I20260709 13:16:27.731914 17465 tablet_bootstrap.cc:492] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab: Bootstrap starting.
I20260709 13:16:27.739174 17467 tablet_bootstrap.cc:492] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37: No bootstrap required, opened a new log
I20260709 13:16:27.739691 17467 ts_tablet_manager.cc:1403] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37: Time spent bootstrapping tablet: real 0.162s	user 0.024s	sys 0.017s
I20260709 13:16:27.743094 17472 leader_election.cc:290] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
W20260709 13:16:27.750635 17374 tablet.cc:2406] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:16:27.750855 17467 raft_consensus.cc:359] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } } peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } }
I20260709 13:16:27.756075 17467 raft_consensus.cc:385] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.756654 17467 raft_consensus.cc:740] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.757534 17467 consensus_queue.cc:260] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } } peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } }
I20260709 13:16:27.757938 17466 ts_tablet_manager.cc:1434] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7: Time spent starting tablet: real 0.046s	user 0.023s	sys 0.009s
I20260709 13:16:27.758587 17447 heartbeater.cc:499] Master 127.16.188.190:40953 was elected leader, sending a full tablet report...
I20260709 13:16:27.761438 17466 tablet_bootstrap.cc:492] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7: Bootstrap starting.
I20260709 13:16:27.761765 17465 tablet_bootstrap.cc:654] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.780056 17298 heartbeater.cc:499] Master 127.16.188.190:40953 was elected leader, sending a full tablet report...
I20260709 13:16:27.781378 17467 ts_tablet_manager.cc:1434] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.016s
I20260709 13:16:27.785914 17467 tablet_bootstrap.cc:492] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37: Bootstrap starting.
I20260709 13:16:27.801445 17466 tablet_bootstrap.cc:654] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.801793 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f459de5cbbd24f6da91c65e002246f37" is_pre_election: true
I20260709 13:16:27.806017 17467 tablet_bootstrap.cc:654] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:27.807492 17314 leader_election.cc:343] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:27.808689 17465 tablet_bootstrap.cc:492] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab: No bootstrap required, opened a new log
I20260709 13:16:27.809188 17465 ts_tablet_manager.cc:1403] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.012s
I20260709 13:16:27.812621 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7" is_pre_election: true
W20260709 13:16:27.814797 17311 leader_election.cc:343] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:27.815281 17311 leader_election.cc:304] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c336c970057e412db6c05a6a2516cfab; no voters: bb67dab9a7854783b5d47a1c08141ec7, f459de5cbbd24f6da91c65e002246f37
I20260709 13:16:27.816335 17472 raft_consensus.cc:2749] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:27.817781 17465 raft_consensus.cc:359] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.818351 17465 raft_consensus.cc:385] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.818619 17465 raft_consensus.cc:740] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.819351 17465 consensus_queue.cc:260] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.821316 17465 ts_tablet_manager.cc:1434] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:16:27.822052 17467 tablet_bootstrap.cc:492] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37: No bootstrap required, opened a new log
I20260709 13:16:27.822317 17465 tablet_bootstrap.cc:492] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab: Bootstrap starting.
I20260709 13:16:27.822641 17467 ts_tablet_manager.cc:1403] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.006s
I20260709 13:16:27.825773 17467 raft_consensus.cc:359] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.826625 17467 raft_consensus.cc:385] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.826987 17467 raft_consensus.cc:740] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.827907 17467 consensus_queue.cc:260] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.830559 17467 ts_tablet_manager.cc:1434] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:16:27.831710 17467 tablet_bootstrap.cc:492] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37: Bootstrap starting.
I20260709 13:16:27.837219 17465 tablet_bootstrap.cc:654] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.840556 17466 tablet_bootstrap.cc:492] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7: No bootstrap required, opened a new log
I20260709 13:16:27.841321 17466 ts_tablet_manager.cc:1403] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7: Time spent bootstrapping tablet: real 0.080s	user 0.008s	sys 0.008s
I20260709 13:16:27.844583 17466 raft_consensus.cc:359] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.845356 17466 raft_consensus.cc:385] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.845654 17466 raft_consensus.cc:740] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.847246 17466 consensus_queue.cc:260] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.852160 17466 ts_tablet_manager.cc:1434] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:16:27.858896 17467 tablet_bootstrap.cc:654] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.861886 17466 tablet_bootstrap.cc:492] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7: Bootstrap starting.
I20260709 13:16:27.866322 17465 tablet_bootstrap.cc:492] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab: No bootstrap required, opened a new log
I20260709 13:16:27.866833 17465 ts_tablet_manager.cc:1403] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.010s
I20260709 13:16:27.869095 17467 tablet_bootstrap.cc:492] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37: No bootstrap required, opened a new log
I20260709 13:16:27.869606 17467 ts_tablet_manager.cc:1403] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.001s
I20260709 13:16:27.869501 17465 raft_consensus.cc:359] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.870479 17466 tablet_bootstrap.cc:654] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.870482 17465 raft_consensus.cc:385] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.870967 17465 raft_consensus.cc:740] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.871821 17465 consensus_queue.cc:260] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.872923 17467 raft_consensus.cc:359] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.873669 17467 raft_consensus.cc:385] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.873984 17467 raft_consensus.cc:740] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.874577 17465 ts_tablet_manager.cc:1434] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:27.874742 17467 consensus_queue.cc:260] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.875911 17465 tablet_bootstrap.cc:492] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab: Bootstrap starting.
I20260709 13:16:27.877507 17467 ts_tablet_manager.cc:1434] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:27.878539 17467 tablet_bootstrap.cc:492] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37: Bootstrap starting.
I20260709 13:16:27.883194 17465 tablet_bootstrap.cc:654] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.885655 17467 tablet_bootstrap.cc:654] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.892906 17466 tablet_bootstrap.cc:492] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7: No bootstrap required, opened a new log
I20260709 13:16:27.893476 17466 ts_tablet_manager.cc:1403] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.000s
I20260709 13:16:27.894660 17465 tablet_bootstrap.cc:492] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab: No bootstrap required, opened a new log
I20260709 13:16:27.895114 17465 ts_tablet_manager.cc:1403] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:16:27.896553 17466 raft_consensus.cc:359] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } } peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } }
I20260709 13:16:27.897392 17466 raft_consensus.cc:385] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.897746 17466 raft_consensus.cc:740] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.897974 17465 raft_consensus.cc:359] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } } peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } }
I20260709 13:16:27.898674 17465 raft_consensus.cc:385] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.898995 17465 raft_consensus.cc:740] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.899096 17467 tablet_bootstrap.cc:492] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37: No bootstrap required, opened a new log
I20260709 13:16:27.898782 17466 consensus_queue.cc:260] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } } peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } }
I20260709 13:16:27.899618 17467 ts_tablet_manager.cc:1403] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 13:16:27.899991 17465 consensus_queue.cc:260] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } } peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } }
I20260709 13:16:27.903321 17466 ts_tablet_manager.cc:1434] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:16:27.903120 17467 raft_consensus.cc:359] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.903909 17467 raft_consensus.cc:385] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.904227 17467 raft_consensus.cc:740] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.904485 17466 tablet_bootstrap.cc:492] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7: Bootstrap starting.
I20260709 13:16:27.904963 17467 consensus_queue.cc:260] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.907537 17465 ts_tablet_manager.cc:1434] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:16:27.908128 17467 ts_tablet_manager.cc:1434] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:16:27.908468 17465 tablet_bootstrap.cc:492] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab: Bootstrap starting.
I20260709 13:16:27.909113 17467 tablet_bootstrap.cc:492] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37: Bootstrap starting.
I20260709 13:16:27.915030 17465 tablet_bootstrap.cc:654] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.918282 17467 tablet_bootstrap.cc:654] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.931614 17467 tablet_bootstrap.cc:492] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37: No bootstrap required, opened a new log
I20260709 13:16:27.932133 17467 ts_tablet_manager.cc:1403] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37: Time spent bootstrapping tablet: real 0.023s	user 0.003s	sys 0.015s
I20260709 13:16:27.933100 17466 tablet_bootstrap.cc:654] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.935230 17467 raft_consensus.cc:359] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.936019 17467 raft_consensus.cc:385] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.936311 17467 raft_consensus.cc:740] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.937251 17467 consensus_queue.cc:260] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.939843 17467 ts_tablet_manager.cc:1434] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:27.940868 17467 tablet_bootstrap.cc:492] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37: Bootstrap starting.
I20260709 13:16:27.946506 17476 raft_consensus.cc:493] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.947017 17476 raft_consensus.cc:515] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } } peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } }
I20260709 13:16:27.951269 17476 leader_election.cc:290] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429), c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069)
I20260709 13:16:27.953749 17467 tablet_bootstrap.cc:654] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.959317 17465 tablet_bootstrap.cc:492] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab: No bootstrap required, opened a new log
I20260709 13:16:27.959880 17465 ts_tablet_manager.cc:1403] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab: Time spent bootstrapping tablet: real 0.052s	user 0.023s	sys 0.017s
I20260709 13:16:27.962855 17465 raft_consensus.cc:359] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.963645 17465 raft_consensus.cc:385] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.963975 17465 raft_consensus.cc:740] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.960458 17466 tablet_bootstrap.cc:492] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7: No bootstrap required, opened a new log
I20260709 13:16:27.964720 17466 ts_tablet_manager.cc:1403] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.002s
I20260709 13:16:27.964838 17465 consensus_queue.cc:260] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.970487 17465 ts_tablet_manager.cc:1434] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:16:27.970834 17467 tablet_bootstrap.cc:492] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37: No bootstrap required, opened a new log
I20260709 13:16:27.971379 17467 ts_tablet_manager.cc:1403] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.003s
I20260709 13:16:27.971581 17465 tablet_bootstrap.cc:492] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab: Bootstrap starting.
I20260709 13:16:27.974675 17467 raft_consensus.cc:359] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.976296 17467 raft_consensus.cc:385] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.977090 17467 raft_consensus.cc:740] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.978029 17467 consensus_queue.cc:260] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.973122 17466 raft_consensus.cc:359] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.979162 17476 raft_consensus.cc:493] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.979605 17466 raft_consensus.cc:385] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:27.979936 17466 raft_consensus.cc:740] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Initialized, Role: FOLLOWER
I20260709 13:16:27.979751 17476 raft_consensus.cc:515] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.980796 17466 consensus_queue.cc:260] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.981868 17476 leader_election.cc:290] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:27.983440 17465 tablet_bootstrap.cc:654] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:27.983491 17466 ts_tablet_manager.cc:1434] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:16:27.985958 17466 tablet_bootstrap.cc:492] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7: Bootstrap starting.
I20260709 13:16:27.994341 17476 raft_consensus.cc:493] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.995306 17421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408d415cca0242f2bd1a949d7a783b8f" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7" is_pre_election: true
I20260709 13:16:27.995222 17476 raft_consensus.cc:515] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:27.994228 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc07ad9bd714d4e859aceea970f8191" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7" is_pre_election: true
I20260709 13:16:27.996218 17421 raft_consensus.cc:2468] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 0.
I20260709 13:16:27.997737 17476 leader_election.cc:290] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:27.996999 17422 raft_consensus.cc:2468] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 0.
I20260709 13:16:28.000166 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7" is_pre_election: true
I20260709 13:16:28.001098 17422 raft_consensus.cc:2468] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 0.
I20260709 13:16:28.003240 17467 ts_tablet_manager.cc:1434] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.005s
I20260709 13:16:28.003947 17466 tablet_bootstrap.cc:654] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.004391 17467 tablet_bootstrap.cc:492] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37: Bootstrap starting.
I20260709 13:16:28.005515 17236 leader_election.cc:304] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:28.008827 17476 raft_consensus.cc:2804] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.008985 17236 leader_election.cc:304] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:28.009303 17476 raft_consensus.cc:493] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.009791 17476 raft_consensus.cc:3060] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.009956 17236 leader_election.cc:304] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:28.013033 17492 raft_consensus.cc:2804] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.013540 17492 raft_consensus.cc:493] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.013924 17492 raft_consensus.cc:3060] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.021908 17347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408d415cca0242f2bd1a949d7a783b8f" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab" is_pre_election: true
I20260709 13:16:28.022141 17348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc07ad9bd714d4e859aceea970f8191" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab" is_pre_election: true
I20260709 13:16:28.022859 17347 raft_consensus.cc:2468] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 0.
I20260709 13:16:28.022987 17348 raft_consensus.cc:2468] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 0.
I20260709 13:16:28.023959 17346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab" is_pre_election: true
I20260709 13:16:28.024726 17346 raft_consensus.cc:2468] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 0.
I20260709 13:16:28.027529 17466 tablet_bootstrap.cc:492] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7: No bootstrap required, opened a new log
I20260709 13:16:28.028049 17466 ts_tablet_manager.cc:1403] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.005s
I20260709 13:16:28.033123 17466 raft_consensus.cc:359] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.034832 17466 raft_consensus.cc:385] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.029937 17495 raft_consensus.cc:2804] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.035635 17495 raft_consensus.cc:493] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.036106 17495 raft_consensus.cc:3060] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.036374 17492 raft_consensus.cc:515] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } } peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } }
I20260709 13:16:28.035233 17466 raft_consensus.cc:740] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.039367 17467 tablet_bootstrap.cc:654] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.041035 17476 raft_consensus.cc:515] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.057667 17496 raft_consensus.cc:493] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.059370 17465 tablet_bootstrap.cc:492] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab: No bootstrap required, opened a new log
I20260709 13:16:28.060384 17492 leader_election.cc:290] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 election: Requested vote from peers bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429), c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069)
I20260709 13:16:28.060796 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc07ad9bd714d4e859aceea970f8191" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:28.061151 17346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408d415cca0242f2bd1a949d7a783b8f" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:28.061313 17476 leader_election.cc:290] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 election: Requested vote from peers c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:28.061394 17422 raft_consensus.cc:3060] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.061679 17346 raft_consensus.cc:3060] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.059090 17466 consensus_queue.cc:260] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.062932 17465 ts_tablet_manager.cc:1403] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.020s
I20260709 13:16:28.067200 17348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc07ad9bd714d4e859aceea970f8191" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:28.067756 17348 raft_consensus.cc:3060] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.067922 17466 ts_tablet_manager.cc:1434] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7: Time spent starting tablet: real 0.040s	user 0.015s	sys 0.002s
I20260709 13:16:28.072081 17466 tablet_bootstrap.cc:492] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7: Bootstrap starting.
I20260709 13:16:28.068730 17421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408d415cca0242f2bd1a949d7a783b8f" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:28.070677 17465 raft_consensus.cc:359] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.074510 17421 raft_consensus.cc:3060] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.074615 17465 raft_consensus.cc:385] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.074932 17465 raft_consensus.cc:740] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.073273 17495 raft_consensus.cc:515] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.058562 17496 raft_consensus.cc:515] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.081501 17465 consensus_queue.cc:260] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.089560 17348 raft_consensus.cc:2468] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 1.
I20260709 13:16:28.091396 17239 leader_election.cc:304] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:28.093050 17473 raft_consensus.cc:493] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.093639 17473 raft_consensus.cc:515] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.096055 17495 leader_election.cc:290] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 election: Requested vote from peers c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:28.094347 17476 raft_consensus.cc:2804] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:28.098325 17473 leader_election.cc:290] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069)
I20260709 13:16:28.097493 17348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:28.108285 17465 ts_tablet_manager.cc:1434] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:16:28.110380 17467 tablet_bootstrap.cc:492] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37: No bootstrap required, opened a new log
I20260709 13:16:28.110520 17496 leader_election.cc:290] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:28.110934 17467 ts_tablet_manager.cc:1403] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.004s
I20260709 13:16:28.100445 17346 raft_consensus.cc:2468] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 1.
I20260709 13:16:28.111203 17347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab" is_pre_election: true
I20260709 13:16:28.101001 17476 raft_consensus.cc:697] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Becoming Leader. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Running, Role: LEADER
I20260709 13:16:28.117874 17420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:28.121868 17420 raft_consensus.cc:3060] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.121913 17465 tablet_bootstrap.cc:492] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab: Bootstrap starting.
I20260709 13:16:28.123477 17466 tablet_bootstrap.cc:654] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.115612 17348 raft_consensus.cc:3060] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.124060 17239 leader_election.cc:304] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:28.127749 17419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7" is_pre_election: true
I20260709 13:16:28.129272 17495 raft_consensus.cc:2804] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:28.131665 17495 raft_consensus.cc:697] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Becoming Leader. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Running, Role: LEADER
I20260709 13:16:28.132330 17467 raft_consensus.cc:359] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.133229 17467 raft_consensus.cc:385] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:16:28.132798 17239 leader_election.cc:343] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:28.133265 17495 consensus_queue.cc:237] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.135275 17476 consensus_queue.cc:237] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } } peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } }
W20260709 13:16:28.136994 17236 leader_election.cc:343] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:28.138475 17236 leader_election.cc:304] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f459de5cbbd24f6da91c65e002246f37; no voters: bb67dab9a7854783b5d47a1c08141ec7, c336c970057e412db6c05a6a2516cfab
I20260709 13:16:28.133762 17467 raft_consensus.cc:740] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.140139 17467 consensus_queue.cc:260] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.142340 17496 raft_consensus.cc:2749] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:28.146042 17467 ts_tablet_manager.cc:1434] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:16:28.139529 17421 raft_consensus.cc:2468] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 1.
I20260709 13:16:28.157011 17472 raft_consensus.cc:493] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.157503 17472 raft_consensus.cc:515] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.155019 17422 raft_consensus.cc:2468] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 1.
I20260709 13:16:28.161980 17472 leader_election.cc:290] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:28.162846 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f459de5cbbd24f6da91c65e002246f37" is_pre_election: true
I20260709 13:16:28.163230 17421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7" is_pre_election: true
I20260709 13:16:28.163554 17273 raft_consensus.cc:2468] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 0.
I20260709 13:16:28.163830 17421 raft_consensus.cc:2468] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 0.
I20260709 13:16:28.165469 17314 leader_election.cc:304] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:28.166975 17465 tablet_bootstrap.cc:654] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.167460 17467 tablet_bootstrap.cc:492] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37: Bootstrap starting.
I20260709 13:16:28.167078 17472 raft_consensus.cc:2804] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.168187 17472 raft_consensus.cc:493] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.169055 17472 raft_consensus.cc:3060] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.175454 17348 raft_consensus.cc:2468] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 1.
I20260709 13:16:28.177202 17239 leader_election.cc:304] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:28.178915 17492 raft_consensus.cc:2804] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:28.179723 17492 raft_consensus.cc:697] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Becoming Leader. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Running, Role: LEADER
I20260709 13:16:28.180660 17492 consensus_queue.cc:237] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.188606 17472 raft_consensus.cc:515] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.190805 17467 tablet_bootstrap.cc:654] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.192862 17472 leader_election.cc:290] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 1 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:28.196419 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:28.196678 17496 raft_consensus.cc:493] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.193127 17420 raft_consensus.cc:2468] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 1.
I20260709 13:16:28.197885 17496 raft_consensus.cc:515] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.200168 17496 leader_election.cc:290] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:28.200255 17466 tablet_bootstrap.cc:492] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7: No bootstrap required, opened a new log
I20260709 13:16:28.202785 17466 ts_tablet_manager.cc:1403] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7: Time spent bootstrapping tablet: real 0.131s	user 0.011s	sys 0.019s
I20260709 13:16:28.202772 17348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9a5135c61a46b99b3fc1add6f1efc2" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab" is_pre_election: true
I20260709 13:16:28.207031 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:28.207716 17422 raft_consensus.cc:3060] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.207051 17348 raft_consensus.cc:2468] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 0.
I20260709 13:16:28.209304 17239 leader_election.cc:304] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:28.210227 17496 raft_consensus.cc:2804] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.210597 17496 raft_consensus.cc:493] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.210973 17496 raft_consensus.cc:3060] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.213984 17273 raft_consensus.cc:3060] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.218092 17466 raft_consensus.cc:359] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.219008 17422 raft_consensus.cc:2468] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 1.
I20260709 13:16:28.219161 17170 catalog_manager.cc:5697] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to f459de5cbbd24f6da91c65e002246f37 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f459de5cbbd24f6da91c65e002246f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.221994 17466 raft_consensus.cc:385] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.222554 17311 leader_election.cc:304] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, c336c970057e412db6c05a6a2516cfab; no voters: 
I20260709 13:16:28.223024 17466 raft_consensus.cc:740] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.224129 17273 raft_consensus.cc:2468] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 1.
I20260709 13:16:28.223698 17472 raft_consensus.cc:2804] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:28.225078 17420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9a5135c61a46b99b3fc1add6f1efc2" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7" is_pre_election: true
I20260709 13:16:28.230429 17466 consensus_queue.cc:260] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.238786 17420 raft_consensus.cc:2468] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 0.
I20260709 13:16:28.250192 17466 ts_tablet_manager.cc:1434] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.004s
I20260709 13:16:28.250723 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f459de5cbbd24f6da91c65e002246f37" is_pre_election: true
I20260709 13:16:28.257088 17496 raft_consensus.cc:515] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.260532 17465 tablet_bootstrap.cc:492] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab: No bootstrap required, opened a new log
I20260709 13:16:28.261102 17465 ts_tablet_manager.cc:1403] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab: Time spent bootstrapping tablet: real 0.140s	user 0.023s	sys 0.010s
I20260709 13:16:28.262595 17273 raft_consensus.cc:2393] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb67dab9a7854783b5d47a1c08141ec7 in current term 1: Already voted for candidate c336c970057e412db6c05a6a2516cfab in this term.
I20260709 13:16:28.263829 17348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9a5135c61a46b99b3fc1add6f1efc2" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:28.262136 17472 raft_consensus.cc:697] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 1 LEADER]: Becoming Leader. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:28.264724 17348 raft_consensus.cc:3060] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.266028 17466 tablet_bootstrap.cc:492] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7: Bootstrap starting.
I20260709 13:16:28.269718 17420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9a5135c61a46b99b3fc1add6f1efc2" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:28.265547 17472 consensus_queue.cc:237] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.270340 17420 raft_consensus.cc:3060] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.271128 17465 raft_consensus.cc:359] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.271916 17465 raft_consensus.cc:385] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.272213 17465 raft_consensus.cc:740] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.273020 17465 consensus_queue.cc:260] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.275435 17467 tablet_bootstrap.cc:492] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37: No bootstrap required, opened a new log
I20260709 13:16:28.275913 17467 ts_tablet_manager.cc:1403] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37: Time spent bootstrapping tablet: real 0.109s	user 0.014s	sys 0.019s
I20260709 13:16:28.266530 17496 leader_election.cc:290] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 election: Requested vote from peers c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:28.282857 17348 raft_consensus.cc:2468] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 1.
I20260709 13:16:28.293371 17420 raft_consensus.cc:2468] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 1.
I20260709 13:16:28.296649 17239 leader_election.cc:304] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:28.298830 17496 raft_consensus.cc:2804] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:28.299675 17496 raft_consensus.cc:697] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Becoming Leader. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Running, Role: LEADER
I20260709 13:16:28.300782 17496 consensus_queue.cc:237] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.291572 17467 raft_consensus.cc:359] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.303048 17467 raft_consensus.cc:385] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.303707 17467 raft_consensus.cc:740] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.303762 17473 raft_consensus.cc:493] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.305719 17467 consensus_queue.cc:260] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.316952 17509 raft_consensus.cc:493] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.317473 17509 raft_consensus.cc:515] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.317899 17467 ts_tablet_manager.cc:1434] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:16:28.319180 17467 tablet_bootstrap.cc:492] T cd0030d950894d17ba45d6fc425c8f15 P f459de5cbbd24f6da91c65e002246f37: Bootstrap starting.
I20260709 13:16:28.319655 17509 leader_election.cc:290] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:28.320487 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be27b8136364b749f7ebf6f6ca0efe1" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f459de5cbbd24f6da91c65e002246f37" is_pre_election: true
I20260709 13:16:28.321180 17273 raft_consensus.cc:2468] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 0.
I20260709 13:16:28.323040 17420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be27b8136364b749f7ebf6f6ca0efe1" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7" is_pre_election: true
I20260709 13:16:28.322381 17167 catalog_manager.cc:5697] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab reported cstate change: term changed from 0 to 1, leader changed from <none> to c336c970057e412db6c05a6a2516cfab (127.16.188.130). New cstate: current_term: 1 leader_uuid: "c336c970057e412db6c05a6a2516cfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:28.324954 17311 leader_election.cc:343] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:28.326423 17466 tablet_bootstrap.cc:654] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.316346 17465 ts_tablet_manager.cc:1434] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.003s
I20260709 13:16:28.329418 17465 tablet_bootstrap.cc:492] T cd0030d950894d17ba45d6fc425c8f15 P c336c970057e412db6c05a6a2516cfab: Bootstrap starting.
I20260709 13:16:28.325769 17314 leader_election.cc:304] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37; no voters: bb67dab9a7854783b5d47a1c08141ec7
I20260709 13:16:28.333359 17495 raft_consensus.cc:493] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.333864 17495 raft_consensus.cc:515] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.335918 17495 leader_election.cc:290] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:28.306102 17473 raft_consensus.cc:515] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.339768 17347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab" is_pre_election: true
I20260709 13:16:28.340569 17420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7" is_pre_election: true
I20260709 13:16:28.343609 17347 raft_consensus.cc:2468] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 0.
I20260709 13:16:28.345194 17239 leader_election.cc:304] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:28.342620 17509 raft_consensus.cc:2804] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.346100 17420 raft_consensus.cc:2468] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 0.
I20260709 13:16:28.347806 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f459de5cbbd24f6da91c65e002246f37" is_pre_election: true
I20260709 13:16:28.348366 17509 raft_consensus.cc:493] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.349153 17509 raft_consensus.cc:3060] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.348485 17273 raft_consensus.cc:2468] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 0.
I20260709 13:16:28.350739 17495 raft_consensus.cc:2804] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.351161 17495 raft_consensus.cc:493] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.351554 17495 raft_consensus.cc:3060] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.353708 17388 leader_election.cc:304] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:28.357290 17348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab" is_pre_election: true
I20260709 13:16:28.367250 17473 leader_election.cc:290] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069)
I20260709 13:16:28.367992 17473 raft_consensus.cc:2804] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.369431 17473 raft_consensus.cc:493] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.369827 17473 raft_consensus.cc:3060] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.376775 17467 tablet_bootstrap.cc:654] T cd0030d950894d17ba45d6fc425c8f15 P f459de5cbbd24f6da91c65e002246f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.383033 17465 tablet_bootstrap.cc:654] T cd0030d950894d17ba45d6fc425c8f15 P c336c970057e412db6c05a6a2516cfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.386242 17466 tablet_bootstrap.cc:492] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7: No bootstrap required, opened a new log
I20260709 13:16:28.387128 17466 ts_tablet_manager.cc:1403] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7: Time spent bootstrapping tablet: real 0.129s	user 0.016s	sys 0.007s
I20260709 13:16:28.389030 17348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab" is_pre_election: true
I20260709 13:16:28.389729 17348 raft_consensus.cc:2468] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 0.
I20260709 13:16:28.390125 17388 leader_election.cc:304] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7; no voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37
I20260709 13:16:28.393383 17467 tablet_bootstrap.cc:492] T cd0030d950894d17ba45d6fc425c8f15 P f459de5cbbd24f6da91c65e002246f37: No bootstrap required, opened a new log
I20260709 13:16:28.393064 17466 raft_consensus.cc:359] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.390969 17495 raft_consensus.cc:515] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.394732 17513 raft_consensus.cc:2749] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:28.395464 17467 ts_tablet_manager.cc:1403] T cd0030d950894d17ba45d6fc425c8f15 P f459de5cbbd24f6da91c65e002246f37: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.007s
I20260709 13:16:28.397714 17348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:28.398407 17348 raft_consensus.cc:3060] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.404085 17170 catalog_manager.cc:5697] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to f459de5cbbd24f6da91c65e002246f37 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f459de5cbbd24f6da91c65e002246f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.405841 17495 leader_election.cc:290] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 election: Requested vote from peers c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:28.407337 17420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:28.408324 17170 catalog_manager.cc:5697] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to f459de5cbbd24f6da91c65e002246f37 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f459de5cbbd24f6da91c65e002246f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.410049 17170 catalog_manager.cc:5697] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to f459de5cbbd24f6da91c65e002246f37 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f459de5cbbd24f6da91c65e002246f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.407951 17467 raft_consensus.cc:359] T cd0030d950894d17ba45d6fc425c8f15 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.411237 17467 raft_consensus.cc:385] T cd0030d950894d17ba45d6fc425c8f15 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.411571 17467 raft_consensus.cc:740] T cd0030d950894d17ba45d6fc425c8f15 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.412573 17348 raft_consensus.cc:2468] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 1.
I20260709 13:16:28.413894 17239 leader_election.cc:304] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:28.414811 17495 raft_consensus.cc:2804] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:28.415400 17495 raft_consensus.cc:697] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Becoming Leader. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Running, Role: LEADER
I20260709 13:16:28.416404 17495 consensus_queue.cc:237] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.412331 17467 consensus_queue.cc:260] T cd0030d950894d17ba45d6fc425c8f15 P f459de5cbbd24f6da91c65e002246f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.419293 17509 raft_consensus.cc:515] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.394686 17466 raft_consensus.cc:385] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.420735 17466 raft_consensus.cc:740] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.421639 17466 consensus_queue.cc:260] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.422767 17467 ts_tablet_manager.cc:1434] T cd0030d950894d17ba45d6fc425c8f15 P f459de5cbbd24f6da91c65e002246f37: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260709 13:16:28.436160 17466 ts_tablet_manager.cc:1434] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7: Time spent starting tablet: real 0.048s	user 0.003s	sys 0.003s
I20260709 13:16:28.446326 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be27b8136364b749f7ebf6f6ca0efe1" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:28.447197 17273 raft_consensus.cc:3060] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.443785 17466 tablet_bootstrap.cc:492] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7: Bootstrap starting.
I20260709 13:16:28.461364 17509 leader_election.cc:290] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 1 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:28.462795 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be27b8136364b749f7ebf6f6ca0efe1" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:28.462540 17473 raft_consensus.cc:515] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.464216 17420 raft_consensus.cc:2393] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f459de5cbbd24f6da91c65e002246f37 in current term 1: Already voted for candidate bb67dab9a7854783b5d47a1c08141ec7 in this term.
W20260709 13:16:28.464447 17311 leader_election.cc:343] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:28.467451 17273 raft_consensus.cc:2468] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 1.
I20260709 13:16:28.469022 17314 leader_election.cc:304] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37; no voters: bb67dab9a7854783b5d47a1c08141ec7
I20260709 13:16:28.473062 17473 leader_election.cc:290] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069)
I20260709 13:16:28.473659 17509 raft_consensus.cc:2804] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:28.474197 17348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:28.475211 17348 raft_consensus.cc:2393] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb67dab9a7854783b5d47a1c08141ec7 in current term 1: Already voted for candidate f459de5cbbd24f6da91c65e002246f37 in this term.
I20260709 13:16:28.474246 17509 raft_consensus.cc:697] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 1 LEADER]: Becoming Leader. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:28.476824 17509 consensus_queue.cc:237] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.481704 17466 tablet_bootstrap.cc:654] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.486737 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:28.488214 17388 leader_election.cc:304] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7; no voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37
I20260709 13:16:28.489523 17465 tablet_bootstrap.cc:492] T cd0030d950894d17ba45d6fc425c8f15 P c336c970057e412db6c05a6a2516cfab: No bootstrap required, opened a new log
I20260709 13:16:28.489995 17465 ts_tablet_manager.cc:1403] T cd0030d950894d17ba45d6fc425c8f15 P c336c970057e412db6c05a6a2516cfab: Time spent bootstrapping tablet: real 0.161s	user 0.050s	sys 0.043s
I20260709 13:16:28.489419 17473 raft_consensus.cc:2749] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:28.492033 17167 catalog_manager.cc:5697] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to f459de5cbbd24f6da91c65e002246f37 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f459de5cbbd24f6da91c65e002246f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.492291 17170 catalog_manager.cc:5697] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab reported cstate change: term changed from 0 to 1, leader changed from <none> to c336c970057e412db6c05a6a2516cfab (127.16.188.130). New cstate: current_term: 1 leader_uuid: "c336c970057e412db6c05a6a2516cfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.493358 17465 raft_consensus.cc:359] T cd0030d950894d17ba45d6fc425c8f15 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.494041 17465 raft_consensus.cc:385] T cd0030d950894d17ba45d6fc425c8f15 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.494306 17465 raft_consensus.cc:740] T cd0030d950894d17ba45d6fc425c8f15 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.494951 17465 consensus_queue.cc:260] T cd0030d950894d17ba45d6fc425c8f15 P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.496567 17465 ts_tablet_manager.cc:1434] T cd0030d950894d17ba45d6fc425c8f15 P c336c970057e412db6c05a6a2516cfab: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:16:28.504534 17465 tablet_bootstrap.cc:492] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab: Bootstrap starting.
I20260709 13:16:28.505864 17466 tablet_bootstrap.cc:492] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7: No bootstrap required, opened a new log
I20260709 13:16:28.506376 17466 ts_tablet_manager.cc:1403] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.004s
I20260709 13:16:28.509364 17466 raft_consensus.cc:359] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.510172 17466 raft_consensus.cc:385] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.510489 17466 raft_consensus.cc:740] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.510780 17465 tablet_bootstrap.cc:654] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.511476 17466 consensus_queue.cc:260] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.517565 17466 ts_tablet_manager.cc:1434] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:16:28.518919 17466 tablet_bootstrap.cc:492] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7: Bootstrap starting.
I20260709 13:16:28.527359 17495 consensus_queue.cc:1048] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:28.532675 17473 raft_consensus.cc:493] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.533576 17473 raft_consensus.cc:515] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.538079 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0030d950894d17ba45d6fc425c8f15" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f459de5cbbd24f6da91c65e002246f37" is_pre_election: true
I20260709 13:16:28.538838 17273 raft_consensus.cc:2468] T cd0030d950894d17ba45d6fc425c8f15 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 0.
I20260709 13:16:28.540457 17388 leader_election.cc:304] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:28.543502 17513 raft_consensus.cc:2804] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.544037 17513 raft_consensus.cc:493] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.544443 17513 raft_consensus.cc:3060] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.552729 17473 leader_election.cc:290] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069)
I20260709 13:16:28.555244 17347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0030d950894d17ba45d6fc425c8f15" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab" is_pre_election: true
I20260709 13:16:28.556017 17347 raft_consensus.cc:2468] T cd0030d950894d17ba45d6fc425c8f15 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 0.
I20260709 13:16:28.560864 17465 tablet_bootstrap.cc:492] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab: No bootstrap required, opened a new log
I20260709 13:16:28.561335 17465 ts_tablet_manager.cc:1403] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.022s
I20260709 13:16:28.564169 17466 tablet_bootstrap.cc:654] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.566524 17465 raft_consensus.cc:359] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.567261 17465 raft_consensus.cc:385] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.567567 17465 raft_consensus.cc:740] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.568279 17465 consensus_queue.cc:260] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.567991 17513 raft_consensus.cc:515] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.570904 17465 ts_tablet_manager.cc:1434] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
W20260709 13:16:28.575866 17217 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:28.577648 17513 leader_election.cc:290] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069)
I20260709 13:16:28.583272 17347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0030d950894d17ba45d6fc425c8f15" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:28.584846 17347 raft_consensus.cc:3060] T cd0030d950894d17ba45d6fc425c8f15 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.587164 17492 consensus_queue.cc:1048] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:28.582916 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0030d950894d17ba45d6fc425c8f15" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:28.590731 17273 raft_consensus.cc:3060] T cd0030d950894d17ba45d6fc425c8f15 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.596868 17466 tablet_bootstrap.cc:492] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7: No bootstrap required, opened a new log
I20260709 13:16:28.597390 17466 ts_tablet_manager.cc:1403] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.012s
I20260709 13:16:28.597106 17347 raft_consensus.cc:2468] T cd0030d950894d17ba45d6fc425c8f15 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 1.
I20260709 13:16:28.602679 17388 leader_election.cc:304] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, c336c970057e412db6c05a6a2516cfab; no voters: 
I20260709 13:16:28.606238 17513 raft_consensus.cc:2804] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:28.606933 17513 raft_consensus.cc:697] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 LEADER]: Becoming Leader. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Running, Role: LEADER
I20260709 13:16:28.606770 17466 raft_consensus.cc:359] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.607666 17466 raft_consensus.cc:385] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.608016 17466 raft_consensus.cc:740] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.608881 17466 consensus_queue.cc:260] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.611109 17273 raft_consensus.cc:2468] T cd0030d950894d17ba45d6fc425c8f15 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 1.
I20260709 13:16:28.611366 17466 ts_tablet_manager.cc:1434] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:16:28.608091 17513 consensus_queue.cc:237] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.627300 17492 consensus_queue.cc:1048] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:28.643575 17495 consensus_queue.cc:1048] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:28.637785 17168 catalog_manager.cc:5697] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "bb67dab9a7854783b5d47a1c08141ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.664426 17509 consensus_queue.cc:1048] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:28.679271 17507 consensus_queue.cc:1048] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:28.688284 17513 raft_consensus.cc:493] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.688969 17513 raft_consensus.cc:515] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.691105 17513 leader_election.cc:290] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069)
I20260709 13:16:28.701872 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f459de5cbbd24f6da91c65e002246f37" is_pre_election: true
I20260709 13:16:28.702644 17273 raft_consensus.cc:2468] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 0.
I20260709 13:16:28.704952 17347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab" is_pre_election: true
I20260709 13:16:28.705678 17347 raft_consensus.cc:2468] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 0.
I20260709 13:16:28.706712 17388 leader_election.cc:304] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:28.707690 17513 raft_consensus.cc:2804] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:28.708045 17513 raft_consensus.cc:493] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.708353 17513 raft_consensus.cc:3060] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.715116 17513 raft_consensus.cc:515] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.717067 17495 consensus_queue.cc:1048] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:28.717478 17513 leader_election.cc:290] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069)
I20260709 13:16:28.719026 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:28.718982 17347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:28.719806 17347 raft_consensus.cc:3060] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.720754 17273 raft_consensus.cc:3060] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.727288 17347 raft_consensus.cc:2468] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 1.
I20260709 13:16:28.728729 17388 leader_election.cc:304] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, c336c970057e412db6c05a6a2516cfab; no voters: 
I20260709 13:16:28.732372 17513 raft_consensus.cc:2804] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:28.733282 17513 raft_consensus.cc:697] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 LEADER]: Becoming Leader. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Running, Role: LEADER
I20260709 13:16:28.734138 17513 consensus_queue.cc:237] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.738188 17476 consensus_queue.cc:1048] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:28.727802 17273 raft_consensus.cc:2468] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 1.
I20260709 13:16:28.740697 17476 consensus_queue.cc:1048] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:28.763710 17476 consensus_queue.cc:1048] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:28.767418 17168 catalog_manager.cc:5697] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "bb67dab9a7854783b5d47a1c08141ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.845463 17535 raft_consensus.cc:493] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.846248 17535 raft_consensus.cc:515] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.848742 17535 leader_election.cc:290] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069)
I20260709 13:16:28.850222 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be27b8136364b749f7ebf6f6ca0efe1" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f459de5cbbd24f6da91c65e002246f37" is_pre_election: true
I20260709 13:16:28.850216 17348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be27b8136364b749f7ebf6f6ca0efe1" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c336c970057e412db6c05a6a2516cfab" is_pre_election: true
I20260709 13:16:28.851363 17273 raft_consensus.cc:2393] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb67dab9a7854783b5d47a1c08141ec7 in current term 1: Already voted for candidate c336c970057e412db6c05a6a2516cfab in this term.
I20260709 13:16:28.852499 17388 leader_election.cc:304] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7; no voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37
I20260709 13:16:28.853363 17535 raft_consensus.cc:3060] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.858791 17535 raft_consensus.cc:2749] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:28.891403 17348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce"
dest_uuid: "c336c970057e412db6c05a6a2516cfab"
mode: GRACEFUL
new_leader_uuid: "f459de5cbbd24f6da91c65e002246f37"
 from {username='slave'} at 127.0.0.1:59122
I20260709 13:16:28.892531 17348 raft_consensus.cc:606] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 1 LEADER]: Received request to transfer leadership to TS f459de5cbbd24f6da91c65e002246f37
I20260709 13:16:28.901144 17495 consensus_queue.cc:1048] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:28.916047 17496 consensus_queue.cc:1048] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:28.925537 17273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27"
dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
mode: GRACEFUL
new_leader_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:54830
I20260709 13:16:28.926141 17273 raft_consensus.cc:606] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Received request to transfer leadership to TS c336c970057e412db6c05a6a2516cfab
I20260709 13:16:28.927275 17507 consensus_queue.cc:1048] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:28.933413 17496 raft_consensus.cc:993] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37: : Instructing follower c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:28.934017 17496 raft_consensus.cc:1081] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Signalling peer c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:28.944818 17273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c9a5135c61a46b99b3fc1add6f1efc2"
dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
mode: GRACEFUL
new_leader_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:54830
I20260709 13:16:28.945428 17273 raft_consensus.cc:606] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Received request to transfer leadership to TS c336c970057e412db6c05a6a2516cfab
I20260709 13:16:28.947302 17348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27"
dest_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:59116
I20260709 13:16:28.947866 17348 raft_consensus.cc:493] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:28.948256 17348 raft_consensus.cc:3060] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.962677 17472 consensus_queue.cc:1048] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:28.979966 17348 raft_consensus.cc:515] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.983770 17272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:28.984469 17272 raft_consensus.cc:3055] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:28.984860 17272 raft_consensus.cc:740] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Running, Role: LEADER
I20260709 13:16:28.985637 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:28.985739 17272 consensus_queue.cc:260] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:28.986485 17422 raft_consensus.cc:3060] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.987345 17272 raft_consensus.cc:3060] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.984274 17348 leader_election.cc:290] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 2 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:28.997627 17272 raft_consensus.cc:2468] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 2.
I20260709 13:16:29.002110 17314 leader_election.cc:304] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:29.003028 17507 raft_consensus.cc:2804] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:29.003691 17507 raft_consensus.cc:697] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Becoming Leader. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:29.005558 17422 raft_consensus.cc:2468] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 2.
I20260709 13:16:29.005096 17507 consensus_queue.cc:237] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:29.017927 17167 catalog_manager.cc:5697] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab reported cstate change: term changed from 1 to 2, leader changed from f459de5cbbd24f6da91c65e002246f37 (127.16.188.129) to c336c970057e412db6c05a6a2516cfab (127.16.188.130). New cstate: current_term: 2 leader_uuid: "c336c970057e412db6c05a6a2516cfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.032855 17422 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0"
dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
mode: GRACEFUL
new_leader_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:43286
I20260709 13:16:29.033470 17422 raft_consensus.cc:606] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 LEADER]: Received request to transfer leadership to TS c336c970057e412db6c05a6a2516cfab
I20260709 13:16:29.167220 17472 raft_consensus.cc:993] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab: : Instructing follower f459de5cbbd24f6da91c65e002246f37 to start an election
I20260709 13:16:29.167754 17472 raft_consensus.cc:1081] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 1 LEADER]: Signalling peer f459de5cbbd24f6da91c65e002246f37 to start an election
I20260709 13:16:29.169366 17273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce"
dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
 from {username='slave'} at 127.0.0.1:54810
I20260709 13:16:29.170202 17273 raft_consensus.cc:493] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:29.170543 17273 raft_consensus.cc:3060] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.176393 17273 raft_consensus.cc:515] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:29.178850 17273 leader_election.cc:290] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 2 election: Requested vote from peers c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:29.179232 17348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:29.179913 17348 raft_consensus.cc:3055] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:29.180262 17348 raft_consensus.cc:740] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:29.180259 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:29.181173 17422 raft_consensus.cc:3060] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.181385 17348 consensus_queue.cc:260] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:29.182531 17348 raft_consensus.cc:3060] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.187574 17348 raft_consensus.cc:2468] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 2.
I20260709 13:16:29.187966 17422 raft_consensus.cc:2468] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 2.
I20260709 13:16:29.189342 17236 leader_election.cc:304] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:29.190305 17492 raft_consensus.cc:2804] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:29.190804 17492 raft_consensus.cc:697] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 2 LEADER]: Becoming Leader. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Running, Role: LEADER
I20260709 13:16:29.191680 17492 consensus_queue.cc:237] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:29.195981 17535 consensus_queue.cc:1048] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:29.199230 17167 catalog_manager.cc:5697] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 reported cstate change: term changed from 1 to 2, leader changed from c336c970057e412db6c05a6a2516cfab (127.16.188.130) to f459de5cbbd24f6da91c65e002246f37 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "f459de5cbbd24f6da91c65e002246f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.215221 17473 consensus_queue.cc:1048] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:29.221383 17473 consensus_queue.cc:1048] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:29.224371 17496 raft_consensus.cc:993] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37: : Instructing follower c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:29.224891 17476 raft_consensus.cc:1081] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Signalling peer c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:29.226883 17348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c9a5135c61a46b99b3fc1add6f1efc2"
dest_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:59116
I20260709 13:16:29.227506 17348 raft_consensus.cc:493] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:29.227945 17348 raft_consensus.cc:3060] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.241611 17513 consensus_queue.cc:1048] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:29.243964 17348 raft_consensus.cc:515] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:29.246729 17272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9a5135c61a46b99b3fc1add6f1efc2" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:29.247308 17272 raft_consensus.cc:3055] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:29.247625 17272 raft_consensus.cc:740] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Running, Role: LEADER
I20260709 13:16:29.248391 17272 consensus_queue.cc:260] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:29.249477 17272 raft_consensus.cc:3060] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.258077 17272 raft_consensus.cc:2468] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 2.
I20260709 13:16:29.259130 17348 leader_election.cc:290] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 2 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:29.260485 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c9a5135c61a46b99b3fc1add6f1efc2" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:29.260604 17314 leader_election.cc:304] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:29.261250 17422 raft_consensus.cc:3060] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.261840 17472 raft_consensus.cc:2804] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:29.262413 17472 raft_consensus.cc:697] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Becoming Leader. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:29.263268 17472 consensus_queue.cc:237] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:29.266601 17535 raft_consensus.cc:993] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7: : Instructing follower c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:29.267040 17535 raft_consensus.cc:1081] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 LEADER]: Signalling peer c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:29.275331 17422 raft_consensus.cc:2468] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 2.
I20260709 13:16:29.275959 17347 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0"
dest_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:59118
I20260709 13:16:29.276579 17347 raft_consensus.cc:493] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:29.276950 17347 raft_consensus.cc:3060] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.282692 17347 raft_consensus.cc:515] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:29.285286 17347 leader_election.cc:290] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 2 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:29.285552 17272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:29.286164 17272 raft_consensus.cc:3060] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.286537 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:29.287169 17422 raft_consensus.cc:3055] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:29.287499 17422 raft_consensus.cc:740] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Running, Role: LEADER
I20260709 13:16:29.288391 17422 consensus_queue.cc:260] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:29.289796 17422 raft_consensus.cc:3060] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.290508 17167 catalog_manager.cc:5697] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab reported cstate change: term changed from 1 to 2, leader changed from f459de5cbbd24f6da91c65e002246f37 (127.16.188.129) to c336c970057e412db6c05a6a2516cfab (127.16.188.130). New cstate: current_term: 2 leader_uuid: "c336c970057e412db6c05a6a2516cfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.293112 17272 raft_consensus.cc:2468] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 2.
I20260709 13:16:29.294343 17314 leader_election.cc:304] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:29.295171 17472 raft_consensus.cc:2804] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:29.295663 17472 raft_consensus.cc:697] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Becoming Leader. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:29.296500 17472 consensus_queue.cc:237] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:29.299450 17422 raft_consensus.cc:2468] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 2.
I20260709 13:16:29.306396 17167 catalog_manager.cc:5697] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab reported cstate change: term changed from 1 to 2, leader changed from bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131) to c336c970057e412db6c05a6a2516cfab (127.16.188.130). New cstate: current_term: 2 leader_uuid: "c336c970057e412db6c05a6a2516cfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.533656 17272 raft_consensus.cc:1275] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:29.535277 17472 consensus_queue.cc:1048] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:29.544488 17422 raft_consensus.cc:1275] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:29.546401 17507 consensus_queue.cc:1048] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:29.657611 17422 raft_consensus.cc:1275] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:29.659798 17472 consensus_queue.cc:1048] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:29.669005 17272 raft_consensus.cc:1275] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:29.672847 17509 consensus_queue.cc:1048] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:29.697206 17422 raft_consensus.cc:1275] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Refusing update from remote peer f459de5cbbd24f6da91c65e002246f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:29.698554 17492 consensus_queue.cc:1048] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:29.707940 17347 raft_consensus.cc:1275] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Refusing update from remote peer f459de5cbbd24f6da91c65e002246f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:29.709429 17492 consensus_queue.cc:1048] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:29.801570 17422 raft_consensus.cc:1275] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:29.802923 17509 consensus_queue.cc:1048] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:29.810889 17272 raft_consensus.cc:1275] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:29.812714 17507 consensus_queue.cc:1048] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:32.070392 17138 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:16:32.071367 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:32.092424 17272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb"
dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
mode: GRACEFUL
new_leader_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
 from {username='slave'} at 127.0.0.1:54844
I20260709 13:16:32.093042 17272 raft_consensus.cc:606] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Received request to transfer leadership to TS bb67dab9a7854783b5d47a1c08141ec7
I20260709 13:16:32.104212 17347 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0"
dest_uuid: "c336c970057e412db6c05a6a2516cfab"
mode: GRACEFUL
new_leader_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
 from {username='slave'} at 127.0.0.1:59130
I20260709 13:16:32.104944 17347 raft_consensus.cc:606] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Received request to transfer leadership to TS bb67dab9a7854783b5d47a1c08141ec7
I20260709 13:16:32.106365 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:32.107074 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:32.116755 17472 raft_consensus.cc:993] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab: : Instructing follower bb67dab9a7854783b5d47a1c08141ec7 to start an election
I20260709 13:16:32.117228 17560 raft_consensus.cc:1081] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Signalling peer bb67dab9a7854783b5d47a1c08141ec7 to start an election
I20260709 13:16:32.118777 17422 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0"
dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
 from {username='slave'} at 127.0.0.1:43274
I20260709 13:16:32.119266 17422 raft_consensus.cc:493] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:32.119562 17422 raft_consensus.cc:3060] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:32.123970 17422 raft_consensus.cc:515] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:32.125636 17422 leader_election.cc:290] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 3 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069)
I20260709 13:16:32.126431 17272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:32.127004 17272 raft_consensus.cc:3060] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:32.126946 17347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:32.127555 17347 raft_consensus.cc:3055] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:32.127894 17347 raft_consensus.cc:740] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:32.128713 17347 consensus_queue.cc:260] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:32.129601 17347 raft_consensus.cc:3060] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:32.133437 17272 raft_consensus.cc:2468] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 3.
I20260709 13:16:32.134595 17388 leader_election.cc:304] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:32.135426 17556 raft_consensus.cc:2804] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:32.136976 17556 raft_consensus.cc:697] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 3 LEADER]: Becoming Leader. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Running, Role: LEADER
I20260709 13:16:32.137228 17347 raft_consensus.cc:2468] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 3.
I20260709 13:16:32.137814 17556 consensus_queue.cc:237] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:32.140914 17562 raft_consensus.cc:993] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37: : Instructing follower bb67dab9a7854783b5d47a1c08141ec7 to start an election
I20260709 13:16:32.141392 17555 raft_consensus.cc:1081] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Signalling peer bb67dab9a7854783b5d47a1c08141ec7 to start an election
I20260709 13:16:32.143314 17422 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb"
dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
 from {username='slave'} at 127.0.0.1:43276
I20260709 13:16:32.143795 17422 raft_consensus.cc:493] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:32.144205 17422 raft_consensus.cc:3060] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.146212 17167 catalog_manager.cc:5697] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 reported cstate change: term changed from 2 to 3, leader changed from c336c970057e412db6c05a6a2516cfab (127.16.188.130) to bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131). New cstate: current_term: 3 leader_uuid: "bb67dab9a7854783b5d47a1c08141ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.149736 17422 raft_consensus.cc:515] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:32.151270 17422 leader_election.cc:290] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 2 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069)
I20260709 13:16:32.152242 17272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:32.152915 17272 raft_consensus.cc:3055] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:32.152884 17347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:32.153626 17272 raft_consensus.cc:740] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Running, Role: LEADER
I20260709 13:16:32.153898 17347 raft_consensus.cc:3060] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.154562 17272 consensus_queue.cc:260] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:32.155972 17272 raft_consensus.cc:3060] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.160698 17347 raft_consensus.cc:2468] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 2.
I20260709 13:16:32.161986 17388 leader_election.cc:304] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, c336c970057e412db6c05a6a2516cfab; no voters: 
I20260709 13:16:32.162091 17272 raft_consensus.cc:2468] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 2.
I20260709 13:16:32.162703 17556 raft_consensus.cc:2804] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:32.163225 17556 raft_consensus.cc:697] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 2 LEADER]: Becoming Leader. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Running, Role: LEADER
I20260709 13:16:32.163947 17556 consensus_queue.cc:237] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:32.170782 17167 catalog_manager.cc:5697] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 reported cstate change: term changed from 1 to 2, leader changed from f459de5cbbd24f6da91c65e002246f37 (127.16.188.129) to bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "bb67dab9a7854783b5d47a1c08141ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.554066 17347 raft_consensus.cc:1275] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Refusing update from remote peer bb67dab9a7854783b5d47a1c08141ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:32.555342 17556 consensus_queue.cc:1048] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:32.567570 17272 raft_consensus.cc:1275] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Refusing update from remote peer bb67dab9a7854783b5d47a1c08141ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:32.572813 17561 consensus_queue.cc:1048] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:32.665457 17347 raft_consensus.cc:1275] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 3 FOLLOWER]: Refusing update from remote peer bb67dab9a7854783b5d47a1c08141ec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:32.666751 17556 consensus_queue.cc:1048] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:32.676200 17272 raft_consensus.cc:1275] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 3 FOLLOWER]: Refusing update from remote peer bb67dab9a7854783b5d47a1c08141ec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:32.678711 17561 consensus_queue.cc:1048] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:33.108084 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:33.118112 17272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fc07ad9bd714d4e859aceea970f8191"
dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
mode: GRACEFUL
new_leader_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:54830
I20260709 13:16:33.118755 17272 raft_consensus.cc:606] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Received request to transfer leadership to TS c336c970057e412db6c05a6a2516cfab
I20260709 13:16:33.123752 17272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "408d415cca0242f2bd1a949d7a783b8f"
dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
mode: GRACEFUL
new_leader_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:54830
I20260709 13:16:33.124305 17272 raft_consensus.cc:606] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Received request to transfer leadership to TS c336c970057e412db6c05a6a2516cfab
I20260709 13:16:33.128993 17422 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb"
dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
mode: GRACEFUL
new_leader_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:43286
I20260709 13:16:33.129492 17422 raft_consensus.cc:606] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 2 LEADER]: Received request to transfer leadership to TS c336c970057e412db6c05a6a2516cfab
I20260709 13:16:33.134294 17272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce"
dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
mode: GRACEFUL
new_leader_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:54830
I20260709 13:16:33.134832 17272 raft_consensus.cc:606] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 2 LEADER]: Received request to transfer leadership to TS c336c970057e412db6c05a6a2516cfab
I20260709 13:16:33.139869 17561 raft_consensus.cc:993] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7: : Instructing follower c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:33.140415 17573 raft_consensus.cc:1081] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 2 LEADER]: Signalling peer c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:33.141964 17347 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb"
dest_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:59118
I20260709 13:16:33.142498 17347 raft_consensus.cc:493] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:33.142925 17347 raft_consensus.cc:3060] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.146611 17422 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0"
dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
mode: GRACEFUL
new_leader_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:43286
I20260709 13:16:33.147101 17422 raft_consensus.cc:606] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 3 LEADER]: Received request to transfer leadership to TS c336c970057e412db6c05a6a2516cfab
I20260709 13:16:33.149092 17347 raft_consensus.cc:515] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:33.151860 17272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:33.151999 17347 leader_election.cc:290] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 3 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:33.152217 17420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:33.153048 17272 raft_consensus.cc:3060] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.153059 17420 raft_consensus.cc:3055] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:33.153651 17420 raft_consensus.cc:740] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Running, Role: LEADER
I20260709 13:16:33.154534 17420 consensus_queue.cc:260] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:33.155671 17420 raft_consensus.cc:3060] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.160645 17272 raft_consensus.cc:2468] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 3.
I20260709 13:16:33.161887 17314 leader_election.cc:304] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:33.162562 17420 raft_consensus.cc:2468] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 3.
I20260709 13:16:33.162575 17560 raft_consensus.cc:2804] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:33.163879 17560 raft_consensus.cc:697] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 3 LEADER]: Becoming Leader. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:33.164649 17560 consensus_queue.cc:237] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:33.170449 17169 catalog_manager.cc:5697] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab reported cstate change: term changed from 2 to 3, leader changed from bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131) to c336c970057e412db6c05a6a2516cfab (127.16.188.130). New cstate: current_term: 3 leader_uuid: "c336c970057e412db6c05a6a2516cfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.274631 17583 raft_consensus.cc:993] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37: : Instructing follower c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:33.275195 17555 raft_consensus.cc:1081] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Signalling peer c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:33.276855 17347 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "408d415cca0242f2bd1a949d7a783b8f"
dest_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:59116
I20260709 13:16:33.277390 17347 raft_consensus.cc:493] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:33.277756 17347 raft_consensus.cc:3060] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.280340 17561 raft_consensus.cc:993] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7: : Instructing follower c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:33.280882 17573 raft_consensus.cc:1081] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 3 LEADER]: Signalling peer c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:33.282382 17348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0"
dest_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:59118
I20260709 13:16:33.282931 17348 raft_consensus.cc:493] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:33.283293 17348 raft_consensus.cc:3060] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.283942 17347 raft_consensus.cc:515] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:33.286403 17347 leader_election.cc:290] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 2 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:33.286769 17272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408d415cca0242f2bd1a949d7a783b8f" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:33.287042 17420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408d415cca0242f2bd1a949d7a783b8f" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:33.287454 17272 raft_consensus.cc:3055] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:33.287562 17420 raft_consensus.cc:3060] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.287847 17272 raft_consensus.cc:740] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Running, Role: LEADER
I20260709 13:16:33.288759 17272 consensus_queue.cc:260] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:33.289219 17348 raft_consensus.cc:515] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:33.290107 17272 raft_consensus.cc:3060] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.291420 17348 leader_election.cc:290] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 4 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:33.291767 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:33.292338 17273 raft_consensus.cc:3060] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.293273 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:33.293762 17422 raft_consensus.cc:3055] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:33.294035 17422 raft_consensus.cc:740] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Running, Role: LEADER
I20260709 13:16:33.294719 17422 consensus_queue.cc:260] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:33.295810 17422 raft_consensus.cc:3060] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.296262 17420 raft_consensus.cc:2468] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 2.
I20260709 13:16:33.297605 17272 raft_consensus.cc:2468] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 2.
I20260709 13:16:33.297607 17311 leader_election.cc:304] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, c336c970057e412db6c05a6a2516cfab; no voters: 
I20260709 13:16:33.298657 17560 raft_consensus.cc:2804] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:33.299154 17273 raft_consensus.cc:2468] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 4.
I20260709 13:16:33.299898 17560 raft_consensus.cc:697] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Becoming Leader. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:33.300300 17314 leader_election.cc:304] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c336c970057e412db6c05a6a2516cfab, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:33.301131 17579 raft_consensus.cc:2804] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:33.301000 17560 consensus_queue.cc:237] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:33.302325 17579 raft_consensus.cc:697] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 4 LEADER]: Becoming Leader. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:33.302868 17422 raft_consensus.cc:2468] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 4.
I20260709 13:16:33.303205 17579 consensus_queue.cc:237] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:33.305858 17583 raft_consensus.cc:993] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37: : Instructing follower c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:33.306795 17555 raft_consensus.cc:1081] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 2 LEADER]: Signalling peer c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:33.310108 17169 catalog_manager.cc:5697] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab reported cstate change: term changed from 1 to 2, leader changed from f459de5cbbd24f6da91c65e002246f37 (127.16.188.129) to c336c970057e412db6c05a6a2516cfab (127.16.188.130). New cstate: current_term: 2 leader_uuid: "c336c970057e412db6c05a6a2516cfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.311180 17348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce"
dest_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:59116
I20260709 13:16:33.311678 17348 raft_consensus.cc:493] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:33.311980 17348 raft_consensus.cc:3060] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.317059 17348 raft_consensus.cc:515] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:33.318814 17348 leader_election.cc:290] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 3 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:33.319628 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:33.320147 17273 raft_consensus.cc:3055] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:33.320454 17273 raft_consensus.cc:740] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Running, Role: LEADER
I20260709 13:16:33.320595 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:33.321079 17422 raft_consensus.cc:3060] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.321264 17273 consensus_queue.cc:260] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:33.322290 17273 raft_consensus.cc:3060] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.325217 17169 catalog_manager.cc:5697] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab reported cstate change: term changed from 3 to 4, leader changed from bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131) to c336c970057e412db6c05a6a2516cfab (127.16.188.130). New cstate: current_term: 4 leader_uuid: "c336c970057e412db6c05a6a2516cfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.326699 17422 raft_consensus.cc:2468] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 3.
I20260709 13:16:33.327879 17311 leader_election.cc:304] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, c336c970057e412db6c05a6a2516cfab; no voters: 
I20260709 13:16:33.328240 17273 raft_consensus.cc:2468] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 3.
I20260709 13:16:33.328802 17560 raft_consensus.cc:2804] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:33.329393 17560 raft_consensus.cc:697] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 3 LEADER]: Becoming Leader. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:33.330236 17560 consensus_queue.cc:237] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:33.338614 17169 catalog_manager.cc:5697] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab reported cstate change: term changed from 2 to 3, leader changed from f459de5cbbd24f6da91c65e002246f37 (127.16.188.129) to c336c970057e412db6c05a6a2516cfab (127.16.188.130). New cstate: current_term: 3 leader_uuid: "c336c970057e412db6c05a6a2516cfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.355690 17583 raft_consensus.cc:993] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37: : Instructing follower c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:33.356164 17555 raft_consensus.cc:1081] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Signalling peer c336c970057e412db6c05a6a2516cfab to start an election
I20260709 13:16:33.357750 17348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fc07ad9bd714d4e859aceea970f8191"
dest_uuid: "c336c970057e412db6c05a6a2516cfab"
 from {username='slave'} at 127.0.0.1:59116
I20260709 13:16:33.358188 17348 raft_consensus.cc:493] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:33.358474 17348 raft_consensus.cc:3060] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.362804 17348 raft_consensus.cc:515] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } } peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } }
I20260709 13:16:33.364305 17348 leader_election.cc:290] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 2 election: Requested vote from peers bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429), f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927)
I20260709 13:16:33.365325 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc07ad9bd714d4e859aceea970f8191" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:33.365424 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fc07ad9bd714d4e859aceea970f8191" candidate_uuid: "c336c970057e412db6c05a6a2516cfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:33.365948 17422 raft_consensus.cc:3060] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.366029 17273 raft_consensus.cc:3055] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:33.366401 17273 raft_consensus.cc:740] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Running, Role: LEADER
I20260709 13:16:33.367071 17273 consensus_queue.cc:260] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } } peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } }
I20260709 13:16:33.367923 17273 raft_consensus.cc:3060] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.370905 17422 raft_consensus.cc:2468] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 2.
I20260709 13:16:33.371948 17311 leader_election.cc:304] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, c336c970057e412db6c05a6a2516cfab; no voters: 
I20260709 13:16:33.372664 17273 raft_consensus.cc:2468] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c336c970057e412db6c05a6a2516cfab in term 2.
I20260709 13:16:33.372763 17560 raft_consensus.cc:2804] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:33.373332 17560 raft_consensus.cc:697] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Becoming Leader. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:33.374109 17560 consensus_queue.cc:237] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } } peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } }
I20260709 13:16:33.381386 17169 catalog_manager.cc:5697] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab reported cstate change: term changed from 1 to 2, leader changed from f459de5cbbd24f6da91c65e002246f37 (127.16.188.129) to c336c970057e412db6c05a6a2516cfab (127.16.188.130). New cstate: current_term: 2 leader_uuid: "c336c970057e412db6c05a6a2516cfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.704653 17422 raft_consensus.cc:1275] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 3 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:33.705964 17560 consensus_queue.cc:1048] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:33.716907 17273 raft_consensus.cc:1275] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 3 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:33.718657 17591 consensus_queue.cc:1048] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:33.789176 17273 raft_consensus.cc:1275] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 4 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:33.790455 17591 consensus_queue.cc:1048] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:33.799237 17422 raft_consensus.cc:1275] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 4 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:33.800870 17591 consensus_queue.cc:1048] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:33.808230 17420 raft_consensus.cc:1275] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.809692 17591 consensus_queue.cc:1048] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.820269 17273 raft_consensus.cc:1275] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.821944 17584 consensus_queue.cc:1048] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.835212 17273 raft_consensus.cc:1275] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 3 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:33.836402 17584 consensus_queue.cc:1048] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:33.845567 17422 raft_consensus.cc:1275] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 3 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:33.847345 17591 consensus_queue.cc:1048] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:33.870806 17273 raft_consensus.cc:1275] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.871938 17560 consensus_queue.cc:1048] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.881008 17422 raft_consensus.cc:1275] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Refusing update from remote peer c336c970057e412db6c05a6a2516cfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.882720 17560 consensus_queue.cc:1048] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:36.159211 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:36.166666 17348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27"
dest_uuid: "c336c970057e412db6c05a6a2516cfab"
mode: GRACEFUL
new_leader_uuid: "f459de5cbbd24f6da91c65e002246f37"
 from {username='slave'} at 127.0.0.1:59130
I20260709 13:16:36.167399 17348 raft_consensus.cc:606] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Received request to transfer leadership to TS f459de5cbbd24f6da91c65e002246f37
I20260709 13:16:36.170099 17348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb"
dest_uuid: "c336c970057e412db6c05a6a2516cfab"
mode: GRACEFUL
new_leader_uuid: "f459de5cbbd24f6da91c65e002246f37"
 from {username='slave'} at 127.0.0.1:59130
I20260709 13:16:36.170600 17348 raft_consensus.cc:606] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 3 LEADER]: Received request to transfer leadership to TS f459de5cbbd24f6da91c65e002246f37
I20260709 13:16:36.172695 17348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7be27b8136364b749f7ebf6f6ca0efe1"
dest_uuid: "c336c970057e412db6c05a6a2516cfab"
mode: GRACEFUL
new_leader_uuid: "f459de5cbbd24f6da91c65e002246f37"
 from {username='slave'} at 127.0.0.1:59130
I20260709 13:16:36.173089 17348 raft_consensus.cc:606] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 1 LEADER]: Received request to transfer leadership to TS f459de5cbbd24f6da91c65e002246f37
I20260709 13:16:36.175410 17348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce"
dest_uuid: "c336c970057e412db6c05a6a2516cfab"
mode: GRACEFUL
new_leader_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
 from {username='slave'} at 127.0.0.1:59130
I20260709 13:16:36.175925 17348 raft_consensus.cc:606] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 3 LEADER]: Received request to transfer leadership to TS bb67dab9a7854783b5d47a1c08141ec7
I20260709 13:16:36.178113 17348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0"
dest_uuid: "c336c970057e412db6c05a6a2516cfab"
mode: GRACEFUL
new_leader_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
 from {username='slave'} at 127.0.0.1:59130
I20260709 13:16:36.178575 17348 raft_consensus.cc:606] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 4 LEADER]: Received request to transfer leadership to TS bb67dab9a7854783b5d47a1c08141ec7
I20260709 13:16:36.179570 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:36.179998 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:36.307950 17591 raft_consensus.cc:993] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab: : Instructing follower f459de5cbbd24f6da91c65e002246f37 to start an election
I20260709 13:16:36.308619 17605 raft_consensus.cc:1081] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 3 LEADER]: Signalling peer f459de5cbbd24f6da91c65e002246f37 to start an election
I20260709 13:16:36.310457 17273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb"
dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
 from {username='slave'} at 127.0.0.1:54810
I20260709 13:16:36.311079 17273 raft_consensus.cc:493] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.311475 17273 raft_consensus.cc:3060] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.312652 17605 raft_consensus.cc:993] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab: : Instructing follower bb67dab9a7854783b5d47a1c08141ec7 to start an election
I20260709 13:16:36.313135 17591 raft_consensus.cc:1081] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 3 LEADER]: Signalling peer bb67dab9a7854783b5d47a1c08141ec7 to start an election
I20260709 13:16:36.314811 17420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce"
dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
 from {username='slave'} at 127.0.0.1:43274
I20260709 13:16:36.315464 17420 raft_consensus.cc:493] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.315966 17420 raft_consensus.cc:3060] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.319480 17273 raft_consensus.cc:515] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:36.322197 17273 leader_election.cc:290] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 4 election: Requested vote from peers c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:36.323259 17348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:36.323644 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20497ae36d814dae907bc3b7a1cd13eb" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:36.324102 17348 raft_consensus.cc:3055] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:36.324250 17422 raft_consensus.cc:3060] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.324486 17348 raft_consensus.cc:740] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:36.324829 17420 raft_consensus.cc:515] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:36.325510 17348 consensus_queue.cc:260] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:36.326700 17348 raft_consensus.cc:3060] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.327148 17420 leader_election.cc:290] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 4 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069)
I20260709 13:16:36.328787 17347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:36.329025 17273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9deacc3fd54645b3b2ef76e85648c3ce" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:36.329583 17273 raft_consensus.cc:3060] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.329478 17347 raft_consensus.cc:3055] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:36.330299 17347 raft_consensus.cc:740] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:36.330873 17422 raft_consensus.cc:2468] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 4.
I20260709 13:16:36.331287 17347 consensus_queue.cc:260] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:36.332358 17236 leader_election.cc:304] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:36.332924 17347 raft_consensus.cc:3060] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.334830 17348 raft_consensus.cc:2468] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 4.
I20260709 13:16:36.336751 17606 raft_consensus.cc:2804] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:36.336849 17273 raft_consensus.cc:2468] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 4.
I20260709 13:16:36.338146 17606 raft_consensus.cc:697] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 4 LEADER]: Becoming Leader. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Running, Role: LEADER
I20260709 13:16:36.338562 17388 leader_election.cc:304] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:36.339588 17573 raft_consensus.cc:2804] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:36.339459 17606 consensus_queue.cc:237] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:36.340745 17573 raft_consensus.cc:697] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 4 LEADER]: Becoming Leader. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Running, Role: LEADER
I20260709 13:16:36.341485 17347 raft_consensus.cc:2468] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 4.
I20260709 13:16:36.341784 17573 consensus_queue.cc:237] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:36.349906 17169 catalog_manager.cc:5697] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 reported cstate change: term changed from 3 to 4, leader changed from c336c970057e412db6c05a6a2516cfab (127.16.188.130) to f459de5cbbd24f6da91c65e002246f37 (127.16.188.129). New cstate: current_term: 4 leader_uuid: "f459de5cbbd24f6da91c65e002246f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:36.351374 17167 catalog_manager.cc:5697] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 reported cstate change: term changed from 3 to 4, leader changed from c336c970057e412db6c05a6a2516cfab (127.16.188.130) to bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131). New cstate: current_term: 4 leader_uuid: "bb67dab9a7854783b5d47a1c08141ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:36.373371 17591 raft_consensus.cc:993] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab: : Instructing follower f459de5cbbd24f6da91c65e002246f37 to start an election
I20260709 13:16:36.373977 17616 raft_consensus.cc:1081] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Signalling peer f459de5cbbd24f6da91c65e002246f37 to start an election
I20260709 13:16:36.375730 17272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27"
dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
 from {username='slave'} at 127.0.0.1:54810
I20260709 13:16:36.376281 17272 raft_consensus.cc:493] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.376694 17272 raft_consensus.cc:3060] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.383031 17272 raft_consensus.cc:515] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:36.385501 17272 leader_election.cc:290] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 3 election: Requested vote from peers c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:36.386140 17347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:36.386777 17347 raft_consensus.cc:3055] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:36.386904 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a81d7a76f54402193f7961a6d357a27" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:36.387140 17347 raft_consensus.cc:740] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:36.387392 17422 raft_consensus.cc:3060] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.388068 17347 consensus_queue.cc:260] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:36.389285 17347 raft_consensus.cc:3060] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.393450 17422 raft_consensus.cc:2468] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 3.
I20260709 13:16:36.394479 17236 leader_election.cc:304] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:36.395035 17347 raft_consensus.cc:2468] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 3.
I20260709 13:16:36.395351 17606 raft_consensus.cc:2804] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:36.395896 17606 raft_consensus.cc:697] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 3 LEADER]: Becoming Leader. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Running, Role: LEADER
I20260709 13:16:36.396797 17606 consensus_queue.cc:237] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:36.403512 17167 catalog_manager.cc:5697] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 reported cstate change: term changed from 2 to 3, leader changed from c336c970057e412db6c05a6a2516cfab (127.16.188.130) to f459de5cbbd24f6da91c65e002246f37 (127.16.188.129). New cstate: current_term: 3 leader_uuid: "f459de5cbbd24f6da91c65e002246f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:36.625029 17591 raft_consensus.cc:993] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab: : Instructing follower f459de5cbbd24f6da91c65e002246f37 to start an election
I20260709 13:16:36.625486 17591 raft_consensus.cc:1081] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 1 LEADER]: Signalling peer f459de5cbbd24f6da91c65e002246f37 to start an election
I20260709 13:16:36.626931 17272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7be27b8136364b749f7ebf6f6ca0efe1"
dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
 from {username='slave'} at 127.0.0.1:54810
I20260709 13:16:36.627404 17272 raft_consensus.cc:493] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.627681 17272 raft_consensus.cc:3060] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.632767 17272 raft_consensus.cc:515] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:36.634429 17272 leader_election.cc:290] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 2 election: Requested vote from peers c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069), bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131:45429)
I20260709 13:16:36.635519 17347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be27b8136364b749f7ebf6f6ca0efe1" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:36.635826 17422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be27b8136364b749f7ebf6f6ca0efe1" candidate_uuid: "f459de5cbbd24f6da91c65e002246f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
I20260709 13:16:36.636068 17347 raft_consensus.cc:3055] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:36.636389 17422 raft_consensus.cc:3060] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.636421 17347 raft_consensus.cc:740] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:36.637471 17347 consensus_queue.cc:260] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:36.638387 17347 raft_consensus.cc:3060] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:36.641433 17422 raft_consensus.cc:2468] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 2.
I20260709 13:16:36.642582 17236 leader_election.cc:304] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:36.642956 17347 raft_consensus.cc:2468] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f459de5cbbd24f6da91c65e002246f37 in term 2.
I20260709 13:16:36.643365 17606 raft_consensus.cc:2804] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:36.643839 17606 raft_consensus.cc:697] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [term 2 LEADER]: Becoming Leader. State: Replica: f459de5cbbd24f6da91c65e002246f37, State: Running, Role: LEADER
I20260709 13:16:36.644786 17606 consensus_queue.cc:237] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:36.651906 17167 catalog_manager.cc:5697] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 reported cstate change: term changed from 1 to 2, leader changed from c336c970057e412db6c05a6a2516cfab (127.16.188.130) to f459de5cbbd24f6da91c65e002246f37 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "f459de5cbbd24f6da91c65e002246f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:36.671892 17616 raft_consensus.cc:993] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab: : Instructing follower bb67dab9a7854783b5d47a1c08141ec7 to start an election
I20260709 13:16:36.672422 17616 raft_consensus.cc:1081] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 4 LEADER]: Signalling peer bb67dab9a7854783b5d47a1c08141ec7 to start an election
I20260709 13:16:36.674124 17422 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0"
dest_uuid: "bb67dab9a7854783b5d47a1c08141ec7"
 from {username='slave'} at 127.0.0.1:43274
I20260709 13:16:36.674538 17422 raft_consensus.cc:493] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.674774 17422 raft_consensus.cc:3060] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.679291 17422 raft_consensus.cc:515] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:36.681074 17422 leader_election.cc:290] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 5 election: Requested vote from peers f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927), c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069)
I20260709 13:16:36.681941 17272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f459de5cbbd24f6da91c65e002246f37"
I20260709 13:16:36.682384 17347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f80a1f3d6849abadfabae77b3f76f0" candidate_uuid: "bb67dab9a7854783b5d47a1c08141ec7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c336c970057e412db6c05a6a2516cfab"
I20260709 13:16:36.682590 17272 raft_consensus.cc:3060] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.682873 17347 raft_consensus.cc:3055] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:36.683145 17347 raft_consensus.cc:740] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c336c970057e412db6c05a6a2516cfab, State: Running, Role: LEADER
I20260709 13:16:36.683889 17347 consensus_queue.cc:260] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:36.685191 17347 raft_consensus.cc:3060] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.688946 17272 raft_consensus.cc:2468] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 5.
I20260709 13:16:36.690043 17388 leader_election.cc:304] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb67dab9a7854783b5d47a1c08141ec7, f459de5cbbd24f6da91c65e002246f37; no voters: 
I20260709 13:16:36.690567 17347 raft_consensus.cc:2468] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb67dab9a7854783b5d47a1c08141ec7 in term 5.
I20260709 13:16:36.690845 17573 raft_consensus.cc:2804] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:36.691375 17573 raft_consensus.cc:697] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 5 LEADER]: Becoming Leader. State: Replica: bb67dab9a7854783b5d47a1c08141ec7, State: Running, Role: LEADER
I20260709 13:16:36.692448 17573 consensus_queue.cc:237] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } }
I20260709 13:16:36.700207 17167 catalog_manager.cc:5697] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 reported cstate change: term changed from 4 to 5, leader changed from c336c970057e412db6c05a6a2516cfab (127.16.188.130) to bb67dab9a7854783b5d47a1c08141ec7 (127.16.188.131). New cstate: current_term: 5 leader_uuid: "bb67dab9a7854783b5d47a1c08141ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:36.735080 17347 raft_consensus.cc:1275] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 4 FOLLOWER]: Refusing update from remote peer bb67dab9a7854783b5d47a1c08141ec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:36.736245 17573 consensus_queue.cc:1048] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:36.745896 17272 raft_consensus.cc:1275] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 4 FOLLOWER]: Refusing update from remote peer bb67dab9a7854783b5d47a1c08141ec7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:36.747349 17608 consensus_queue.cc:1048] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:36.813206 17422 raft_consensus.cc:1275] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 3 FOLLOWER]: Refusing update from remote peer f459de5cbbd24f6da91c65e002246f37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:36.814393 17606 consensus_queue.cc:1048] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:36.824239 17347 raft_consensus.cc:1275] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 3 FOLLOWER]: Refusing update from remote peer f459de5cbbd24f6da91c65e002246f37: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:36.826387 17606 consensus_queue.cc:1048] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:36.901722 17347 raft_consensus.cc:1275] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 4 FOLLOWER]: Refusing update from remote peer f459de5cbbd24f6da91c65e002246f37: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:36.902947 17606 consensus_queue.cc:1048] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:36.912161 17422 raft_consensus.cc:1275] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 4 FOLLOWER]: Refusing update from remote peer f459de5cbbd24f6da91c65e002246f37: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:36.913810 17607 consensus_queue.cc:1048] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:37.061112 17422 raft_consensus.cc:1275] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Refusing update from remote peer f459de5cbbd24f6da91c65e002246f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:37.062376 17607 consensus_queue.cc:1048] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb67dab9a7854783b5d47a1c08141ec7" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:37.074597 17347 raft_consensus.cc:1275] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Refusing update from remote peer f459de5cbbd24f6da91c65e002246f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:37.076283 17631 consensus_queue.cc:1048] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:37.087082 17272 raft_consensus.cc:1275] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 5 FOLLOWER]: Refusing update from remote peer bb67dab9a7854783b5d47a1c08141ec7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:37.088323 17573 consensus_queue.cc:1048] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f459de5cbbd24f6da91c65e002246f37" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:37.097575 17347 raft_consensus.cc:1275] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 5 FOLLOWER]: Refusing update from remote peer bb67dab9a7854783b5d47a1c08141ec7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:37.099112 17573 consensus_queue.cc:1048] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c336c970057e412db6c05a6a2516cfab" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:37.180874 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:37.187788 17138 tablet_server.cc:179] TabletServer@127.16.188.129:0 shutting down...
I20260709 13:16:37.223956 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:37.224727 17138 tablet_replica.cc:333] T cd0030d950894d17ba45d6fc425c8f15 P f459de5cbbd24f6da91c65e002246f37: stopping tablet replica
I20260709 13:16:37.225375 17138 raft_consensus.cc:2243] T cd0030d950894d17ba45d6fc425c8f15 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.225795 17138 raft_consensus.cc:2272] T cd0030d950894d17ba45d6fc425c8f15 P f459de5cbbd24f6da91c65e002246f37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.227941 17138 tablet_replica.cc:333] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37: stopping tablet replica
I20260709 13:16:37.228384 17138 raft_consensus.cc:2243] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:37.229141 17138 raft_consensus.cc:2272] T 0a81d7a76f54402193f7961a6d357a27 P f459de5cbbd24f6da91c65e002246f37 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.231185 17138 tablet_replica.cc:333] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37: stopping tablet replica
I20260709 13:16:37.231746 17138 raft_consensus.cc:2243] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:37.232410 17138 raft_consensus.cc:2272] T 7be27b8136364b749f7ebf6f6ca0efe1 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.234865 17138 tablet_replica.cc:333] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37: stopping tablet replica
I20260709 13:16:37.235385 17138 raft_consensus.cc:2243] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.235785 17138 raft_consensus.cc:2272] T c9f80a1f3d6849abadfabae77b3f76f0 P f459de5cbbd24f6da91c65e002246f37 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.238008 17138 tablet_replica.cc:333] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37: stopping tablet replica
I20260709 13:16:37.238492 17138 raft_consensus.cc:2243] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.238910 17138 raft_consensus.cc:2272] T 0fc07ad9bd714d4e859aceea970f8191 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.240554 17138 tablet_replica.cc:333] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37: stopping tablet replica
I20260709 13:16:37.241078 17138 raft_consensus.cc:2243] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.241469 17138 raft_consensus.cc:2272] T 9deacc3fd54645b3b2ef76e85648c3ce P f459de5cbbd24f6da91c65e002246f37 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.243410 17138 tablet_replica.cc:333] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37: stopping tablet replica
I20260709 13:16:37.243913 17138 raft_consensus.cc:2243] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.244300 17138 raft_consensus.cc:2272] T 408d415cca0242f2bd1a949d7a783b8f P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.245853 17138 tablet_replica.cc:333] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37: stopping tablet replica
I20260709 13:16:37.246289 17138 raft_consensus.cc:2243] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:37.246942 17138 raft_consensus.cc:2272] T 20497ae36d814dae907bc3b7a1cd13eb P f459de5cbbd24f6da91c65e002246f37 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.248765 17138 tablet_replica.cc:333] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37: stopping tablet replica
I20260709 13:16:37.249186 17138 raft_consensus.cc:2243] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.249568 17138 raft_consensus.cc:2272] T 0c9a5135c61a46b99b3fc1add6f1efc2 P f459de5cbbd24f6da91c65e002246f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.349244 17138 tablet_server.cc:196] TabletServer@127.16.188.129:0 shutdown complete.
I20260709 13:16:37.367110 17138 tablet_server.cc:179] TabletServer@127.16.188.130:0 shutting down...
W20260709 13:16:37.381883 17314 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.188.129:44927: connect: Connection refused (error 111)
W20260709 13:16:37.387703 17314 consensus_peers.cc:597] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab -> Peer f459de5cbbd24f6da91c65e002246f37 (127.16.188.129:44927): Couldn't send request to peer f459de5cbbd24f6da91c65e002246f37. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:44927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:37.400662 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:37.401289 17138 tablet_replica.cc:333] T cd0030d950894d17ba45d6fc425c8f15 P c336c970057e412db6c05a6a2516cfab: stopping tablet replica
I20260709 13:16:37.401883 17138 raft_consensus.cc:2243] T cd0030d950894d17ba45d6fc425c8f15 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.402343 17138 raft_consensus.cc:2272] T cd0030d950894d17ba45d6fc425c8f15 P c336c970057e412db6c05a6a2516cfab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.404012 17138 tablet_replica.cc:333] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab: stopping tablet replica
I20260709 13:16:37.404503 17138 raft_consensus.cc:2243] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.404950 17138 raft_consensus.cc:2272] T 0a81d7a76f54402193f7961a6d357a27 P c336c970057e412db6c05a6a2516cfab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.406834 17138 tablet_replica.cc:333] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab: stopping tablet replica
I20260709 13:16:37.407336 17138 raft_consensus.cc:2243] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.407718 17138 raft_consensus.cc:2272] T 7be27b8136364b749f7ebf6f6ca0efe1 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.409627 17138 tablet_replica.cc:333] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab: stopping tablet replica
I20260709 13:16:37.410116 17138 raft_consensus.cc:2243] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.410495 17138 raft_consensus.cc:2272] T c9f80a1f3d6849abadfabae77b3f76f0 P c336c970057e412db6c05a6a2516cfab [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.412336 17138 tablet_replica.cc:333] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab: stopping tablet replica
I20260709 13:16:37.412845 17138 raft_consensus.cc:2243] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.413223 17138 raft_consensus.cc:2272] T 9deacc3fd54645b3b2ef76e85648c3ce P c336c970057e412db6c05a6a2516cfab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.415071 17138 tablet_replica.cc:333] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab: stopping tablet replica
I20260709 13:16:37.415653 17138 raft_consensus.cc:2243] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:37.416409 17138 raft_consensus.cc:2272] T 0fc07ad9bd714d4e859aceea970f8191 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.417970 17138 tablet_replica.cc:333] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab: stopping tablet replica
I20260709 13:16:37.418412 17138 raft_consensus.cc:2243] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:37.419057 17138 raft_consensus.cc:2272] T 408d415cca0242f2bd1a949d7a783b8f P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.420639 17138 tablet_replica.cc:333] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab: stopping tablet replica
I20260709 13:16:37.421098 17138 raft_consensus.cc:2243] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:37.421743 17138 raft_consensus.cc:2272] T 0c9a5135c61a46b99b3fc1add6f1efc2 P c336c970057e412db6c05a6a2516cfab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.423218 17138 tablet_replica.cc:333] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab: stopping tablet replica
I20260709 13:16:37.423635 17138 raft_consensus.cc:2243] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.424008 17138 raft_consensus.cc:2272] T 20497ae36d814dae907bc3b7a1cd13eb P c336c970057e412db6c05a6a2516cfab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.450620 17138 tablet_server.cc:196] TabletServer@127.16.188.130:0 shutdown complete.
I20260709 13:16:37.466490 17138 tablet_server.cc:179] TabletServer@127.16.188.131:0 shutting down...
I20260709 13:16:37.498502 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:37.499269 17138 tablet_replica.cc:333] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7: stopping tablet replica
I20260709 13:16:37.500162 17138 raft_consensus.cc:2243] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:16:37.500882 17388 consensus_peers.cc:597] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 -> Peer c336c970057e412db6c05a6a2516cfab (127.16.188.130:46069): Couldn't send request to peer c336c970057e412db6c05a6a2516cfab. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:46069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:37.501183 17138 raft_consensus.cc:2272] T cd0030d950894d17ba45d6fc425c8f15 P bb67dab9a7854783b5d47a1c08141ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.502928 17138 tablet_replica.cc:333] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7: stopping tablet replica
I20260709 13:16:37.503383 17138 raft_consensus.cc:2243] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.503782 17138 raft_consensus.cc:2272] T 0c9a5135c61a46b99b3fc1add6f1efc2 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.505364 17138 tablet_replica.cc:333] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7: stopping tablet replica
I20260709 13:16:37.505885 17138 raft_consensus.cc:2243] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.506232 17138 raft_consensus.cc:2272] T 7be27b8136364b749f7ebf6f6ca0efe1 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.508173 17138 tablet_replica.cc:333] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7: stopping tablet replica
I20260709 13:16:37.508670 17138 raft_consensus.cc:2243] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.509085 17138 raft_consensus.cc:2272] T 0a81d7a76f54402193f7961a6d357a27 P bb67dab9a7854783b5d47a1c08141ec7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.511049 17138 tablet_replica.cc:333] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7: stopping tablet replica
I20260709 13:16:37.511540 17138 raft_consensus.cc:2243] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.511938 17138 raft_consensus.cc:2272] T 20497ae36d814dae907bc3b7a1cd13eb P bb67dab9a7854783b5d47a1c08141ec7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.513867 17138 tablet_replica.cc:333] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7: stopping tablet replica
I20260709 13:16:37.514333 17138 raft_consensus.cc:2243] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:16:37.514988 17138 raft_consensus.cc:2272] T c9f80a1f3d6849abadfabae77b3f76f0 P bb67dab9a7854783b5d47a1c08141ec7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.516916 17138 tablet_replica.cc:333] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7: stopping tablet replica
I20260709 13:16:37.517369 17138 raft_consensus.cc:2243] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.517730 17138 raft_consensus.cc:2272] T 0fc07ad9bd714d4e859aceea970f8191 P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.519174 17138 tablet_replica.cc:333] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7: stopping tablet replica
I20260709 13:16:37.519609 17138 raft_consensus.cc:2243] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:37.520236 17138 raft_consensus.cc:2272] T 9deacc3fd54645b3b2ef76e85648c3ce P bb67dab9a7854783b5d47a1c08141ec7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.522085 17138 tablet_replica.cc:333] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7: stopping tablet replica
I20260709 13:16:37.522537 17138 raft_consensus.cc:2243] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:37.522930 17138 raft_consensus.cc:2272] T 408d415cca0242f2bd1a949d7a783b8f P bb67dab9a7854783b5d47a1c08141ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.548777 17138 tablet_server.cc:196] TabletServer@127.16.188.131:0 shutdown complete.
I20260709 13:16:37.564391 17138 master.cc:562] Master@127.16.188.190:40953 shutting down...
I20260709 13:16:37.628957 17225 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:16:37.680497 17138 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:37.681404 17138 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:37.681763 17138 tablet_replica.cc:333] T 00000000000000000000000000000000 P 662bd8cff35c476a8ce0656f43777494: stopping tablet replica
I20260709 13:16:37.702678 17138 master.cc:584] Master@127.16.188.190:40953 shutdown complete.
bb67dab9a7854783b5d47a1c08141ec7  1
c336c970057e412db6c05a6a2516cfab  4
f459de5cbbd24f6da91c65e002246f37  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12742 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:16:37.744971 17138 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.188.190:36085
I20260709 13:16:37.746085 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:37.752082 17640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:37.752183 17641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:37.753561 17643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:37.755206 17138 server_base.cc:1061] running on GCE node
I20260709 13:16:37.756002 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:37.756172 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:37.756371 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783602997756337 us; error 0 us; skew 500 ppm
I20260709 13:16:37.756939 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:37.759428 17138 webserver.cc:533] Webserver started at http://127.16.188.190:35639/ using document root <none> and password file <none>
I20260709 13:16:37.759941 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:37.760123 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:37.760419 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:37.761878 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/master-0-root/instance:
uuid: "696a293f52ab4de2936da980eca0f5bb"
format_stamp: "Formatted at 2026-07-09 13:16:37 on dist-test-slave-2hqk"
I20260709 13:16:37.766184 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:16:37.769624 17648 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:37.770394 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:16:37.770690 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/master-0-root
uuid: "696a293f52ab4de2936da980eca0f5bb"
format_stamp: "Formatted at 2026-07-09 13:16:37 on dist-test-slave-2hqk"
I20260709 13:16:37.770952 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:37.787144 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:37.788307 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:37.827710 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.190:36085
I20260709 13:16:37.827874 17699 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.190:36085 every 8 connection(s)
I20260709 13:16:37.831863 17700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.841909 17700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb: Bootstrap starting.
I20260709 13:16:37.846863 17700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.851366 17700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb: No bootstrap required, opened a new log
I20260709 13:16:37.853677 17700 raft_consensus.cc:359] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "696a293f52ab4de2936da980eca0f5bb" member_type: VOTER }
I20260709 13:16:37.854076 17700 raft_consensus.cc:385] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.854259 17700 raft_consensus.cc:740] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 696a293f52ab4de2936da980eca0f5bb, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.854856 17700 consensus_queue.cc:260] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "696a293f52ab4de2936da980eca0f5bb" member_type: VOTER }
I20260709 13:16:37.855290 17700 raft_consensus.cc:399] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:37.855484 17700 raft_consensus.cc:493] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:37.855693 17700 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.859984 17700 raft_consensus.cc:515] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "696a293f52ab4de2936da980eca0f5bb" member_type: VOTER }
I20260709 13:16:37.860467 17700 leader_election.cc:304] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 696a293f52ab4de2936da980eca0f5bb; no voters: 
I20260709 13:16:37.861737 17700 leader_election.cc:290] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:37.862126 17703 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:37.863525 17703 raft_consensus.cc:697] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [term 1 LEADER]: Becoming Leader. State: Replica: 696a293f52ab4de2936da980eca0f5bb, State: Running, Role: LEADER
I20260709 13:16:37.864239 17703 consensus_queue.cc:237] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "696a293f52ab4de2936da980eca0f5bb" member_type: VOTER }
I20260709 13:16:37.864959 17700 sys_catalog.cc:565] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:37.868932 17704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "696a293f52ab4de2936da980eca0f5bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "696a293f52ab4de2936da980eca0f5bb" member_type: VOTER } }
I20260709 13:16:37.869602 17704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:37.869577 17705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 696a293f52ab4de2936da980eca0f5bb. Latest consensus state: current_term: 1 leader_uuid: "696a293f52ab4de2936da980eca0f5bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "696a293f52ab4de2936da980eca0f5bb" member_type: VOTER } }
I20260709 13:16:37.873765 17705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:37.882047 17710 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:37.886885 17710 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:37.890609 17138 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:37.896180 17710 catalog_manager.cc:1383] Generated new cluster ID: cd40036754f14cf0b4e0db38e8abead9
I20260709 13:16:37.896440 17710 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:37.927354 17710 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:37.928565 17710 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:37.940641 17710 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb: Generated new TSK 0
I20260709 13:16:37.941210 17710 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:37.957041 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:37.963411 17722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:37.964258 17723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:37.965884 17725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:37.966976 17138 server_base.cc:1061] running on GCE node
I20260709 13:16:37.968007 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:37.968190 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:37.968312 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783602997968300 us; error 0 us; skew 500 ppm
I20260709 13:16:37.968876 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:37.971288 17138 webserver.cc:533] Webserver started at http://127.16.188.129:40103/ using document root <none> and password file <none>
I20260709 13:16:37.971745 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:37.971911 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:37.972146 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:37.973531 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/ts-0-root/instance:
uuid: "d9422034907349c88c03b1996d6de230"
format_stamp: "Formatted at 2026-07-09 13:16:37 on dist-test-slave-2hqk"
I20260709 13:16:37.978098 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:16:37.981376 17730 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:37.982205 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:37.982518 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/ts-0-root
uuid: "d9422034907349c88c03b1996d6de230"
format_stamp: "Formatted at 2026-07-09 13:16:37 on dist-test-slave-2hqk"
I20260709 13:16:37.982786 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:37.998978 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:38.000370 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:38.002015 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:38.004402 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:38.004685 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:16:38.004951 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:38.005138 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:38.050170 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.129:44347
I20260709 13:16:38.050294 17792 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.129:44347 every 8 connection(s)
I20260709 13:16:38.055089 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:38.063424 17797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:38.065260 17798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:38.067778 17138 server_base.cc:1061] running on GCE node
W20260709 13:16:38.067909 17800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:38.069298 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:38.069628 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:38.069839 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783602998069817 us; error 0 us; skew 500 ppm
I20260709 13:16:38.070551 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:38.073472 17793 heartbeater.cc:344] Connected to a master server at 127.16.188.190:36085
I20260709 13:16:38.073834 17793 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:38.074487 17138 webserver.cc:533] Webserver started at http://127.16.188.130:37603/ using document root <none> and password file <none>
I20260709 13:16:38.074647 17793 heartbeater.cc:507] Master 127.16.188.190:36085 requested a full tablet report, sending...
I20260709 13:16:38.075104 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:38.075335 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:38.075649 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:38.077054 17665 ts_manager.cc:194] Registered new tserver with Master: d9422034907349c88c03b1996d6de230 (127.16.188.129:44347)
I20260709 13:16:38.077145 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/ts-1-root/instance:
uuid: "f39d3b2933284b88ac4fea4be785a795"
format_stamp: "Formatted at 2026-07-09 13:16:38 on dist-test-slave-2hqk"
I20260709 13:16:38.078780 17665 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52144
I20260709 13:16:38.082368 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:16:38.085902 17805 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:38.086740 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:38.087095 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/ts-1-root
uuid: "f39d3b2933284b88ac4fea4be785a795"
format_stamp: "Formatted at 2026-07-09 13:16:38 on dist-test-slave-2hqk"
I20260709 13:16:38.087363 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:38.118386 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:38.119874 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:38.121758 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:38.124346 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:38.124640 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:16:38.124928 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:38.125089 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:38.174075 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.130:43493
I20260709 13:16:38.174190 17867 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.130:43493 every 8 connection(s)
I20260709 13:16:38.179699 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:38.188886 17871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:38.189142 17872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:38.192257 17138 server_base.cc:1061] running on GCE node
I20260709 13:16:38.193435 17868 heartbeater.cc:344] Connected to a master server at 127.16.188.190:36085
I20260709 13:16:38.193922 17868 heartbeater.cc:461] Registering TS with master...
W20260709 13:16:38.194065 17875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:38.195114 17868 heartbeater.cc:507] Master 127.16.188.190:36085 requested a full tablet report, sending...
I20260709 13:16:38.195326 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:38.195621 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:38.195851 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783602998195826 us; error 0 us; skew 500 ppm
I20260709 13:16:38.196648 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:38.197930 17665 ts_manager.cc:194] Registered new tserver with Master: f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493)
I20260709 13:16:38.199795 17138 webserver.cc:533] Webserver started at http://127.16.188.131:40855/ using document root <none> and password file <none>
I20260709 13:16:38.200074 17665 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52154
I20260709 13:16:38.200596 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:38.200917 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:38.201335 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:38.202718 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/ts-2-root/instance:
uuid: "0765f9e97a7d4c3494bc3894d5158707"
format_stamp: "Formatted at 2026-07-09 13:16:38 on dist-test-slave-2hqk"
I20260709 13:16:38.207746 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:16:38.211354 17879 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:38.212194 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:38.212612 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/ts-2-root
uuid: "0765f9e97a7d4c3494bc3894d5158707"
format_stamp: "Formatted at 2026-07-09 13:16:38 on dist-test-slave-2hqk"
I20260709 13:16:38.212935 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602984839783-17138-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:38.245971 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:38.247622 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:38.249300 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:38.251629 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:38.251863 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:38.252130 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:38.252307 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:38.299034 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.131:40969
I20260709 13:16:38.299147 17941 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.131:40969 every 8 connection(s)
I20260709 13:16:38.314152 17942 heartbeater.cc:344] Connected to a master server at 127.16.188.190:36085
I20260709 13:16:38.314559 17942 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:38.315438 17942 heartbeater.cc:507] Master 127.16.188.190:36085 requested a full tablet report, sending...
I20260709 13:16:38.317478 17665 ts_manager.cc:194] Registered new tserver with Master: 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:38.317605 17138 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015165691s
I20260709 13:16:38.319352 17665 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52166
I20260709 13:16:38.344440 17665 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52172:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:38.347601 17665 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:38.421787 17907 tablet_service.cc:1511] Processing CreateTablet for tablet c38be702d9534f81aa8da70651291fca (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:38.423250 17907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38be702d9534f81aa8da70651291fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.424561 17904 tablet_service.cc:1511] Processing CreateTablet for tablet a6ae27936e574c819309ad25e67919eb (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:38.425920 17904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ae27936e574c819309ad25e67919eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.425577 17906 tablet_service.cc:1511] Processing CreateTablet for tablet eaa5893e258d4c69bb266054eba17939 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:38.426839 17906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa5893e258d4c69bb266054eba17939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.428841 17832 tablet_service.cc:1511] Processing CreateTablet for tablet eaa5893e258d4c69bb266054eba17939 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:38.430171 17832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa5893e258d4c69bb266054eba17939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.433704 17833 tablet_service.cc:1511] Processing CreateTablet for tablet c38be702d9534f81aa8da70651291fca (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:38.434902 17833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38be702d9534f81aa8da70651291fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.436184 17903 tablet_service.cc:1511] Processing CreateTablet for tablet fc759e91da9844dbbea7f4fb00a7fec6 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:38.437719 17831 tablet_service.cc:1511] Processing CreateTablet for tablet 3dd1faf857564069b5a19e08a2d4f485 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:38.439036 17831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dd1faf857564069b5a19e08a2d4f485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.439613 17828 tablet_service.cc:1511] Processing CreateTablet for tablet 311001c17f3149b2b2574cc558f4cf53 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:38.440856 17828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311001c17f3149b2b2574cc558f4cf53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.441694 17830 tablet_service.cc:1511] Processing CreateTablet for tablet a6ae27936e574c819309ad25e67919eb (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:38.442941 17830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ae27936e574c819309ad25e67919eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.445541 17829 tablet_service.cc:1511] Processing CreateTablet for tablet fc759e91da9844dbbea7f4fb00a7fec6 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:38.446825 17829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc759e91da9844dbbea7f4fb00a7fec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.430186 17905 tablet_service.cc:1511] Processing CreateTablet for tablet 3dd1faf857564069b5a19e08a2d4f485 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:38.451102 17902 tablet_service.cc:1511] Processing CreateTablet for tablet 311001c17f3149b2b2574cc558f4cf53 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:38.452346 17902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311001c17f3149b2b2574cc558f4cf53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.456822 17905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dd1faf857564069b5a19e08a2d4f485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.462586 17903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc759e91da9844dbbea7f4fb00a7fec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.481554 17957 tablet_bootstrap.cc:492] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795: Bootstrap starting.
I20260709 13:16:38.483385 17956 tablet_bootstrap.cc:492] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707: Bootstrap starting.
I20260709 13:16:38.489048 17957 tablet_bootstrap.cc:654] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.494684 17956 tablet_bootstrap.cc:654] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.510160 17905 tablet_service.cc:1511] Processing CreateTablet for tablet a1c466ab270145d8878ff252633bb237 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:38.510383 17830 tablet_service.cc:1511] Processing CreateTablet for tablet 4a5e29ace7654f9e9cb32e9021a1d244 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:38.511547 17905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c466ab270145d8878ff252633bb237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.511680 17830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5e29ace7654f9e9cb32e9021a1d244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.516722 17829 tablet_service.cc:1511] Processing CreateTablet for tablet ab9e064069a04b40895ff324e99def22 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:38.517943 17829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9e064069a04b40895ff324e99def22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.518539 17907 tablet_service.cc:1511] Processing CreateTablet for tablet 4a5e29ace7654f9e9cb32e9021a1d244 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:38.519948 17907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5e29ace7654f9e9cb32e9021a1d244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.520634 17827 tablet_service.cc:1511] Processing CreateTablet for tablet dd202abadc574532960e95cb45899a19 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:38.522652 17903 tablet_service.cc:1511] Processing CreateTablet for tablet dd202abadc574532960e95cb45899a19 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:38.521518 17956 tablet_bootstrap.cc:492] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707: No bootstrap required, opened a new log
I20260709 13:16:38.523692 17827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd202abadc574532960e95cb45899a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.524102 17956 ts_tablet_manager.cc:1403] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.006s
I20260709 13:16:38.536844 17903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd202abadc574532960e95cb45899a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.536113 17957 tablet_bootstrap.cc:492] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795: No bootstrap required, opened a new log
I20260709 13:16:38.540099 17957 ts_tablet_manager.cc:1403] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.014s
I20260709 13:16:38.523692 17828 tablet_service.cc:1511] Processing CreateTablet for tablet a1c466ab270145d8878ff252633bb237 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:38.543789 17828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c466ab270145d8878ff252633bb237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.544935 17758 tablet_service.cc:1511] Processing CreateTablet for tablet c38be702d9534f81aa8da70651291fca (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:38.546241 17758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38be702d9534f81aa8da70651291fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.545935 17755 tablet_service.cc:1511] Processing CreateTablet for tablet a6ae27936e574c819309ad25e67919eb (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:38.547191 17755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ae27936e574c819309ad25e67919eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.532155 17956 raft_consensus.cc:359] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:38.548308 17757 tablet_service.cc:1511] Processing CreateTablet for tablet eaa5893e258d4c69bb266054eba17939 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:38.548806 17956 raft_consensus.cc:385] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.549201 17956 raft_consensus.cc:740] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.549677 17754 tablet_service.cc:1511] Processing CreateTablet for tablet fc759e91da9844dbbea7f4fb00a7fec6 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:38.549978 17956 consensus_queue.cc:260] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:38.550920 17756 tablet_service.cc:1511] Processing CreateTablet for tablet 3dd1faf857564069b5a19e08a2d4f485 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:38.549707 17757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa5893e258d4c69bb266054eba17939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.552505 17753 tablet_service.cc:1511] Processing CreateTablet for tablet 311001c17f3149b2b2574cc558f4cf53 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:38.552759 17752 tablet_service.cc:1511] Processing CreateTablet for tablet a1c466ab270145d8878ff252633bb237 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:38.554242 17753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 311001c17f3149b2b2574cc558f4cf53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.556331 17750 tablet_service.cc:1511] Processing CreateTablet for tablet ab9e064069a04b40895ff324e99def22 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:38.556919 17756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dd1faf857564069b5a19e08a2d4f485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.557665 17750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9e064069a04b40895ff324e99def22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.554703 17751 tablet_service.cc:1511] Processing CreateTablet for tablet 4a5e29ace7654f9e9cb32e9021a1d244 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:38.548097 17957 raft_consensus.cc:359] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.561429 17752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c466ab270145d8878ff252633bb237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.562811 17957 raft_consensus.cc:385] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.563798 17751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5e29ace7654f9e9cb32e9021a1d244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.564884 17754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc759e91da9844dbbea7f4fb00a7fec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.562964 17749 tablet_service.cc:1511] Processing CreateTablet for tablet dd202abadc574532960e95cb45899a19 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:38.571108 17749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd202abadc574532960e95cb45899a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.564745 17957 raft_consensus.cc:740] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.587690 17956 ts_tablet_manager.cc:1434] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707: Time spent starting tablet: real 0.063s	user 0.003s	sys 0.009s
I20260709 13:16:38.594399 17942 heartbeater.cc:499] Master 127.16.188.190:36085 was elected leader, sending a full tablet report...
I20260709 13:16:38.607558 17961 raft_consensus.cc:493] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.608283 17961 raft_consensus.cc:515] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:38.626000 17956 tablet_bootstrap.cc:492] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707: Bootstrap starting.
I20260709 13:16:38.629324 17962 tablet_bootstrap.cc:492] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230: Bootstrap starting.
I20260709 13:16:38.635445 17956 tablet_bootstrap.cc:654] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.618508 17961 leader_election.cc:290] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), d9422034907349c88c03b1996d6de230 (127.16.188.129:44347)
I20260709 13:16:38.615192 17906 tablet_service.cc:1511] Processing CreateTablet for tablet ab9e064069a04b40895ff324e99def22 (DEFAULT_TABLE table=test-workload [id=ff332ea1347a486aba56751a26923870]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:38.638172 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38be702d9534f81aa8da70651291fca" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795" is_pre_election: true
W20260709 13:16:38.647794 17880 leader_election.cc:343] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:38.648543 17882 leader_election.cc:343] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9422034907349c88c03b1996d6de230 (127.16.188.129:44347): Not found: Tablet not found: c38be702d9534f81aa8da70651291fca
I20260709 13:16:38.618117 17957 consensus_queue.cc:260] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.650615 17906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9e064069a04b40895ff324e99def22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:38.653821 17882 leader_election.cc:304] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707; no voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795
I20260709 13:16:38.656476 17961 raft_consensus.cc:2749] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:38.677794 17956 tablet_bootstrap.cc:492] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707: No bootstrap required, opened a new log
I20260709 13:16:38.678356 17956 ts_tablet_manager.cc:1403] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707: Time spent bootstrapping tablet: real 0.061s	user 0.004s	sys 0.009s
I20260709 13:16:38.679598 17964 raft_consensus.cc:493] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.681052 17964 raft_consensus.cc:515] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.681607 17956 raft_consensus.cc:359] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.683525 17956 raft_consensus.cc:385] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.684270 17956 raft_consensus.cc:740] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.685207 17868 heartbeater.cc:499] Master 127.16.188.190:36085 was elected leader, sending a full tablet report...
I20260709 13:16:38.686936 17962 tablet_bootstrap.cc:654] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.685945 17957 ts_tablet_manager.cc:1434] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795: Time spent starting tablet: real 0.145s	user 0.013s	sys 0.000s
I20260709 13:16:38.691011 17957 tablet_bootstrap.cc:492] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795: Bootstrap starting.
I20260709 13:16:38.694058 17956 consensus_queue.cc:260] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.697477 17768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc759e91da9844dbbea7f4fb00a7fec6" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230" is_pre_election: true
W20260709 13:16:38.698944 17808 leader_election.cc:343] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9422034907349c88c03b1996d6de230 (127.16.188.129:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.703413 17956 ts_tablet_manager.cc:1434] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:16:38.708575 17964 leader_election.cc:290] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:38.710336 17956 tablet_bootstrap.cc:492] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707: Bootstrap starting.
I20260709 13:16:38.711705 17962 tablet_bootstrap.cc:492] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230: No bootstrap required, opened a new log
I20260709 13:16:38.712159 17962 ts_tablet_manager.cc:1403] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.020s
I20260709 13:16:38.708225 17957 tablet_bootstrap.cc:654] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.715677 17962 raft_consensus.cc:359] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.716423 17962 raft_consensus.cc:385] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.716769 17962 raft_consensus.cc:740] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.717568 17962 consensus_queue.cc:260] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.721774 17956 tablet_bootstrap.cc:654] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.724881 17917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc759e91da9844dbbea7f4fb00a7fec6" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707" is_pre_election: true
W20260709 13:16:38.727996 17806 leader_election.cc:343] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.729833 17806 leader_election.cc:304] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f39d3b2933284b88ac4fea4be785a795; no voters: 0765f9e97a7d4c3494bc3894d5158707, d9422034907349c88c03b1996d6de230
I20260709 13:16:38.731355 17964 raft_consensus.cc:2749] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:38.734652 17962 ts_tablet_manager.cc:1434] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.015s
I20260709 13:16:38.735322 17793 heartbeater.cc:499] Master 127.16.188.190:36085 was elected leader, sending a full tablet report...
I20260709 13:16:38.737112 17957 tablet_bootstrap.cc:492] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795: No bootstrap required, opened a new log
I20260709 13:16:38.737479 17962 tablet_bootstrap.cc:492] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230: Bootstrap starting.
I20260709 13:16:38.737582 17957 ts_tablet_manager.cc:1403] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795: Time spent bootstrapping tablet: real 0.047s	user 0.025s	sys 0.006s
I20260709 13:16:38.738853 17956 tablet_bootstrap.cc:492] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707: No bootstrap required, opened a new log
I20260709 13:16:38.739374 17956 ts_tablet_manager.cc:1403] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.000s
I20260709 13:16:38.740718 17957 raft_consensus.cc:359] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.741451 17957 raft_consensus.cc:385] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.741743 17957 raft_consensus.cc:740] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.742519 17957 consensus_queue.cc:260] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.742926 17956 raft_consensus.cc:359] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.743748 17956 raft_consensus.cc:385] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.744079 17956 raft_consensus.cc:740] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.744938 17956 consensus_queue.cc:260] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.746048 17962 tablet_bootstrap.cc:654] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.746456 17957 ts_tablet_manager.cc:1434] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:38.747515 17957 tablet_bootstrap.cc:492] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795: Bootstrap starting.
I20260709 13:16:38.753031 17956 ts_tablet_manager.cc:1434] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:16:38.754032 17957 tablet_bootstrap.cc:654] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.754385 17956 tablet_bootstrap.cc:492] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707: Bootstrap starting.
I20260709 13:16:38.760910 17969 raft_consensus.cc:493] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.761574 17969 raft_consensus.cc:515] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.763640 17962 tablet_bootstrap.cc:492] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230: No bootstrap required, opened a new log
I20260709 13:16:38.764192 17962 ts_tablet_manager.cc:1403] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.008s
I20260709 13:16:38.764539 17956 tablet_bootstrap.cc:654] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.768098 17962 raft_consensus.cc:359] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.768972 17962 raft_consensus.cc:385] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.769122 17969 leader_election.cc:290] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:38.769356 17962 raft_consensus.cc:740] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.770437 17957 tablet_bootstrap.cc:492] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795: No bootstrap required, opened a new log
I20260709 13:16:38.771019 17957 ts_tablet_manager.cc:1403] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 13:16:38.770401 17962 consensus_queue.cc:260] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.772910 17962 ts_tablet_manager.cc:1434] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:38.774025 17962 tablet_bootstrap.cc:492] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230: Bootstrap starting.
I20260709 13:16:38.776649 17957 raft_consensus.cc:359] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.777403 17957 raft_consensus.cc:385] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.777738 17957 raft_consensus.cc:740] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.778586 17957 consensus_queue.cc:260] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.781404 17962 tablet_bootstrap.cc:654] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.784140 17956 tablet_bootstrap.cc:492] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707: No bootstrap required, opened a new log
I20260709 13:16:38.784739 17956 ts_tablet_manager.cc:1403] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.000s
I20260709 13:16:38.788585 17956 raft_consensus.cc:359] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.789773 17956 raft_consensus.cc:385] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.790169 17956 raft_consensus.cc:740] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.791164 17956 consensus_queue.cc:260] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.793145 17957 ts_tablet_manager.cc:1434] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:16:38.794526 17957 tablet_bootstrap.cc:492] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795: Bootstrap starting.
I20260709 13:16:38.798770 17956 ts_tablet_manager.cc:1434] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:16:38.800087 17956 tablet_bootstrap.cc:492] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707: Bootstrap starting.
I20260709 13:16:38.803555 17961 raft_consensus.cc:493] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.804072 17961 raft_consensus.cc:515] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.806175 17961 leader_election.cc:290] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493)
I20260709 13:16:38.807421 17842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795" is_pre_election: true
I20260709 13:16:38.808029 17956 tablet_bootstrap.cc:654] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:38.808766 17880 leader_election.cc:343] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.809605 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795" is_pre_election: true
I20260709 13:16:38.810016 17843 raft_consensus.cc:2468] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 0.
I20260709 13:16:38.813412 17957 tablet_bootstrap.cc:654] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.813759 17731 leader_election.cc:304] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:38.814637 17969 raft_consensus.cc:2804] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.814983 17969 raft_consensus.cc:493] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.815304 17969 raft_consensus.cc:3060] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.817545 17768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230" is_pre_election: true
W20260709 13:16:38.818933 17882 leader_election.cc:343] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9422034907349c88c03b1996d6de230 (127.16.188.129:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.819378 17882 leader_election.cc:304] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707; no voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795
I20260709 13:16:38.820362 17961 raft_consensus.cc:2749] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:38.821460 17917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707" is_pre_election: true
I20260709 13:16:38.822077 17917 raft_consensus.cc:2468] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 0.
I20260709 13:16:38.823892 17957 tablet_bootstrap.cc:492] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795: No bootstrap required, opened a new log
I20260709 13:16:38.824401 17957 ts_tablet_manager.cc:1403] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 13:16:38.824463 17969 raft_consensus.cc:515] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.826583 17962 tablet_bootstrap.cc:492] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230: No bootstrap required, opened a new log
I20260709 13:16:38.827045 17962 ts_tablet_manager.cc:1403] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230: Time spent bootstrapping tablet: real 0.053s	user 0.023s	sys 0.008s
I20260709 13:16:38.827144 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:38.827696 17843 raft_consensus.cc:3060] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.827669 17957 raft_consensus.cc:359] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:38.828671 17957 raft_consensus.cc:385] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.828989 17957 raft_consensus.cc:740] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.829919 17957 consensus_queue.cc:260] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:38.830296 17962 raft_consensus.cc:359] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.831167 17962 raft_consensus.cc:385] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.831516 17962 raft_consensus.cc:740] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.832294 17962 consensus_queue.cc:260] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.834374 17956 tablet_bootstrap.cc:492] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707: No bootstrap required, opened a new log
I20260709 13:16:38.834904 17956 ts_tablet_manager.cc:1403] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.002s
I20260709 13:16:38.835484 17843 raft_consensus.cc:2468] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 1.
I20260709 13:16:38.837055 17731 leader_election.cc:304] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:38.838203 17956 raft_consensus.cc:359] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.838969 17956 raft_consensus.cc:385] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.838832 17969 leader_election.cc:290] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 election: Requested vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:38.839423 17956 raft_consensus.cc:740] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.840224 17957 ts_tablet_manager.cc:1434] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 13:16:38.840272 17956 consensus_queue.cc:260] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.842681 17956 ts_tablet_manager.cc:1434] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:38.843024 17969 raft_consensus.cc:2804] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.843513 17969 raft_consensus.cc:697] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Becoming Leader. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:38.843675 17956 tablet_bootstrap.cc:492] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707: Bootstrap starting.
I20260709 13:16:38.848265 17957 tablet_bootstrap.cc:492] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795: Bootstrap starting.
I20260709 13:16:38.849915 17964 raft_consensus.cc:493] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.850443 17964 raft_consensus.cc:515] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.851125 17969 consensus_queue.cc:237] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.852658 17964 leader_election.cc:290] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:38.854389 17768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ae27936e574c819309ad25e67919eb" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230" is_pre_election: true
I20260709 13:16:38.855338 17980 raft_consensus.cc:493] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:38.856792 17808 leader_election.cc:343] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9422034907349c88c03b1996d6de230 (127.16.188.129:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.855928 17980 raft_consensus.cc:515] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.857661 17917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ae27936e574c819309ad25e67919eb" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707" is_pre_election: true
I20260709 13:16:38.858217 17916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:38.858839 17916 raft_consensus.cc:3060] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:38.859836 17806 leader_election.cc:343] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.860446 17806 leader_election.cc:304] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f39d3b2933284b88ac4fea4be785a795; no voters: 0765f9e97a7d4c3494bc3894d5158707, d9422034907349c88c03b1996d6de230
I20260709 13:16:38.862583 17964 raft_consensus.cc:2749] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:38.866839 17957 tablet_bootstrap.cc:654] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.867095 17916 raft_consensus.cc:2468] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 1.
I20260709 13:16:38.867317 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5e29ace7654f9e9cb32e9021a1d244" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795" is_pre_election: true
W20260709 13:16:38.869055 17731 leader_election.cc:343] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.869388 17980 leader_election.cc:290] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:38.871168 17917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5e29ace7654f9e9cb32e9021a1d244" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707" is_pre_election: true
W20260709 13:16:38.873085 17731 leader_election.cc:343] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.873638 17731 leader_election.cc:304] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9422034907349c88c03b1996d6de230; no voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795
I20260709 13:16:38.875001 17980 raft_consensus.cc:2749] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:38.877878 17962 ts_tablet_manager.cc:1434] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230: Time spent starting tablet: real 0.051s	user 0.026s	sys 0.018s
I20260709 13:16:38.878973 17962 tablet_bootstrap.cc:492] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230: Bootstrap starting.
I20260709 13:16:38.879957 17956 tablet_bootstrap.cc:654] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:38.884542 17714 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:38.887611 17957 tablet_bootstrap.cc:492] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795: No bootstrap required, opened a new log
I20260709 13:16:38.887643 17962 tablet_bootstrap.cc:654] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.888217 17957 ts_tablet_manager.cc:1403] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.015s
I20260709 13:16:38.888015 17665 catalog_manager.cc:5697] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9422034907349c88c03b1996d6de230 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "d9422034907349c88c03b1996d6de230" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.891681 17957 raft_consensus.cc:359] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.892740 17957 raft_consensus.cc:385] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.893111 17957 raft_consensus.cc:740] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.894632 17956 tablet_bootstrap.cc:492] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707: No bootstrap required, opened a new log
I20260709 13:16:38.894127 17957 consensus_queue.cc:260] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.895164 17956 ts_tablet_manager.cc:1403] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.004s
I20260709 13:16:38.897377 17957 ts_tablet_manager.cc:1434] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:16:38.897490 17961 raft_consensus.cc:493] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.897938 17961 raft_consensus.cc:515] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.898420 17957 tablet_bootstrap.cc:492] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795: Bootstrap starting.
I20260709 13:16:38.898344 17956 raft_consensus.cc:359] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.899210 17956 raft_consensus.cc:385] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.899510 17956 raft_consensus.cc:740] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.899928 17961 leader_election.cc:290] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493)
I20260709 13:16:38.900184 17956 consensus_queue.cc:260] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.902061 17768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa5893e258d4c69bb266054eba17939" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230" is_pre_election: true
I20260709 13:16:38.902217 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa5893e258d4c69bb266054eba17939" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795" is_pre_election: true
I20260709 13:16:38.902650 17956 ts_tablet_manager.cc:1434] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:16:38.903579 17956 tablet_bootstrap.cc:492] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707: Bootstrap starting.
W20260709 13:16:38.903574 17882 leader_election.cc:343] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9422034907349c88c03b1996d6de230 (127.16.188.129:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.905503 17957 tablet_bootstrap.cc:654] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.910620 17956 tablet_bootstrap.cc:654] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:38.916353 17880 leader_election.cc:343] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.918836 17880 leader_election.cc:304] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707; no voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795
I20260709 13:16:38.919315 17957 tablet_bootstrap.cc:492] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795: No bootstrap required, opened a new log
I20260709 13:16:38.920101 17957 ts_tablet_manager.cc:1403] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.009s
I20260709 13:16:38.920439 17961 raft_consensus.cc:2749] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:38.923945 17957 raft_consensus.cc:359] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.924970 17957 raft_consensus.cc:385] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.925417 17957 raft_consensus.cc:740] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.926609 17957 consensus_queue.cc:260] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.932968 17957 ts_tablet_manager.cc:1434] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:16:38.934332 17957 tablet_bootstrap.cc:492] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795: Bootstrap starting.
I20260709 13:16:38.942749 17957 tablet_bootstrap.cc:654] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.955602 17957 tablet_bootstrap.cc:492] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795: No bootstrap required, opened a new log
I20260709 13:16:38.956326 17957 ts_tablet_manager.cc:1403] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 13:16:38.960148 17957 raft_consensus.cc:359] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.960904 17957 raft_consensus.cc:385] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.961181 17957 raft_consensus.cc:740] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.961822 17957 consensus_queue.cc:260] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.962306 17956 tablet_bootstrap.cc:492] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707: No bootstrap required, opened a new log
I20260709 13:16:38.962868 17956 ts_tablet_manager.cc:1403] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.038s
I20260709 13:16:38.963616 17957 ts_tablet_manager.cc:1434] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:16:38.964771 17957 tablet_bootstrap.cc:492] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795: Bootstrap starting.
I20260709 13:16:38.966034 17956 raft_consensus.cc:359] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.966595 17962 tablet_bootstrap.cc:492] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230: No bootstrap required, opened a new log
I20260709 13:16:38.966816 17956 raft_consensus.cc:385] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.967324 17956 raft_consensus.cc:740] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.967475 17962 ts_tablet_manager.cc:1403] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230: Time spent bootstrapping tablet: real 0.089s	user 0.023s	sys 0.050s
I20260709 13:16:38.968240 17956 consensus_queue.cc:260] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.970647 17956 ts_tablet_manager.cc:1434] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:16:38.970736 17962 raft_consensus.cc:359] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.971506 17957 tablet_bootstrap.cc:654] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.971696 17962 raft_consensus.cc:385] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.971756 17956 tablet_bootstrap.cc:492] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707: Bootstrap starting.
I20260709 13:16:38.972136 17962 raft_consensus.cc:740] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.973481 17962 consensus_queue.cc:260] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.976665 17962 ts_tablet_manager.cc:1434] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:38.977977 17962 tablet_bootstrap.cc:492] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230: Bootstrap starting.
I20260709 13:16:38.979532 17956 tablet_bootstrap.cc:654] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.983137 17957 tablet_bootstrap.cc:492] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795: No bootstrap required, opened a new log
I20260709 13:16:38.983588 17957 ts_tablet_manager.cc:1403] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:16:38.985563 17962 tablet_bootstrap.cc:654] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.986186 17957 raft_consensus.cc:359] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.986883 17957 raft_consensus.cc:385] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.987147 17957 raft_consensus.cc:740] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.988029 17957 consensus_queue.cc:260] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.988737 17969 raft_consensus.cc:493] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.989171 17969 raft_consensus.cc:515] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:38.990204 17957 ts_tablet_manager.cc:1434] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:16:38.991072 17957 tablet_bootstrap.cc:492] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795: Bootstrap starting.
I20260709 13:16:38.991111 17969 leader_election.cc:290] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:38.994369 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc759e91da9844dbbea7f4fb00a7fec6" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795" is_pre_election: true
I20260709 13:16:38.995250 17843 raft_consensus.cc:2468] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 0.
I20260709 13:16:38.997021 17731 leader_election.cc:304] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:38.998232 17957 tablet_bootstrap.cc:654] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.993206 17916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc759e91da9844dbbea7f4fb00a7fec6" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707" is_pre_election: true
I20260709 13:16:38.999450 17916 raft_consensus.cc:2468] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 0.
I20260709 13:16:38.998222 17969 raft_consensus.cc:2804] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.004434 17969 raft_consensus.cc:493] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.004951 17969 raft_consensus.cc:3060] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.012233 17962 tablet_bootstrap.cc:492] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230: No bootstrap required, opened a new log
I20260709 13:16:39.012840 17962 ts_tablet_manager.cc:1403] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.017s
I20260709 13:16:39.014791 17957 tablet_bootstrap.cc:492] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795: No bootstrap required, opened a new log
I20260709 13:16:39.015210 17957 ts_tablet_manager.cc:1403] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 13:16:39.016005 17962 raft_consensus.cc:359] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.016784 17962 raft_consensus.cc:385] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.017118 17962 raft_consensus.cc:740] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.017844 17979 raft_consensus.cc:493] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.017748 17957 raft_consensus.cc:359] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.018394 17957 raft_consensus.cc:385] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.018302 17979 raft_consensus.cc:515] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.018687 17957 raft_consensus.cc:740] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.019411 17957 consensus_queue.cc:260] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.020385 17979 leader_election.cc:290] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.021595 17957 ts_tablet_manager.cc:1434] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:16:39.022477 17957 tablet_bootstrap.cc:492] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795: Bootstrap starting.
I20260709 13:16:39.022292 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd202abadc574532960e95cb45899a19" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795" is_pre_election: true
I20260709 13:16:39.022908 17843 raft_consensus.cc:2468] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 0.
I20260709 13:16:39.023509 17916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd202abadc574532960e95cb45899a19" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707" is_pre_election: true
I20260709 13:16:39.024080 17731 leader_election.cc:304] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:39.024827 17979 raft_consensus.cc:2804] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:16:39.025005 17731 leader_election.cc:343] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.025260 17979 raft_consensus.cc:493] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.025702 17979 raft_consensus.cc:3060] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.030934 17957 tablet_bootstrap.cc:654] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.035812 17962 consensus_queue.cc:260] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.037901 17962 ts_tablet_manager.cc:1434] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:16:39.038775 17962 tablet_bootstrap.cc:492] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230: Bootstrap starting.
I20260709 13:16:39.045481 17962 tablet_bootstrap.cc:654] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.046396 17969 raft_consensus.cc:515] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.050917 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc759e91da9844dbbea7f4fb00a7fec6" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:39.051535 17843 raft_consensus.cc:3060] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.053089 17979 raft_consensus.cc:515] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.055151 17956 tablet_bootstrap.cc:492] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707: No bootstrap required, opened a new log
I20260709 13:16:39.055658 17956 ts_tablet_manager.cc:1403] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707: Time spent bootstrapping tablet: real 0.084s	user 0.036s	sys 0.039s
I20260709 13:16:39.056217 17979 leader_election.cc:290] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 election: Requested vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.056826 17842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd202abadc574532960e95cb45899a19" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:39.057405 17842 raft_consensus.cc:3060] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.058499 17956 raft_consensus.cc:359] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.059274 17956 raft_consensus.cc:385] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.059535 17956 raft_consensus.cc:740] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.059566 17969 leader_election.cc:290] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 election: Requested vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.060336 17956 consensus_queue.cc:260] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.062486 17956 ts_tablet_manager.cc:1434] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:39.062460 17916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd202abadc574532960e95cb45899a19" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:39.063290 17916 raft_consensus.cc:3060] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.063691 17956 tablet_bootstrap.cc:492] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707: Bootstrap starting.
I20260709 13:16:39.064903 17917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc759e91da9844dbbea7f4fb00a7fec6" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:39.065457 17917 raft_consensus.cc:3060] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.070004 17956 tablet_bootstrap.cc:654] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.070107 17843 raft_consensus.cc:2468] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 1.
I20260709 13:16:39.071517 17731 leader_election.cc:304] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:39.072448 17964 raft_consensus.cc:493] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.072530 17969 raft_consensus.cc:2804] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:39.073156 17964 raft_consensus.cc:515] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.074285 17842 raft_consensus.cc:2468] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 1.
I20260709 13:16:39.074877 17916 raft_consensus.cc:2468] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 1.
I20260709 13:16:39.075229 17964 leader_election.cc:290] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.073340 17969 raft_consensus.cc:697] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Becoming Leader. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:39.076779 17768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c466ab270145d8878ff252633bb237" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230" is_pre_election: true
I20260709 13:16:39.077292 17731 leader_election.cc:304] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:39.076894 17969 consensus_queue.cc:237] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.078233 17980 raft_consensus.cc:2804] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:16:39.078392 17808 leader_election.cc:343] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9422034907349c88c03b1996d6de230 (127.16.188.129:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.078743 17980 raft_consensus.cc:697] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Becoming Leader. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:39.079875 17980 consensus_queue.cc:237] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.082249 17979 raft_consensus.cc:493] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.076957 17915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c466ab270145d8878ff252633bb237" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707" is_pre_election: true
I20260709 13:16:39.081243 17917 raft_consensus.cc:2468] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 1.
I20260709 13:16:39.090073 17915 raft_consensus.cc:2468] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 0.
I20260709 13:16:39.088632 17979 raft_consensus.cc:515] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.091514 17806 leader_election.cc:304] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795; no voters: d9422034907349c88c03b1996d6de230
I20260709 13:16:39.092367 17964 raft_consensus.cc:2804] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.092792 17964 raft_consensus.cc:493] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.093127 17964 raft_consensus.cc:3060] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.098515 17917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ae27936e574c819309ad25e67919eb" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707" is_pre_election: true
I20260709 13:16:39.099728 17917 raft_consensus.cc:2468] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 0.
I20260709 13:16:39.099517 17664 catalog_manager.cc:5697] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9422034907349c88c03b1996d6de230 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "d9422034907349c88c03b1996d6de230" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.101329 17731 leader_election.cc:304] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, d9422034907349c88c03b1996d6de230; no voters: 
I20260709 13:16:39.099071 17956 tablet_bootstrap.cc:492] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707: No bootstrap required, opened a new log
I20260709 13:16:39.102993 17956 ts_tablet_manager.cc:1403] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.009s
I20260709 13:16:39.103251 17964 raft_consensus.cc:515] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.099030 17979 leader_election.cc:290] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.104404 17979 raft_consensus.cc:2804] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.104964 17979 raft_consensus.cc:493] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.105423 17979 raft_consensus.cc:3060] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.106616 17768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c466ab270145d8878ff252633bb237" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230"
W20260709 13:16:39.108114 17808 leader_election.cc:343] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d9422034907349c88c03b1996d6de230 (127.16.188.129:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.111177 17964 leader_election.cc:290] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 election: Requested vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.111887 17956 raft_consensus.cc:359] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.113135 17956 raft_consensus.cc:385] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.113397 17956 raft_consensus.cc:740] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.113552 17917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c466ab270145d8878ff252633bb237" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:39.114411 17917 raft_consensus.cc:3060] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.114078 17956 consensus_queue.cc:260] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.116747 17956 ts_tablet_manager.cc:1434] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:16:39.116868 17964 raft_consensus.cc:493] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.117467 17964 raft_consensus.cc:515] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.118717 17956 tablet_bootstrap.cc:492] T ab9e064069a04b40895ff324e99def22 P 0765f9e97a7d4c3494bc3894d5158707: Bootstrap starting.
I20260709 13:16:39.119760 17966 raft_consensus.cc:493] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.120260 17966 raft_consensus.cc:515] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:39.122107 17768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa5893e258d4c69bb266054eba17939" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230" is_pre_election: true
I20260709 13:16:39.122496 17966 leader_election.cc:290] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969), d9422034907349c88c03b1996d6de230 (127.16.188.129:44347)
I20260709 13:16:39.124491 17915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38be702d9534f81aa8da70651291fca" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707" is_pre_election: true
I20260709 13:16:39.125155 17915 raft_consensus.cc:2468] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 0.
I20260709 13:16:39.125883 17917 raft_consensus.cc:2468] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 1.
I20260709 13:16:39.126334 17806 leader_election.cc:304] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795; no voters: 
W20260709 13:16:39.127053 17808 leader_election.cc:343] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9422034907349c88c03b1996d6de230 (127.16.188.129:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.127610 17806 leader_election.cc:304] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795; no voters: d9422034907349c88c03b1996d6de230
I20260709 13:16:39.127947 17768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38be702d9534f81aa8da70651291fca" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230" is_pre_election: true
I20260709 13:16:39.117771 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ae27936e574c819309ad25e67919eb" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795" is_pre_election: true
I20260709 13:16:39.133900 17964 leader_election.cc:290] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.135004 17917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa5893e258d4c69bb266054eba17939" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707" is_pre_election: true
I20260709 13:16:39.135710 17917 raft_consensus.cc:2468] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 0.
I20260709 13:16:39.132172 17966 raft_consensus.cc:2804] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.134071 17998 raft_consensus.cc:2804] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:39.136749 17966 raft_consensus.cc:493] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.137022 17998 raft_consensus.cc:697] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Becoming Leader. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Running, Role: LEADER
I20260709 13:16:39.137138 17966 raft_consensus.cc:3060] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.140938 17979 raft_consensus.cc:515] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.125900 17665 catalog_manager.cc:5697] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9422034907349c88c03b1996d6de230 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "d9422034907349c88c03b1996d6de230" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:39.141510 17808 leader_election.cc:343] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9422034907349c88c03b1996d6de230 (127.16.188.129:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.142961 17979 leader_election.cc:290] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 election: Requested vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.143375 17962 tablet_bootstrap.cc:492] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230: No bootstrap required, opened a new log
I20260709 13:16:39.143944 17843 raft_consensus.cc:2468] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 0.
I20260709 13:16:39.144356 17915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ae27936e574c819309ad25e67919eb" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:39.144929 17915 raft_consensus.cc:3060] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.144124 17962 ts_tablet_manager.cc:1403] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230: Time spent bootstrapping tablet: real 0.106s	user 0.025s	sys 0.002s
I20260709 13:16:39.147159 17806 leader_election.cc:304] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795; no voters: d9422034907349c88c03b1996d6de230
I20260709 13:16:39.148419 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ae27936e574c819309ad25e67919eb" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:39.148970 17843 raft_consensus.cc:3060] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.150063 17962 raft_consensus.cc:359] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.151129 17962 raft_consensus.cc:385] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.151590 17962 raft_consensus.cc:740] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.152706 17962 consensus_queue.cc:260] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.155867 17962 ts_tablet_manager.cc:1434] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:16:39.145885 17998 consensus_queue.cc:237] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.157997 17962 tablet_bootstrap.cc:492] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230: Bootstrap starting.
I20260709 13:16:39.160104 17956 tablet_bootstrap.cc:654] T ab9e064069a04b40895ff324e99def22 P 0765f9e97a7d4c3494bc3894d5158707: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.161458 17964 raft_consensus.cc:2804] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.162848 17964 raft_consensus.cc:493] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.163552 17964 raft_consensus.cc:3060] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.165400 17957 tablet_bootstrap.cc:492] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795: No bootstrap required, opened a new log
I20260709 13:16:39.165895 17957 ts_tablet_manager.cc:1403] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795: Time spent bootstrapping tablet: real 0.144s	user 0.018s	sys 0.019s
I20260709 13:16:39.156263 17966 raft_consensus.cc:515] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:39.172202 17917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38be702d9534f81aa8da70651291fca" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:39.172950 17917 raft_consensus.cc:3060] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.173094 17962 tablet_bootstrap.cc:654] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.173843 17966 leader_election.cc:290] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 election: Requested vote from peers 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969), d9422034907349c88c03b1996d6de230 (127.16.188.129:44347)
I20260709 13:16:39.173976 17768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38be702d9534f81aa8da70651291fca" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230"
W20260709 13:16:39.175647 17808 leader_election.cc:343] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d9422034907349c88c03b1996d6de230 (127.16.188.129:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.179608 17957 raft_consensus.cc:359] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.180390 17957 raft_consensus.cc:385] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.180826 17957 raft_consensus.cc:740] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.182438 17957 consensus_queue.cc:260] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.184305 17957 ts_tablet_manager.cc:1434] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.003s
I20260709 13:16:39.184579 17843 raft_consensus.cc:2468] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 1.
I20260709 13:16:39.189440 17731 leader_election.cc:304] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:39.190299 17979 raft_consensus.cc:2804] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:39.190980 17979 raft_consensus.cc:697] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Becoming Leader. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:39.192082 17915 raft_consensus.cc:2468] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 1.
I20260709 13:16:39.191843 17979 consensus_queue.cc:237] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.192500 17662 catalog_manager.cc:5697] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 reported cstate change: term changed from 0 to 1, leader changed from <none> to f39d3b2933284b88ac4fea4be785a795 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "f39d3b2933284b88ac4fea4be785a795" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.201198 17956 tablet_bootstrap.cc:492] T ab9e064069a04b40895ff324e99def22 P 0765f9e97a7d4c3494bc3894d5158707: No bootstrap required, opened a new log
I20260709 13:16:39.201848 17956 ts_tablet_manager.cc:1403] T ab9e064069a04b40895ff324e99def22 P 0765f9e97a7d4c3494bc3894d5158707: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.005s
I20260709 13:16:39.201776 17964 raft_consensus.cc:515] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.204952 17964 leader_election.cc:290] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 election: Requested vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.205106 17768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa5893e258d4c69bb266054eba17939" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230"
I20260709 13:16:39.206125 17964 raft_consensus.cc:493] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.207284 17808 leader_election.cc:343] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d9422034907349c88c03b1996d6de230 (127.16.188.129:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:39.201131 17917 raft_consensus.cc:2468] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 1.
I20260709 13:16:39.208184 17915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa5893e258d4c69bb266054eba17939" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:39.208846 17915 raft_consensus.cc:3060] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.208967 17806 leader_election.cc:304] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795; no voters: d9422034907349c88c03b1996d6de230
I20260709 13:16:39.210147 17998 raft_consensus.cc:2804] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:39.210685 17998 raft_consensus.cc:697] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Becoming Leader. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Running, Role: LEADER
I20260709 13:16:39.211248 17962 tablet_bootstrap.cc:492] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230: No bootstrap required, opened a new log
I20260709 13:16:39.211882 17962 ts_tablet_manager.cc:1403] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.027s
I20260709 13:16:39.211619 17998 consensus_queue.cc:237] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:39.206703 17964 raft_consensus.cc:515] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.215881 17962 raft_consensus.cc:359] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.216703 17962 raft_consensus.cc:385] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.217083 17962 raft_consensus.cc:740] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.217881 17964 leader_election.cc:290] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.218823 17768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230" is_pre_election: true
I20260709 13:16:39.219061 17917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707" is_pre_election: true
I20260709 13:16:39.219761 17917 raft_consensus.cc:2468] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 0.
I20260709 13:16:39.219774 17768 raft_consensus.cc:2468] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 0.
I20260709 13:16:39.221024 17806 leader_election.cc:304] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:39.222247 17964 raft_consensus.cc:2804] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.222697 17964 raft_consensus.cc:493] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.223398 17964 raft_consensus.cc:3060] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.222630 17956 raft_consensus.cc:359] T ab9e064069a04b40895ff324e99def22 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.223937 17956 raft_consensus.cc:385] T ab9e064069a04b40895ff324e99def22 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.224354 17956 raft_consensus.cc:740] T ab9e064069a04b40895ff324e99def22 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.218025 17962 consensus_queue.cc:260] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.226606 17956 consensus_queue.cc:260] T ab9e064069a04b40895ff324e99def22 P 0765f9e97a7d4c3494bc3894d5158707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.224648 17662 catalog_manager.cc:5697] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9422034907349c88c03b1996d6de230 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "d9422034907349c88c03b1996d6de230" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.225749 17915 raft_consensus.cc:2468] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 1.
I20260709 13:16:39.229069 17806 leader_election.cc:304] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795; no voters: d9422034907349c88c03b1996d6de230
I20260709 13:16:39.230744 17962 ts_tablet_manager.cc:1434] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:16:39.231278 17964 raft_consensus.cc:515] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.232259 17962 tablet_bootstrap.cc:492] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230: Bootstrap starting.
I20260709 13:16:39.232426 17966 raft_consensus.cc:2804] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:39.233497 17964 leader_election.cc:290] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 election: Requested vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.235440 17768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230"
I20260709 13:16:39.236323 17768 raft_consensus.cc:3060] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.240301 17962 tablet_bootstrap.cc:654] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.247244 17915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:39.248168 17915 raft_consensus.cc:3060] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.249969 17956 ts_tablet_manager.cc:1434] T ab9e064069a04b40895ff324e99def22 P 0765f9e97a7d4c3494bc3894d5158707: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 13:16:39.250433 17768 raft_consensus.cc:2468] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 1.
I20260709 13:16:39.253791 17966 raft_consensus.cc:697] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Becoming Leader. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Running, Role: LEADER
I20260709 13:16:39.253991 17808 leader_election.cc:304] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:39.254843 17966 consensus_queue.cc:237] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.258945 17966 raft_consensus.cc:2804] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:39.259742 17966 raft_consensus.cc:697] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Becoming Leader. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Running, Role: LEADER
I20260709 13:16:39.260646 17966 consensus_queue.cc:237] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.262091 17665 catalog_manager.cc:5697] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 reported cstate change: term changed from 0 to 1, leader changed from <none> to f39d3b2933284b88ac4fea4be785a795 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "f39d3b2933284b88ac4fea4be785a795" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.270859 17915 raft_consensus.cc:2468] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 1.
I20260709 13:16:39.274300 17962 tablet_bootstrap.cc:492] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230: No bootstrap required, opened a new log
I20260709 13:16:39.274716 17962 ts_tablet_manager.cc:1403] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.025s
I20260709 13:16:39.276904 17962 raft_consensus.cc:359] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.277401 17962 raft_consensus.cc:385] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.277626 17962 raft_consensus.cc:740] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.278249 17962 consensus_queue.cc:260] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.279158 17665 catalog_manager.cc:5697] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 reported cstate change: term changed from 0 to 1, leader changed from <none> to f39d3b2933284b88ac4fea4be785a795 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "f39d3b2933284b88ac4fea4be785a795" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.279982 17962 ts_tablet_manager.cc:1434] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:39.281086 17962 tablet_bootstrap.cc:492] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230: Bootstrap starting.
I20260709 13:16:39.280719 17665 catalog_manager.cc:5697] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 reported cstate change: term changed from 0 to 1, leader changed from <none> to f39d3b2933284b88ac4fea4be785a795 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "f39d3b2933284b88ac4fea4be785a795" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.286652 17962 tablet_bootstrap.cc:654] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.293201 17962 tablet_bootstrap.cc:492] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230: No bootstrap required, opened a new log
I20260709 13:16:39.293613 17962 ts_tablet_manager.cc:1403] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 13:16:39.295699 17962 raft_consensus.cc:359] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:39.296222 17962 raft_consensus.cc:385] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.296442 17962 raft_consensus.cc:740] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.297114 17962 consensus_queue.cc:260] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:39.298673 17962 ts_tablet_manager.cc:1434] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:39.299572 17962 tablet_bootstrap.cc:492] T ab9e064069a04b40895ff324e99def22 P d9422034907349c88c03b1996d6de230: Bootstrap starting.
I20260709 13:16:39.304219 17962 tablet_bootstrap.cc:654] T ab9e064069a04b40895ff324e99def22 P d9422034907349c88c03b1996d6de230: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:39.309023 17962 tablet_bootstrap.cc:492] T ab9e064069a04b40895ff324e99def22 P d9422034907349c88c03b1996d6de230: No bootstrap required, opened a new log
I20260709 13:16:39.309506 17962 ts_tablet_manager.cc:1403] T ab9e064069a04b40895ff324e99def22 P d9422034907349c88c03b1996d6de230: Time spent bootstrapping tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:16:39.311504 17962 raft_consensus.cc:359] T ab9e064069a04b40895ff324e99def22 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.312121 17962 raft_consensus.cc:385] T ab9e064069a04b40895ff324e99def22 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:39.312405 17962 raft_consensus.cc:740] T ab9e064069a04b40895ff324e99def22 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Initialized, Role: FOLLOWER
I20260709 13:16:39.313180 17962 consensus_queue.cc:260] T ab9e064069a04b40895ff324e99def22 P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.315003 17962 ts_tablet_manager.cc:1434] T ab9e064069a04b40895ff324e99def22 P d9422034907349c88c03b1996d6de230: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:16:39.362164 17961 raft_consensus.cc:493] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.362746 17961 raft_consensus.cc:515] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.364651 17961 leader_election.cc:290] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493)
I20260709 13:16:39.365666 17768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5e29ace7654f9e9cb32e9021a1d244" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230" is_pre_election: true
I20260709 13:16:39.365823 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5e29ace7654f9e9cb32e9021a1d244" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795" is_pre_election: true
I20260709 13:16:39.366492 17768 raft_consensus.cc:2468] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0765f9e97a7d4c3494bc3894d5158707 in term 0.
I20260709 13:16:39.366641 17843 raft_consensus.cc:2468] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0765f9e97a7d4c3494bc3894d5158707 in term 0.
I20260709 13:16:39.367602 17882 leader_election.cc:304] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, d9422034907349c88c03b1996d6de230; no voters: 
I20260709 13:16:39.368454 17961 raft_consensus.cc:2804] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.368854 17961 raft_consensus.cc:493] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.369143 17961 raft_consensus.cc:3060] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.370357 18004 raft_consensus.cc:493] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.370806 18004 raft_consensus.cc:515] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.373725 17915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9e064069a04b40895ff324e99def22" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707" is_pre_election: true
I20260709 13:16:39.373826 17768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9e064069a04b40895ff324e99def22" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230" is_pre_election: true
I20260709 13:16:39.374217 18004 leader_election.cc:290] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.374352 17915 raft_consensus.cc:2468] T ab9e064069a04b40895ff324e99def22 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 0.
I20260709 13:16:39.374567 17768 raft_consensus.cc:2468] T ab9e064069a04b40895ff324e99def22 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 0.
I20260709 13:16:39.375208 17961 raft_consensus.cc:515] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.375550 17806 leader_election.cc:304] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:39.376457 18004 raft_consensus.cc:2804] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:39.376853 18004 raft_consensus.cc:493] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.377359 17961 leader_election.cc:290] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 election: Requested vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493)
I20260709 13:16:39.377156 18004 raft_consensus.cc:3060] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.378141 17768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5e29ace7654f9e9cb32e9021a1d244" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230"
I20260709 13:16:39.378482 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5e29ace7654f9e9cb32e9021a1d244" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:39.378734 17768 raft_consensus.cc:3060] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.379009 17843 raft_consensus.cc:3060] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.383095 18004 raft_consensus.cc:515] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.385488 17768 raft_consensus.cc:2468] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0765f9e97a7d4c3494bc3894d5158707 in term 1.
I20260709 13:16:39.385488 17843 raft_consensus.cc:2468] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0765f9e97a7d4c3494bc3894d5158707 in term 1.
I20260709 13:16:39.385931 18004 leader_election.cc:290] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 election: Requested vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.386917 17882 leader_election.cc:304] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, d9422034907349c88c03b1996d6de230; no voters: 
I20260709 13:16:39.387578 17915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9e064069a04b40895ff324e99def22" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:39.387799 17961 raft_consensus.cc:2804] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:39.387931 17767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9e064069a04b40895ff324e99def22" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9422034907349c88c03b1996d6de230"
I20260709 13:16:39.388173 17915 raft_consensus.cc:3060] T ab9e064069a04b40895ff324e99def22 P 0765f9e97a7d4c3494bc3894d5158707 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.388612 17767 raft_consensus.cc:3060] T ab9e064069a04b40895ff324e99def22 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.389355 17961 raft_consensus.cc:697] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 LEADER]: Becoming Leader. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Running, Role: LEADER
I20260709 13:16:39.390946 17961 consensus_queue.cc:237] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.394357 17767 raft_consensus.cc:2468] T ab9e064069a04b40895ff324e99def22 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 1.
I20260709 13:16:39.395170 17915 raft_consensus.cc:2468] T ab9e064069a04b40895ff324e99def22 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 1.
I20260709 13:16:39.395596 17808 leader_election.cc:304] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:39.396828 18004 raft_consensus.cc:2804] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:39.397816 18004 raft_consensus.cc:697] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Becoming Leader. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Running, Role: LEADER
I20260709 13:16:39.398687 18004 consensus_queue.cc:237] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.400085 17664 catalog_manager.cc:5697] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "0765f9e97a7d4c3494bc3894d5158707" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:39.407178 17665 catalog_manager.cc:5697] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 reported cstate change: term changed from 0 to 1, leader changed from <none> to f39d3b2933284b88ac4fea4be785a795 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "f39d3b2933284b88ac4fea4be785a795" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.417903 17979 consensus_queue.cc:1048] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.429231 17979 consensus_queue.cc:1048] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.466295 17995 raft_consensus.cc:493] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.466907 17995 raft_consensus.cc:515] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.468868 17995 leader_election.cc:290] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.469617 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa5893e258d4c69bb266054eba17939" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795" is_pre_election: true
I20260709 13:16:39.469810 17915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa5893e258d4c69bb266054eba17939" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707" is_pre_election: true
I20260709 13:16:39.470553 17915 raft_consensus.cc:2393] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d9422034907349c88c03b1996d6de230 in current term 1: Already voted for candidate f39d3b2933284b88ac4fea4be785a795 in this term.
I20260709 13:16:39.471509 17731 leader_election.cc:304] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9422034907349c88c03b1996d6de230; no voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795
I20260709 13:16:39.472173 17995 raft_consensus.cc:3060] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.477496 17995 raft_consensus.cc:2749] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:39.536230 17995 consensus_queue.cc:1048] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.547407 17969 consensus_queue.cc:1048] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.575364 17843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c38be702d9534f81aa8da70651291fca"
dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
mode: GRACEFUL
new_leader_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:44234
I20260709 13:16:39.576030 17843 raft_consensus.cc:606] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Received request to transfer leadership to TS d9422034907349c88c03b1996d6de230
I20260709 13:16:39.582113 17843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaa5893e258d4c69bb266054eba17939"
dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
mode: GRACEFUL
new_leader_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:44234
I20260709 13:16:39.582715 17843 raft_consensus.cc:606] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Received request to transfer leadership to TS d9422034907349c88c03b1996d6de230
I20260709 13:16:39.588054 17767 raft_consensus.cc:3060] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.588783 17843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485"
dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
mode: GRACEFUL
new_leader_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:44234
I20260709 13:16:39.589465 17843 raft_consensus.cc:606] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Received request to transfer leadership to TS d9422034907349c88c03b1996d6de230
I20260709 13:16:39.597745 18004 consensus_queue.cc:1048] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:39.613560 18004 consensus_queue.cc:1048] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.620831 17767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53"
dest_uuid: "d9422034907349c88c03b1996d6de230"
mode: GRACEFUL
new_leader_uuid: "f39d3b2933284b88ac4fea4be785a795"
 from {username='slave'} at 127.0.0.1:58062
I20260709 13:16:39.621464 17767 raft_consensus.cc:606] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Received request to transfer leadership to TS f39d3b2933284b88ac4fea4be785a795
I20260709 13:16:39.640410 17915 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a5e29ace7654f9e9cb32e9021a1d244"
dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
mode: GRACEFUL
new_leader_uuid: "f39d3b2933284b88ac4fea4be785a795"
 from {username='slave'} at 127.0.0.1:55050
I20260709 13:16:39.641008 17915 raft_consensus.cc:606] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 LEADER]: Received request to transfer leadership to TS f39d3b2933284b88ac4fea4be785a795
I20260709 13:16:39.648905 17767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd202abadc574532960e95cb45899a19"
dest_uuid: "d9422034907349c88c03b1996d6de230"
mode: GRACEFUL
new_leader_uuid: "0765f9e97a7d4c3494bc3894d5158707"
 from {username='slave'} at 127.0.0.1:58062
I20260709 13:16:39.649384 17767 raft_consensus.cc:606] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Received request to transfer leadership to TS 0765f9e97a7d4c3494bc3894d5158707
I20260709 13:16:39.666723 17969 raft_consensus.cc:493] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.667203 17969 raft_consensus.cc:515] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:39.668807 17969 leader_election.cc:290] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969), f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493)
I20260709 13:16:39.669687 17915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38be702d9534f81aa8da70651291fca" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0765f9e97a7d4c3494bc3894d5158707" is_pre_election: true
I20260709 13:16:39.670423 17915 raft_consensus.cc:2393] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d9422034907349c88c03b1996d6de230 in current term 1: Already voted for candidate f39d3b2933284b88ac4fea4be785a795 in this term.
I20260709 13:16:39.670219 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38be702d9534f81aa8da70651291fca" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f39d3b2933284b88ac4fea4be785a795" is_pre_election: true
I20260709 13:16:39.671808 17731 leader_election.cc:304] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9422034907349c88c03b1996d6de230; no voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795
I20260709 13:16:39.672641 17969 raft_consensus.cc:3060] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:39.677920 17969 raft_consensus.cc:2749] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:39.681397 18004 consensus_queue.cc:1048] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.683144 17969 consensus_queue.cc:1048] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.690145 18004 raft_consensus.cc:993] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795: : Instructing follower d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:39.690665 17966 raft_consensus.cc:1081] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Signalling peer d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:39.692571 17766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c38be702d9534f81aa8da70651291fca"
dest_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:58048
I20260709 13:16:39.693197 17766 raft_consensus.cc:493] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.693571 17766 raft_consensus.cc:3060] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.702344 17995 consensus_queue.cc:1048] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.703428 17766 raft_consensus.cc:515] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:39.703836 17966 consensus_queue.cc:1048] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.705643 17766 leader_election.cc:290] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 2 election: Requested vote from peers 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969), f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493)
I20260709 13:16:39.715073 17842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38be702d9534f81aa8da70651291fca" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:39.715736 17842 raft_consensus.cc:3055] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:39.716104 17842 raft_consensus.cc:740] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Running, Role: LEADER
I20260709 13:16:39.717026 17842 consensus_queue.cc:260] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:39.718309 17842 raft_consensus.cc:3060] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.715617 17915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38be702d9534f81aa8da70651291fca" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:39.720748 17915 raft_consensus.cc:3060] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.725925 17995 consensus_queue.cc:1048] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.728350 17842 raft_consensus.cc:2468] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 2.
I20260709 13:16:39.728825 17966 consensus_queue.cc:1048] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.729640 17731 leader_election.cc:304] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:39.730551 17995 raft_consensus.cc:2804] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:39.731181 17995 raft_consensus.cc:697] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 2 LEADER]: Becoming Leader. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:39.731479 17966 consensus_queue.cc:1048] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.732372 17995 consensus_queue.cc:237] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:39.729677 17915 raft_consensus.cc:2468] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 2.
I20260709 13:16:39.740000 17969 consensus_queue.cc:1048] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.744764 17998 raft_consensus.cc:993] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795: : Instructing follower d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:39.745290 17998 raft_consensus.cc:1081] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Signalling peer d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:39.751713 17767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eaa5893e258d4c69bb266054eba17939"
dest_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:58048
I20260709 13:16:39.752440 17767 raft_consensus.cc:493] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.757606 17767 raft_consensus.cc:3060] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.758482 17966 consensus_queue.cc:1048] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.760128 17664 catalog_manager.cc:5697] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 reported cstate change: term changed from 1 to 2, leader changed from f39d3b2933284b88ac4fea4be785a795 (127.16.188.130) to d9422034907349c88c03b1996d6de230 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "d9422034907349c88c03b1996d6de230" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:39.767295 17767 raft_consensus.cc:515] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.769548 17767 leader_election.cc:290] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 2 election: Requested vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.770943 17964 consensus_queue.cc:1048] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.774356 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa5893e258d4c69bb266054eba17939" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:39.774935 17843 raft_consensus.cc:3055] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:39.775244 17843 raft_consensus.cc:740] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Running, Role: LEADER
I20260709 13:16:39.776011 17843 consensus_queue.cc:260] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.777261 17843 raft_consensus.cc:3060] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.784096 17843 raft_consensus.cc:2468] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 2.
I20260709 13:16:39.785470 17731 leader_election.cc:304] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:39.786016 17916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa5893e258d4c69bb266054eba17939" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:39.786362 17969 raft_consensus.cc:2804] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:39.786921 17969 raft_consensus.cc:697] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [term 2 LEADER]: Becoming Leader. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:39.786571 17916 raft_consensus.cc:3060] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.787822 17969 consensus_queue.cc:237] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.790901 17964 raft_consensus.cc:993] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795: : Instructing follower d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:39.791385 17964 raft_consensus.cc:1081] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Signalling peer d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:39.793255 17766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485"
dest_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:58048
I20260709 13:16:39.793839 17766 raft_consensus.cc:493] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.794217 17766 raft_consensus.cc:3060] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.795192 17916 raft_consensus.cc:2468] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 2.
I20260709 13:16:39.799880 17961 consensus_queue.cc:1048] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.803076 17766 raft_consensus.cc:515] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.803090 17665 catalog_manager.cc:5697] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 reported cstate change: term changed from 1 to 2, leader changed from f39d3b2933284b88ac4fea4be785a795 (127.16.188.130) to d9422034907349c88c03b1996d6de230 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "d9422034907349c88c03b1996d6de230" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.805378 17766 leader_election.cc:290] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 2 election: Requested vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.806450 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:39.807013 17843 raft_consensus.cc:3055] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:39.806911 17916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:39.807377 17843 raft_consensus.cc:740] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Running, Role: LEADER
I20260709 13:16:39.807600 17916 raft_consensus.cc:3060] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.808169 17843 consensus_queue.cc:260] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.809470 17843 raft_consensus.cc:3060] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.815928 17843 raft_consensus.cc:2468] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 2.
I20260709 13:16:39.814179 17916 raft_consensus.cc:2468] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 2.
I20260709 13:16:39.818413 17964 consensus_queue.cc:1048] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.819185 17731 leader_election.cc:304] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:39.820546 17969 raft_consensus.cc:2804] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:39.820948 17969 raft_consensus.cc:697] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 2 LEADER]: Becoming Leader. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:39.821597 17969 consensus_queue.cc:237] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.823220 18010 consensus_queue.cc:1048] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.831436 18010 raft_consensus.cc:993] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707: : Instructing follower f39d3b2933284b88ac4fea4be785a795 to start an election
I20260709 13:16:39.831905 18010 raft_consensus.cc:1081] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 LEADER]: Signalling peer f39d3b2933284b88ac4fea4be785a795 to start an election
I20260709 13:16:39.832357 17664 catalog_manager.cc:5697] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 reported cstate change: term changed from 1 to 2, leader changed from f39d3b2933284b88ac4fea4be785a795 (127.16.188.130) to d9422034907349c88c03b1996d6de230 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "d9422034907349c88c03b1996d6de230" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.833892 17842 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a5e29ace7654f9e9cb32e9021a1d244"
dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
 from {username='slave'} at 127.0.0.1:44208
I20260709 13:16:39.834311 17842 raft_consensus.cc:493] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.834621 17842 raft_consensus.cc:3060] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.841463 18004 consensus_queue.cc:1048] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.842365 17842 raft_consensus.cc:515] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.844861 17842 leader_election.cc:290] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 2 election: Requested vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:39.846903 17766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5e29ace7654f9e9cb32e9021a1d244" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9422034907349c88c03b1996d6de230"
I20260709 13:16:39.847486 17766 raft_consensus.cc:3060] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.847708 17917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5e29ace7654f9e9cb32e9021a1d244" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:39.848270 17917 raft_consensus.cc:3055] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:39.848644 17917 raft_consensus.cc:740] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Running, Role: LEADER
I20260709 13:16:39.849472 17917 consensus_queue.cc:260] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.850519 17917 raft_consensus.cc:3060] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.854708 17766 raft_consensus.cc:2468] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 2.
I20260709 13:16:39.855868 17808 leader_election.cc:304] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:39.856621 18004 raft_consensus.cc:2804] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:39.857064 18004 raft_consensus.cc:697] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 2 LEADER]: Becoming Leader. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Running, Role: LEADER
I20260709 13:16:39.857818 18004 consensus_queue.cc:237] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:39.862367 17917 raft_consensus.cc:2468] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 2.
I20260709 13:16:39.866303 17664 catalog_manager.cc:5697] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 reported cstate change: term changed from 1 to 2, leader changed from 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131) to f39d3b2933284b88ac4fea4be785a795 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "f39d3b2933284b88ac4fea4be785a795" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.994068 17995 raft_consensus.cc:993] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230: : Instructing follower f39d3b2933284b88ac4fea4be785a795 to start an election
I20260709 13:16:39.994565 17969 raft_consensus.cc:1081] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Signalling peer f39d3b2933284b88ac4fea4be785a795 to start an election
I20260709 13:16:39.996102 17842 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53"
dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
 from {username='slave'} at 127.0.0.1:44218
I20260709 13:16:39.996773 17842 raft_consensus.cc:493] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.997130 17842 raft_consensus.cc:3060] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:40.002646 17842 raft_consensus.cc:515] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:40.004406 17842 leader_election.cc:290] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 2 election: Requested vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:40.005316 17766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9422034907349c88c03b1996d6de230"
I20260709 13:16:40.005545 17917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:40.006021 17766 raft_consensus.cc:3055] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:40.006033 17917 raft_consensus.cc:3060] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:40.006517 17766 raft_consensus.cc:740] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:40.007361 17766 consensus_queue.cc:260] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:40.008586 17766 raft_consensus.cc:3060] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:40.013309 17917 raft_consensus.cc:2468] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 2.
I20260709 13:16:40.014627 17806 leader_election.cc:304] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:40.014993 17766 raft_consensus.cc:2468] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 2.
I20260709 13:16:40.015472 18004 raft_consensus.cc:2804] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:40.015982 18004 raft_consensus.cc:697] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 2 LEADER]: Becoming Leader. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Running, Role: LEADER
I20260709 13:16:40.016775 18004 consensus_queue.cc:237] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:40.023245 17664 catalog_manager.cc:5697] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 reported cstate change: term changed from 1 to 2, leader changed from d9422034907349c88c03b1996d6de230 (127.16.188.129) to f39d3b2933284b88ac4fea4be785a795 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "f39d3b2933284b88ac4fea4be785a795" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:40.071540 17980 raft_consensus.cc:993] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230: : Instructing follower 0765f9e97a7d4c3494bc3894d5158707 to start an election
I20260709 13:16:40.072069 17969 raft_consensus.cc:1081] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Signalling peer 0765f9e97a7d4c3494bc3894d5158707 to start an election
I20260709 13:16:40.074074 17917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd202abadc574532960e95cb45899a19"
dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
 from {username='slave'} at 127.0.0.1:55046
I20260709 13:16:40.075016 17917 raft_consensus.cc:493] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:40.075443 17917 raft_consensus.cc:3060] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:40.080121 17917 raft_consensus.cc:515] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:40.081811 17917 leader_election.cc:290] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 2 election: Requested vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493)
I20260709 13:16:40.082747 17766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd202abadc574532960e95cb45899a19" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9422034907349c88c03b1996d6de230"
I20260709 13:16:40.082983 17842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd202abadc574532960e95cb45899a19" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:40.083336 17766 raft_consensus.cc:3055] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:40.083509 17842 raft_consensus.cc:3060] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:40.083715 17766 raft_consensus.cc:740] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:40.084664 17766 consensus_queue.cc:260] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:40.085670 17766 raft_consensus.cc:3060] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:40.088284 17842 raft_consensus.cc:2468] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0765f9e97a7d4c3494bc3894d5158707 in term 2.
I20260709 13:16:40.089375 17880 leader_election.cc:304] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:40.090240 18010 raft_consensus.cc:2804] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:40.090677 18010 raft_consensus.cc:697] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 LEADER]: Becoming Leader. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Running, Role: LEADER
I20260709 13:16:40.091524 17766 raft_consensus.cc:2468] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0765f9e97a7d4c3494bc3894d5158707 in term 2.
I20260709 13:16:40.091454 18010 consensus_queue.cc:237] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:40.097908 17664 catalog_manager.cc:5697] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 reported cstate change: term changed from 1 to 2, leader changed from d9422034907349c88c03b1996d6de230 (127.16.188.129) to 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "0765f9e97a7d4c3494bc3894d5158707" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:40.239784 17917 raft_consensus.cc:1275] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.241117 17980 consensus_queue.cc:1048] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.242681 17917 raft_consensus.cc:1275] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.244133 17980 consensus_queue.cc:1048] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.250020 17842 raft_consensus.cc:1275] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.251820 17980 consensus_queue.cc:1048] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.256100 17843 raft_consensus.cc:1275] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.256613 17766 raft_consensus.cc:1275] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Refusing update from remote peer f39d3b2933284b88ac4fea4be785a795: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.258011 18004 consensus_queue.cc:1048] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.258625 17980 consensus_queue.cc:1048] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.274559 17916 raft_consensus.cc:1275] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Refusing update from remote peer f39d3b2933284b88ac4fea4be785a795: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.276114 18004 consensus_queue.cc:1048] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.395516 17766 raft_consensus.cc:1275] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Refusing update from remote peer f39d3b2933284b88ac4fea4be785a795: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.396992 18004 consensus_queue.cc:1048] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.404498 17842 raft_consensus.cc:1275] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.407222 17916 raft_consensus.cc:1275] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Refusing update from remote peer f39d3b2933284b88ac4fea4be785a795: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.407387 17969 consensus_queue.cc:1048] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.410413 17964 consensus_queue.cc:1048] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.418438 17916 raft_consensus.cc:1275] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.419878 17980 consensus_queue.cc:1048] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.537757 17842 raft_consensus.cc:1275] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Refusing update from remote peer 0765f9e97a7d4c3494bc3894d5158707: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.539199 18010 consensus_queue.cc:1048] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.547297 17766 raft_consensus.cc:1275] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Refusing update from remote peer 0765f9e97a7d4c3494bc3894d5158707: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.549463 18010 consensus_queue.cc:1048] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:42.720252 17138 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:16:42.721171 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:42.739013 17767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485"
dest_uuid: "d9422034907349c88c03b1996d6de230"
mode: GRACEFUL
new_leader_uuid: "0765f9e97a7d4c3494bc3894d5158707"
 from {username='slave'} at 127.0.0.1:42568
I20260709 13:16:42.739528 17767 raft_consensus.cc:606] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 2 LEADER]: Received request to transfer leadership to TS 0765f9e97a7d4c3494bc3894d5158707
I20260709 13:16:42.742105 17767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c38be702d9534f81aa8da70651291fca"
dest_uuid: "d9422034907349c88c03b1996d6de230"
mode: GRACEFUL
new_leader_uuid: "0765f9e97a7d4c3494bc3894d5158707"
 from {username='slave'} at 127.0.0.1:42568
I20260709 13:16:42.742543 17767 raft_consensus.cc:606] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 2 LEADER]: Received request to transfer leadership to TS 0765f9e97a7d4c3494bc3894d5158707
I20260709 13:16:42.743570 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:42.744069 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:16:42.857352 17696 debug-util.cc:398] Leaking SignalData structure 0x7b080004ef40 after lost signal to thread 17141
W20260709 13:16:42.858430 17696 debug-util.cc:398] Leaking SignalData structure 0x7b08000515e0 after lost signal to thread 17699
W20260709 13:16:42.860080 17696 debug-util.cc:398] Leaking SignalData structure 0x7b08001bff40 after lost signal to thread 17867
W20260709 13:16:42.861029 17696 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7f00 after lost signal to thread 17941
I20260709 13:16:43.138651 18047 raft_consensus.cc:993] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230: : Instructing follower 0765f9e97a7d4c3494bc3894d5158707 to start an election
I20260709 13:16:43.139211 18042 raft_consensus.cc:1081] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 2 LEADER]: Signalling peer 0765f9e97a7d4c3494bc3894d5158707 to start an election
I20260709 13:16:43.140997 17917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c38be702d9534f81aa8da70651291fca"
dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
 from {username='slave'} at 127.0.0.1:55046
I20260709 13:16:43.141475 17917 raft_consensus.cc:493] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.141813 17917 raft_consensus.cc:3060] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.146377 18047 raft_consensus.cc:993] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230: : Instructing follower 0765f9e97a7d4c3494bc3894d5158707 to start an election
I20260709 13:16:43.146868 18042 raft_consensus.cc:1081] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 2 LEADER]: Signalling peer 0765f9e97a7d4c3494bc3894d5158707 to start an election
I20260709 13:16:43.147985 17917 raft_consensus.cc:515] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:43.148841 17916 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485"
dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
 from {username='slave'} at 127.0.0.1:55046
I20260709 13:16:43.149389 17916 raft_consensus.cc:493] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.149756 17916 raft_consensus.cc:3060] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.150802 17841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38be702d9534f81aa8da70651291fca" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:43.151506 17841 raft_consensus.cc:3060] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.151552 17767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38be702d9534f81aa8da70651291fca" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9422034907349c88c03b1996d6de230"
I20260709 13:16:43.152261 17767 raft_consensus.cc:3055] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:43.152594 17767 raft_consensus.cc:740] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:43.153451 17767 consensus_queue.cc:260] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:43.154543 17767 raft_consensus.cc:3060] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.156591 17916 raft_consensus.cc:515] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:43.158706 17916 leader_election.cc:290] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 3 election: Requested vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493)
I20260709 13:16:43.159451 17766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9422034907349c88c03b1996d6de230"
I20260709 13:16:43.159960 17766 raft_consensus.cc:3055] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:43.159972 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:43.160375 17766 raft_consensus.cc:740] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:43.160648 17843 raft_consensus.cc:3060] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.161211 17766 consensus_queue.cc:260] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:43.162405 17766 raft_consensus.cc:3060] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.163242 17841 raft_consensus.cc:2468] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0765f9e97a7d4c3494bc3894d5158707 in term 3.
I20260709 13:16:43.167387 17843 raft_consensus.cc:2468] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0765f9e97a7d4c3494bc3894d5158707 in term 3.
I20260709 13:16:43.167984 17880 leader_election.cc:304] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:43.168944 18040 raft_consensus.cc:2804] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:43.169085 17880 leader_election.cc:304] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:43.169665 17767 raft_consensus.cc:2468] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0765f9e97a7d4c3494bc3894d5158707 in term 3.
I20260709 13:16:43.173321 17917 leader_election.cc:290] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 3 election: Requested vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), d9422034907349c88c03b1996d6de230 (127.16.188.129:44347)
I20260709 13:16:43.176527 17766 raft_consensus.cc:2468] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0765f9e97a7d4c3494bc3894d5158707 in term 3.
I20260709 13:16:43.178772 18040 raft_consensus.cc:697] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 3 LEADER]: Becoming Leader. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Running, Role: LEADER
I20260709 13:16:43.179795 18048 raft_consensus.cc:2804] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:43.179646 18040 consensus_queue.cc:237] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:43.180233 18048 raft_consensus.cc:697] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 LEADER]: Becoming Leader. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Running, Role: LEADER
I20260709 13:16:43.181061 18048 consensus_queue.cc:237] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:43.190606 17664 catalog_manager.cc:5697] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 reported cstate change: term changed from 2 to 3, leader changed from d9422034907349c88c03b1996d6de230 (127.16.188.129) to 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131). New cstate: current_term: 3 leader_uuid: "0765f9e97a7d4c3494bc3894d5158707" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.210340 17664 catalog_manager.cc:5697] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 reported cstate change: term changed from 2 to 3, leader changed from d9422034907349c88c03b1996d6de230 (127.16.188.129) to 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131). New cstate: current_term: 3 leader_uuid: "0765f9e97a7d4c3494bc3894d5158707" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:43.562904 17766 raft_consensus.cc:1275] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 3 FOLLOWER]: Refusing update from remote peer 0765f9e97a7d4c3494bc3894d5158707: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:43.564404 18048 consensus_queue.cc:1048] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:43.575840 17843 raft_consensus.cc:1275] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 3 FOLLOWER]: Refusing update from remote peer 0765f9e97a7d4c3494bc3894d5158707: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:43.578332 18049 consensus_queue.cc:1048] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:43.615614 17767 raft_consensus.cc:1275] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 3 FOLLOWER]: Refusing update from remote peer 0765f9e97a7d4c3494bc3894d5158707: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:43.617133 18048 consensus_queue.cc:1048] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:43.626720 17843 raft_consensus.cc:1275] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 3 FOLLOWER]: Refusing update from remote peer 0765f9e97a7d4c3494bc3894d5158707: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:43.630594 18040 consensus_queue.cc:1048] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:43.744920 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:43.755347 17916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c38be702d9534f81aa8da70651291fca"
dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
mode: GRACEFUL
new_leader_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:55050
I20260709 13:16:43.755844 17916 raft_consensus.cc:606] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 3 LEADER]: Received request to transfer leadership to TS d9422034907349c88c03b1996d6de230
I20260709 13:16:43.763037 17916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485"
dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
mode: GRACEFUL
new_leader_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:55050
I20260709 13:16:43.763484 17916 raft_consensus.cc:606] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 LEADER]: Received request to transfer leadership to TS d9422034907349c88c03b1996d6de230
I20260709 13:16:43.774343 17843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53"
dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
mode: GRACEFUL
new_leader_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:44234
I20260709 13:16:43.775147 17843 raft_consensus.cc:606] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 2 LEADER]: Received request to transfer leadership to TS d9422034907349c88c03b1996d6de230
I20260709 13:16:43.781705 17843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1c466ab270145d8878ff252633bb237"
dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
mode: GRACEFUL
new_leader_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:44234
I20260709 13:16:43.782320 17843 raft_consensus.cc:606] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Received request to transfer leadership to TS d9422034907349c88c03b1996d6de230
I20260709 13:16:43.788259 17843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a5e29ace7654f9e9cb32e9021a1d244"
dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
mode: GRACEFUL
new_leader_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:44234
I20260709 13:16:43.788874 17843 raft_consensus.cc:606] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 2 LEADER]: Received request to transfer leadership to TS d9422034907349c88c03b1996d6de230
I20260709 13:16:43.809234 18063 raft_consensus.cc:993] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795: : Instructing follower d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:43.809669 18004 raft_consensus.cc:1081] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Signalling peer d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:43.811179 17767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1c466ab270145d8878ff252633bb237"
dest_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:58048
I20260709 13:16:43.811635 17767 raft_consensus.cc:493] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.811977 17767 raft_consensus.cc:3060] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.817205 17767 raft_consensus.cc:515] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:43.818898 17767 leader_election.cc:290] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 2 election: Requested vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:43.819898 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c466ab270145d8878ff252633bb237" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:43.820865 17843 raft_consensus.cc:3055] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:43.821271 17843 raft_consensus.cc:740] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Running, Role: LEADER
I20260709 13:16:43.821216 17916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c466ab270145d8878ff252633bb237" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:43.822063 17916 raft_consensus.cc:3060] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.822587 17843 consensus_queue.cc:260] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:43.823864 17843 raft_consensus.cc:3060] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.829331 17843 raft_consensus.cc:2468] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 2.
I20260709 13:16:43.829356 17916 raft_consensus.cc:2468] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 2.
I20260709 13:16:43.830674 17731 leader_election.cc:304] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:43.831578 18042 raft_consensus.cc:2804] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:43.832947 18042 raft_consensus.cc:697] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [term 2 LEADER]: Becoming Leader. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:43.834033 18042 consensus_queue.cc:237] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:43.843271 17662 catalog_manager.cc:5697] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 reported cstate change: term changed from 1 to 2, leader changed from f39d3b2933284b88ac4fea4be785a795 (127.16.188.130) to d9422034907349c88c03b1996d6de230 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "d9422034907349c88c03b1996d6de230" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.974290 18063 raft_consensus.cc:993] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795: : Instructing follower d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:43.974907 18004 raft_consensus.cc:1081] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 2 LEADER]: Signalling peer d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:43.976951 17767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a5e29ace7654f9e9cb32e9021a1d244"
dest_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:58048
I20260709 13:16:43.977612 17767 raft_consensus.cc:493] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.978044 17767 raft_consensus.cc:3060] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.983536 17767 raft_consensus.cc:515] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:43.985560 17767 leader_election.cc:290] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 3 election: Requested vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:43.986562 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5e29ace7654f9e9cb32e9021a1d244" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:43.986860 17916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5e29ace7654f9e9cb32e9021a1d244" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:43.987232 17843 raft_consensus.cc:3055] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:43.987572 17916 raft_consensus.cc:3060] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.987715 17843 raft_consensus.cc:740] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Running, Role: LEADER
I20260709 13:16:43.988719 17843 consensus_queue.cc:260] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:43.989969 17843 raft_consensus.cc:3060] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.995308 17843 raft_consensus.cc:2468] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 3.
I20260709 13:16:43.995434 17916 raft_consensus.cc:2468] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 3.
I20260709 13:16:43.996548 17731 leader_election.cc:304] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:43.997332 18042 raft_consensus.cc:2804] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:43.997875 18042 raft_consensus.cc:697] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 3 LEADER]: Becoming Leader. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:43.998791 18042 consensus_queue.cc:237] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:44.007771 17662 catalog_manager.cc:5697] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 reported cstate change: term changed from 2 to 3, leader changed from f39d3b2933284b88ac4fea4be785a795 (127.16.188.130) to d9422034907349c88c03b1996d6de230 (127.16.188.129). New cstate: current_term: 3 leader_uuid: "d9422034907349c88c03b1996d6de230" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.033896 18063 raft_consensus.cc:993] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795: : Instructing follower d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:44.034415 18004 raft_consensus.cc:1081] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 2 LEADER]: Signalling peer d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:44.036314 17767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53"
dest_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:58048
I20260709 13:16:44.036954 17767 raft_consensus.cc:493] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:44.037305 17767 raft_consensus.cc:3060] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:44.042630 17767 raft_consensus.cc:515] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:44.044742 17767 leader_election.cc:290] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 3 election: Requested vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:44.045982 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:44.046605 17843 raft_consensus.cc:3055] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:44.046578 17916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:44.047077 17843 raft_consensus.cc:740] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Running, Role: LEADER
I20260709 13:16:44.047353 17916 raft_consensus.cc:3060] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:44.047981 17843 consensus_queue.cc:260] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:44.049286 17843 raft_consensus.cc:3060] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:44.050949 18049 raft_consensus.cc:993] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707: : Instructing follower d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:44.051463 18040 raft_consensus.cc:1081] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 3 LEADER]: Signalling peer d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:44.053432 17767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c38be702d9534f81aa8da70651291fca"
dest_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:58032
I20260709 13:16:44.054085 17767 raft_consensus.cc:493] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:44.054524 17767 raft_consensus.cc:3060] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.054674 17916 raft_consensus.cc:2468] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 3.
I20260709 13:16:44.055894 17731 leader_election.cc:304] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, d9422034907349c88c03b1996d6de230; no voters: 
I20260709 13:16:44.056815 18042 raft_consensus.cc:2804] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:44.057510 18042 raft_consensus.cc:697] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 3 LEADER]: Becoming Leader. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:44.058386 18042 consensus_queue.cc:237] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:44.061058 17843 raft_consensus.cc:2468] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 3.
I20260709 13:16:44.065191 17767 raft_consensus.cc:515] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:44.067348 17767 leader_election.cc:290] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 4 election: Requested vote from peers 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969), f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493)
I20260709 13:16:44.068859 17916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38be702d9534f81aa8da70651291fca" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:44.069370 17916 raft_consensus.cc:3055] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:44.069835 17916 raft_consensus.cc:740] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Running, Role: LEADER
I20260709 13:16:44.069290 17662 catalog_manager.cc:5697] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 reported cstate change: term changed from 2 to 3, leader changed from f39d3b2933284b88ac4fea4be785a795 (127.16.188.130) to d9422034907349c88c03b1996d6de230 (127.16.188.129). New cstate: current_term: 3 leader_uuid: "d9422034907349c88c03b1996d6de230" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.070557 17916 consensus_queue.cc:260] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:44.071604 17916 raft_consensus.cc:3060] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.073345 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38be702d9534f81aa8da70651291fca" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:44.073911 17843 raft_consensus.cc:3060] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.080976 17916 raft_consensus.cc:2468] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 4.
I20260709 13:16:44.081342 17843 raft_consensus.cc:2468] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 4.
I20260709 13:16:44.082397 17731 leader_election.cc:304] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, d9422034907349c88c03b1996d6de230; no voters: 
I20260709 13:16:44.083218 18042 raft_consensus.cc:2804] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:44.083810 18042 raft_consensus.cc:697] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 4 LEADER]: Becoming Leader. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:44.085026 18040 raft_consensus.cc:993] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707: : Instructing follower d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:44.084678 18042 consensus_queue.cc:237] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:44.085467 18040 raft_consensus.cc:1081] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 LEADER]: Signalling peer d9422034907349c88c03b1996d6de230 to start an election
I20260709 13:16:44.087535 17766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485"
dest_uuid: "d9422034907349c88c03b1996d6de230"
 from {username='slave'} at 127.0.0.1:58032
I20260709 13:16:44.088095 17766 raft_consensus.cc:493] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:44.088465 17766 raft_consensus.cc:3060] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.093706 17662 catalog_manager.cc:5697] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 reported cstate change: term changed from 3 to 4, leader changed from 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131) to d9422034907349c88c03b1996d6de230 (127.16.188.129). New cstate: current_term: 4 leader_uuid: "d9422034907349c88c03b1996d6de230" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.095060 17766 raft_consensus.cc:515] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:44.098067 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:44.098599 17843 raft_consensus.cc:3060] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.099416 17916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dd1faf857564069b5a19e08a2d4f485" candidate_uuid: "d9422034907349c88c03b1996d6de230" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:44.100124 17916 raft_consensus.cc:3055] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:44.100551 17916 raft_consensus.cc:740] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Running, Role: LEADER
I20260709 13:16:44.101529 17916 consensus_queue.cc:260] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:44.102947 17766 leader_election.cc:290] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 4 election: Requested vote from peers f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:44.102727 17916 raft_consensus.cc:3060] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.113436 17916 raft_consensus.cc:2468] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 4.
I20260709 13:16:44.113502 17843 raft_consensus.cc:2468] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9422034907349c88c03b1996d6de230 in term 4.
I20260709 13:16:44.115006 17731 leader_election.cc:304] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9422034907349c88c03b1996d6de230, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:44.115868 18042 raft_consensus.cc:2804] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:44.116354 18042 raft_consensus.cc:697] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 4 LEADER]: Becoming Leader. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:44.117192 18042 consensus_queue.cc:237] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:44.124338 17662 catalog_manager.cc:5697] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 reported cstate change: term changed from 3 to 4, leader changed from 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131) to d9422034907349c88c03b1996d6de230 (127.16.188.129). New cstate: current_term: 4 leader_uuid: "d9422034907349c88c03b1996d6de230" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.235941 17843 raft_consensus.cc:1275] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:44.237295 18042 consensus_queue.cc:1048] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:44.256069 17916 raft_consensus.cc:1275] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:44.257862 18042 consensus_queue.cc:1048] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:44.487810 17843 raft_consensus.cc:1275] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 3 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:44.489377 18064 consensus_queue.cc:1048] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:44.499852 17916 raft_consensus.cc:1275] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:44.502233 18042 consensus_queue.cc:1048] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:44.519676 17843 raft_consensus.cc:1275] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 3 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:44.524263 18064 consensus_queue.cc:1048] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:44.525388 17917 raft_consensus.cc:1275] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:44.527776 17916 raft_consensus.cc:1275] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 4 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:44.531526 18064 consensus_queue.cc:1048] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:44.532169 18042 consensus_queue.cc:1048] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:44.572873 17841 raft_consensus.cc:1275] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 4 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:44.573100 17917 raft_consensus.cc:1275] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 4 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:44.574779 17843 raft_consensus.cc:1275] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 4 FOLLOWER]: Refusing update from remote peer d9422034907349c88c03b1996d6de230: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:44.574680 18042 consensus_queue.cc:1048] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:44.578979 18064 consensus_queue.cc:1048] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:44.582213 18042 consensus_queue.cc:1048] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:46.798235 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:46.806864 17766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53"
dest_uuid: "d9422034907349c88c03b1996d6de230"
mode: GRACEFUL
new_leader_uuid: "0765f9e97a7d4c3494bc3894d5158707"
 from {username='slave'} at 127.0.0.1:42568
I20260709 13:16:46.807744 17766 raft_consensus.cc:606] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 3 LEADER]: Received request to transfer leadership to TS 0765f9e97a7d4c3494bc3894d5158707
I20260709 13:16:46.811699 17766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6ae27936e574c819309ad25e67919eb"
dest_uuid: "d9422034907349c88c03b1996d6de230"
mode: GRACEFUL
new_leader_uuid: "f39d3b2933284b88ac4fea4be785a795"
 from {username='slave'} at 127.0.0.1:42568
I20260709 13:16:46.812305 17766 raft_consensus.cc:606] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Received request to transfer leadership to TS f39d3b2933284b88ac4fea4be785a795
I20260709 13:16:46.815032 17766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c38be702d9534f81aa8da70651291fca"
dest_uuid: "d9422034907349c88c03b1996d6de230"
mode: GRACEFUL
new_leader_uuid: "f39d3b2933284b88ac4fea4be785a795"
 from {username='slave'} at 127.0.0.1:42568
I20260709 13:16:46.815505 17766 raft_consensus.cc:606] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 4 LEADER]: Received request to transfer leadership to TS f39d3b2933284b88ac4fea4be785a795
I20260709 13:16:46.818020 17766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc759e91da9844dbbea7f4fb00a7fec6"
dest_uuid: "d9422034907349c88c03b1996d6de230"
mode: GRACEFUL
new_leader_uuid: "0765f9e97a7d4c3494bc3894d5158707"
 from {username='slave'} at 127.0.0.1:42568
I20260709 13:16:46.818416 17766 raft_consensus.cc:606] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Received request to transfer leadership to TS 0765f9e97a7d4c3494bc3894d5158707
I20260709 13:16:46.819528 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:46.820106 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:46.976658 18085 raft_consensus.cc:993] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230: : Instructing follower 0765f9e97a7d4c3494bc3894d5158707 to start an election
I20260709 13:16:46.977293 18081 raft_consensus.cc:1081] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 3 LEADER]: Signalling peer 0765f9e97a7d4c3494bc3894d5158707 to start an election
I20260709 13:16:46.978868 17915 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53"
dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
 from {username='slave'} at 127.0.0.1:55046
I20260709 13:16:46.979342 17915 raft_consensus.cc:493] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:46.979671 17915 raft_consensus.cc:3060] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.986104 17915 raft_consensus.cc:515] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:46.988830 17915 leader_election.cc:290] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 4 election: Requested vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493)
I20260709 13:16:46.989074 17766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d9422034907349c88c03b1996d6de230"
I20260709 13:16:46.989971 17766 raft_consensus.cc:3055] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:46.990329 17766 raft_consensus.cc:740] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:46.990497 17841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "311001c17f3149b2b2574cc558f4cf53" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:46.991338 17841 raft_consensus.cc:3060] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.991564 18081 raft_consensus.cc:993] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230: : Instructing follower f39d3b2933284b88ac4fea4be785a795 to start an election
I20260709 13:16:46.991402 17766 consensus_queue.cc:260] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:46.992241 18081 raft_consensus.cc:1081] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Signalling peer f39d3b2933284b88ac4fea4be785a795 to start an election
I20260709 13:16:46.993221 17766 raft_consensus.cc:3060] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.994280 17843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6ae27936e574c819309ad25e67919eb"
dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
 from {username='slave'} at 127.0.0.1:44218
I20260709 13:16:46.994884 17843 raft_consensus.cc:493] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:46.995246 17843 raft_consensus.cc:3060] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.000891 17766 raft_consensus.cc:2468] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0765f9e97a7d4c3494bc3894d5158707 in term 4.
I20260709 13:16:47.000984 17841 raft_consensus.cc:2468] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0765f9e97a7d4c3494bc3894d5158707 in term 4.
I20260709 13:16:47.002429 17882 leader_election.cc:304] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, d9422034907349c88c03b1996d6de230; no voters: 
I20260709 13:16:47.003767 18048 raft_consensus.cc:2804] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:47.005127 18048 raft_consensus.cc:697] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 4 LEADER]: Becoming Leader. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Running, Role: LEADER
I20260709 13:16:47.003795 17843 raft_consensus.cc:515] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:47.006210 18048 consensus_queue.cc:237] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:47.009433 17843 leader_election.cc:290] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 2 election: Requested vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969)
I20260709 13:16:47.009716 17766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ae27936e574c819309ad25e67919eb" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9422034907349c88c03b1996d6de230"
I20260709 13:16:47.010454 17766 raft_consensus.cc:3055] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:47.010891 17766 raft_consensus.cc:740] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:47.012185 17766 consensus_queue.cc:260] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:47.012838 17915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ae27936e574c819309ad25e67919eb" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:47.013478 17915 raft_consensus.cc:3060] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.013974 17766 raft_consensus.cc:3060] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.019601 17915 raft_consensus.cc:2468] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 2.
I20260709 13:16:47.018707 17662 catalog_manager.cc:5697] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 reported cstate change: term changed from 3 to 4, leader changed from d9422034907349c88c03b1996d6de230 (127.16.188.129) to 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131). New cstate: current_term: 4 leader_uuid: "0765f9e97a7d4c3494bc3894d5158707" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.021116 17806 leader_election.cc:304] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:47.022200 18082 raft_consensus.cc:2804] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:47.022783 17766 raft_consensus.cc:2468] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 2.
I20260709 13:16:47.024734 18082 raft_consensus.cc:697] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 2 LEADER]: Becoming Leader. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Running, Role: LEADER
I20260709 13:16:47.025878 18082 consensus_queue.cc:237] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:47.035650 17664 catalog_manager.cc:5697] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 reported cstate change: term changed from 1 to 2, leader changed from d9422034907349c88c03b1996d6de230 (127.16.188.129) to f39d3b2933284b88ac4fea4be785a795 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "f39d3b2933284b88ac4fea4be785a795" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.086896 18085 raft_consensus.cc:993] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230: : Instructing follower f39d3b2933284b88ac4fea4be785a795 to start an election
I20260709 13:16:47.087361 18081 raft_consensus.cc:1081] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 4 LEADER]: Signalling peer f39d3b2933284b88ac4fea4be785a795 to start an election
I20260709 13:16:47.088693 17843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c38be702d9534f81aa8da70651291fca"
dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
 from {username='slave'} at 127.0.0.1:44218
I20260709 13:16:47.089183 17843 raft_consensus.cc:493] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:47.089498 17843 raft_consensus.cc:3060] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.093923 17843 raft_consensus.cc:515] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:47.095319 17843 leader_election.cc:290] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 5 election: Requested vote from peers 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131:40969), d9422034907349c88c03b1996d6de230 (127.16.188.129:44347)
I20260709 13:16:47.096227 17915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38be702d9534f81aa8da70651291fca" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
I20260709 13:16:47.096465 17766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38be702d9534f81aa8da70651291fca" candidate_uuid: "f39d3b2933284b88ac4fea4be785a795" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d9422034907349c88c03b1996d6de230"
I20260709 13:16:47.096902 17915 raft_consensus.cc:3060] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.097054 17766 raft_consensus.cc:3055] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:47.097429 17766 raft_consensus.cc:740] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:47.098069 17766 consensus_queue.cc:260] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:47.098903 17766 raft_consensus.cc:3060] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.102378 17915 raft_consensus.cc:2468] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 5.
I20260709 13:16:47.103266 17766 raft_consensus.cc:2468] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f39d3b2933284b88ac4fea4be785a795 in term 5.
I20260709 13:16:47.103483 17806 leader_election.cc:304] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:47.104343 18082 raft_consensus.cc:2804] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:47.104758 18082 raft_consensus.cc:697] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 5 LEADER]: Becoming Leader. State: Replica: f39d3b2933284b88ac4fea4be785a795, State: Running, Role: LEADER
I20260709 13:16:47.105494 18082 consensus_queue.cc:237] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } }
I20260709 13:16:47.113273 17664 catalog_manager.cc:5697] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 reported cstate change: term changed from 4 to 5, leader changed from d9422034907349c88c03b1996d6de230 (127.16.188.129) to f39d3b2933284b88ac4fea4be785a795 (127.16.188.130). New cstate: current_term: 5 leader_uuid: "f39d3b2933284b88ac4fea4be785a795" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.282666 18085 raft_consensus.cc:993] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230: : Instructing follower 0765f9e97a7d4c3494bc3894d5158707 to start an election
I20260709 13:16:47.283200 18085 raft_consensus.cc:1081] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Signalling peer 0765f9e97a7d4c3494bc3894d5158707 to start an election
I20260709 13:16:47.284767 17915 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc759e91da9844dbbea7f4fb00a7fec6"
dest_uuid: "0765f9e97a7d4c3494bc3894d5158707"
 from {username='slave'} at 127.0.0.1:55046
I20260709 13:16:47.285403 17915 raft_consensus.cc:493] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:47.285734 17915 raft_consensus.cc:3060] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.290845 17915 raft_consensus.cc:515] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:47.292658 17915 leader_election.cc:290] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 2 election: Requested vote from peers d9422034907349c88c03b1996d6de230 (127.16.188.129:44347), f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493)
I20260709 13:16:47.293429 17766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc759e91da9844dbbea7f4fb00a7fec6" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9422034907349c88c03b1996d6de230"
I20260709 13:16:47.294013 17766 raft_consensus.cc:3055] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:47.293928 17843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc759e91da9844dbbea7f4fb00a7fec6" candidate_uuid: "0765f9e97a7d4c3494bc3894d5158707" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f39d3b2933284b88ac4fea4be785a795"
I20260709 13:16:47.294303 17766 raft_consensus.cc:740] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d9422034907349c88c03b1996d6de230, State: Running, Role: LEADER
I20260709 13:16:47.294624 17843 raft_consensus.cc:3060] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.295032 17766 consensus_queue.cc:260] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:47.295970 17766 raft_consensus.cc:3060] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:47.299494 17843 raft_consensus.cc:2468] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0765f9e97a7d4c3494bc3894d5158707 in term 2.
I20260709 13:16:47.300658 17766 raft_consensus.cc:2468] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0765f9e97a7d4c3494bc3894d5158707 in term 2.
I20260709 13:16:47.300797 17880 leader_election.cc:304] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0765f9e97a7d4c3494bc3894d5158707, f39d3b2933284b88ac4fea4be785a795; no voters: 
I20260709 13:16:47.301703 18048 raft_consensus.cc:2804] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:47.302111 18048 raft_consensus.cc:697] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 LEADER]: Becoming Leader. State: Replica: 0765f9e97a7d4c3494bc3894d5158707, State: Running, Role: LEADER
I20260709 13:16:47.302876 18048 consensus_queue.cc:237] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } }
I20260709 13:16:47.310753 17664 catalog_manager.cc:5697] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 reported cstate change: term changed from 1 to 2, leader changed from d9422034907349c88c03b1996d6de230 (127.16.188.129) to 0765f9e97a7d4c3494bc3894d5158707 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "0765f9e97a7d4c3494bc3894d5158707" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.437453 17843 raft_consensus.cc:1275] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 4 FOLLOWER]: Refusing update from remote peer 0765f9e97a7d4c3494bc3894d5158707: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:47.438601 18048 consensus_queue.cc:1048] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:47.449956 17766 raft_consensus.cc:1275] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 4 FOLLOWER]: Refusing update from remote peer 0765f9e97a7d4c3494bc3894d5158707: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:47.451449 18086 consensus_queue.cc:1048] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:47.523947 17915 raft_consensus.cc:1275] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 5 FOLLOWER]: Refusing update from remote peer f39d3b2933284b88ac4fea4be785a795: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:47.525243 18082 consensus_queue.cc:1048] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:47.535583 17766 raft_consensus.cc:1275] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 5 FOLLOWER]: Refusing update from remote peer f39d3b2933284b88ac4fea4be785a795: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:47.537292 18102 consensus_queue.cc:1048] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:47.627310 17915 raft_consensus.cc:1275] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Refusing update from remote peer f39d3b2933284b88ac4fea4be785a795: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:47.628717 18102 consensus_queue.cc:1048] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0765f9e97a7d4c3494bc3894d5158707" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:47.633667 17766 raft_consensus.cc:1275] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Refusing update from remote peer f39d3b2933284b88ac4fea4be785a795: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:47.634980 18102 consensus_queue.cc:1048] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9422034907349c88c03b1996d6de230" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:47.821132 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:47.827670 17138 tablet_server.cc:179] TabletServer@127.16.188.129:0 shutting down...
W20260709 13:16:47.849354 17882 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:16:47.854972 17882 consensus_peers.cc:597] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 -> Peer d9422034907349c88c03b1996d6de230 (127.16.188.129:44347): Couldn't send request to peer d9422034907349c88c03b1996d6de230. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:47.864023 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:47.864931 17138 tablet_replica.cc:333] T ab9e064069a04b40895ff324e99def22 P d9422034907349c88c03b1996d6de230: stopping tablet replica
I20260709 13:16:47.865980 17138 raft_consensus.cc:2243] T ab9e064069a04b40895ff324e99def22 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.866766 17138 raft_consensus.cc:2272] T ab9e064069a04b40895ff324e99def22 P d9422034907349c88c03b1996d6de230 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.869091 17138 tablet_replica.cc:333] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230: stopping tablet replica
I20260709 13:16:47.869590 17138 raft_consensus.cc:2243] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.869961 17138 raft_consensus.cc:2272] T c38be702d9534f81aa8da70651291fca P d9422034907349c88c03b1996d6de230 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.872172 17138 tablet_replica.cc:333] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230: stopping tablet replica
I20260709 13:16:47.872828 17138 raft_consensus.cc:2243] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:47.873572 17138 raft_consensus.cc:2272] T a1c466ab270145d8878ff252633bb237 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.875308 17138 tablet_replica.cc:333] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230: stopping tablet replica
I20260709 13:16:47.875761 17138 raft_consensus.cc:2243] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:47.876593 17138 raft_consensus.cc:2272] T 3dd1faf857564069b5a19e08a2d4f485 P d9422034907349c88c03b1996d6de230 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.878290 17138 tablet_replica.cc:333] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230: stopping tablet replica
I20260709 13:16:47.878754 17138 raft_consensus.cc:2243] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:47.879590 17138 raft_consensus.cc:2272] T 4a5e29ace7654f9e9cb32e9021a1d244 P d9422034907349c88c03b1996d6de230 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.881737 17138 tablet_replica.cc:333] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230: stopping tablet replica
I20260709 13:16:47.882292 17138 raft_consensus.cc:2243] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.882747 17138 raft_consensus.cc:2272] T dd202abadc574532960e95cb45899a19 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.884686 17138 tablet_replica.cc:333] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230: stopping tablet replica
I20260709 13:16:47.885311 17138 raft_consensus.cc:2243] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.885689 17138 raft_consensus.cc:2272] T fc759e91da9844dbbea7f4fb00a7fec6 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.887338 17138 tablet_replica.cc:333] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230: stopping tablet replica
I20260709 13:16:47.887821 17138 raft_consensus.cc:2243] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.888217 17138 raft_consensus.cc:2272] T a6ae27936e574c819309ad25e67919eb P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.890287 17138 tablet_replica.cc:333] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230: stopping tablet replica
I20260709 13:16:47.890802 17138 raft_consensus.cc:2243] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:47.891548 17138 raft_consensus.cc:2272] T eaa5893e258d4c69bb266054eba17939 P d9422034907349c88c03b1996d6de230 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.893357 17138 tablet_replica.cc:333] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230: stopping tablet replica
I20260709 13:16:47.893792 17138 raft_consensus.cc:2243] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.894187 17138 raft_consensus.cc:2272] T 311001c17f3149b2b2574cc558f4cf53 P d9422034907349c88c03b1996d6de230 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:47.926061 17882 consensus_peers.cc:597] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 -> Peer d9422034907349c88c03b1996d6de230 (127.16.188.129:44347): Couldn't send request to peer d9422034907349c88c03b1996d6de230. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:44347: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:47.927875 17138 tablet_server.cc:196] TabletServer@127.16.188.129:0 shutdown complete.
I20260709 13:16:47.930908 17843 raft_consensus.cc:1275] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Refusing update from remote peer 0765f9e97a7d4c3494bc3894d5158707: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:47.932327 18107 consensus_queue.cc:1048] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f39d3b2933284b88ac4fea4be785a795" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:47.956949 17138 tablet_server.cc:179] TabletServer@127.16.188.130:0 shutting down...
I20260709 13:16:47.988595 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:47.989353 17138 tablet_replica.cc:333] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795: stopping tablet replica
I20260709 13:16:47.990213 17138 raft_consensus.cc:2243] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.990718 17138 raft_consensus.cc:2272] T 3dd1faf857564069b5a19e08a2d4f485 P f39d3b2933284b88ac4fea4be785a795 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.992381 17138 tablet_replica.cc:333] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795: stopping tablet replica
I20260709 13:16:47.992944 17138 raft_consensus.cc:2243] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.993315 17138 raft_consensus.cc:2272] T a1c466ab270145d8878ff252633bb237 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.994832 17138 tablet_replica.cc:333] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795: stopping tablet replica
I20260709 13:16:47.995261 17138 raft_consensus.cc:2243] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.995620 17138 raft_consensus.cc:2272] T 4a5e29ace7654f9e9cb32e9021a1d244 P f39d3b2933284b88ac4fea4be785a795 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.997170 17138 tablet_replica.cc:333] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795: stopping tablet replica
I20260709 13:16:47.997612 17138 raft_consensus.cc:2243] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.997967 17138 raft_consensus.cc:2272] T dd202abadc574532960e95cb45899a19 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.999451 17138 tablet_replica.cc:333] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795: stopping tablet replica
I20260709 13:16:47.999892 17138 raft_consensus.cc:2243] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.000586 17138 raft_consensus.cc:2272] T c38be702d9534f81aa8da70651291fca P f39d3b2933284b88ac4fea4be785a795 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.002673 17138 tablet_replica.cc:333] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795: stopping tablet replica
I20260709 13:16:48.003154 17138 raft_consensus.cc:2243] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.003907 17138 raft_consensus.cc:2272] T ab9e064069a04b40895ff324e99def22 P f39d3b2933284b88ac4fea4be785a795 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.005632 17138 tablet_replica.cc:333] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795: stopping tablet replica
I20260709 13:16:48.006258 17138 raft_consensus.cc:2243] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.006729 17138 raft_consensus.cc:2272] T eaa5893e258d4c69bb266054eba17939 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.008876 17138 tablet_replica.cc:333] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795: stopping tablet replica
I20260709 13:16:48.009418 17138 raft_consensus.cc:2243] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.009908 17138 raft_consensus.cc:2272] T 311001c17f3149b2b2574cc558f4cf53 P f39d3b2933284b88ac4fea4be785a795 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:48.010519 17880 consensus_peers.cc:597] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 -> Peer f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493): Couldn't send request to peer f39d3b2933284b88ac4fea4be785a795. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.013067 17138 tablet_replica.cc:333] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795: stopping tablet replica
I20260709 13:16:48.013532 17138 raft_consensus.cc:2243] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.014325 17138 raft_consensus.cc:2272] T a6ae27936e574c819309ad25e67919eb P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.016256 17138 tablet_replica.cc:333] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795: stopping tablet replica
I20260709 13:16:48.016731 17138 raft_consensus.cc:2243] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.017108 17138 raft_consensus.cc:2272] T fc759e91da9844dbbea7f4fb00a7fec6 P f39d3b2933284b88ac4fea4be785a795 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:48.038080 17882 consensus_peers.cc:597] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 -> Peer d9422034907349c88c03b1996d6de230 (127.16.188.129:44347): Couldn't send request to peer d9422034907349c88c03b1996d6de230. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:44347: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.046121 17138 tablet_server.cc:196] TabletServer@127.16.188.130:0 shutdown complete.
I20260709 13:16:48.063462 17138 tablet_server.cc:179] TabletServer@127.16.188.131:0 shutting down...
I20260709 13:16:48.089258 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:48.090169 17138 tablet_replica.cc:333] T ab9e064069a04b40895ff324e99def22 P 0765f9e97a7d4c3494bc3894d5158707: stopping tablet replica
I20260709 13:16:48.090910 17138 raft_consensus.cc:2243] T ab9e064069a04b40895ff324e99def22 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.091391 17138 raft_consensus.cc:2272] T ab9e064069a04b40895ff324e99def22 P 0765f9e97a7d4c3494bc3894d5158707 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:48.092986 17880 consensus_peers.cc:597] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 -> Peer f39d3b2933284b88ac4fea4be785a795 (127.16.188.130:43493): Couldn't send request to peer f39d3b2933284b88ac4fea4be785a795. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:43493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.093866 17138 tablet_replica.cc:333] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707: stopping tablet replica
I20260709 13:16:48.094368 17138 raft_consensus.cc:2243] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.094785 17138 raft_consensus.cc:2272] T 4a5e29ace7654f9e9cb32e9021a1d244 P 0765f9e97a7d4c3494bc3894d5158707 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.096302 17138 tablet_replica.cc:333] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707: stopping tablet replica
I20260709 13:16:48.096874 17138 raft_consensus.cc:2243] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.097546 17138 raft_consensus.cc:2272] T dd202abadc574532960e95cb45899a19 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.099066 17138 tablet_replica.cc:333] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707: stopping tablet replica
I20260709 13:16:48.099504 17138 raft_consensus.cc:2243] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.099819 17138 raft_consensus.cc:2272] T a1c466ab270145d8878ff252633bb237 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.101325 17138 tablet_replica.cc:333] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707: stopping tablet replica
I20260709 13:16:48.101827 17138 raft_consensus.cc:2243] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.102243 17138 raft_consensus.cc:2272] T a6ae27936e574c819309ad25e67919eb P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.105542 17138 tablet_replica.cc:333] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707: stopping tablet replica
I20260709 13:16:48.106321 17138 raft_consensus.cc:2243] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.107354 17138 raft_consensus.cc:2272] T fc759e91da9844dbbea7f4fb00a7fec6 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.109774 17138 tablet_replica.cc:333] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707: stopping tablet replica
I20260709 13:16:48.110313 17138 raft_consensus.cc:2243] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.111131 17138 raft_consensus.cc:2272] T 311001c17f3149b2b2574cc558f4cf53 P 0765f9e97a7d4c3494bc3894d5158707 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.113350 17138 tablet_replica.cc:333] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707: stopping tablet replica
I20260709 13:16:48.113757 17138 raft_consensus.cc:2243] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.114099 17138 raft_consensus.cc:2272] T eaa5893e258d4c69bb266054eba17939 P 0765f9e97a7d4c3494bc3894d5158707 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.115765 17138 tablet_replica.cc:333] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707: stopping tablet replica
I20260709 13:16:48.116155 17138 raft_consensus.cc:2243] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.116549 17138 raft_consensus.cc:2272] T 3dd1faf857564069b5a19e08a2d4f485 P 0765f9e97a7d4c3494bc3894d5158707 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.118135 17138 tablet_replica.cc:333] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707: stopping tablet replica
I20260709 13:16:48.118505 17138 raft_consensus.cc:2243] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.118856 17138 raft_consensus.cc:2272] T c38be702d9534f81aa8da70651291fca P 0765f9e97a7d4c3494bc3894d5158707 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.148115 17138 tablet_server.cc:196] TabletServer@127.16.188.131:0 shutdown complete.
I20260709 13:16:48.168722 17138 master.cc:562] Master@127.16.188.190:36085 shutting down...
I20260709 13:16:48.191888 17138 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:48.192600 17138 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.192955 17138 tablet_replica.cc:333] T 00000000000000000000000000000000 P 696a293f52ab4de2936da980eca0f5bb: stopping tablet replica
I20260709 13:16:48.229808 17138 master.cc:584] Master@127.16.188.190:36085 shutdown complete.
0765f9e97a7d4c3494bc3894d5158707  1
d9422034907349c88c03b1996d6de230  5
f39d3b2933284b88ac4fea4be785a795  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10526 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:16:48.271255 17138 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.188.190:46739
I20260709 13:16:48.272305 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:48.278378 18110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:48.278528 18111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:48.279879 18113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:48.281399 17138 server_base.cc:1061] running on GCE node
I20260709 13:16:48.282195 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:48.282372 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:48.282487 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603008282477 us; error 0 us; skew 500 ppm
I20260709 13:16:48.282945 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:48.285391 17138 webserver.cc:533] Webserver started at http://127.16.188.190:46559/ using document root <none> and password file <none>
I20260709 13:16:48.285815 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:48.285964 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:48.286180 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:48.287207 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/master-0-root/instance:
uuid: "dc71a90b0e6d42fc8a6b135fbfbac453"
format_stamp: "Formatted at 2026-07-09 13:16:48 on dist-test-slave-2hqk"
I20260709 13:16:48.291546 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:16:48.294817 18118 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:48.295603 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:48.295895 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/master-0-root
uuid: "dc71a90b0e6d42fc8a6b135fbfbac453"
format_stamp: "Formatted at 2026-07-09 13:16:48 on dist-test-slave-2hqk"
I20260709 13:16:48.296162 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:48.310149 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:48.311259 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:48.350919 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.190:46739
I20260709 13:16:48.351084 18169 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.190:46739 every 8 connection(s)
I20260709 13:16:48.355070 18170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:48.365653 18170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Bootstrap starting.
I20260709 13:16:48.370859 18170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.375522 18170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: No bootstrap required, opened a new log
I20260709 13:16:48.377816 18170 raft_consensus.cc:359] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc71a90b0e6d42fc8a6b135fbfbac453" member_type: VOTER }
I20260709 13:16:48.378206 18170 raft_consensus.cc:385] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.378482 18170 raft_consensus.cc:740] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc71a90b0e6d42fc8a6b135fbfbac453, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.379060 18170 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc71a90b0e6d42fc8a6b135fbfbac453" member_type: VOTER }
I20260709 13:16:48.379537 18170 raft_consensus.cc:399] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:48.379747 18170 raft_consensus.cc:493] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:48.380021 18170 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.384630 18170 raft_consensus.cc:515] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc71a90b0e6d42fc8a6b135fbfbac453" member_type: VOTER }
I20260709 13:16:48.385164 18170 leader_election.cc:304] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc71a90b0e6d42fc8a6b135fbfbac453; no voters: 
I20260709 13:16:48.386416 18170 leader_election.cc:290] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:48.386902 18173 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.388307 18173 raft_consensus.cc:697] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [term 1 LEADER]: Becoming Leader. State: Replica: dc71a90b0e6d42fc8a6b135fbfbac453, State: Running, Role: LEADER
I20260709 13:16:48.389039 18173 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc71a90b0e6d42fc8a6b135fbfbac453" member_type: VOTER }
I20260709 13:16:48.389645 18170 sys_catalog.cc:565] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:48.393546 18174 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc71a90b0e6d42fc8a6b135fbfbac453" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc71a90b0e6d42fc8a6b135fbfbac453" member_type: VOTER } }
I20260709 13:16:48.395156 18174 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:48.394479 18175 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc71a90b0e6d42fc8a6b135fbfbac453. Latest consensus state: current_term: 1 leader_uuid: "dc71a90b0e6d42fc8a6b135fbfbac453" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc71a90b0e6d42fc8a6b135fbfbac453" member_type: VOTER } }
I20260709 13:16:48.396351 18175 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:48.397886 18181 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:48.405653 18181 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:48.406625 17138 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:48.415077 18181 catalog_manager.cc:1383] Generated new cluster ID: de8d7f487d85460c9044522e3aa26285
I20260709 13:16:48.415351 18181 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:48.450371 18181 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:48.451589 18181 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:48.468621 18181 catalog_manager.cc:6070] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Generated new TSK 0
I20260709 13:16:48.469203 18181 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:48.537309 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:48.543526 18191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:48.544469 18192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:48.547307 17138 server_base.cc:1061] running on GCE node
W20260709 13:16:48.547287 18194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:48.548676 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:48.548871 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:48.549052 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603008549037 us; error 0 us; skew 500 ppm
I20260709 13:16:48.549610 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:48.552119 17138 webserver.cc:533] Webserver started at http://127.16.188.129:42785/ using document root <none> and password file <none>
I20260709 13:16:48.552640 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:48.552845 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:48.553131 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:48.554189 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-0-root/instance:
uuid: "b52e2477fc524694967c4a16afa983e3"
format_stamp: "Formatted at 2026-07-09 13:16:48 on dist-test-slave-2hqk"
I20260709 13:16:48.558667 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:16:48.562100 18199 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:48.562932 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:48.563231 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-0-root
uuid: "b52e2477fc524694967c4a16afa983e3"
format_stamp: "Formatted at 2026-07-09 13:16:48 on dist-test-slave-2hqk"
I20260709 13:16:48.563500 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:48.579212 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:48.580470 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:48.582033 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:48.584293 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:48.584466 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:48.584772 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:48.584944 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:48.627569 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.129:43781
I20260709 13:16:48.627737 18261 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.129:43781 every 8 connection(s)
I20260709 13:16:48.632489 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:48.639544 18266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:48.640636 18267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:48.643671 18269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:48.643910 17138 server_base.cc:1061] running on GCE node
I20260709 13:16:48.645157 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:48.645337 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:48.645465 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603008645454 us; error 0 us; skew 500 ppm
I20260709 13:16:48.645902 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:48.648252 17138 webserver.cc:533] Webserver started at http://127.16.188.130:34903/ using document root <none> and password file <none>
I20260709 13:16:48.648752 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:48.648978 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:48.649272 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:48.650821 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-1-root/instance:
uuid: "459e82ee6b564cc19be6f73186938e79"
format_stamp: "Formatted at 2026-07-09 13:16:48 on dist-test-slave-2hqk"
I20260709 13:16:48.652637 18262 heartbeater.cc:344] Connected to a master server at 127.16.188.190:46739
I20260709 13:16:48.653079 18262 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:48.653875 18262 heartbeater.cc:507] Master 127.16.188.190:46739 requested a full tablet report, sending...
I20260709 13:16:48.655881 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.005s
I20260709 13:16:48.656051 18135 ts_manager.cc:194] Registered new tserver with Master: b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:16:48.658107 18135 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39270
I20260709 13:16:48.659647 18274 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:48.660581 17138 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:16:48.660946 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-1-root
uuid: "459e82ee6b564cc19be6f73186938e79"
format_stamp: "Formatted at 2026-07-09 13:16:48 on dist-test-slave-2hqk"
I20260709 13:16:48.661195 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:48.678774 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:48.679864 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:48.681368 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:48.683763 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:48.683954 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:48.684262 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:48.684427 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:48.726784 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.130:34605
I20260709 13:16:48.727032 18336 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.130:34605 every 8 connection(s)
I20260709 13:16:48.731436 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:48.737874 18340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:48.739061 18341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:48.744732 17138 server_base.cc:1061] running on GCE node
I20260709 13:16:48.745469 18337 heartbeater.cc:344] Connected to a master server at 127.16.188.190:46739
I20260709 13:16:48.745972 18337 heartbeater.cc:461] Registering TS with master...
W20260709 13:16:48.745932 18343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:48.746923 18337 heartbeater.cc:507] Master 127.16.188.190:46739 requested a full tablet report, sending...
I20260709 13:16:48.747066 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:48.747370 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:48.747560 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603008747529 us; error 0 us; skew 500 ppm
I20260709 13:16:48.748318 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:48.749256 18135 ts_manager.cc:194] Registered new tserver with Master: 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:48.750850 18135 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39284
I20260709 13:16:48.751190 17138 webserver.cc:533] Webserver started at http://127.16.188.131:37449/ using document root <none> and password file <none>
I20260709 13:16:48.751784 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:48.752034 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:48.752372 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:48.753868 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-2-root/instance:
uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
format_stamp: "Formatted at 2026-07-09 13:16:48 on dist-test-slave-2hqk"
I20260709 13:16:48.758419 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:16:48.761844 18348 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:48.762710 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:16:48.763063 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-2-root
uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
format_stamp: "Formatted at 2026-07-09 13:16:48 on dist-test-slave-2hqk"
I20260709 13:16:48.763414 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:48.793360 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:48.794778 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:48.796168 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:48.798740 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:48.798969 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:48.799213 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:48.799415 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:48.845134 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.131:44265
I20260709 13:16:48.845264 18410 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.131:44265 every 8 connection(s)
I20260709 13:16:48.859874 18411 heartbeater.cc:344] Connected to a master server at 127.16.188.190:46739
I20260709 13:16:48.860246 18411 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:48.861099 18411 heartbeater.cc:507] Master 127.16.188.190:46739 requested a full tablet report, sending...
I20260709 13:16:48.863131 18135 ts_manager.cc:194] Registered new tserver with Master: 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:48.863547 17138 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014807787s
I20260709 13:16:48.864475 18135 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39288
I20260709 13:16:48.891785 18135 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39300:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:48.898145 18135 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:49.107285 18376 tablet_service.cc:1511] Processing CreateTablet for tablet 7db17400d59a40a786f346aefbfbcbb0 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:16:49.108824 18376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db17400d59a40a786f346aefbfbcbb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.114091 18375 tablet_service.cc:1511] Processing CreateTablet for tablet eafcec4c722f49fa90d23d1326870a82 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:16:49.115770 18375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eafcec4c722f49fa90d23d1326870a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.117631 18374 tablet_service.cc:1511] Processing CreateTablet for tablet 9d7e53f100fe49dea344afeea45f7cf5 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:16:49.118938 18374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d7e53f100fe49dea344afeea45f7cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.121726 18373 tablet_service.cc:1511] Processing CreateTablet for tablet 35ee2a6512e24d10af3526398de71490 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:16:49.123004 18373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ee2a6512e24d10af3526398de71490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.123782 18301 tablet_service.cc:1511] Processing CreateTablet for tablet eafcec4c722f49fa90d23d1326870a82 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:16:49.125473 18301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eafcec4c722f49fa90d23d1326870a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.125765 18371 tablet_service.cc:1511] Processing CreateTablet for tablet 069a152975ce431fb5fd1abe7e07178e (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:16:49.127102 18371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069a152975ce431fb5fd1abe7e07178e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.127002 18370 tablet_service.cc:1511] Processing CreateTablet for tablet e5a31bcfc315403994b8ecac224542b5 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:16:49.128136 18300 tablet_service.cc:1511] Processing CreateTablet for tablet 9d7e53f100fe49dea344afeea45f7cf5 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:16:49.128856 18372 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6cd802105b49c68d85e7abdce24871 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:16:49.129758 18300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d7e53f100fe49dea344afeea45f7cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.130193 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6cd802105b49c68d85e7abdce24871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.130594 18226 tablet_service.cc:1511] Processing CreateTablet for tablet eafcec4c722f49fa90d23d1326870a82 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:16:49.132134 18226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eafcec4c722f49fa90d23d1326870a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.133769 18225 tablet_service.cc:1511] Processing CreateTablet for tablet 9d7e53f100fe49dea344afeea45f7cf5 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:16:49.135380 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d7e53f100fe49dea344afeea45f7cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.135704 18298 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6cd802105b49c68d85e7abdce24871 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:16:49.137213 18298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6cd802105b49c68d85e7abdce24871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.137941 18224 tablet_service.cc:1511] Processing CreateTablet for tablet 35ee2a6512e24d10af3526398de71490 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:16:49.139678 18224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ee2a6512e24d10af3526398de71490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.140913 18370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a31bcfc315403994b8ecac224542b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.141798 18223 tablet_service.cc:1511] Processing CreateTablet for tablet 3c6cd802105b49c68d85e7abdce24871 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:16:49.143353 18223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6cd802105b49c68d85e7abdce24871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.141676 18297 tablet_service.cc:1511] Processing CreateTablet for tablet 069a152975ce431fb5fd1abe7e07178e (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:16:49.133882 18299 tablet_service.cc:1511] Processing CreateTablet for tablet 35ee2a6512e24d10af3526398de71490 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:16:49.145642 18222 tablet_service.cc:1511] Processing CreateTablet for tablet 069a152975ce431fb5fd1abe7e07178e (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:16:49.147425 18227 tablet_service.cc:1511] Processing CreateTablet for tablet 7db17400d59a40a786f346aefbfbcbb0 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:16:49.149365 18221 tablet_service.cc:1511] Processing CreateTablet for tablet e5a31bcfc315403994b8ecac224542b5 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:16:49.153227 18297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069a152975ce431fb5fd1abe7e07178e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.153018 18302 tablet_service.cc:1511] Processing CreateTablet for tablet 7db17400d59a40a786f346aefbfbcbb0 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:16:49.155963 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ee2a6512e24d10af3526398de71490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.156668 18302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db17400d59a40a786f346aefbfbcbb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.143774 18296 tablet_service.cc:1511] Processing CreateTablet for tablet e5a31bcfc315403994b8ecac224542b5 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:16:49.158245 18296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a31bcfc315403994b8ecac224542b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.160995 18221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a31bcfc315403994b8ecac224542b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.163823 18369 tablet_service.cc:1511] Processing CreateTablet for tablet e0d4b879cb5a45d0ab3dc5401e957620 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:16:49.165566 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d4b879cb5a45d0ab3dc5401e957620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.169423 18222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 069a152975ce431fb5fd1abe7e07178e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.170025 18368 tablet_service.cc:1511] Processing CreateTablet for tablet 647155b6479b4f689aca5b6c1efcc633 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:16:49.171571 18368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647155b6479b4f689aca5b6c1efcc633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.183723 18227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db17400d59a40a786f346aefbfbcbb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.193710 18295 tablet_service.cc:1511] Processing CreateTablet for tablet e0d4b879cb5a45d0ab3dc5401e957620 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:16:49.194018 18220 tablet_service.cc:1511] Processing CreateTablet for tablet e0d4b879cb5a45d0ab3dc5401e957620 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:16:49.195482 18220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d4b879cb5a45d0ab3dc5401e957620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.197538 18367 tablet_service.cc:1511] Processing CreateTablet for tablet 2b14d7467c934fdca91c8a466ef2d764 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:16:49.197754 18294 tablet_service.cc:1511] Processing CreateTablet for tablet 647155b6479b4f689aca5b6c1efcc633 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:16:49.199847 18367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b14d7467c934fdca91c8a466ef2d764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.209815 18219 tablet_service.cc:1511] Processing CreateTablet for tablet 647155b6479b4f689aca5b6c1efcc633 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:16:49.210331 18293 tablet_service.cc:1511] Processing CreateTablet for tablet 2b14d7467c934fdca91c8a466ef2d764 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:16:49.211177 18219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647155b6479b4f689aca5b6c1efcc633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.195538 18295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d4b879cb5a45d0ab3dc5401e957620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.215143 18218 tablet_service.cc:1511] Processing CreateTablet for tablet 2b14d7467c934fdca91c8a466ef2d764 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:16:49.216840 18218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b14d7467c934fdca91c8a466ef2d764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.222075 18372 tablet_service.cc:1511] Processing CreateTablet for tablet 23abbfc724a94243a40588649dd76b4f (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:16:49.238454 18371 tablet_service.cc:1511] Processing CreateTablet for tablet 3c074d20c77e423597f342d5ed4ccc6d (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:16:49.242790 18293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b14d7467c934fdca91c8a466ef2d764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.256685 18426 tablet_bootstrap.cc:492] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:49.256608 18374 tablet_service.cc:1511] Processing CreateTablet for tablet d88cda52389848d584c846a8597f4977 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:16:49.257464 18294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647155b6479b4f689aca5b6c1efcc633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.254283 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23abbfc724a94243a40588649dd76b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.268580 18374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88cda52389848d584c846a8597f4977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.276865 18371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c074d20c77e423597f342d5ed4ccc6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.285930 18298 tablet_service.cc:1511] Processing CreateTablet for tablet 23abbfc724a94243a40588649dd76b4f (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:16:49.287441 18298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23abbfc724a94243a40588649dd76b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.295789 18427 tablet_bootstrap.cc:492] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:49.324990 18374 tablet_service.cc:1511] Processing CreateTablet for tablet 2682a7690fb640b1a9ad52d5fa19e281 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:16:49.326297 18374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2682a7690fb640b1a9ad52d5fa19e281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.339123 18376 tablet_service.cc:1511] Processing CreateTablet for tablet d03313400e274f83883c84395905b4cd (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:16:49.347451 18376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03313400e274f83883c84395905b4cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.345853 18294 tablet_service.cc:1511] Processing CreateTablet for tablet d88cda52389848d584c846a8597f4977 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:16:49.347287 18221 tablet_service.cc:1511] Processing CreateTablet for tablet 23abbfc724a94243a40588649dd76b4f (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:16:49.349828 18294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88cda52389848d584c846a8597f4977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.340390 18426 tablet_bootstrap.cc:654] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.339118 18375 tablet_service.cc:1511] Processing CreateTablet for tablet 0d2ac0cb46434c19a6e4f18836703096 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:16:49.357687 18375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2ac0cb46434c19a6e4f18836703096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.354305 18225 tablet_service.cc:1511] Processing CreateTablet for tablet 3c074d20c77e423597f342d5ed4ccc6d (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:16:49.347543 18226 tablet_service.cc:1511] Processing CreateTablet for tablet d88cda52389848d584c846a8597f4977 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:16:49.364058 18370 tablet_service.cc:1511] Processing CreateTablet for tablet 83392764a50d4598aedbe4d1cc557dad (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:16:49.365633 18369 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd00413a3134a12a08e72e7925f6473 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:16:49.367103 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd00413a3134a12a08e72e7925f6473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.369645 18301 tablet_service.cc:1511] Processing CreateTablet for tablet 3c074d20c77e423597f342d5ed4ccc6d (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:16:49.375373 18219 tablet_service.cc:1511] Processing CreateTablet for tablet 2682a7690fb640b1a9ad52d5fa19e281 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:16:49.376809 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c074d20c77e423597f342d5ed4ccc6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.380388 18301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c074d20c77e423597f342d5ed4ccc6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.382002 18370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83392764a50d4598aedbe4d1cc557dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.376012 18222 tablet_service.cc:1511] Processing CreateTablet for tablet 0d2ac0cb46434c19a6e4f18836703096 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:16:49.392999 18373 tablet_service.cc:1511] Processing CreateTablet for tablet fa1f5c8f2c0e4687bcbe4eb6baed26c8 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:16:49.394382 18223 tablet_service.cc:1511] Processing CreateTablet for tablet d03313400e274f83883c84395905b4cd (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:16:49.397411 18299 tablet_service.cc:1511] Processing CreateTablet for tablet 2682a7690fb640b1a9ad52d5fa19e281 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:16:49.397926 18371 tablet_service.cc:1511] Processing CreateTablet for tablet 7a18591c0ed248258c1fcafa9811f7c4 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:16:49.398846 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2682a7690fb640b1a9ad52d5fa19e281. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:49.401026 18183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:49.402171 18221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23abbfc724a94243a40588649dd76b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.409137 18220 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd00413a3134a12a08e72e7925f6473 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:16:49.410511 18220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd00413a3134a12a08e72e7925f6473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.410440 18224 tablet_service.cc:1511] Processing CreateTablet for tablet fa1f5c8f2c0e4687bcbe4eb6baed26c8 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:16:49.412179 18224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1f5c8f2c0e4687bcbe4eb6baed26c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.416709 18373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1f5c8f2c0e4687bcbe4eb6baed26c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.417119 18222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2ac0cb46434c19a6e4f18836703096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.419478 18219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2682a7690fb640b1a9ad52d5fa19e281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.421016 18371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a18591c0ed248258c1fcafa9811f7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.421547 18223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03313400e274f83883c84395905b4cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.421614 18368 tablet_service.cc:1511] Processing CreateTablet for tablet fd151355294e450f85a51ac658d4a465 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:16:49.423204 18368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd151355294e450f85a51ac658d4a465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.424466 18226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88cda52389848d584c846a8597f4977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.424888 18428 tablet_bootstrap.cc:492] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:49.425944 18218 tablet_service.cc:1511] Processing CreateTablet for tablet 7a18591c0ed248258c1fcafa9811f7c4 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:16:49.427176 18218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a18591c0ed248258c1fcafa9811f7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.432178 18227 tablet_service.cc:1511] Processing CreateTablet for tablet 83392764a50d4598aedbe4d1cc557dad (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:16:49.433545 18227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83392764a50d4598aedbe4d1cc557dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.436743 18293 tablet_service.cc:1511] Processing CreateTablet for tablet d03313400e274f83883c84395905b4cd (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:16:49.439235 18372 tablet_service.cc:1511] Processing CreateTablet for tablet d6d3055da6db47abb16a433d66a5c79e (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:16:49.445230 18427 tablet_bootstrap.cc:654] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.440207 18300 tablet_service.cc:1511] Processing CreateTablet for tablet 0d2ac0cb46434c19a6e4f18836703096 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
W20260709 13:16:49.453325 18121 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63149.1us
I20260709 13:16:49.458521 18426 tablet_bootstrap.cc:492] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:49.459124 18426 ts_tablet_manager.cc:1403] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.203s	user 0.016s	sys 0.011s
I20260709 13:16:49.462952 18428 tablet_bootstrap.cc:654] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.468927 18426 raft_consensus.cc:359] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:49.469827 18426 raft_consensus.cc:385] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.470153 18426 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.472250 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d3055da6db47abb16a433d66a5c79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.477104 18293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03313400e274f83883c84395905b4cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.493079 18300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2ac0cb46434c19a6e4f18836703096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.488405 18295 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd00413a3134a12a08e72e7925f6473 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:16:49.496037 18295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd00413a3134a12a08e72e7925f6473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.498950 18298 tablet_service.cc:1511] Processing CreateTablet for tablet 7a18591c0ed248258c1fcafa9811f7c4 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:16:49.501688 18296 tablet_service.cc:1511] Processing CreateTablet for tablet fa1f5c8f2c0e4687bcbe4eb6baed26c8 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:16:49.481256 18297 tablet_service.cc:1511] Processing CreateTablet for tablet 83392764a50d4598aedbe4d1cc557dad (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:16:49.504853 18426 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:49.506929 18301 tablet_service.cc:1511] Processing CreateTablet for tablet fd151355294e450f85a51ac658d4a465 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:16:49.507691 18302 tablet_service.cc:1511] Processing CreateTablet for tablet d6d3055da6db47abb16a433d66a5c79e (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:16:49.505129 18224 tablet_service.cc:1511] Processing CreateTablet for tablet fd151355294e450f85a51ac658d4a465 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:16:49.513258 18221 tablet_service.cc:1511] Processing CreateTablet for tablet d6d3055da6db47abb16a433d66a5c79e (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:16:49.514519 18221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d3055da6db47abb16a433d66a5c79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.516105 18224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd151355294e450f85a51ac658d4a465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.526196 18431 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.533769 18298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a18591c0ed248258c1fcafa9811f7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.533880 18226 tablet_service.cc:1511] Processing CreateTablet for tablet ef83aa6f9534403ebe38156348430345 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:16:49.534852 18411 heartbeater.cc:499] Master 127.16.188.190:46739 was elected leader, sending a full tablet report...
I20260709 13:16:49.536417 18375 tablet_service.cc:1511] Processing CreateTablet for tablet ef83aa6f9534403ebe38156348430345 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:16:49.543313 18225 tablet_service.cc:1511] Processing CreateTablet for tablet 87ce294aa3d9426291ec809884e80749 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:16:49.545483 18367 tablet_service.cc:1511] Processing CreateTablet for tablet 1dea3366ee674017a0bbfc9bce0d9a73 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:16:49.536172 18223 tablet_service.cc:1511] Processing CreateTablet for tablet 1dea3366ee674017a0bbfc9bce0d9a73 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:16:49.577059 18223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dea3366ee674017a0bbfc9bce0d9a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.571384 18426 ts_tablet_manager.cc:1434] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.009s
I20260709 13:16:49.564249 18299 tablet_service.cc:1511] Processing CreateTablet for tablet 1dea3366ee674017a0bbfc9bce0d9a73 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:16:49.581423 18226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef83aa6f9534403ebe38156348430345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.589354 18367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dea3366ee674017a0bbfc9bce0d9a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.591004 18370 tablet_service.cc:1511] Processing CreateTablet for tablet 87ce294aa3d9426291ec809884e80749 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:16:49.592556 18370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ce294aa3d9426291ec809884e80749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.596655 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ce294aa3d9426291ec809884e80749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.597491 18426 tablet_bootstrap.cc:492] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:49.609860 18426 tablet_bootstrap.cc:654] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.612972 18299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dea3366ee674017a0bbfc9bce0d9a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.627679 18301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd151355294e450f85a51ac658d4a465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.622296 18431 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:49.630426 18375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef83aa6f9534403ebe38156348430345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.636315 18368 tablet_service.cc:1511] Processing CreateTablet for tablet b6e6be0c25704f45b1b4f3c4f246fa02 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:16:49.526796 18294 tablet_service.cc:1511] Processing CreateTablet for tablet ef83aa6f9534403ebe38156348430345 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:16:49.651319 18302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d3055da6db47abb16a433d66a5c79e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.651587 18368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e6be0c25704f45b1b4f3c4f246fa02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.657688 18373 tablet_service.cc:1511] Processing CreateTablet for tablet ed649e8e79144f338d9c590603fa0b7c (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:16:49.658684 18427 tablet_bootstrap.cc:492] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:49.659196 18427 ts_tablet_manager.cc:1403] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.364s	user 0.017s	sys 0.005s
I20260709 13:16:49.660458 18428 tablet_bootstrap.cc:492] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:49.660951 18428 ts_tablet_manager.cc:1403] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.237s	user 0.039s	sys 0.039s
I20260709 13:16:49.661182 18262 heartbeater.cc:499] Master 127.16.188.190:46739 was elected leader, sending a full tablet report...
I20260709 13:16:49.657805 18221 tablet_service.cc:1511] Processing CreateTablet for tablet ed649e8e79144f338d9c590603fa0b7c (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:16:49.668789 18220 tablet_service.cc:1511] Processing CreateTablet for tablet b6e6be0c25704f45b1b4f3c4f246fa02 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:16:49.666304 18297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83392764a50d4598aedbe4d1cc557dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.670111 18371 tablet_service.cc:1511] Processing CreateTablet for tablet 4300927be0384401aa46050bd5996d2f (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:16:49.672326 18373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed649e8e79144f338d9c590603fa0b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.672612 18218 tablet_service.cc:1511] Processing CreateTablet for tablet 4300927be0384401aa46050bd5996d2f (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:16:49.674057 18371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4300927be0384401aa46050bd5996d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.674408 18369 tablet_service.cc:1511] Processing CreateTablet for tablet fac262d04a1a4d94aec44b2679caee9d (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:16:49.675454 18294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef83aa6f9534403ebe38156348430345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.675755 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac262d04a1a4d94aec44b2679caee9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.678041 18221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed649e8e79144f338d9c590603fa0b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.680640 18431 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:49.680769 18296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1f5c8f2c0e4687bcbe4eb6baed26c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.682229 18295 tablet_service.cc:1511] Processing CreateTablet for tablet 87ce294aa3d9426291ec809884e80749 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:16:49.681078 18428 raft_consensus.cc:359] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:49.683951 18428 raft_consensus.cc:385] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.684585 18428 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.684181 18222 tablet_service.cc:1511] Processing CreateTablet for tablet fac262d04a1a4d94aec44b2679caee9d (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:16:49.685472 18428 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:49.692008 18218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4300927be0384401aa46050bd5996d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.692770 18220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e6be0c25704f45b1b4f3c4f246fa02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.695418 18222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac262d04a1a4d94aec44b2679caee9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.711107 18426 tablet_bootstrap.cc:492] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:49.711701 18426 ts_tablet_manager.cc:1403] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.114s	user 0.012s	sys 0.009s
I20260709 13:16:49.717617 18427 raft_consensus.cc:359] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:49.718421 18427 raft_consensus.cc:385] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.718725 18427 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.719666 18427 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:49.721655 18293 tablet_service.cc:1511] Processing CreateTablet for tablet b6e6be0c25704f45b1b4f3c4f246fa02 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:16:49.683923 18295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ce294aa3d9426291ec809884e80749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.725608 18293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e6be0c25704f45b1b4f3c4f246fa02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.738683 18428 ts_tablet_manager.cc:1434] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.003s
I20260709 13:16:49.739800 18428 tablet_bootstrap.cc:492] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:49.739459 18219 tablet_service.cc:1511] Processing CreateTablet for tablet 6cdcc6f227f447c0bd7e5ce750cc3c04 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:16:49.740787 18219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cdcc6f227f447c0bd7e5ce750cc3c04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.750797 18428 tablet_bootstrap.cc:654] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.754608 18337 heartbeater.cc:499] Master 127.16.188.190:46739 was elected leader, sending a full tablet report...
I20260709 13:16:49.756434 18426 raft_consensus.cc:359] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:49.757277 18426 raft_consensus.cc:385] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.757591 18426 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.784144 18372 tablet_service.cc:1511] Processing CreateTablet for tablet 6cdcc6f227f447c0bd7e5ce750cc3c04 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:16:49.785598 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cdcc6f227f447c0bd7e5ce750cc3c04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.785468 18302 tablet_service.cc:1511] Processing CreateTablet for tablet ed649e8e79144f338d9c590603fa0b7c (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:16:49.786132 18227 tablet_service.cc:1511] Processing CreateTablet for tablet d094a2c1f67e4ab7bc263e71d49ced86 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:16:49.787182 18302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed649e8e79144f338d9c590603fa0b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.787375 18227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d094a2c1f67e4ab7bc263e71d49ced86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.793780 18298 tablet_service.cc:1511] Processing CreateTablet for tablet fac262d04a1a4d94aec44b2679caee9d (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:16:49.795336 18298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac262d04a1a4d94aec44b2679caee9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.777670 18426 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:49.802665 18426 ts_tablet_manager.cc:1434] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.003s
I20260709 13:16:49.803814 18426 tablet_bootstrap.cc:492] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:49.824856 18370 tablet_service.cc:1511] Processing CreateTablet for tablet d094a2c1f67e4ab7bc263e71d49ced86 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:16:49.825685 18296 tablet_service.cc:1511] Processing CreateTablet for tablet 6cdcc6f227f447c0bd7e5ce750cc3c04 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:16:49.827136 18296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cdcc6f227f447c0bd7e5ce750cc3c04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.828102 18294 tablet_service.cc:1511] Processing CreateTablet for tablet d094a2c1f67e4ab7bc263e71d49ced86 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:16:49.829361 18294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d094a2c1f67e4ab7bc263e71d49ced86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.833606 18370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d094a2c1f67e4ab7bc263e71d49ced86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.845402 18427 ts_tablet_manager.cc:1434] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.186s	user 0.005s	sys 0.010s
I20260709 13:16:49.848390 18427 tablet_bootstrap.cc:492] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:49.848956 18226 tablet_service.cc:1511] Processing CreateTablet for tablet 58f88ffc8ca74740b36c09a2eb312c10 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:16:49.850378 18226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f88ffc8ca74740b36c09a2eb312c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.852599 18426 tablet_bootstrap.cc:654] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.820294 18300 tablet_service.cc:1511] Processing CreateTablet for tablet 4300927be0384401aa46050bd5996d2f (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:16:49.874795 18300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4300927be0384401aa46050bd5996d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.879047 18427 tablet_bootstrap.cc:654] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.880499 18373 tablet_service.cc:1511] Processing CreateTablet for tablet 58f88ffc8ca74740b36c09a2eb312c10 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:16:49.884814 18373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f88ffc8ca74740b36c09a2eb312c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.884400 18372 tablet_service.cc:1511] Processing CreateTablet for tablet 96c6309e774a4e15bd33a0a93d1a7f2e (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:16:49.886003 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96c6309e774a4e15bd33a0a93d1a7f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.889035 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:16:49.890801 18351 leader_election.cc:343] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.892474 18293 tablet_service.cc:1511] Processing CreateTablet for tablet 96c6309e774a4e15bd33a0a93d1a7f2e (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:16:49.893922 18293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96c6309e774a4e15bd33a0a93d1a7f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.895272 18225 tablet_service.cc:1511] Processing CreateTablet for tablet 96c6309e774a4e15bd33a0a93d1a7f2e (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:16:49.874488 18301 tablet_service.cc:1511] Processing CreateTablet for tablet 58f88ffc8ca74740b36c09a2eb312c10 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:16:49.902489 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96c6309e774a4e15bd33a0a93d1a7f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.911368 18301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f88ffc8ca74740b36c09a2eb312c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.911978 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:49.913136 18219 tablet_service.cc:1511] Processing CreateTablet for tablet b1889d6d746545a0bdf04811a102b35b (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 13:16:49.914000 18351 leader_election.cc:343] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.914553 18219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1889d6d746545a0bdf04811a102b35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.914523 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:49.919782 18431 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.922884 18428 tablet_bootstrap.cc:492] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:49.923475 18428 ts_tablet_manager.cc:1403] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.184s	user 0.013s	sys 0.011s
I20260709 13:16:49.927032 18428 raft_consensus.cc:359] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:49.927832 18428 raft_consensus.cc:385] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.928157 18428 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.952677 18428 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:49.959697 18428 ts_tablet_manager.cc:1434] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.001s
I20260709 13:16:49.960894 18428 tablet_bootstrap.cc:492] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:49.963656 18369 tablet_service.cc:1511] Processing CreateTablet for tablet b1889d6d746545a0bdf04811a102b35b (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:16:49.965430 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1889d6d746545a0bdf04811a102b35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.970708 18427 tablet_bootstrap.cc:492] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:49.971494 18427 ts_tablet_manager.cc:1403] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.123s	user 0.008s	sys 0.005s
I20260709 13:16:49.975870 18428 tablet_bootstrap.cc:654] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.976224 18370 tablet_service.cc:1511] Processing CreateTablet for tablet fbab600bb4ff4ad99b8a9ff2604b8f4b (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:16:49.977525 18370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbab600bb4ff4ad99b8a9ff2604b8f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.979020 18226 tablet_service.cc:1511] Processing CreateTablet for tablet 23d48585586a4bb3bc800da7f54e12f0 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:16:49.980203 18226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d48585586a4bb3bc800da7f54e12f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.992077 18300 tablet_service.cc:1511] Processing CreateTablet for tablet 23d48585586a4bb3bc800da7f54e12f0 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:16:49.993394 18300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d48585586a4bb3bc800da7f54e12f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.993599 18437 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.994045 18437 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:49.980098 18427 raft_consensus.cc:359] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:49.997958 18427 raft_consensus.cc:385] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.998281 18298 tablet_service.cc:1511] Processing CreateTablet for tablet fbab600bb4ff4ad99b8a9ff2604b8f4b (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:16:50.000811 18437 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:50.016083 18298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbab600bb4ff4ad99b8a9ff2604b8f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.998302 18427 raft_consensus.cc:740] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.025439 18296 tablet_service.cc:1511] Processing CreateTablet for tablet b1889d6d746545a0bdf04811a102b35b (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:16:50.026854 18296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1889d6d746545a0bdf04811a102b35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.032532 18438 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.033072 18438 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.040028 18225 tablet_service.cc:1511] Processing CreateTablet for tablet fbab600bb4ff4ad99b8a9ff2604b8f4b (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:16:50.041594 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbab600bb4ff4ad99b8a9ff2604b8f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.041234 18372 tablet_service.cc:1511] Processing CreateTablet for tablet 23d48585586a4bb3bc800da7f54e12f0 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:16:50.042840 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d48585586a4bb3bc800da7f54e12f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.044955 18427 consensus_queue.cc:260] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.054344 18293 tablet_service.cc:1511] Processing CreateTablet for tablet 23eb586495714fcf90b0b81c5ec4cc2f (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:16:50.054872 18295 tablet_service.cc:1511] Processing CreateTablet for tablet fe9abdaa4bb845cd8d40c4f182cf98c9 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:16:50.055812 18293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23eb586495714fcf90b0b81c5ec4cc2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.057104 18438 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:50.058168 18426 tablet_bootstrap.cc:492] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:50.058701 18426 ts_tablet_manager.cc:1403] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.255s	user 0.026s	sys 0.018s
I20260709 13:16:50.061658 18373 tablet_service.cc:1511] Processing CreateTablet for tablet 23eb586495714fcf90b0b81c5ec4cc2f (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:16:50.055795 18428 tablet_bootstrap.cc:492] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:50.066150 18428 ts_tablet_manager.cc:1403] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.106s	user 0.021s	sys 0.032s
I20260709 13:16:50.071401 18295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9abdaa4bb845cd8d40c4f182cf98c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.077399 18428 raft_consensus.cc:359] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.077836 18426 raft_consensus.cc:359] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.078478 18428 raft_consensus.cc:385] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.078701 18426 raft_consensus.cc:385] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.078941 18428 raft_consensus.cc:740] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.079167 18426 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.080035 18428 consensus_queue.cc:260] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.081028 18373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23eb586495714fcf90b0b81c5ec4cc2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.101429 18428 ts_tablet_manager.cc:1434] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 13:16:50.101294 18219 tablet_service.cc:1511] Processing CreateTablet for tablet 23eb586495714fcf90b0b81c5ec4cc2f (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:16:50.102766 18428 tablet_bootstrap.cc:492] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:50.106253 18370 tablet_service.cc:1511] Processing CreateTablet for tablet fe9abdaa4bb845cd8d40c4f182cf98c9 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:16:50.107574 18370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9abdaa4bb845cd8d40c4f182cf98c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.080022 18426 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.111196 18426 ts_tablet_manager.cc:1434] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 13:16:50.112198 18426 tablet_bootstrap.cc:492] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:50.102775 18219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23eb586495714fcf90b0b81c5ec4cc2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.121187 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:16:50.122987 18202 leader_election.cc:343] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.129417 18302 tablet_service.cc:1511] Processing CreateTablet for tablet 7e1dd423d7184b408a5257ea471f540d (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:16:50.129417 18227 tablet_service.cc:1511] Processing CreateTablet for tablet fe9abdaa4bb845cd8d40c4f182cf98c9 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:16:50.129966 18220 tablet_service.cc:1511] Processing CreateTablet for tablet 7e1dd423d7184b408a5257ea471f540d (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:16:50.131016 18227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9abdaa4bb845cd8d40c4f182cf98c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.131016 18302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1dd423d7184b408a5257ea471f540d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.132229 18220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1dd423d7184b408a5257ea471f540d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.141142 18427 ts_tablet_manager.cc:1434] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.169s	user 0.014s	sys 0.008s
I20260709 13:16:50.142313 18427 tablet_bootstrap.cc:492] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:50.147513 18375 tablet_service.cc:1511] Processing CreateTablet for tablet 7e1dd423d7184b408a5257ea471f540d (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:16:50.148880 18375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1dd423d7184b408a5257ea471f540d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.150887 18428 tablet_bootstrap.cc:654] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.151521 18431 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.152043 18431 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.156212 18431 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:50.157286 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:50.178583 18426 tablet_bootstrap.cc:654] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:50.181628 18351 leader_election.cc:343] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.181849 18294 tablet_service.cc:1511] Processing CreateTablet for tablet d49caac43d924696b2d3a9cc660f2c48 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:16:50.182248 18301 tablet_service.cc:1511] Processing CreateTablet for tablet 39dd19f13a42412b9dda536e24c324b1 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:16:50.183099 18294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d49caac43d924696b2d3a9cc660f2c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.182945 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:50.183606 18312 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:50.183830 18301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39dd19f13a42412b9dda536e24c324b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.184624 18437 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.186288 18437 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.196725 18226 tablet_service.cc:1511] Processing CreateTablet for tablet d49caac43d924696b2d3a9cc660f2c48 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:16:50.197314 18222 tablet_service.cc:1511] Processing CreateTablet for tablet cbd66a28ecbc4386b9e1489688542ca9 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:16:50.197629 18218 tablet_service.cc:1511] Processing CreateTablet for tablet 39dd19f13a42412b9dda536e24c324b1 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:16:50.202667 18297 tablet_service.cc:1511] Processing CreateTablet for tablet cbd66a28ecbc4386b9e1489688542ca9 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:16:50.203977 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:50.203979 18297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd66a28ecbc4386b9e1489688542ca9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:50.205449 18202 leader_election.cc:343] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.206369 18437 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:50.194454 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:16:50.207580 18431 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:50.207966 18431 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.208081 18226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d49caac43d924696b2d3a9cc660f2c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.208317 18431 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.211999 18222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd66a28ecbc4386b9e1489688542ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.213006 18369 tablet_service.cc:1511] Processing CreateTablet for tablet d49caac43d924696b2d3a9cc660f2c48 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:16:50.214388 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d49caac43d924696b2d3a9cc660f2c48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.216023 18218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39dd19f13a42412b9dda536e24c324b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.216828 18371 tablet_service.cc:1511] Processing CreateTablet for tablet 39dd19f13a42412b9dda536e24c324b1 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:16:50.218119 18371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39dd19f13a42412b9dda536e24c324b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.220742 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:50.222847 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:16:50.224965 18201 leader_election.cc:343] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.229004 18201 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:50.229867 18437 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.231645 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:50.231760 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:16:50.233623 18277 leader_election.cc:343] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.238137 18367 tablet_service.cc:1511] Processing CreateTablet for tablet cbd66a28ecbc4386b9e1489688542ca9 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:16:50.239506 18367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd66a28ecbc4386b9e1489688542ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.255522 18368 tablet_service.cc:1511] Processing CreateTablet for tablet 943649b738074d87a593c237cf998758 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:16:50.257030 18368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 943649b738074d87a593c237cf998758. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:50.262694 18201 leader_election.cc:343] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.263242 18201 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:50.264050 18437 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.265303 18293 tablet_service.cc:1511] Processing CreateTablet for tablet 3611564ea3974f58a23e3fea4f39c5c7 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:16:50.266615 18293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3611564ea3974f58a23e3fea4f39c5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.269027 18295 tablet_service.cc:1511] Processing CreateTablet for tablet 943649b738074d87a593c237cf998758 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:16:50.270457 18295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 943649b738074d87a593c237cf998758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.272678 18428 tablet_bootstrap.cc:492] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:50.273178 18428 ts_tablet_manager.cc:1403] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.171s	user 0.018s	sys 0.017s
I20260709 13:16:50.276129 18428 raft_consensus.cc:359] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.276989 18428 raft_consensus.cc:385] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.277323 18428 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.281752 18428 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.280609 18373 tablet_service.cc:1511] Processing CreateTablet for tablet 3611564ea3974f58a23e3fea4f39c5c7 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:16:50.286464 18373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3611564ea3974f58a23e3fea4f39c5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.278097 18427 tablet_bootstrap.cc:654] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.312228 18293 tablet_service.cc:1511] Processing CreateTablet for tablet 80d0760748294d8d8cb291466766b8a5 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:16:50.313570 18293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d0760748294d8d8cb291466766b8a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.314394 18431 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.315656 18386 raft_consensus.cc:2393] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:16:50.317533 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:50.319446 18276 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:50.320726 18449 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:50.321609 18351 leader_election.cc:343] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.322894 18370 tablet_service.cc:1511] Processing CreateTablet for tablet 80d0760748294d8d8cb291466766b8a5 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:16:50.324201 18370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d0760748294d8d8cb291466766b8a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.330188 18220 tablet_service.cc:1511] Processing CreateTablet for tablet 80d0760748294d8d8cb291466766b8a5 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:16:50.330451 18219 tablet_service.cc:1511] Processing CreateTablet for tablet 715a2657f09449038e569acddbab1aea (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:16:50.331045 18227 tablet_service.cc:1511] Processing CreateTablet for tablet 943649b738074d87a593c237cf998758 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:16:50.331710 18220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d0760748294d8d8cb291466766b8a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.332188 18449 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.332383 18219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 715a2657f09449038e569acddbab1aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.335757 18225 tablet_service.cc:1511] Processing CreateTablet for tablet 3611564ea3974f58a23e3fea4f39c5c7 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:16:50.337071 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3611564ea3974f58a23e3fea4f39c5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.343362 18293 tablet_service.cc:1511] Processing CreateTablet for tablet 715a2657f09449038e569acddbab1aea (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:16:50.344628 18293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 715a2657f09449038e569acddbab1aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.344678 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:50.347533 18449 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.348031 18449 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.359552 18428 ts_tablet_manager.cc:1434] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.086s	user 0.001s	sys 0.005s
I20260709 13:16:50.360702 18227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 943649b738074d87a593c237cf998758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.368180 18428 tablet_bootstrap.cc:492] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:50.379812 18225 tablet_service.cc:1511] Processing CreateTablet for tablet fdde66e5e9e64c508bb1a79d0f5754bd (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:16:50.356621 18312 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:50.385964 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:16:50.350517 18431 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:50.388456 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdde66e5e9e64c508bb1a79d0f5754bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.388998 18431 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.384335 18295 tablet_service.cc:1511] Processing CreateTablet for tablet fdde66e5e9e64c508bb1a79d0f5754bd (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:16:50.389596 18431 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.390574 18295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdde66e5e9e64c508bb1a79d0f5754bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.391733 18431 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:50.392287 18431 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:50.392161 18226 tablet_service.cc:1511] Processing CreateTablet for tablet efd953e96dc54f10a635581a413244e2 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:16:50.392756 18431 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:16:50.393596 18431 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.397792 18226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd953e96dc54f10a635581a413244e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.401167 18369 tablet_service.cc:1511] Processing CreateTablet for tablet fdde66e5e9e64c508bb1a79d0f5754bd (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:16:50.401819 18426 tablet_bootstrap.cc:492] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:50.402274 18297 tablet_service.cc:1511] Processing CreateTablet for tablet efd953e96dc54f10a635581a413244e2 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:16:50.402478 18426 ts_tablet_manager.cc:1403] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.291s	user 0.019s	sys 0.020s
I20260709 13:16:50.403510 18297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd953e96dc54f10a635581a413244e2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:50.405022 18183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:50.405272 18449 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:50.406665 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:50.406610 18371 tablet_service.cc:1511] Processing CreateTablet for tablet 715a2657f09449038e569acddbab1aea (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:16:50.407433 18237 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:50.408872 18277 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:50.408784 18426 raft_consensus.cc:359] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } }
I20260709 13:16:50.409761 18426 raft_consensus.cc:385] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.409848 18449 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:50.410177 18426 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.410303 18449 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.402587 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdde66e5e9e64c508bb1a79d0f5754bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.419225 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:16:50.420639 18276 leader_election.cc:343] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.421509 18218 tablet_service.cc:1511] Processing CreateTablet for tablet 2cbade5381d641e9b60bcc9994ae9b51 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:16:50.423678 18218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cbade5381d641e9b60bcc9994ae9b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.424569 18367 tablet_service.cc:1511] Processing CreateTablet for tablet 2cbade5381d641e9b60bcc9994ae9b51 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:16:50.427309 18294 tablet_service.cc:1511] Processing CreateTablet for tablet 2cbade5381d641e9b60bcc9994ae9b51 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:16:50.428231 18219 tablet_service.cc:1511] Processing CreateTablet for tablet c230199b226a4b03b63c04fd79847b50 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:16:50.424257 18368 tablet_service.cc:1511] Processing CreateTablet for tablet efd953e96dc54f10a635581a413244e2 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:16:50.429534 18219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c230199b226a4b03b63c04fd79847b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.429894 18368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd953e96dc54f10a635581a413244e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.430382 18293 tablet_service.cc:1511] Processing CreateTablet for tablet c230199b226a4b03b63c04fd79847b50 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:16:50.428689 18294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cbade5381d641e9b60bcc9994ae9b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.432191 18222 tablet_service.cc:1511] Processing CreateTablet for tablet 49c6a2a19b90491f9336362305339eca (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:16:50.433557 18222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c6a2a19b90491f9336362305339eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.435324 18372 tablet_service.cc:1511] Processing CreateTablet for tablet c230199b226a4b03b63c04fd79847b50 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:16:50.412259 18449 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.436685 18372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c230199b226a4b03b63c04fd79847b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.447160 18437 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.447840 18371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 715a2657f09449038e569acddbab1aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.449139 18293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c230199b226a4b03b63c04fd79847b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.464658 18367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cbade5381d641e9b60bcc9994ae9b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.447927 18437 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.468312 18437 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:50.469249 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:50.469413 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:50.470268 18386 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
W20260709 13:16:50.471058 18202 leader_election.cc:343] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.472178 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:50.473448 18437 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:50.473827 18437 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.474185 18437 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.481775 18293 tablet_service.cc:1511] Processing CreateTablet for tablet 49c6a2a19b90491f9336362305339eca (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:16:50.483103 18293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c6a2a19b90491f9336362305339eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.484742 18437 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.485592 18373 tablet_service.cc:1511] Processing CreateTablet for tablet 49c6a2a19b90491f9336362305339eca (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:16:50.487102 18373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c6a2a19b90491f9336362305339eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.487936 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:50.450253 18426 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } }
W20260709 13:16:50.489480 18202 leader_election.cc:343] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.490653 18426 ts_tablet_manager.cc:1434] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.001s
I20260709 13:16:50.491734 18426 tablet_bootstrap.cc:492] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:50.492676 18428 tablet_bootstrap.cc:700] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Time spent opening tablet: real 0.117s	user 0.005s	sys 0.000s
I20260709 13:16:50.493374 18428 tablet_bootstrap.cc:654] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.493574 18449 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.499249 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:50.499927 18386 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:50.457278 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 71437.2us
I20260709 13:16:50.504863 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:16:50.508417 18351 leader_election.cc:343] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.508558 18437 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:50.508189 18221 tablet_service.cc:1511] Processing CreateTablet for tablet 9db2383f92d34ec9ab6bed764ba818f4 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:16:50.513000 18298 tablet_service.cc:1511] Processing CreateTablet for tablet 9db2383f92d34ec9ab6bed764ba818f4 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:16:50.514391 18298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db2383f92d34ec9ab6bed764ba818f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.516767 18386 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:50.518333 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:50.519357 18427 tablet_bootstrap.cc:492] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:50.519598 18437 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:50.519833 18427 ts_tablet_manager.cc:1403] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.378s	user 0.009s	sys 0.012s
I20260709 13:16:50.523052 18427 raft_consensus.cc:359] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.523774 18427 raft_consensus.cc:385] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.524155 18427 raft_consensus.cc:740] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.525266 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:50.526636 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:50.527228 18237 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.529412 18221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db2383f92d34ec9ab6bed764ba818f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.531160 18220 tablet_service.cc:1511] Processing CreateTablet for tablet 4c7dd453327840c0811097f0c2b4c75b (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:16:50.532573 18220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c7dd453327840c0811097f0c2b4c75b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.526427 18369 tablet_service.cc:1511] Processing CreateTablet for tablet 9db2383f92d34ec9ab6bed764ba818f4 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:16:50.545910 18135 catalog_manager.cc:5697] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.524963 18427 consensus_queue.cc:260] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.549567 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db2383f92d34ec9ab6bed764ba818f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.550215 18427 ts_tablet_manager.cc:1434] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 13:16:50.551375 18427 tablet_bootstrap.cc:492] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:50.553318 18449 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:50.554932 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:16:50.556910 18276 leader_election.cc:343] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.562841 18301 tablet_service.cc:1511] Processing CreateTablet for tablet 4c7dd453327840c0811097f0c2b4c75b (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:16:50.564152 18301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c7dd453327840c0811097f0c2b4c75b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.563887 18375 tablet_service.cc:1511] Processing CreateTablet for tablet 4c7dd453327840c0811097f0c2b4c75b (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:16:50.565526 18375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c7dd453327840c0811097f0c2b4c75b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.578029 18222 tablet_service.cc:1511] Processing CreateTablet for tablet fbb0f3b6bc6342f0bd5d2efc5d4f6463 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:16:50.578933 18302 tablet_service.cc:1511] Processing CreateTablet for tablet fbb0f3b6bc6342f0bd5d2efc5d4f6463 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:16:50.579526 18222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb0f3b6bc6342f0bd5d2efc5d4f6463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.580302 18302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb0f3b6bc6342f0bd5d2efc5d4f6463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.581073 18370 tablet_service.cc:1511] Processing CreateTablet for tablet fbb0f3b6bc6342f0bd5d2efc5d4f6463 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:16:50.582363 18370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb0f3b6bc6342f0bd5d2efc5d4f6463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.600564 18428 tablet_bootstrap.cc:492] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:50.601202 18428 ts_tablet_manager.cc:1403] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.241s	user 0.016s	sys 0.001s
I20260709 13:16:50.646092 18431 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.646627 18431 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } }
I20260709 13:16:50.648798 18431 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:16:50.649441 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:50.650954 18428 raft_consensus.cc:359] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.651494 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:50.651737 18428 raft_consensus.cc:385] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.652166 18428 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.652207 18369 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5058a8396d4e77a38f85a04e24eae7 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:16:50.653227 18351 leader_election.cc:343] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:50.659489 18351 leader_election.cc:343] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.659957 18351 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:50.660411 18227 tablet_service.cc:1511] Processing CreateTablet for tablet 610ebeb615ff40b9baae6de30d397e22 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:16:50.661160 18431 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.653355 18437 raft_consensus.cc:697] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:50.656865 18226 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5058a8396d4e77a38f85a04e24eae7 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:16:50.657855 18237 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:50.657631 18294 tablet_service.cc:1511] Processing CreateTablet for tablet 6c5058a8396d4e77a38f85a04e24eae7 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:16:50.665347 18294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5058a8396d4e77a38f85a04e24eae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.667210 18426 tablet_bootstrap.cc:654] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.661762 18227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 610ebeb615ff40b9baae6de30d397e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.677008 18226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5058a8396d4e77a38f85a04e24eae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.680362 18297 tablet_service.cc:1511] Processing CreateTablet for tablet 610ebeb615ff40b9baae6de30d397e22 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:16:50.680028 18428 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.682273 18427 tablet_bootstrap.cc:654] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.681680 18297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 610ebeb615ff40b9baae6de30d397e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.663722 18437 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.691964 18369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5058a8396d4e77a38f85a04e24eae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.692987 18277 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:50.694169 18428 ts_tablet_manager.cc:1434] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.093s	user 0.012s	sys 0.000s
I20260709 13:16:50.701049 18449 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:50.702706 18449 raft_consensus.cc:697] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:50.706110 18449 consensus_queue.cc:237] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.721738 18222 tablet_service.cc:1511] Processing CreateTablet for tablet 20a11d8d7fb14609b0bb479587b23e37 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:16:50.723745 18222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a11d8d7fb14609b0bb479587b23e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.732246 18428 tablet_bootstrap.cc:492] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:50.737140 18298 tablet_service.cc:1511] Processing CreateTablet for tablet dd45943dc64b4e86b54ae5c263345e6e (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:16:50.738497 18226 tablet_service.cc:1511] Processing CreateTablet for tablet dd45943dc64b4e86b54ae5c263345e6e (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:16:50.738761 18225 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4cde9a14cb4fca95a288de6d075e9a (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:16:50.733843 18301 tablet_service.cc:1511] Processing CreateTablet for tablet 20a11d8d7fb14609b0bb479587b23e37 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:16:50.740833 18302 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4cde9a14cb4fca95a288de6d075e9a (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:16:50.743656 18226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd45943dc64b4e86b54ae5c263345e6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.738492 18298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd45943dc64b4e86b54ae5c263345e6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.749483 18367 tablet_service.cc:1511] Processing CreateTablet for tablet dd45943dc64b4e86b54ae5c263345e6e (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:16:50.750855 18367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd45943dc64b4e86b54ae5c263345e6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.743152 18373 tablet_service.cc:1511] Processing CreateTablet for tablet 20a11d8d7fb14609b0bb479587b23e37 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:16:50.751571 18351 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:50.752709 18431 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.753104 18373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a11d8d7fb14609b0bb479587b23e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.756649 18225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4cde9a14cb4fca95a288de6d075e9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.758379 18371 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4cde9a14cb4fca95a288de6d075e9a (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:16:50.742863 18368 tablet_service.cc:1511] Processing CreateTablet for tablet 610ebeb615ff40b9baae6de30d397e22 (DEFAULT_TABLE table=test-workload [id=c260e37555894198a5aaf373491ba341]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:16:50.759660 18371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4cde9a14cb4fca95a288de6d075e9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.760581 18368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 610ebeb615ff40b9baae6de30d397e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.761598 18301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a11d8d7fb14609b0bb479587b23e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.763396 18302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4cde9a14cb4fca95a288de6d075e9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.764302 18426 tablet_bootstrap.cc:492] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:50.764950 18426 ts_tablet_manager.cc:1403] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.273s	user 0.017s	sys 0.006s
I20260709 13:16:50.785419 18426 raft_consensus.cc:359] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.786142 18426 raft_consensus.cc:385] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.786439 18426 raft_consensus.cc:740] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.791388 18426 consensus_queue.cc:260] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.793695 18426 ts_tablet_manager.cc:1434] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:16:50.794708 18426 tablet_bootstrap.cc:492] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:50.798368 18236 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.813074 18133 catalog_manager.cc:5697] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.814309 18426 tablet_bootstrap.cc:654] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.817975 18428 tablet_bootstrap.cc:654] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.841542 18431 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.842134 18431 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.846891 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:50.848477 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:16:50.850932 18351 leader_election.cc:343] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:50.851845 18351 leader_election.cc:343] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.852361 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:50.844450 18431 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:50.855403 18455 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.877184 18427 tablet_bootstrap.cc:492] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:50.877717 18427 ts_tablet_manager.cc:1403] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.327s	user 0.020s	sys 0.037s
I20260709 13:16:50.880671 18427 raft_consensus.cc:359] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.881404 18427 raft_consensus.cc:385] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.881690 18427 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.884812 18427 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.887231 18427 ts_tablet_manager.cc:1434] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:16:50.888224 18427 tablet_bootstrap.cc:492] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:50.899434 18135 catalog_manager.cc:5697] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.910861 18427 tablet_bootstrap.cc:654] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.911273 18426 tablet_bootstrap.cc:492] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:50.911775 18426 ts_tablet_manager.cc:1403] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.117s	user 0.005s	sys 0.008s
I20260709 13:16:50.913260 18428 tablet_bootstrap.cc:492] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:50.913877 18428 ts_tablet_manager.cc:1403] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.185s	user 0.036s	sys 0.034s
I20260709 13:16:50.914959 18426 raft_consensus.cc:359] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.915962 18426 raft_consensus.cc:385] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.916857 18428 raft_consensus.cc:359] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.917619 18428 raft_consensus.cc:385] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.918898 18428 raft_consensus.cc:740] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.919665 18428 consensus_queue.cc:260] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.920431 18431 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:50.921996 18428 ts_tablet_manager.cc:1434] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
I20260709 13:16:50.923015 18428 tablet_bootstrap.cc:492] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:50.931237 18428 tablet_bootstrap.cc:654] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.916344 18426 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.941649 18426 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.944205 18426 ts_tablet_manager.cc:1434] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:16:50.945571 18426 tablet_bootstrap.cc:492] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:50.946884 18428 tablet_bootstrap.cc:492] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:50.947405 18428 ts_tablet_manager.cc:1403] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.013s
I20260709 13:16:50.950598 18428 raft_consensus.cc:359] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } }
I20260709 13:16:50.951377 18428 raft_consensus.cc:385] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.951673 18428 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.952474 18428 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } }
I20260709 13:16:50.955222 18428 ts_tablet_manager.cc:1434] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:16:50.956323 18428 tablet_bootstrap.cc:492] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:50.961752 18455 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:50.963075 18428 tablet_bootstrap.cc:654] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.952467 18426 tablet_bootstrap.cc:654] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.970664 18427 tablet_bootstrap.cc:492] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:50.971276 18427 ts_tablet_manager.cc:1403] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.019s
I20260709 13:16:50.974915 18427 raft_consensus.cc:359] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.975837 18427 raft_consensus.cc:385] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.976207 18427 raft_consensus.cc:740] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.977624 18427 consensus_queue.cc:260] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:50.980424 18427 ts_tablet_manager.cc:1434] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:50.981689 18427 tablet_bootstrap.cc:492] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:50.990363 18427 tablet_bootstrap.cc:654] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.997931 18449 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.998672 18449 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.001072 18438 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.001729 18438 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.006105 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:51.008668 18438 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:16:51.009913 18276 leader_election.cc:343] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.011082 18449 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:51.013252 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:51.013274 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:16:51.015368 18277 leader_election.cc:343] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:51.016108 18276 leader_election.cc:343] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.016744 18276 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:51.017784 18449 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.018420 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:51.019299 18236 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:51.020718 18277 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:51.022730 18449 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.023272 18449 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.023768 18449 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.033658 18449 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.037602 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:51.038367 18237 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.042495 18438 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.044829 18438 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.047284 18427 tablet_bootstrap.cc:492] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:51.048005 18427 ts_tablet_manager.cc:1403] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.004s
I20260709 13:16:51.052703 18237 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:51.052125 18427 raft_consensus.cc:359] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.058308 18427 raft_consensus.cc:385] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.058615 18428 tablet_bootstrap.cc:492] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:51.058645 18427 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.058948 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:51.059350 18426 tablet_bootstrap.cc:492] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:51.056891 18438 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:51.060014 18426 ts_tablet_manager.cc:1403] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.115s	user 0.044s	sys 0.055s
I20260709 13:16:51.059372 18428 ts_tablet_manager.cc:1403] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.103s	user 0.052s	sys 0.044s
I20260709 13:16:51.059828 18427 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:51.060551 18276 leader_election.cc:343] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.055222 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:16:51.061968 18276 leader_election.cc:343] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.062166 18427 ts_tablet_manager.cc:1434] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:16:51.057824 18449 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:51.057567 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:51.063050 18426 raft_consensus.cc:359] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.063319 18428 raft_consensus.cc:359] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.063831 18426 raft_consensus.cc:385] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:16:51.063848 18277 leader_election.cc:343] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.064105 18428 raft_consensus.cc:385] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.064319 18426 raft_consensus.cc:740] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.064673 18428 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.064930 18277 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:51.065338 18426 consensus_queue.cc:260] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.065615 18428 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.066172 18277 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:51.070304 18428 ts_tablet_manager.cc:1434] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:16:51.071575 18428 tablet_bootstrap.cc:492] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:51.073073 18449 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.073555 18449 raft_consensus.cc:697] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:51.066956 18438 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.067694 18426 ts_tablet_manager.cc:1434] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:16:51.075613 18426 tablet_bootstrap.cc:492] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:51.077512 18428 tablet_bootstrap.cc:654] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.081955 18426 tablet_bootstrap.cc:654] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.086481 18437 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:51.090945 18449 consensus_queue.cc:237] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.093189 18455 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.093746 18427 tablet_bootstrap.cc:492] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:51.093935 18455 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.094712 18426 tablet_bootstrap.cc:492] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:51.095247 18426 ts_tablet_manager.cc:1403] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:16:51.098014 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:51.098219 18426 raft_consensus.cc:359] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.099140 18426 raft_consensus.cc:385] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.099188 18236 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:51.099491 18426 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.100535 18426 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.102764 18455 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:51.105618 18426 ts_tablet_manager.cc:1434] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:16:51.106564 18426 tablet_bootstrap.cc:492] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:51.107555 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:51.109963 18427 tablet_bootstrap.cc:654] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.112212 18426 tablet_bootstrap.cc:654] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.113153 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:51.120210 18426 tablet_bootstrap.cc:492] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:51.120687 18426 ts_tablet_manager.cc:1403] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:16:51.121285 18312 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.121764 18133 catalog_manager.cc:5697] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.123193 18426 raft_consensus.cc:359] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.123831 18426 raft_consensus.cc:385] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.124075 18426 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.126402 18385 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.124835 18426 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.131639 18426 ts_tablet_manager.cc:1434] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:16:51.132576 18426 tablet_bootstrap.cc:492] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:51.135715 18449 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:51.137938 18426 tablet_bootstrap.cc:654] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.144446 18437 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:51.147545 18427 tablet_bootstrap.cc:492] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:51.148217 18427 ts_tablet_manager.cc:1403] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.003s
I20260709 13:16:51.157989 18427 raft_consensus.cc:359] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.158944 18427 raft_consensus.cc:385] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.159312 18427 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.163058 18427 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.171247 18427 ts_tablet_manager.cc:1434] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.005s
I20260709 13:16:51.174118 18427 tablet_bootstrap.cc:492] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:51.181149 18455 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.198724 18427 tablet_bootstrap.cc:654] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.211503 18438 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:51.223543 18428 tablet_bootstrap.cc:492] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:51.224138 18428 ts_tablet_manager.cc:1403] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.153s	user 0.058s	sys 0.074s
I20260709 13:16:51.224449 18426 tablet_bootstrap.cc:492] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:51.225023 18426 ts_tablet_manager.cc:1403] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.093s	user 0.027s	sys 0.045s
I20260709 13:16:51.227308 18428 raft_consensus.cc:359] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.227596 18426 raft_consensus.cc:359] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.228122 18428 raft_consensus.cc:385] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.228541 18428 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.229529 18427 tablet_bootstrap.cc:492] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:51.229475 18428 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.230265 18427 ts_tablet_manager.cc:1403] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.008s
I20260709 13:16:51.232048 18428 ts_tablet_manager.cc:1434] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:51.233071 18428 tablet_bootstrap.cc:492] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:51.232919 18427 raft_consensus.cc:359] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.233628 18427 raft_consensus.cc:385] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.233907 18427 raft_consensus.cc:740] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.234627 18427 consensus_queue.cc:260] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.228335 18426 raft_consensus.cc:385] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.239349 18426 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.240480 18428 tablet_bootstrap.cc:654] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.243470 18427 ts_tablet_manager.cc:1434] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:16:51.240129 18426 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.244432 18427 tablet_bootstrap.cc:492] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:51.245455 18426 ts_tablet_manager.cc:1434] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:16:51.246423 18426 tablet_bootstrap.cc:492] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:51.250958 18427 tablet_bootstrap.cc:654] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.252859 18426 tablet_bootstrap.cc:654] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.258349 18455 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.259083 18455 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.263012 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:51.263736 18455 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:51.265718 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:51.266564 18311 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:51.268301 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:51.263888 18236 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:51.270937 18455 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.271402 18455 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.271811 18455 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.281719 18455 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.282291 18428 tablet_bootstrap.cc:492] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:51.282904 18428 ts_tablet_manager.cc:1403] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.012s
I20260709 13:16:51.283564 18427 tablet_bootstrap.cc:492] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:51.284026 18427 ts_tablet_manager.cc:1403] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.003s
I20260709 13:16:51.284271 18426 tablet_bootstrap.cc:492] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:51.284430 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:51.284826 18426 ts_tablet_manager.cc:1403] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.039s	user 0.025s	sys 0.011s
I20260709 13:16:51.285076 18236 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.286016 18428 raft_consensus.cc:359] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.286777 18428 raft_consensus.cc:385] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.286536 18427 raft_consensus.cc:359] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.287120 18428 raft_consensus.cc:740] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.287259 18427 raft_consensus.cc:385] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.287631 18427 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.287961 18428 consensus_queue.cc:260] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.288318 18426 raft_consensus.cc:359] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.289162 18426 raft_consensus.cc:385] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.289528 18426 raft_consensus.cc:740] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.290688 18428 ts_tablet_manager.cc:1434] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:51.290428 18426 consensus_queue.cc:260] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.291716 18236 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:51.291917 18428 tablet_bootstrap.cc:492] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:51.292704 18426 ts_tablet_manager.cc:1434] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:51.292806 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:51.293776 18426 tablet_bootstrap.cc:492] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:51.293772 18454 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.294445 18454 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:16:51.295262 18454 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.300099 18428 tablet_bootstrap.cc:654] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.300338 18426 tablet_bootstrap.cc:654] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.301434 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:51.302011 18311 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.308775 18311 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:51.288825 18427 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.310465 18455 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:51.317274 18455 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.317718 18455 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.320216 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:51.320825 18236 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:51.321151 18427 ts_tablet_manager.cc:1434] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.005s
I20260709 13:16:51.321946 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:51.322723 18431 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.323096 18431 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.323421 18431 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.328927 18427 tablet_bootstrap.cc:492] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:51.329927 18431 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.332490 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:51.333091 18237 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.333128 18459 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.334031 18459 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } }
I20260709 13:16:51.335248 18427 tablet_bootstrap.cc:654] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.339071 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:51.340054 18384 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:51.341547 18201 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:51.342319 18426 tablet_bootstrap.cc:492] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:51.342671 18486 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.342936 18426 ts_tablet_manager.cc:1403] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.049s	user 0.021s	sys 0.026s
I20260709 13:16:51.343075 18486 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.343549 18486 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.343474 18237 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:51.345217 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:51.346603 18426 raft_consensus.cc:359] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.347419 18426 raft_consensus.cc:385] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.347796 18426 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.348748 18426 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.350139 18459 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:51.351184 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:16:51.353041 18202 leader_election.cc:343] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.358925 18431 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:51.358870 18486 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } }
I20260709 13:16:51.359987 18431 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.360550 18431 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:16:51.360682 18426 ts_tablet_manager.cc:1434] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:16:51.361847 18426 tablet_bootstrap.cc:492] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:51.361635 18431 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.362963 18428 tablet_bootstrap.cc:492] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:51.363474 18428 ts_tablet_manager.cc:1403] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.030s
I20260709 13:16:51.377636 18486 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:51.383700 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:51.385618 18455 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:51.387303 18426 tablet_bootstrap.cc:654] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.386072 18428 raft_consensus.cc:359] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.388250 18428 raft_consensus.cc:385] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.388625 18428 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.389899 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:51.390920 18428 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.391595 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:51.392225 18384 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:51.392752 18202 leader_election.cc:343] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.393780 18428 ts_tablet_manager.cc:1434] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.011s
I20260709 13:16:51.396324 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:51.402096 18428 tablet_bootstrap.cc:492] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:51.405875 18135 catalog_manager.cc:5697] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:51.408257 18183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:16:51.408787 18351 leader_election.cc:343] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:51.422896 18351 leader_election.cc:343] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.413373 18428 tablet_bootstrap.cc:654] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.418517 18427 tablet_bootstrap.cc:492] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:51.426383 18427 ts_tablet_manager.cc:1403] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.098s	user 0.045s	sys 0.006s
I20260709 13:16:51.429833 18427 raft_consensus.cc:359] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.430720 18427 raft_consensus.cc:385] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.431068 18427 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.432071 18427 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.420238 18384 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:51.420423 18426 tablet_bootstrap.cc:492] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:51.435719 18426 ts_tablet_manager.cc:1403] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.002s
I20260709 13:16:51.436555 18201 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:51.438050 18486 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.438572 18486 raft_consensus.cc:697] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:51.438885 18503 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.438884 18426 raft_consensus.cc:359] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.439847 18426 raft_consensus.cc:385] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.439563 18486 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } }
I20260709 13:16:51.442827 18427 ts_tablet_manager.cc:1434] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:16:51.443097 18428 tablet_bootstrap.cc:492] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:51.443492 18428 ts_tablet_manager.cc:1403] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.004s
I20260709 13:16:51.443790 18427 tablet_bootstrap.cc:492] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:51.439703 18503 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.440176 18426 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.445209 18426 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.447566 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:51.448338 18237 raft_consensus.cc:2393] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:51.449059 18426 ts_tablet_manager.cc:1434] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:16:51.448989 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:51.450150 18426 tablet_bootstrap.cc:492] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:51.450237 18503 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:51.450789 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:51.451776 18431 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.456694 18426 tablet_bootstrap.cc:654] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.458104 18438 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.458577 18438 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.459717 18431 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.460685 18438 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:51.460551 18428 raft_consensus.cc:359] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.461221 18428 raft_consensus.cc:385] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.461506 18428 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.462138 18428 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.462481 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:51.463426 18384 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:51.464321 18428 ts_tablet_manager.cc:1434] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:16:51.465626 18428 tablet_bootstrap.cc:492] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:51.465284 18276 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:51.468274 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:16:51.469614 18277 leader_election.cc:343] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.469338 18135 catalog_manager.cc:5697] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.472937 18438 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.473532 18428 tablet_bootstrap.cc:654] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.473498 18438 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.474146 18427 tablet_bootstrap.cc:654] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.474267 18438 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.476233 18132 catalog_manager.cc:5697] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.481432 18438 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.484418 18486 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.484899 18486 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.486941 18486 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:51.487208 18481 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.487725 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:51.487648 18481 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.488291 18384 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.489724 18481 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:51.491432 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:51.492353 18385 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:51.484938 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:16:51.494403 18277 leader_election.cc:343] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.495193 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:51.495551 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:51.495839 18312 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:51.497699 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:51.497725 18202 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:51.498384 18237 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:51.498800 18486 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.499187 18486 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.499675 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:51.499518 18486 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:51.500926 18201 leader_election.cc:343] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.501083 18481 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.501570 18481 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.501991 18481 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.506441 18426 tablet_bootstrap.cc:492] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:51.506913 18426 ts_tablet_manager.cc:1403] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.029s
I20260709 13:16:51.506814 18459 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.507635 18459 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.510324 18384 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:51.510607 18459 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:51.511543 18276 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:16:51.512161 18431 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.508105 18486 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.512701 18431 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.513690 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:51.514866 18431 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:51.510098 18426 raft_consensus.cc:359] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.514636 18486 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:51.515734 18426 raft_consensus.cc:385] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.516163 18438 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:51.516121 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:51.516853 18311 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:51.517464 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:51.515568 18449 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.518273 18427 tablet_bootstrap.cc:492] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:51.518494 18449 raft_consensus.cc:697] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:51.516090 18426 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.518802 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:16:51.520308 18201 leader_election.cc:343] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.518743 18427 ts_tablet_manager.cc:1403] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.075s	user 0.016s	sys 0.000s
I20260709 13:16:51.518121 18237 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:51.521498 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:51.522061 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:51.522742 18384 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:51.523437 18431 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.523974 18431 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.524121 18427 raft_consensus.cc:359] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } }
I20260709 13:16:51.524433 18431 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.524864 18427 raft_consensus.cc:385] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.525192 18427 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.519780 18426 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.525949 18427 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } }
I20260709 13:16:51.527849 18426 ts_tablet_manager.cc:1434] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:16:51.529098 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:51.534042 18312 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.534402 18426 tablet_bootstrap.cc:492] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
W20260709 13:16:51.515532 18202 leader_election.cc:343] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.537177 18201 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:51.538033 18486 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.538388 18486 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.538689 18486 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.530378 18481 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.519729 18449 consensus_queue.cc:237] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.550860 18426 tablet_bootstrap.cc:654] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.551334 18486 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.561460 18486 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:51.562651 18426 tablet_bootstrap.cc:492] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:51.563174 18426 ts_tablet_manager.cc:1403] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.005s
I20260709 13:16:51.563123 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:51.563865 18384 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.568054 18428 tablet_bootstrap.cc:492] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:51.567991 18438 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:51.568789 18428 ts_tablet_manager.cc:1403] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.017s
I20260709 13:16:51.569931 18481 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:51.571305 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:51.572177 18237 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.573134 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:51.568113 18312 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:51.574422 18385 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.575592 18431 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.578068 18431 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:51.580432 18426 raft_consensus.cc:359] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.581355 18426 raft_consensus.cc:385] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.581672 18426 raft_consensus.cc:740] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.582474 18426 consensus_queue.cc:260] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.583976 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:51.587522 18426 ts_tablet_manager.cc:1434] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:16:51.588727 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:51.588557 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:51.594836 18427 ts_tablet_manager.cc:1434] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.074s	user 0.018s	sys 0.020s
I20260709 13:16:51.594734 18428 raft_consensus.cc:359] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.596038 18427 tablet_bootstrap.cc:492] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:51.595635 18428 raft_consensus.cc:385] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.598867 18428 raft_consensus.cc:740] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.601104 18428 consensus_queue.cc:260] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.598637 18132 catalog_manager.cc:5697] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.603262 18237 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:51.603896 18426 tablet_bootstrap.cc:492] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:51.600999 18312 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.604707 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:51.603462 18428 ts_tablet_manager.cc:1434] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:16:51.601162 18235 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.609023 18512 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.593797 18202 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:51.616117 18513 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.616802 18428 tablet_bootstrap.cc:492] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:51.616875 18513 raft_consensus.cc:697] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:51.612349 18512 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:51.620776 18438 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.621352 18438 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.623548 18438 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:51.620874 18513 consensus_queue.cc:237] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.625188 18481 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.625694 18481 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } }
I20260709 13:16:51.626248 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:51.629122 18481 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:16:51.641939 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:51.642184 18512 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.644304 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:51.645102 18237 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:16:51.645150 18437 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.645922 18437 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.648854 18384 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:51.648940 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:51.650413 18449 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.651803 18385 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:51.652686 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:51.653751 18384 raft_consensus.cc:2393] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:51.650411 18201 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:51.652972 18437 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:51.659682 18514 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:51.663075 18486 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.663717 18486 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:51.663863 18449 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.664033 18431 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.665411 18431 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.672637 18427 tablet_bootstrap.cc:654] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:51.658891 18202 leader_election.cc:343] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.665370 18486 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.663123 18312 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:51.680001 18426 tablet_bootstrap.cc:654] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.673735 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:51.682794 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:51.683844 18503 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.677304 18235 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:51.684538 18503 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:16:51.675238 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:51.688050 18503 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:51.688993 18201 leader_election.cc:343] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.686523 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:16:51.693524 18351 leader_election.cc:343] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:51.695490 18202 leader_election.cc:343] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.696008 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:51.696429 18431 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:51.673336 18276 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:51.697642 18513 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.697997 18481 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.699060 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:51.679489 18132 catalog_manager.cc:5697] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:51.700809 18351 leader_election.cc:343] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.701436 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:51.702895 18431 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.710686 18513 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.714730 18513 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.717914 18513 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:51.717949 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:51.718297 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:51.719614 18385 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:51.721000 18428 tablet_bootstrap.cc:654] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.720918 18201 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:51.704461 18131 catalog_manager.cc:5697] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.729862 18481 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.723341 18513 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.743645 18135 catalog_manager.cc:5697] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.757956 18513 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.767153 18503 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.768555 18503 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.772024 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:51.773617 18503 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:16:51.773655 18351 leader_election.cc:343] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.775652 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:51.776563 18426 tablet_bootstrap.cc:492] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:51.777089 18426 ts_tablet_manager.cc:1403] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.176s	user 0.026s	sys 0.024s
I20260709 13:16:51.776901 18133 catalog_manager.cc:5697] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:51.777897 18351 leader_election.cc:343] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.778441 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:51.780350 18426 raft_consensus.cc:359] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.781409 18426 raft_consensus.cc:385] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.781775 18426 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.781509 18503 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.784272 18428 tablet_bootstrap.cc:492] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:51.784816 18428 ts_tablet_manager.cc:1403] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.168s	user 0.016s	sys 0.017s
I20260709 13:16:51.787501 18428 raft_consensus.cc:359] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.788045 18503 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.788265 18428 raft_consensus.cc:385] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.788846 18428 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.782815 18426 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.788895 18503 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.791389 18426 ts_tablet_manager.cc:1434] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:16:51.792224 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:51.792939 18427 tablet_bootstrap.cc:492] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:51.793474 18427 ts_tablet_manager.cc:1403] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.198s	user 0.014s	sys 0.017s
I20260709 13:16:51.794014 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:16:51.795666 18351 leader_election.cc:343] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:51.796442 18351 leader_election.cc:343] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.796564 18427 raft_consensus.cc:359] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.797030 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:51.798243 18431 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.797361 18427 raft_consensus.cc:385] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.792476 18426 tablet_bootstrap.cc:492] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:51.797785 18428 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.799963 18503 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:51.799571 18427 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.801394 18427 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.802205 18428 ts_tablet_manager.cc:1434] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:16:51.803140 18428 tablet_bootstrap.cc:492] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:51.803632 18427 ts_tablet_manager.cc:1434] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:16:51.804711 18427 tablet_bootstrap.cc:492] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:51.809579 18428 tablet_bootstrap.cc:654] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.810222 18426 tablet_bootstrap.cc:654] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.825629 18427 tablet_bootstrap.cc:654] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.835521 18431 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:51.853993 18431 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:51.858260 18427 tablet_bootstrap.cc:492] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:51.858815 18427 ts_tablet_manager.cc:1403] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.000s
I20260709 13:16:51.862469 18427 raft_consensus.cc:359] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.863257 18427 raft_consensus.cc:385] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.863570 18427 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.864393 18427 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.869978 18454 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:51.873826 18427 ts_tablet_manager.cc:1434] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:16:51.875164 18427 tablet_bootstrap.cc:492] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:51.889643 18512 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.890419 18512 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.921065 18518 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.921859 18518 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.941749 18503 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.942510 18503 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:51.946997 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:51.949981 18503 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:51.951895 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:51.953629 18311 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:51.955018 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:51.984206 18426 tablet_bootstrap.cc:492] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:51.984908 18426 ts_tablet_manager.cc:1403] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.193s	user 0.007s	sys 0.027s
I20260709 13:16:51.978327 18503 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.998791 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:51.999485 18384 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:51.995774 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:16:52.001823 18277 leader_election.cc:343] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.002660 18276 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:16:52.010025 18512 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:52.010634 18512 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.011862 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:52.012059 18427 tablet_bootstrap.cc:654] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.012013 18486 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.013196 18385 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:51.993088 18518 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:52.010975 18512 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.014950 18512 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.022833 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:52.026964 18428 tablet_bootstrap.cc:492] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:52.027447 18428 ts_tablet_manager.cc:1403] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.225s	user 0.058s	sys 0.074s
I20260709 13:16:52.030018 18428 raft_consensus.cc:359] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.030650 18428 raft_consensus.cc:385] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.030900 18428 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.031522 18428 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.033010 18454 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.034845 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:52.041476 18486 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.042035 18486 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.037781 18428 ts_tablet_manager.cc:1434] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:16:52.043541 18426 raft_consensus.cc:359] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.044449 18426 raft_consensus.cc:385] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.044764 18481 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.046124 18426 raft_consensus.cc:740] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.047030 18426 consensus_queue.cc:260] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.047894 18427 tablet_bootstrap.cc:492] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:52.044153 18512 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.050551 18427 ts_tablet_manager.cc:1403] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.176s	user 0.016s	sys 0.001s
I20260709 13:16:52.052856 18504 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.052744 18513 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.053449 18428 tablet_bootstrap.cc:492] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:52.057127 18427 raft_consensus.cc:359] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.057844 18427 raft_consensus.cc:385] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.057905 18426 ts_tablet_manager.cc:1434] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 13:16:52.058121 18427 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.053421 18504 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.059623 18486 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:52.059625 18426 tablet_bootstrap.cc:492] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:52.059406 18427 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.089538 18514 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.090317 18514 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.063606 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:52.164477 18427 ts_tablet_manager.cc:1434] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.114s	user 0.009s	sys 0.005s
I20260709 13:16:52.131057 18514 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:52.167541 18427 tablet_bootstrap.cc:492] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:52.167135 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:52.181164 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:52.182367 18504 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:16:52.183256 18202 leader_election.cc:343] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:52.184688 18533 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.107s	user 0.022s	sys 0.048s
I20260709 13:16:52.186555 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:52.186655 18449 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.187268 18386 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:52.188766 18481 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.189538 18481 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.190901 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:52.185460 18503 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.192670 18449 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.193421 18449 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.193782 18449 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.190629 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:52.196610 18428 tablet_bootstrap.cc:654] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.198572 18437 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:52.198802 18351 leader_election.cc:343] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.202184 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:52.202785 18236 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.200034 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:52.185791 18385 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:52.208067 18426 tablet_bootstrap.cc:654] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.206391 18449 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.212929 18427 tablet_bootstrap.cc:654] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.214305 18437 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:52.223143 18351 leader_election.cc:343] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.223575 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:52.224186 18503 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.226500 18503 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:52.229034 18277 leader_election.cc:343] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.236550 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:52.237896 18449 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:52.244896 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:52.231382 18514 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:16:52.245651 18382 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.251929 18428 tablet_bootstrap.cc:492] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:52.263123 18236 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:52.306082 18428 ts_tablet_manager.cc:1403] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.253s	user 0.017s	sys 0.021s
I20260709 13:16:52.275002 18512 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:52.257732 18201 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:52.308835 18437 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.309201 18437 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.310146 18437 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.281910 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:52.313186 18385 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.299249 18382 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:52.260619 18503 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.315539 18503 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:52.260656 18277 leader_election.cc:343] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.319900 18428 raft_consensus.cc:359] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.321059 18428 raft_consensus.cc:385] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.321352 18428 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.321856 18428 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.327943 18437 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:52.325824 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63774.2us
I20260709 13:16:52.260993 18518 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260709 13:16:52.330619 18437 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:16:52.323208 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 65630.2us
I20260709 13:16:52.331892 18486 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.332909 18428 ts_tablet_manager.cc:1434] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 13:16:52.334040 18428 tablet_bootstrap.cc:492] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:52.335930 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:16:52.338716 18514 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.339498 18514 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:52.340371 18514 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.340895 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:52.341500 18382 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.344274 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:52.348129 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:52.349718 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:52.350685 18512 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.351209 18512 raft_consensus.cc:697] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:52.352042 18512 consensus_queue.cc:237] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:52.354640 18351 leader_election.cc:343] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.354877 18382 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:52.357267 18201 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:52.358099 18426 tablet_bootstrap.cc:492] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
W20260709 13:16:52.359004 18202 leader_election.cc:343] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.359515 18426 ts_tablet_manager.cc:1403] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.300s	user 0.026s	sys 0.033s
I20260709 13:16:52.359872 18513 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.358259 18437 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.363562 18427 tablet_bootstrap.cc:492] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:52.364193 18427 ts_tablet_manager.cc:1403] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.197s	user 0.007s	sys 0.014s
I20260709 13:16:52.360394 18513 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:52.378964 18504 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:16:52.384085 18427 raft_consensus.cc:359] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.385098 18427 raft_consensus.cc:385] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.384651 18513 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.385478 18427 raft_consensus.cc:740] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.386387 18427 consensus_queue.cc:260] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.360586 18385 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:52.390184 18426 raft_consensus.cc:359] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.391121 18426 raft_consensus.cc:385] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.391597 18426 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.392385 18426 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.396399 18427 ts_tablet_manager.cc:1434] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:16:52.398294 18427 tablet_bootstrap.cc:492] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:52.400486 18486 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.396004 18503 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:52.402927 18486 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.417835 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:52.439188 18311 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:52.440727 18428 tablet_bootstrap.cc:654] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.448143 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:16:52.449628 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 55239.9us
I20260709 13:16:52.440819 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:16:52.464398 18486 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:52.457340 18504 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.467715 18504 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.483691 18504 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.481297 18426 ts_tablet_manager.cc:1434] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.121s	user 0.013s	sys 0.005s
I20260709 13:16:52.483121 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:52.485124 18427 tablet_bootstrap.cc:654] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:52.486506 18183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:52.490211 18426 tablet_bootstrap.cc:492] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:52.499485 18384 raft_consensus.cc:2393] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:52.503221 18201 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:52.512274 18558 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.534507 18426 tablet_bootstrap.cc:654] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.534875 18428 tablet_bootstrap.cc:492] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:52.535385 18428 ts_tablet_manager.cc:1403] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.202s	user 0.017s	sys 0.013s
I20260709 13:16:52.537362 18504 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.540215 18428 raft_consensus.cc:359] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.549571 18428 raft_consensus.cc:385] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.549422 18556 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.549968 18428 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.550295 18556 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.550704 18428 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.550912 18131 catalog_manager.cc:5697] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.552847 18428 ts_tablet_manager.cc:1434] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.007s
I20260709 13:16:52.553747 18428 tablet_bootstrap.cc:492] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:52.541095 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:52.542271 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:52.540443 18558 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.548614 18504 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:52.557288 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:52.558552 18556 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:16:52.559096 18351 leader_election.cc:343] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.560853 18312 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.561671 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:52.561678 18236 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
W20260709 13:16:52.564906 18351 leader_election.cc:343] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.565762 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:52.566560 18556 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.566913 18556 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.567307 18556 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.567442 18427 tablet_bootstrap.cc:492] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:52.568078 18427 ts_tablet_manager.cc:1403] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.170s	user 0.011s	sys 0.010s
I20260709 13:16:52.571569 18427 raft_consensus.cc:359] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.572736 18428 tablet_bootstrap.cc:654] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.572430 18427 raft_consensus.cc:385] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.575436 18427 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.576541 18426 tablet_bootstrap.cc:492] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:52.576232 18427 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.577070 18426 ts_tablet_manager.cc:1403] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.087s	user 0.030s	sys 0.003s
I20260709 13:16:52.578702 18427 ts_tablet_manager.cc:1434] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:16:52.581851 18427 tablet_bootstrap.cc:492] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:52.583012 18556 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.585731 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:52.586359 18236 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.580003 18312 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:52.579891 18426 raft_consensus.cc:359] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.588379 18426 raft_consensus.cc:385] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.588276 18556 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:52.588814 18426 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.588948 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:52.589722 18426 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.590772 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:16:52.591991 18426 ts_tablet_manager.cc:1434] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:16:52.592983 18426 tablet_bootstrap.cc:492] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:52.593168 18504 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.593669 18504 raft_consensus.cc:697] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:16:52.594540 18504 consensus_queue.cc:237] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:52.598846 18351 leader_election.cc:343] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.603649 18426 tablet_bootstrap.cc:654] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.603763 18427 tablet_bootstrap.cc:654] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.607489 18428 tablet_bootstrap.cc:492] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:52.608114 18428 ts_tablet_manager.cc:1403] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.009s
I20260709 13:16:52.611086 18428 raft_consensus.cc:359] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.611838 18428 raft_consensus.cc:385] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.612182 18428 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.613253 18428 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.611181 18236 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:52.616412 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:52.617903 18556 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.618423 18556 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:16:52.618983 18427 tablet_bootstrap.cc:492] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:52.619437 18427 ts_tablet_manager.cc:1403] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.000s
I20260709 13:16:52.619285 18556 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.617862 18428 ts_tablet_manager.cc:1434] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:16:52.629374 18428 tablet_bootstrap.cc:492] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:52.630743 18427 raft_consensus.cc:359] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.631476 18427 raft_consensus.cc:385] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.631827 18427 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.632575 18427 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.638744 18426 tablet_bootstrap.cc:492] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:52.639246 18426 ts_tablet_manager.cc:1403] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.008s
I20260709 13:16:52.641673 18428 tablet_bootstrap.cc:654] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.642377 18427 ts_tablet_manager.cc:1434] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.006s
I20260709 13:16:52.642783 18426 raft_consensus.cc:359] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.642444 18132 catalog_manager.cc:5697] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.643477 18426 raft_consensus.cc:385] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.643589 18427 tablet_bootstrap.cc:492] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:52.644243 18426 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.645012 18426 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.646919 18426 ts_tablet_manager.cc:1434] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:52.647722 18426 tablet_bootstrap.cc:492] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:52.652223 18426 tablet_bootstrap.cc:654] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.653774 18133 catalog_manager.cc:5697] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.657693 18427 tablet_bootstrap.cc:654] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.657212 18133 catalog_manager.cc:5697] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.668143 18135 catalog_manager.cc:5697] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.669821 18428 tablet_bootstrap.cc:492] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:52.670495 18428 ts_tablet_manager.cc:1403] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.010s
I20260709 13:16:52.671667 18558 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.672191 18558 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.674192 18428 raft_consensus.cc:359] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.674727 18428 raft_consensus.cc:385] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.674957 18428 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.675599 18428 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.676479 18427 tablet_bootstrap.cc:492] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:52.676434 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:52.677405 18427 ts_tablet_manager.cc:1403] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.010s
I20260709 13:16:52.677409 18384 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:52.679544 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:52.679593 18201 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:52.680588 18437 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.680944 18437 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.681149 18428 ts_tablet_manager.cc:1434] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:16:52.681490 18437 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.680962 18427 raft_consensus.cc:359] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.682145 18428 tablet_bootstrap.cc:492] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:52.682092 18427 raft_consensus.cc:385] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.682533 18427 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.683215 18427 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:52.683910 18202 leader_election.cc:343] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.686322 18427 ts_tablet_manager.cc:1434] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 13:16:52.687256 18427 tablet_bootstrap.cc:492] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:52.675223 18558 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:52.688901 18437 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.692266 18428 tablet_bootstrap.cc:654] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.692116 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:52.692613 18426 tablet_bootstrap.cc:492] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:52.693090 18426 ts_tablet_manager.cc:1403] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.003s
I20260709 13:16:52.693349 18427 tablet_bootstrap.cc:654] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:52.693665 18202 leader_election.cc:343] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.696328 18426 raft_consensus.cc:359] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.697093 18426 raft_consensus.cc:385] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.697355 18426 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.698285 18426 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.700598 18426 ts_tablet_manager.cc:1434] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:52.701539 18426 tablet_bootstrap.cc:492] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:52.702340 18427 tablet_bootstrap.cc:492] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:52.702840 18427 ts_tablet_manager.cc:1403] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:16:52.705435 18427 raft_consensus.cc:359] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.706238 18427 raft_consensus.cc:385] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.706579 18427 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.707770 18426 tablet_bootstrap.cc:654] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.707945 18427 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.710408 18427 ts_tablet_manager.cc:1434] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:52.711588 18427 tablet_bootstrap.cc:492] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:52.724148 18437 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:52.725330 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:52.725983 18384 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.736881 18427 tablet_bootstrap.cc:654] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.737843 18428 tablet_bootstrap.cc:492] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:52.738461 18428 ts_tablet_manager.cc:1403] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.005s
I20260709 13:16:52.741794 18426 tablet_bootstrap.cc:492] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:52.741698 18428 raft_consensus.cc:359] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.742311 18426 ts_tablet_manager.cc:1403] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.007s
I20260709 13:16:52.742396 18427 tablet_bootstrap.cc:492] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:52.743072 18384 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:52.743599 18427 ts_tablet_manager.cc:1403] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 13:16:52.744366 18201 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:52.745621 18426 raft_consensus.cc:359] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.745910 18437 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.745950 18518 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.746137 18427 raft_consensus.cc:359] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.746734 18437 raft_consensus.cc:697] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:52.747311 18427 raft_consensus.cc:385] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.747634 18427 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.746326 18426 raft_consensus.cc:385] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.748131 18426 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.747822 18437 consensus_queue.cc:237] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.748986 18426 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.748602 18427 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.742447 18428 raft_consensus.cc:385] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.750193 18428 raft_consensus.cc:740] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.750878 18428 consensus_queue.cc:260] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.751583 18426 ts_tablet_manager.cc:1434] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:16:52.752571 18426 tablet_bootstrap.cc:492] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:52.753372 18428 ts_tablet_manager.cc:1434] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 13:16:52.754580 18428 tablet_bootstrap.cc:492] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:52.751616 18427 ts_tablet_manager.cc:1434] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:16:52.757627 18427 tablet_bootstrap.cc:492] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:52.758010 18512 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.758814 18512 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.762182 18512 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:52.763207 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:16:52.767964 18277 leader_election.cc:343] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.767447 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:52.769019 18385 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:52.770670 18428 tablet_bootstrap.cc:654] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.770821 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:16:52.771744 18512 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.772176 18512 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.772502 18512 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.776947 18518 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.778635 18426 tablet_bootstrap.cc:654] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.794196 18427 tablet_bootstrap.cc:654] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.802810 18133 catalog_manager.cc:5697] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.822206 18514 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.822785 18514 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.824425 18449 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.824985 18514 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:52.826809 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:52.827445 18385 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:52.829066 18276 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:52.830154 18518 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.830637 18518 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.831106 18518 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.831041 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:52.837005 18236 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:52.837479 18512 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.840211 18512 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:52.840816 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:52.841634 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:52.853709 18385 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.844614 18426 tablet_bootstrap.cc:492] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:52.847388 18518 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.854812 18426 ts_tablet_manager.cc:1403] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.000s
W20260709 13:16:52.855835 18277 leader_election.cc:343] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.859899 18426 raft_consensus.cc:359] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.861155 18426 raft_consensus.cc:385] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.861567 18426 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.862643 18426 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.871528 18426 ts_tablet_manager.cc:1434] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:16:52.872434 18426 tablet_bootstrap.cc:492] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:52.872592 18428 tablet_bootstrap.cc:492] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:52.873127 18428 ts_tablet_manager.cc:1403] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.119s	user 0.021s	sys 0.014s
I20260709 13:16:52.877967 18427 tablet_bootstrap.cc:492] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:52.878378 18427 ts_tablet_manager.cc:1403] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.121s	user 0.036s	sys 0.024s
I20260709 13:16:52.871367 18437 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:16:52.885955 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:52.886561 18234 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.896384 18518 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:52.896996 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:52.898324 18234 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:52.901087 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:52.904067 18383 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.905267 18512 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.905758 18512 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:52.906582 18512 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.917117 18518 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.920594 18428 raft_consensus.cc:359] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.921257 18428 raft_consensus.cc:385] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.921511 18428 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.922128 18428 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.917783 18385 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:52.932437 18428 ts_tablet_manager.cc:1434] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:16:52.933487 18428 tablet_bootstrap.cc:492] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:52.937966 18518 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.938548 18518 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.940639 18518 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:52.941731 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:52.939704 18427 raft_consensus.cc:359] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.944926 18427 raft_consensus.cc:385] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.945231 18427 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.945902 18427 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.946883 18383 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:52.958338 18427 ts_tablet_manager.cc:1434] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.001s
I20260709 13:16:52.959458 18556 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.962648 18556 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.965404 18556 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:52.965332 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:52.966177 18234 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:52.967468 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:52.968492 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:52.970156 18556 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.970544 18556 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.970897 18556 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:52.978083 18351 leader_election.cc:343] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.985204 18426 tablet_bootstrap.cc:654] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:52.986037 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 77526.7us
I20260709 13:16:52.987471 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:16:52.987955 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:52.989537 18431 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.990079 18431 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.992173 18428 tablet_bootstrap.cc:654] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.992333 18587 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.992332 18431 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:52.993383 18587 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:52.994247 18587 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.995208 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:16:52.997918 18351 leader_election.cc:343] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.997484 18556 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.998591 18558 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.999117 18558 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:52.999840 18427 tablet_bootstrap.cc:492] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:53.000567 18556 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:53.001441 18558 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.002921 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:53.003715 18381 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:53.005671 18276 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:53.006397 18514 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.008742 18427 tablet_bootstrap.cc:654] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.009696 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:53.011315 18310 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.018015 18426 tablet_bootstrap.cc:492] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:53.018757 18426 ts_tablet_manager.cc:1403] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.146s	user 0.016s	sys 0.010s
I20260709 13:16:53.021391 18437 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.022012 18427 tablet_bootstrap.cc:492] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:53.021853 18437 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.022459 18427 ts_tablet_manager.cc:1403] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.007s
I20260709 13:16:53.022921 18426 raft_consensus.cc:359] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.023757 18437 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.024976 18427 raft_consensus.cc:359] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.025622 18427 raft_consensus.cc:385] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.023953 18426 raft_consensus.cc:385] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.026397 18426 raft_consensus.cc:740] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.027119 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:53.027868 18309 raft_consensus.cc:2393] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:16:53.027439 18426 consensus_queue.cc:260] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.025960 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:53.030210 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:53.030725 18135 catalog_manager.cc:5697] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.031201 18426 ts_tablet_manager.cc:1434] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:16:53.031272 18437 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.032897 18426 tablet_bootstrap.cc:492] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:53.033203 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:16:53.034457 18351 leader_election.cc:343] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.034770 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:53.034885 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:53.035354 18236 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.035712 18556 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.038935 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:53.039860 18201 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:53.025871 18427 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.041376 18555 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.041813 18427 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.042675 18312 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.068110 18555 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.069412 18428 tablet_bootstrap.cc:492] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:53.069913 18428 ts_tablet_manager.cc:1403] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.137s	user 0.035s	sys 0.027s
I20260709 13:16:53.072695 18428 raft_consensus.cc:359] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.073410 18428 raft_consensus.cc:385] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.073699 18428 raft_consensus.cc:740] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.073107 18555 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:53.072371 18236 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:53.074441 18428 consensus_queue.cc:260] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.076860 18437 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.076979 18428 ts_tablet_manager.cc:1434] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:16:53.077996 18428 tablet_bootstrap.cc:492] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:53.079609 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:53.080461 18556 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.080947 18556 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:16:53.081707 18556 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.084151 18428 tablet_bootstrap.cc:654] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.088891 18556 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.089526 18556 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.091079 18556 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:53.092918 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:16:53.094731 18351 leader_election.cc:343] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.096132 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:16:53.097782 18351 leader_election.cc:343] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.098304 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:53.099587 18556 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.110061 18312 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:53.111279 18426 tablet_bootstrap.cc:654] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.114748 18427 ts_tablet_manager.cc:1434] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.002s
I20260709 13:16:53.115901 18427 tablet_bootstrap.cc:492] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:53.123559 18427 tablet_bootstrap.cc:654] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.124781 18426 tablet_bootstrap.cc:492] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:53.123984 18131 catalog_manager.cc:5697] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.125303 18426 ts_tablet_manager.cc:1403] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.012s
I20260709 13:16:53.128221 18426 raft_consensus.cc:359] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.128971 18426 raft_consensus.cc:385] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.129240 18426 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.129889 18426 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.131978 18426 ts_tablet_manager.cc:1434] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:53.132129 18428 tablet_bootstrap.cc:492] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:53.132944 18428 ts_tablet_manager.cc:1403] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.055s	user 0.028s	sys 0.017s
I20260709 13:16:53.132963 18426 tablet_bootstrap.cc:492] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:53.138615 18428 raft_consensus.cc:359] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.139469 18428 raft_consensus.cc:385] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.139727 18428 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.140393 18428 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.142815 18428 ts_tablet_manager.cc:1434] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:16:53.143860 18428 tablet_bootstrap.cc:492] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:53.146648 18426 tablet_bootstrap.cc:654] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.150579 18587 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.151063 18587 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.152015 18428 tablet_bootstrap.cc:654] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.156380 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:53.157759 18514 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.158304 18512 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.159552 18512 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.161042 18310 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.162425 18512 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.163956 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:53.158803 18587 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.158833 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:53.167135 18236 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:16:53.168910 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:53.169237 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:53.170327 18384 raft_consensus.cc:2393] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:53.171231 18431 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.171850 18276 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:53.172076 18556 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.173424 18587 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.158375 18514 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.177582 18514 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.177906 18428 tablet_bootstrap.cc:492] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:53.178436 18428 ts_tablet_manager.cc:1403] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.012s
I20260709 13:16:53.178627 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:16:53.179961 18276 leader_election.cc:343] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.180832 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:53.181429 18428 raft_consensus.cc:359] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.182835 18428 raft_consensus.cc:385] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.183159 18428 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.183652 18587 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.183986 18428 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:53.185513 18277 leader_election.cc:343] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.186035 18277 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:53.186322 18428 ts_tablet_manager.cc:1434] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:53.187289 18428 tablet_bootstrap.cc:492] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:53.187296 18587 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.193146 18512 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.195598 18428 tablet_bootstrap.cc:654] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.196133 18132 catalog_manager.cc:5697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.200557 18431 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.206485 18427 tablet_bootstrap.cc:492] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:53.207088 18427 ts_tablet_manager.cc:1403] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.091s	user 0.008s	sys 0.016s
I20260709 13:16:53.209025 18428 tablet_bootstrap.cc:492] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:53.209591 18428 ts_tablet_manager.cc:1403] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:16:53.212355 18428 raft_consensus.cc:359] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.213160 18428 raft_consensus.cc:385] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.213431 18428 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.214308 18428 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.214753 18426 tablet_bootstrap.cc:492] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:53.217118 18428 ts_tablet_manager.cc:1434] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:16:53.220227 18428 tablet_bootstrap.cc:492] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:53.223533 18431 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.227039 18428 tablet_bootstrap.cc:654] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.215361 18426 ts_tablet_manager.cc:1403] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.007s
I20260709 13:16:53.229296 18427 raft_consensus.cc:359] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.230116 18427 raft_consensus.cc:385] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.231954 18426 raft_consensus.cc:359] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.242789 18427 raft_consensus.cc:740] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.249666 18427 consensus_queue.cc:260] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.251956 18427 ts_tablet_manager.cc:1434] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.000s
I20260709 13:16:53.248781 18428 tablet_bootstrap.cc:492] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:53.252962 18427 tablet_bootstrap.cc:492] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:53.253358 18428 ts_tablet_manager.cc:1403] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.010s
I20260709 13:16:53.256346 18428 raft_consensus.cc:359] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.257117 18428 raft_consensus.cc:385] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.257380 18428 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.258054 18428 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.260201 18428 ts_tablet_manager.cc:1434] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:53.261059 18428 tablet_bootstrap.cc:492] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:53.261148 18427 tablet_bootstrap.cc:654] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.258060 18426 raft_consensus.cc:385] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.264143 18426 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.264530 18437 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.265187 18437 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.264911 18426 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.268350 18428 tablet_bootstrap.cc:654] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.268556 18426 ts_tablet_manager.cc:1434] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.007s
I20260709 13:16:53.269505 18426 tablet_bootstrap.cc:492] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:53.275132 18437 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.275259 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:53.276224 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:53.281157 18384 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:53.278232 18426 tablet_bootstrap.cc:654] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:53.282949 18202 leader_election.cc:343] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.287820 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:53.292938 18437 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.293533 18437 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.294052 18437 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.301661 18555 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.302369 18555 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.302971 18427 tablet_bootstrap.cc:492] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:53.303503 18427 ts_tablet_manager.cc:1403] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.000s
I20260709 13:16:53.304616 18428 tablet_bootstrap.cc:492] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:53.305097 18428 ts_tablet_manager.cc:1403] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.044s	user 0.023s	sys 0.020s
I20260709 13:16:53.306126 18427 raft_consensus.cc:359] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.305019 18426 tablet_bootstrap.cc:492] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:53.306778 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:53.307101 18426 ts_tablet_manager.cc:1403] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.011s
I20260709 13:16:53.308260 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:53.308929 18310 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
W20260709 13:16:53.309209 18201 leader_election.cc:343] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.309501 18428 raft_consensus.cc:359] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.310191 18428 raft_consensus.cc:385] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.310014 18426 raft_consensus.cc:359] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.310535 18428 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.304464 18555 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.310824 18426 raft_consensus.cc:385] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.311154 18426 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.311344 18428 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.312034 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:53.311880 18426 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.313151 18558 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.313504 18558 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.306787 18427 raft_consensus.cc:385] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.313969 18558 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.314083 18427 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.314930 18427 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.322678 18427 ts_tablet_manager.cc:1434] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:16:53.323688 18427 tablet_bootstrap.cc:492] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:53.325074 18437 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.328080 18437 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.328894 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:53.329550 18310 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.329738 18426 ts_tablet_manager.cc:1434] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:16:53.330435 18428 ts_tablet_manager.cc:1434] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:16:53.331597 18428 tablet_bootstrap.cc:492] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:53.333741 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:53.334318 18381 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.338234 18427 tablet_bootstrap.cc:654] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.340167 18428 tablet_bootstrap.cc:654] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.342712 18310 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:53.343643 18558 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.344089 18202 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:53.345088 18437 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.345608 18437 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:53.346014 18428 tablet_bootstrap.cc:492] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:53.346479 18428 ts_tablet_manager.cc:1403] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.002s
I20260709 13:16:53.346427 18437 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.348897 18426 tablet_bootstrap.cc:492] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:53.349315 18428 raft_consensus.cc:359] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.350001 18428 raft_consensus.cc:385] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.350273 18428 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.349691 18427 tablet_bootstrap.cc:492] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:53.350907 18428 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.351971 18427 ts_tablet_manager.cc:1403] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 13:16:53.352595 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:53.353314 18310 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.351832 18381 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:53.358775 18426 tablet_bootstrap.cc:654] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.365453 18555 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:53.366256 18514 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.369213 18555 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.371337 18310 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:53.374256 18427 raft_consensus.cc:359] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.376300 18427 raft_consensus.cc:385] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.376715 18427 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.376565 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:53.375399 18558 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.380818 18428 ts_tablet_manager.cc:1434] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:16:53.388795 18427 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.391983 18428 tablet_bootstrap.cc:492] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:53.405030 18427 ts_tablet_manager.cc:1434] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:16:53.417500 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:53.405190 18558 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.420686 18558 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.431816 18513 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.395081 18555 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.448796 18587 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.472954 18587 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.481063 18427 tablet_bootstrap.cc:492] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:53.483038 18426 tablet_bootstrap.cc:492] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:53.484352 18426 ts_tablet_manager.cc:1403] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.136s	user 0.035s	sys 0.013s
I20260709 13:16:53.487558 18587 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.473107 18555 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.495119 18619 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.495698 18619 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.497467 18558 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.499594 18437 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:53.490317 18201 leader_election.cc:343] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.499759 18513 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:53.517194 18426 raft_consensus.cc:359] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.518345 18426 raft_consensus.cc:385] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.518792 18426 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.519771 18426 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.504904 18431 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.531613 18427 tablet_bootstrap.cc:654] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.533232 18426 ts_tablet_manager.cc:1434] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:16:53.536144 18426 tablet_bootstrap.cc:492] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
W20260709 13:16:53.504426 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 51271.3us
I20260709 13:16:53.510952 18555 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.542440 18556 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:53.535519 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 49514.5us
I20260709 13:16:53.522141 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:53.512125 18619 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.542353 18513 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.537374 18504 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.549077 18504 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.551302 18504 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:53.516623 18437 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.555670 18619 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.561473 18619 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.563668 18619 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.563748 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:53.564541 18309 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:53.566166 18437 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.535835 18431 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.544046 18556 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.571439 18556 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:53.572150 18431 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:53.572911 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:16:53.574101 18202 leader_election.cc:343] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.575073 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:53.575873 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:53.578980 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:53.592088 18202 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:53.593060 18431 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:53.593992 18614 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:16:53.593593 18431 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.596508 18558 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.596987 18558 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.597327 18558 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.613607 18131 catalog_manager.cc:5697] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:53.617352 18202 leader_election.cc:343] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.609922 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:53.618578 18383 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:53.629969 18556 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:53.632194 18431 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:53.634725 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:53.635174 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:53.647794 18234 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:53.637651 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:53.648989 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:53.637820 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:53.638664 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:53.651779 18384 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:53.635618 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:53.651743 18381 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
W20260709 13:16:53.671919 18202 leader_election.cc:343] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.656423 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:53.699501 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:53.700397 18381 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:53.705999 18558 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.707568 18233 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:16:53.711611 18351 leader_election.cc:343] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:53.714785 18202 leader_election.cc:343] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.717444 18427 tablet_bootstrap.cc:492] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:53.717813 18427 ts_tablet_manager.cc:1403] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.237s	user 0.033s	sys 0.029s
I20260709 13:16:53.722962 18558 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.725958 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:16:53.720333 18201 leader_election.cc:343] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.727566 18201 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:53.726136 18620 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:53.728171 18512 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.729507 18512 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.729956 18512 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.733426 18428 tablet_bootstrap.cc:654] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.734581 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:53.734970 18431 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.734834 18427 raft_consensus.cc:359] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.735407 18310 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:53.735961 18427 raft_consensus.cc:385] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.736295 18427 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.737102 18427 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.739374 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:53.739629 18427 ts_tablet_manager.cc:1434] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:16:53.740579 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:53.740965 18427 tablet_bootstrap.cc:492] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:53.735478 18431 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.729432 18201 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:53.744894 18431 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:16:53.744920 18201 leader_election.cc:343] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.747716 18622 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.748086 18622 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.748458 18622 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.747975 18201 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:53.750001 18437 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.750186 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:53.750422 18201 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:53.751173 18437 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.751562 18437 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.751904 18437 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.733856 18513 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.754022 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:53.757889 18381 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.758376 18426 tablet_bootstrap.cc:654] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.759182 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:53.789271 18623 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.789839 18623 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.790256 18623 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.798221 18620 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.802457 18620 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.807039 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:53.808219 18622 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.809370 18233 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:53.821604 18427 tablet_bootstrap.cc:654] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:53.834844 18183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:53.835619 18622 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.838557 18428 tablet_bootstrap.cc:492] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:53.839087 18428 ts_tablet_manager.cc:1403] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.447s	user 0.017s	sys 0.017s
I20260709 13:16:53.840024 18426 tablet_bootstrap.cc:492] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:53.840425 18426 ts_tablet_manager.cc:1403] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.306s	user 0.029s	sys 0.027s
I20260709 13:16:53.831306 18437 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:53.839391 18351 leader_election.cc:343] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.833032 18512 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.841981 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:53.843554 18384 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.851112 18623 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.853572 18312 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:53.862679 18512 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.864913 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:53.867954 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:53.869351 18437 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:53.870635 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:53.872117 18383 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:16:53.888969 18428 raft_consensus.cc:359] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.889664 18428 raft_consensus.cc:385] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.889956 18428 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.892409 18428 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.898202 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:16:53.899442 18351 leader_election.cc:343] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.901198 18504 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.902324 18623 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:53.904824 18384 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:53.905730 18428 ts_tablet_manager.cc:1434] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.066s	user 0.011s	sys 0.000s
I20260709 13:16:53.910305 18428 tablet_bootstrap.cc:492] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:53.910169 18201 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:53.911441 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:53.906394 18426 raft_consensus.cc:359] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.908133 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:53.908658 18427 tablet_bootstrap.cc:492] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:53.909130 18431 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.912237 18426 raft_consensus.cc:385] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.912802 18427 ts_tablet_manager.cc:1403] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.172s	user 0.008s	sys 0.011s
I20260709 13:16:53.913540 18426 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.914542 18622 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.920222 18622 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:53.921425 18426 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.892650 18381 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:53.924492 18426 ts_tablet_manager.cc:1434] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.002s
I20260709 13:16:53.925251 18426 tablet_bootstrap.cc:492] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:53.930217 18427 raft_consensus.cc:359] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.932626 18427 raft_consensus.cc:385] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.932915 18427 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.933599 18427 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.921072 18622 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.937670 18437 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.943292 18201 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:53.943313 18427 ts_tablet_manager.cc:1434] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 13:16:53.948035 18427 tablet_bootstrap.cc:492] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:53.947572 18437 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:16:53.952718 18202 leader_election.cc:343] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.953191 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:53.953680 18437 raft_consensus.cc:697] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:53.955272 18558 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:16:53.955394 18202 leader_election.cc:343] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.956236 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:53.956619 18437 consensus_queue.cc:237] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.959159 18512 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.959769 18558 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.960212 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:53.959707 18512 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:53.968214 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:53.968852 18383 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:53.970086 18276 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:53.970911 18514 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.971321 18514 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.971644 18514 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.972000 18277 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:16:53.954015 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 53643.7us
I20260709 13:16:53.977018 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:53.977773 18504 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.978040 18587 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.981248 18428 tablet_bootstrap.cc:654] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.970949 18512 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.007210 18504 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:54.010977 18426 tablet_bootstrap.cc:654] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.021341 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:54.033797 18622 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.000844 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:54.026654 18427 tablet_bootstrap.cc:654] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.035678 18622 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:54.041687 18277 leader_election.cc:343] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.042891 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:54.043830 18384 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:54.045138 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:54.018292 18131 catalog_manager.cc:5697] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.047179 18201 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:54.047057 18131 catalog_manager.cc:5697] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.048264 18618 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.048672 18618 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.049021 18618 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.049765 18428 tablet_bootstrap.cc:492] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:54.050220 18428 ts_tablet_manager.cc:1403] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.140s	user 0.002s	sys 0.018s
I20260709 13:16:54.051406 18622 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.007678 18514 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.053552 18514 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.054448 18504 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:54.055400 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:54.056030 18384 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:54.055428 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 57372.9us
I20260709 13:16:54.057507 18618 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.064285 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:16:54.058610 18351 leader_election.cc:343] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.065850 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:54.071853 18428 raft_consensus.cc:359] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.072572 18504 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:54.070313 18202 leader_election.cc:343] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.073743 18427 tablet_bootstrap.cc:492] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:54.074244 18427 ts_tablet_manager.cc:1403] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.000s
I20260709 13:16:54.072717 18428 raft_consensus.cc:385] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:16:54.076493 18277 leader_election.cc:343] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.076668 18428 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.078722 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:54.077472 18428 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.077836 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:54.081465 18428 ts_tablet_manager.cc:1434] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.006s
I20260709 13:16:54.079527 18381 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.082832 18428 tablet_bootstrap.cc:492] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:54.083071 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:54.083848 18234 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:54.089468 18381 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:54.090090 18618 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.090977 18437 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.093304 18426 tablet_bootstrap.cc:492] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:54.093839 18426 ts_tablet_manager.cc:1403] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.169s	user 0.026s	sys 0.028s
I20260709 13:16:54.095386 18201 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:54.096318 18437 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:54.096825 18437 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:54.097078 18426 raft_consensus.cc:359] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.097853 18426 raft_consensus.cc:385] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.098104 18426 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
W20260709 13:16:54.098968 18202 leader_election.cc:343] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.098747 18426 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.101044 18426 ts_tablet_manager.cc:1434] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:54.099996 18437 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.070284 18384 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:54.105275 18276 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:16:54.106455 18514 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:54.107187 18426 tablet_bootstrap.cc:492] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:54.107124 18514 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:54.077096 18427 raft_consensus.cc:359] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.107972 18427 raft_consensus.cc:385] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.108265 18427 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.108951 18427 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.111259 18514 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.114523 18622 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.115648 18428 tablet_bootstrap.cc:654] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.119942 18426 tablet_bootstrap.cc:654] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.139967 18427 ts_tablet_manager.cc:1434] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:16:54.141369 18427 tablet_bootstrap.cc:492] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:54.134626 18635 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:54.172135 18644 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:16:54.162926 18504 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.182701 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:54.184639 18504 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.187163 18504 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:54.169546 18635 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.203424 18635 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:54.193249 18514 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.211232 18514 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.213310 18514 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:16:54.215811 18351 leader_election.cc:343] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.218535 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:54.218623 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:54.219208 18312 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
W20260709 13:16:54.220314 18276 leader_election.cc:343] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.221202 18427 tablet_bootstrap.cc:654] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.222119 18426 tablet_bootstrap.cc:492] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:54.222610 18426 ts_tablet_manager.cc:1403] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.116s	user 0.010s	sys 0.018s
I20260709 13:16:54.223640 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:54.224311 18236 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:54.216223 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:54.225386 18623 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:54.228820 18428 tablet_bootstrap.cc:492] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:54.229305 18428 ts_tablet_manager.cc:1403] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.147s	user 0.010s	sys 0.010s
I20260709 13:16:54.227778 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:54.230783 18234 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:54.231572 18428 raft_consensus.cc:359] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.232409 18428 raft_consensus.cc:385] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.232738 18428 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.232028 18426 raft_consensus.cc:359] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.233383 18428 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.233997 18426 raft_consensus.cc:385] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.234438 18426 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.236284 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:54.236259 18426 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.242377 18426 ts_tablet_manager.cc:1434] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:16:54.243287 18426 tablet_bootstrap.cc:492] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:54.245478 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:54.247412 18133 catalog_manager.cc:5697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.249985 18428 ts_tablet_manager.cc:1434] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 13:16:54.251231 18428 tablet_bootstrap.cc:492] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
W20260709 13:16:54.244283 18277 leader_election.cc:343] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.261147 18277 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:54.266521 18587 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:54.267146 18587 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.267601 18587 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.269601 18587 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.240645 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:54.272172 18556 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.272550 18556 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.272890 18556 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.272953 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:54.273602 18236 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:54.274745 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:54.275765 18514 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.276099 18514 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.276415 18514 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.281472 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:54.281986 18384 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:54.283422 18427 tablet_bootstrap.cc:492] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:54.283855 18427 ts_tablet_manager.cc:1403] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.143s	user 0.026s	sys 0.014s
W20260709 13:16:54.280680 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 44788.9us
W20260709 13:16:54.287515 18351 leader_election.cc:343] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.292402 18428 tablet_bootstrap.cc:654] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.293023 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:54.292011 18556 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.294821 18131 catalog_manager.cc:5697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.298887 18426 tablet_bootstrap.cc:654] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.296363 18131 catalog_manager.cc:5697] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.300902 18431 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.301673 18431 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.302136 18431 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.305385 18514 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.310532 18514 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.308537 18427 raft_consensus.cc:359] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.312682 18427 raft_consensus.cc:385] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.311124 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:54.313076 18427 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.313038 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:54.313215 18236 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.314152 18384 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.314390 18427 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.316712 18427 ts_tablet_manager.cc:1434] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:16:54.317781 18427 tablet_bootstrap.cc:492] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:54.318559 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:54.319171 18234 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.307144 18556 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:54.326665 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:54.327327 18310 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.329298 18431 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.330066 18427 tablet_bootstrap.cc:654] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.330955 18236 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:54.332299 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:54.333559 18587 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:54.334132 18587 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:54.335638 18587 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.340855 18384 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:54.343040 18427 tablet_bootstrap.cc:492] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:54.343503 18427 ts_tablet_manager.cc:1403] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.003s
I20260709 13:16:54.345865 18427 raft_consensus.cc:359] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.346544 18427 raft_consensus.cc:385] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.346827 18427 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.347709 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:54.346899 18234 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:54.349298 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:16:54.350198 18351 leader_election.cc:343] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.351373 18310 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:54.350199 18312 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.352890 18556 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:54.353096 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:54.353648 18556 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:16:54.354051 18236 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.354537 18556 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.355132 18427 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.357162 18427 ts_tablet_manager.cc:1434] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:16:54.358058 18427 tablet_bootstrap.cc:492] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:54.346256 18431 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:54.361964 18618 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:54.363732 18427 tablet_bootstrap.cc:654] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.364207 18236 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:54.365568 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:54.366243 18431 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:54.366935 18431 raft_consensus.cc:697] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:16:54.368064 18431 consensus_queue.cc:237] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.368626 18428 tablet_bootstrap.cc:492] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:54.375756 18618 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.376303 18618 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.379032 18618 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.381243 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:54.382050 18381 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:54.384672 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:54.386152 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:54.386309 18513 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.387333 18558 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.389544 18427 tablet_bootstrap.cc:492] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:54.389977 18427 ts_tablet_manager.cc:1403] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.004s
I20260709 13:16:54.395006 18427 raft_consensus.cc:359] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.395622 18427 raft_consensus.cc:385] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.395664 18558 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:54.395954 18427 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.396693 18427 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.398674 18427 ts_tablet_manager.cc:1434] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:16:54.399518 18427 tablet_bootstrap.cc:492] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:54.402426 18426 tablet_bootstrap.cc:492] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:54.401367 18131 catalog_manager.cc:5697] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:54.402869 18426 ts_tablet_manager.cc:1403] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.160s	user 0.008s	sys 0.035s
I20260709 13:16:54.403975 18428 ts_tablet_manager.cc:1403] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.153s	user 0.011s	sys 0.013s
I20260709 13:16:54.405390 18426 raft_consensus.cc:359] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.406054 18426 raft_consensus.cc:385] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.406314 18426 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.406852 18428 raft_consensus.cc:359] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.407176 18426 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.407850 18428 raft_consensus.cc:385] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.408169 18428 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.410303 18135 catalog_manager.cc:5697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.411136 18426 ts_tablet_manager.cc:1434] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:16:54.412895 18426 tablet_bootstrap.cc:492] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:54.415992 18428 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.418067 18428 ts_tablet_manager.cc:1434] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:16:54.418349 18426 tablet_bootstrap.cc:654] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.418946 18428 tablet_bootstrap.cc:492] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:54.425326 18428 tablet_bootstrap.cc:654] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.425344 18427 tablet_bootstrap.cc:654] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.425354 18133 catalog_manager.cc:5697] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:54.431155 18427 tablet_bootstrap.cc:492] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:54.431596 18427 ts_tablet_manager.cc:1403] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 13:16:54.432498 18428 tablet_bootstrap.cc:492] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:54.433555 18428 ts_tablet_manager.cc:1403] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:16:54.434070 18427 raft_consensus.cc:359] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.434738 18427 raft_consensus.cc:385] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.435009 18427 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.435621 18427 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.436560 18513 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.437333 18428 raft_consensus.cc:359] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.438007 18428 raft_consensus.cc:385] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.438278 18428 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.440780 18427 ts_tablet_manager.cc:1434] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:54.441700 18427 tablet_bootstrap.cc:492] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:54.451956 18426 tablet_bootstrap.cc:492] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:54.452404 18426 ts_tablet_manager.cc:1403] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.003s
I20260709 13:16:54.445277 18428 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.454945 18426 raft_consensus.cc:359] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.460464 18426 raft_consensus.cc:385] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.460742 18426 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.461380 18426 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.463263 18426 ts_tablet_manager.cc:1434] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
I20260709 13:16:54.464603 18427 tablet_bootstrap.cc:654] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.467265 18426 tablet_bootstrap.cc:492] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:54.468711 18618 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.456411 18428 ts_tablet_manager.cc:1434] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:16:54.472761 18428 tablet_bootstrap.cc:492] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:54.472898 18426 tablet_bootstrap.cc:654] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.477578 18427 tablet_bootstrap.cc:492] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:54.478016 18427 ts_tablet_manager.cc:1403] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.005s
I20260709 13:16:54.480635 18427 raft_consensus.cc:359] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.481281 18427 raft_consensus.cc:385] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.481513 18427 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.482543 18428 tablet_bootstrap.cc:654] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.482260 18427 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.484372 18427 ts_tablet_manager.cc:1434] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:54.485199 18427 tablet_bootstrap.cc:492] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:54.498749 18427 tablet_bootstrap.cc:654] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.508806 18428 tablet_bootstrap.cc:492] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:54.509325 18428 ts_tablet_manager.cc:1403] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.002s
I20260709 13:16:54.512055 18428 raft_consensus.cc:359] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.512809 18428 raft_consensus.cc:385] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.512702 18514 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:54.513274 18428 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.514020 18428 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.516016 18428 ts_tablet_manager.cc:1434] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:54.517354 18428 tablet_bootstrap.cc:492] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:54.518591 18426 tablet_bootstrap.cc:492] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:54.519058 18426 ts_tablet_manager.cc:1403] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.003s
I20260709 13:16:54.522540 18427 tablet_bootstrap.cc:492] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:54.522449 18426 raft_consensus.cc:359] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.523142 18427 ts_tablet_manager.cc:1403] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.000s
I20260709 13:16:54.523339 18426 raft_consensus.cc:385] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.523535 18428 tablet_bootstrap.cc:654] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.523914 18426 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.523965 18514 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.524777 18514 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.526880 18427 raft_consensus.cc:359] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.527663 18427 raft_consensus.cc:385] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.528298 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:54.527958 18427 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.529592 18236 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:54.530471 18427 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.533583 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:54.534461 18384 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:16:54.535346 18428 tablet_bootstrap.cc:492] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:54.532823 18427 ts_tablet_manager.cc:1434] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:54.535807 18428 ts_tablet_manager.cc:1403] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.011s
I20260709 13:16:54.535770 18276 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:54.536767 18427 tablet_bootstrap.cc:492] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:54.536922 18587 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.538779 18428 raft_consensus.cc:359] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.539479 18428 raft_consensus.cc:385] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.539745 18428 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.540429 18428 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.542500 18428 ts_tablet_manager.cc:1434] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:54.543462 18428 tablet_bootstrap.cc:492] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:54.552655 18514 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.553943 18426 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.554437 18513 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.555051 18513 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.557201 18428 tablet_bootstrap.cc:654] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.557785 18310 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.559691 18513 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.556300 18426 ts_tablet_manager.cc:1434] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.005s
I20260709 13:16:54.561004 18426 tablet_bootstrap.cc:492] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:54.562868 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:54.563555 18384 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:54.565084 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:54.567054 18558 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.567550 18558 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.568073 18558 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.569447 18426 tablet_bootstrap.cc:654] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.579061 18427 tablet_bootstrap.cc:654] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.584877 18514 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.585500 18514 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.588016 18514 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.589752 18618 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.590381 18618 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.592034 18426 tablet_bootstrap.cc:492] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:54.592473 18426 ts_tablet_manager.cc:1403] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.007s
I20260709 13:16:54.593503 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:54.594341 18381 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:54.595381 18618 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.595583 18201 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:54.596481 18618 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.596356 18426 raft_consensus.cc:359] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.596979 18618 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.597093 18426 raft_consensus.cc:385] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.597368 18618 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.597472 18426 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.598270 18426 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.599316 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:54.600248 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:54.601136 18312 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:54.605436 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:54.606237 18305 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:54.606712 18618 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.600298 18426 ts_tablet_manager.cc:1434] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:16:54.608866 18426 tablet_bootstrap.cc:492] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:54.607662 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:54.611308 18236 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:16:54.611328 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:54.612210 18381 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.614467 18426 tablet_bootstrap.cc:654] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.614374 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:54.615062 18305 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.619326 18587 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:54.619495 18558 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.619757 18381 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:54.620333 18617 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.620887 18617 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.621675 18201 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:54.622594 18513 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:54.623112 18513 raft_consensus.cc:697] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:54.624017 18513 consensus_queue.cc:237] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.624874 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:54.626422 18558 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.627647 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:54.628234 18384 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.628350 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:54.629240 18383 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:54.631382 18201 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:54.632074 18618 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.632453 18617 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.637084 18512 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.638407 18384 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:54.643744 18427 tablet_bootstrap.cc:492] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:54.642083 18428 tablet_bootstrap.cc:492] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:54.645144 18427 ts_tablet_manager.cc:1403] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.000s
I20260709 13:16:54.638954 18622 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:16:54.645239 18428 ts_tablet_manager.cc:1403] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.102s	user 0.030s	sys 0.011s
I20260709 13:16:54.647794 18131 catalog_manager.cc:5697] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.650864 18427 raft_consensus.cc:359] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.651569 18427 raft_consensus.cc:385] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.651846 18427 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.638726 18513 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.652882 18513 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.659750 18635 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.652460 18512 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:54.637595 18587 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:54.660144 18513 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.660364 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:54.654130 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:54.661229 18310 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.652536 18427 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.653767 18428 raft_consensus.cc:359] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.663296 18428 raft_consensus.cc:385] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.663574 18428 raft_consensus.cc:740] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.660442 18635 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.665784 18427 ts_tablet_manager.cc:1434] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:16:54.666935 18635 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:54.666740 18428 consensus_queue.cc:260] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.667774 18622 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:54.667721 18310 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:54.668351 18622 raft_consensus.cc:697] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:54.668942 18428 ts_tablet_manager.cc:1434] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:16:54.669839 18428 tablet_bootstrap.cc:492] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:54.669620 18622 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.675832 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:54.676102 18428 tablet_bootstrap.cc:654] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.676461 18312 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:54.677016 18427 tablet_bootstrap.cc:492] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:54.683328 18427 tablet_bootstrap.cc:654] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.685791 18305 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:54.688365 18426 tablet_bootstrap.cc:492] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:54.688835 18426 ts_tablet_manager.cc:1403] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.080s	user 0.032s	sys 0.010s
I20260709 13:16:54.689682 18513 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.692859 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:54.693528 18426 raft_consensus.cc:359] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.699221 18426 raft_consensus.cc:385] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.699518 18426 raft_consensus.cc:740] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.697109 18427 tablet_bootstrap.cc:492] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:54.698691 18558 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.701000 18426 consensus_queue.cc:260] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.703095 18426 ts_tablet_manager.cc:1434] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 13:16:54.703958 18426 tablet_bootstrap.cc:492] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:54.704803 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:54.700600 18427 ts_tablet_manager.cc:1403] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.009s
I20260709 13:16:54.708902 18427 raft_consensus.cc:359] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.709558 18427 raft_consensus.cc:385] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.709813 18427 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
W20260709 13:16:54.710330 18351 leader_election.cc:343] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.710973 18427 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.714846 18427 ts_tablet_manager.cc:1434] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:16:54.715758 18427 tablet_bootstrap.cc:492] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
W20260709 13:16:54.716185 18351 leader_election.cc:343] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.716671 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:54.717654 18431 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:54.717078 18513 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.721426 18427 tablet_bootstrap.cc:654] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.721726 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:54.722301 18310 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.725524 18426 tablet_bootstrap.cc:654] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.729941 18310 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:54.735746 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:54.736450 18381 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.747803 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:54.749246 18617 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:54.749883 18617 raft_consensus.cc:697] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:54.751014 18617 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.758302 18381 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:54.761129 18426 tablet_bootstrap.cc:492] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:54.761556 18426 ts_tablet_manager.cc:1403] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.008s
I20260709 13:16:54.773550 18426 raft_consensus.cc:359] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.774224 18426 raft_consensus.cc:385] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.774498 18426 raft_consensus.cc:740] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.775110 18426 consensus_queue.cc:260] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.777081 18426 ts_tablet_manager.cc:1434] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:16:54.778247 18426 tablet_bootstrap.cc:492] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:54.779999 18427 tablet_bootstrap.cc:492] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:54.780493 18427 ts_tablet_manager.cc:1403] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.008s
I20260709 13:16:54.783735 18426 tablet_bootstrap.cc:654] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.783692 18427 raft_consensus.cc:359] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.784618 18427 raft_consensus.cc:385] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.784971 18427 raft_consensus.cc:740] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.785691 18427 consensus_queue.cc:260] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.791791 18428 tablet_bootstrap.cc:492] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:54.792935 18428 ts_tablet_manager.cc:1403] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.123s	user 0.027s	sys 0.067s
I20260709 13:16:54.793567 18427 ts_tablet_manager.cc:1434] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:16:54.794570 18427 tablet_bootstrap.cc:492] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:54.794842 18426 tablet_bootstrap.cc:492] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:54.795243 18426 ts_tablet_manager.cc:1403] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 13:16:54.795727 18428 raft_consensus.cc:359] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.796451 18428 raft_consensus.cc:385] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.796777 18428 raft_consensus.cc:740] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.797559 18428 consensus_queue.cc:260] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.797770 18426 raft_consensus.cc:359] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.798554 18426 raft_consensus.cc:385] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.798858 18426 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.800086 18428 ts_tablet_manager.cc:1434] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:54.801085 18428 tablet_bootstrap.cc:492] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:54.801501 18427 tablet_bootstrap.cc:654] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.800928 18133 catalog_manager.cc:5697] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.802161 18587 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.802625 18587 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.806700 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:54.808108 18428 tablet_bootstrap.cc:654] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.811424 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:16:54.813591 18276 leader_election.cc:343] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:54.814879 18277 leader_election.cc:343] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:54.815424 18277 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:54.816416 18512 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:54.817639 18635 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.819752 18428 tablet_bootstrap.cc:492] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:54.820194 18428 ts_tablet_manager.cc:1403] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.011s
I20260709 13:16:54.822860 18428 raft_consensus.cc:359] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.823513 18428 raft_consensus.cc:385] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.823778 18428 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.824645 18428 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.827019 18428 ts_tablet_manager.cc:1434] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:54.827942 18428 tablet_bootstrap.cc:492] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:54.827636 18426 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.831167 18587 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.831408 18426 ts_tablet_manager.cc:1434] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:16:54.832770 18426 tablet_bootstrap.cc:492] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:54.835783 18428 tablet_bootstrap.cc:654] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.841958 18132 catalog_manager.cc:5697] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.855712 18427 tablet_bootstrap.cc:492] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:54.856163 18427 ts_tablet_manager.cc:1403] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.042s
I20260709 13:16:54.858712 18427 raft_consensus.cc:359] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.859388 18427 raft_consensus.cc:385] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.859656 18427 raft_consensus.cc:740] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.860460 18427 consensus_queue.cc:260] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.861971 18428 tablet_bootstrap.cc:492] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:54.862488 18428 ts_tablet_manager.cc:1403] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.004s
I20260709 13:16:54.862677 18427 ts_tablet_manager.cc:1434] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:16:54.863634 18427 tablet_bootstrap.cc:492] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:54.865002 18426 tablet_bootstrap.cc:654] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.865949 18428 raft_consensus.cc:359] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.866685 18428 raft_consensus.cc:385] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.866971 18428 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.867630 18428 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.869681 18427 tablet_bootstrap.cc:654] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.870060 18428 ts_tablet_manager.cc:1434] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 13:16:54.871001 18428 tablet_bootstrap.cc:492] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:54.877039 18428 tablet_bootstrap.cc:654] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.881130 18427 tablet_bootstrap.cc:492] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:54.881572 18427 ts_tablet_manager.cc:1403] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.005s
I20260709 13:16:54.883970 18635 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.888321 18428 tablet_bootstrap.cc:492] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:54.889019 18428 ts_tablet_manager.cc:1403] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:16:54.889919 18617 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.890600 18635 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.890431 18617 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.891057 18635 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.892652 18617 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.893002 18635 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:54.893355 18427 raft_consensus.cc:359] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.894089 18427 raft_consensus.cc:385] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.894351 18427 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.894675 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:54.895200 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:54.895308 18381 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:54.895836 18235 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:54.896469 18201 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:54.897260 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:54.897773 18427 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.898627 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:54.899222 18312 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:54.897316 18617 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.899870 18617 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.908396 18617 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.900058 18635 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.900064 18518 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.900182 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:54.911154 18518 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.913712 18518 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.915025 18304 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:54.899397 18427 ts_tablet_manager.cc:1434] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:16:54.918414 18427 tablet_bootstrap.cc:492] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:54.918905 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:54.919041 18617 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.919787 18635 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.920234 18635 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.921463 18426 tablet_bootstrap.cc:492] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:54.922017 18426 ts_tablet_manager.cc:1403] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.090s	user 0.005s	sys 0.008s
I20260709 13:16:54.925408 18426 raft_consensus.cc:359] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.926290 18426 raft_consensus.cc:385] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.926612 18426 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.927448 18426 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.929957 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:54.930678 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:54.932111 18234 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:54.932334 18617 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.934716 18427 tablet_bootstrap.cc:654] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.902014 18587 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 13:16:54.900861 18428 raft_consensus.cc:359] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.949064 18428 raft_consensus.cc:385] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.949376 18428 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.950057 18428 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.952134 18428 ts_tablet_manager.cc:1434] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 13:16:54.952479 18426 ts_tablet_manager.cc:1434] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:16:54.952989 18428 tablet_bootstrap.cc:492] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:54.953327 18426 tablet_bootstrap.cc:492] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:54.953542 18431 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.955308 18431 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:54.941751 18183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:54.943370 18617 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.957996 18617 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.960155 18622 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.960944 18428 tablet_bootstrap.cc:654] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.960680 18622 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.961041 18617 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.961275 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:54.961915 18383 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:54.962798 18622 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.964432 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:54.966090 18558 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.966446 18558 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.966774 18558 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.967305 18427 tablet_bootstrap.cc:492] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:54.967753 18427 ts_tablet_manager.cc:1403] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.007s
I20260709 13:16:54.969277 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:54.969987 18304 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.970553 18427 raft_consensus.cc:359] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.971253 18427 raft_consensus.cc:385] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:54.971514 18427 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:54.972198 18427 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.973379 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:54.973978 18620 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.974289 18383 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:54.974452 18620 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.975378 18427 ts_tablet_manager.cc:1434] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:16:54.975737 18201 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:54.976246 18427 tablet_bootstrap.cc:492] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:54.976737 18620 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:54.976975 18437 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.977356 18437 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.977631 18437 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.978704 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:54.979393 18384 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:54.980844 18276 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:54.982587 18427 tablet_bootstrap.cc:654] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:54.985572 18620 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:54.985685 18512 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:54.986116 18620 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.986582 18620 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:54.993479 18437 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:54.996811 18558 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.000355 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:55.000928 18384 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.004372 18304 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:54.995965 18620 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.008805 18620 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.008934 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:55.009749 18385 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:55.010273 18688 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:16:55.013082 18427 tablet_bootstrap.cc:492] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:55.013505 18427 ts_tablet_manager.cc:1403] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.004s
I20260709 13:16:55.016502 18427 raft_consensus.cc:359] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.017249 18427 raft_consensus.cc:385] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.017524 18427 raft_consensus.cc:740] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.018301 18427 consensus_queue.cc:260] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.022183 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:55.022887 18312 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:55.024129 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:55.024887 18312 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:55.027264 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:55.029110 18234 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:55.032632 18635 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.033970 18381 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:16:55.035079 18385 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:55.035967 18276 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:55.040051 18518 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.040664 18698 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.041205 18698 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.042289 18427 ts_tablet_manager.cc:1434] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:16:55.038619 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:55.040294 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:55.042814 18312 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.042989 18310 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:55.038476 18618 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.041985 18276 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:55.043396 18698 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:55.044595 18514 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.037582 18384 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:55.047617 18514 raft_consensus.cc:697] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:55.048446 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:55.048570 18514 consensus_queue.cc:237] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.049446 18617 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.045526 18437 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.054096 18427 tablet_bootstrap.cc:492] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:55.055529 18426 tablet_bootstrap.cc:654] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.059226 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:55.059862 18235 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:55.061949 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:55.050546 18312 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:55.052829 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:55.063032 18381 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:55.064550 18694 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.064958 18694 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.065343 18694 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.068562 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:55.069563 18237 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:55.070863 18618 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.071408 18618 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.072930 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:55.056628 18558 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.073513 18427 tablet_bootstrap.cc:654] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.058400 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:55.073580 18618 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.075656 18235 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:55.077178 18518 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.077258 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:55.077898 18381 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:55.077508 18694 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.077761 18518 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.080088 18518 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.081212 18635 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:55.081332 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:55.081977 18381 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:55.083035 18201 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:55.083180 18276 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:55.084364 18518 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.050922 18617 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:55.085034 18518 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.085173 18428 tablet_bootstrap.cc:492] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:55.085631 18518 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.085855 18428 ts_tablet_manager.cc:1403] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.133s	user 0.021s	sys 0.024s
I20260709 13:16:55.088877 18428 raft_consensus.cc:359] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.089695 18428 raft_consensus.cc:385] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.090008 18428 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.090698 18428 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.094599 18694 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:55.083593 18618 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.096267 18618 raft_consensus.cc:697] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:55.097246 18618 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.100220 18428 ts_tablet_manager.cc:1434] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:16:55.106344 18428 tablet_bootstrap.cc:492] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:55.085623 18617 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.114352 18622 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.114876 18622 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.115543 18622 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.118113 18514 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.118666 18514 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.120946 18514 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.122182 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:55.122804 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:55.123584 18384 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:16:55.122841 18236 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.126890 18428 tablet_bootstrap.cc:654] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.128295 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:55.131136 18513 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.131942 18513 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.132604 18236 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:55.136026 18558 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.143796 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:55.144754 18312 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:55.145576 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:55.146497 18635 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.146829 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:55.147333 18635 raft_consensus.cc:697] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:16:55.147779 18310 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:55.147800 18426 tablet_bootstrap.cc:492] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:55.148479 18426 ts_tablet_manager.cc:1403] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.195s	user 0.026s	sys 0.006s
I20260709 13:16:55.148281 18635 consensus_queue.cc:237] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.151587 18426 raft_consensus.cc:359] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.160550 18426 raft_consensus.cc:385] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.160895 18426 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.163151 18622 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.164125 18426 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.172749 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:55.176545 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:55.201686 18237 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:16:55.202688 18310 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.202839 18426 ts_tablet_manager.cc:1434] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 13:16:55.182192 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:55.205258 18426 tablet_bootstrap.cc:492] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:55.205451 18234 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:55.211742 18426 tablet_bootstrap.cc:654] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.215250 18131 catalog_manager.cc:5697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.190768 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:55.136705 18558 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.211783 18622 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.212774 18617 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.217971 18428 tablet_bootstrap.cc:492] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:55.218489 18428 ts_tablet_manager.cc:1403] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.117s	user 0.015s	sys 0.014s
I20260709 13:16:55.112319 18518 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.219466 18694 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.219960 18558 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.220777 18310 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:55.221697 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:55.222384 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:55.222680 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:55.223605 18312 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:55.225584 18384 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.227587 18427 tablet_bootstrap.cc:492] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:55.228154 18427 ts_tablet_manager.cc:1403] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.174s	user 0.022s	sys 0.019s
I20260709 13:16:55.224720 18518 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.233172 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:55.235523 18512 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.253001 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:55.254032 18234 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:55.256426 18426 tablet_bootstrap.cc:492] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:55.256973 18426 ts_tablet_manager.cc:1403] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.000s
I20260709 13:16:55.257884 18132 catalog_manager.cc:5697] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:55.265437 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:55.268502 18427 raft_consensus.cc:359] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.269811 18427 raft_consensus.cc:385] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.263546 18135 catalog_manager.cc:5697] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.270171 18427 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.259842 18426 raft_consensus.cc:359] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:55.278972 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 45886.1us
I20260709 13:16:55.279474 18426 raft_consensus.cc:385] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.279806 18426 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.281031 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:55.278182 18427 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.285828 18426 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.286978 18384 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:55.284566 18518 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.289248 18620 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.289815 18620 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.295073 18428 raft_consensus.cc:359] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.296258 18428 raft_consensus.cc:385] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.296692 18428 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.297663 18428 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.301066 18201 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:55.309314 18428 ts_tablet_manager.cc:1434] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.091s	user 0.017s	sys 0.001s
I20260709 13:16:55.307446 18622 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.311159 18427 ts_tablet_manager.cc:1434] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.002s
I20260709 13:16:55.311791 18428 tablet_bootstrap.cc:492] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:55.310815 18622 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:55.305846 18514 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.294466 18381 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:55.319686 18514 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.323926 18514 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.324129 18620 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.315698 18622 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.329954 18426 ts_tablet_manager.cc:1434] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.003s
I20260709 13:16:55.331231 18426 tablet_bootstrap.cc:492] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:55.337556 18426 tablet_bootstrap.cc:654] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.337863 18428 tablet_bootstrap.cc:654] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:55.385488 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 68751.2us
I20260709 13:16:55.396667 18514 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.399744 18514 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.320106 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:55.406689 18514 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.408069 18617 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.407876 18618 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:55.409325 18617 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.412431 18617 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.412720 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:55.415216 18622 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.418851 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:55.419688 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:55.423408 18715 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.424620 18428 tablet_bootstrap.cc:492] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:55.424358 18715 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.423408 18427 tablet_bootstrap.cc:492] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:55.415596 18622 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.434974 18622 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.445187 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:16:55.449934 18276 leader_election.cc:343] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.451192 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:55.452060 18235 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:55.448851 18306 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:55.456923 18428 ts_tablet_manager.cc:1403] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.145s	user 0.008s	sys 0.011s
I20260709 13:16:55.456890 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:55.462073 18437 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:16:55.454684 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:55.466706 18426 tablet_bootstrap.cc:492] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:55.467875 18426 ts_tablet_manager.cc:1403] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.137s	user 0.013s	sys 0.000s
I20260709 13:16:55.479158 18384 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:55.481803 18131 catalog_manager.cc:5697] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.484673 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:16:55.485466 18201 leader_election.cc:343] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.491530 18276 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:55.492089 18622 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.494788 18622 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:16:55.499477 18276 leader_election.cc:343] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.504266 18426 raft_consensus.cc:359] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.505826 18426 raft_consensus.cc:385] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.506223 18426 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.509045 18715 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.511979 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:55.518093 18587 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.518762 18587 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.507958 18514 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.519455 18587 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.526340 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:55.527071 18385 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.521674 18514 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.528569 18514 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.539294 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:55.543920 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:55.530349 18426 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.557269 18635 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:55.560367 18426 ts_tablet_manager.cc:1434] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.092s	user 0.011s	sys 0.000s
I20260709 13:16:55.562024 18426 tablet_bootstrap.cc:492] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:55.521202 18428 raft_consensus.cc:359] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.563851 18428 raft_consensus.cc:385] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.564193 18428 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.564908 18428 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.566640 18427 tablet_bootstrap.cc:654] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.566763 18428 ts_tablet_manager.cc:1434] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.000s
I20260709 13:16:55.552166 18385 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:55.575472 18428 tablet_bootstrap.cc:492] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
W20260709 13:16:55.573163 18201 leader_election.cc:343] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.585563 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:16:55.586884 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 113425us
W20260709 13:16:55.607447 18202 leader_election.cc:343] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.610029 18426 tablet_bootstrap.cc:654] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.616950 18622 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:55.631809 18514 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:55.640676 18277 leader_election.cc:343] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:55.641765 18277 leader_election.cc:343] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.642161 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:55.642822 18587 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.643759 18512 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.644974 18304 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:55.647710 18587 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.659735 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:55.666086 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:55.666473 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:55.669865 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:55.672874 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:55.673542 18234 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:55.674029 18202 leader_election.cc:343] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.676160 18622 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.676188 18715 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.676304 18437 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:55.677605 18276 leader_election.cc:343] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.689153 18635 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.689788 18635 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.690950 18587 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.692360 18635 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:55.693722 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:55.694732 18724 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.694571 18715 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.696780 18715 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.697043 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:55.697257 18622 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:16:55.698458 18202 leader_election.cc:343] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.698319 18622 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.701728 18428 tablet_bootstrap.cc:654] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.706378 18426 tablet_bootstrap.cc:492] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:55.706939 18426 ts_tablet_manager.cc:1403] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.003s
I20260709 13:16:55.719342 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:55.720381 18312 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:55.727100 18694 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:16:55.728259 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:55.729007 18381 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:55.709753 18512 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:16:55.731474 18201 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:55.732431 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:55.734681 18715 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:55.735131 18715 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.735493 18715 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.740664 18437 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.742187 18426 raft_consensus.cc:359] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.743116 18426 raft_consensus.cc:385] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.743429 18426 raft_consensus.cc:740] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.746245 18514 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:55.748700 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:55.749387 18382 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:55.752837 18437 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:55.753963 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:55.770989 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:55.776614 18437 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.778731 18715 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.780951 18237 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:55.786540 18427 tablet_bootstrap.cc:492] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:55.787051 18427 ts_tablet_manager.cc:1403] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.364s	user 0.014s	sys 0.015s
I20260709 13:16:55.771801 18132 catalog_manager.cc:5697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.788869 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:55.781654 18426 consensus_queue.cc:260] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.796012 18427 raft_consensus.cc:359] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.797015 18427 raft_consensus.cc:385] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.797329 18427 raft_consensus.cc:740] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.787767 18382 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:55.808760 18427 consensus_queue.cc:260] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.788875 18715 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:16:55.811697 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 97543.6us
I20260709 13:16:55.812235 18426 ts_tablet_manager.cc:1434] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.105s	user 0.002s	sys 0.009s
W20260709 13:16:55.813333 18351 leader_election.cc:343] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:55.814698 18351 leader_election.cc:343] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:55.815114 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:55.809629 18234 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:55.822490 18276 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:55.824934 18428 tablet_bootstrap.cc:492] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:55.826924 18723 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.828344 18428 ts_tablet_manager.cc:1403] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.253s	user 0.016s	sys 0.003s
I20260709 13:16:55.829972 18427 ts_tablet_manager.cc:1434] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.004s
I20260709 13:16:55.818904 18635 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.835355 18514 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.839875 18514 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:55.843191 18514 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.848665 18426 tablet_bootstrap.cc:492] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:55.858536 18427 tablet_bootstrap.cc:492] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:55.858258 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:55.866468 18724 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:16:55.873540 18715 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:55.884241 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:55.881814 18428 raft_consensus.cc:359] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.886013 18428 raft_consensus.cc:385] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:55.887662 18428 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:55.890614 18587 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:55.898399 18587 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:55.900461 18428 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.907636 18426 tablet_bootstrap.cc:654] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:55.910290 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:55.918452 18437 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:55.920038 18587 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:55.926098 18428 ts_tablet_manager.cc:1434] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.097s	user 0.010s	sys 0.002s
I20260709 13:16:55.956538 18428 tablet_bootstrap.cc:492] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:55.993347 18427 tablet_bootstrap.cc:654] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.014232 18132 catalog_manager.cc:5697] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.022279 18512 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.041226 18512 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:56.133996 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 108090us
I20260709 13:16:56.136071 18437 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.136541 18428 tablet_bootstrap.cc:654] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.136664 18437 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.133656 18715 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.146574 18437 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:56.172881 18697 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.151413 18715 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.173384 18697 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.174882 18715 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:56.182042 18426 tablet_bootstrap.cc:492] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:56.167529 18512 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:56.223642 18426 ts_tablet_manager.cc:1403] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.393s	user 0.026s	sys 0.017s
I20260709 13:16:56.233659 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:56.234678 18379 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:56.241809 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:56.243152 18587 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:56.243585 18587 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.243999 18587 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.241938 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:56.253186 18385 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:56.255875 18201 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:56.256476 18587 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.256827 18754 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:56.259166 18587 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:56.259374 18754 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.262351 18428 tablet_bootstrap.cc:492] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:56.262939 18428 ts_tablet_manager.cc:1403] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.307s	user 0.011s	sys 0.012s
I20260709 13:16:56.266826 18697 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:56.267091 18426 raft_consensus.cc:359] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.268774 18428 raft_consensus.cc:359] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.269547 18428 raft_consensus.cc:385] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.269802 18428 raft_consensus.cc:740] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.270606 18426 raft_consensus.cc:385] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.270476 18428 consensus_queue.cc:260] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.270949 18426 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.271646 18426 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.260332 18754 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.279920 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:56.280973 18383 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:56.282567 18201 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:56.283565 18513 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:56.283936 18513 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.284269 18513 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:56.285017 18183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:16:56.282619 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 291033us
I20260709 13:16:56.295044 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:56.295748 18383 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.296150 18426 ts_tablet_manager.cc:1434] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.001s
I20260709 13:16:56.297323 18426 tablet_bootstrap.cc:492] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:56.305701 18428 ts_tablet_manager.cc:1434] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:16:56.309648 18428 tablet_bootstrap.cc:492] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:56.313817 18427 tablet_bootstrap.cc:492] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:56.314503 18427 ts_tablet_manager.cc:1403] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.456s	user 0.022s	sys 0.005s
I20260709 13:16:56.329789 18383 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:56.331393 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:56.332058 18311 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:56.330282 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:56.342100 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:56.345878 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:56.346728 18306 raft_consensus.cc:2393] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:56.353132 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:56.354584 18620 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:56.355077 18620 raft_consensus.cc:697] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:56.355865 18620 consensus_queue.cc:237] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.361416 18427 raft_consensus.cc:359] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.362076 18427 raft_consensus.cc:385] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.361794 18426 tablet_bootstrap.cc:654] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.362426 18427 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.366919 18754 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.368116 18427 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.371824 18428 tablet_bootstrap.cc:654] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.372781 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:56.376557 18381 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:56.385031 18202 leader_election.cc:343] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.390220 18381 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:56.393208 18201 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:56.394032 18723 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:56.394317 18427 ts_tablet_manager.cc:1434] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.003s
I20260709 13:16:56.394476 18723 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:56.396905 18427 tablet_bootstrap.cc:492] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:56.397135 18622 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:16:56.373267 18754 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:56.394773 18699 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.414412 18759 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.396721 18723 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.419294 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:56.420715 18759 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.422353 18513 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.423321 18135 catalog_manager.cc:5697] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.415779 18699 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.427224 18135 catalog_manager.cc:5697] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.428843 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:56.430785 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:56.421350 18620 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:16:56.440949 18759 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:56.461499 18428 tablet_bootstrap.cc:492] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:56.461371 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:56.462086 18428 ts_tablet_manager.cc:1403] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.153s	user 0.008s	sys 0.023s
I20260709 13:16:56.462255 18310 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:56.457687 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:16:56.473377 18351 leader_election.cc:343] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.475793 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:56.476811 18697 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:56.479041 18428 raft_consensus.cc:359] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.479748 18428 raft_consensus.cc:385] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.480005 18428 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
W20260709 13:16:56.471709 18277 leader_election.cc:343] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.482498 18513 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:56.480675 18428 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.484078 18699 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:56.484907 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:56.485733 18233 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:16:56.485798 18277 leader_election.cc:343] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.487763 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:56.488404 18386 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.489343 18428 ts_tablet_manager.cc:1434] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 13:16:56.489540 18512 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.490576 18587 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.496698 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:56.497913 18378 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.500018 18428 tablet_bootstrap.cc:492] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:56.498893 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:16:56.509763 18201 leader_election.cc:343] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.514592 18694 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:56.515522 18512 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.516103 18386 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:16:56.541179 18426 tablet_bootstrap.cc:492] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:56.541864 18426 ts_tablet_manager.cc:1403] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.245s	user 0.016s	sys 0.017s
I20260709 13:16:56.548892 18426 raft_consensus.cc:359] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.549513 18426 raft_consensus.cc:385] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.549764 18426 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.550309 18426 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.555579 18135 catalog_manager.cc:5697] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.566918 18426 ts_tablet_manager.cc:1434] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:16:56.568033 18426 tablet_bootstrap.cc:492] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:56.574205 18201 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:56.588765 18131 catalog_manager.cc:5697] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.592689 18723 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:56.593344 18723 raft_consensus.cc:697] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:56.594391 18723 consensus_queue.cc:237] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.595546 18620 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.596072 18620 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.601366 18428 tablet_bootstrap.cc:654] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:56.603631 18202 leader_election.cc:343] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.606566 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:56.607227 18233 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:56.608208 18620 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:16:56.608398 18202 consensus_peers.cc:597] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:56.609467 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:56.612484 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:56.716794 18699 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.740810 18699 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:56.741299 18276 leader_election.cc:343] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.630481 18427 tablet_bootstrap.cc:654] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.743700 18699 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:56.744095 18131 catalog_manager.cc:5697] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 2, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:56.613379 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:56.751277 18426 tablet_bootstrap.cc:654] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.751858 18518 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:56.752913 18518 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.753265 18518 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.753695 18723 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:56.754099 18723 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.754421 18723 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:56.760850 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 147569us
I20260709 13:16:56.769891 18723 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.772058 18723 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:56.772948 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:56.774914 18518 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.776158 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:16:56.777705 18351 leader_election.cc:343] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:56.752389 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 143013us
I20260709 13:16:56.779286 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:56.778640 18518 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:56.780340 18428 tablet_bootstrap.cc:492] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:56.780855 18428 ts_tablet_manager.cc:1403] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.281s	user 0.015s	sys 0.011s
W20260709 13:16:56.781304 18276 leader_election.cc:343] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:56.783946 18201 leader_election.cc:343] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.784915 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:56.785540 18309 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.788934 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:56.789542 18233 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.789242 18428 raft_consensus.cc:359] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.789987 18428 raft_consensus.cc:385] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.793721 18309 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:16:56.793908 18428 raft_consensus.cc:740] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.796711 18233 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:56.796819 18428 consensus_queue.cc:260] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.799661 18426 tablet_bootstrap.cc:492] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:56.799736 18428 ts_tablet_manager.cc:1434] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:16:56.800263 18426 ts_tablet_manager.cc:1403] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.232s	user 0.009s	sys 0.003s
I20260709 13:16:56.801316 18428 tablet_bootstrap.cc:492] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:56.802958 18426 raft_consensus.cc:359] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.803584 18426 raft_consensus.cc:385] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.803819 18426 raft_consensus.cc:740] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.808638 18428 tablet_bootstrap.cc:654] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.810793 18427 tablet_bootstrap.cc:492] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:56.811252 18427 ts_tablet_manager.cc:1403] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.415s	user 0.008s	sys 0.009s
I20260709 13:16:56.817777 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:56.818655 18759 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.818890 18312 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.819211 18759 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.820422 18427 raft_consensus.cc:359] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.821354 18427 raft_consensus.cc:385] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.821508 18759 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:56.821635 18427 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.822410 18427 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.824028 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:56.824879 18426 consensus_queue.cc:260] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:56.825924 18201 leader_election.cc:343] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.826874 18426 ts_tablet_manager.cc:1434] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.001s
I20260709 13:16:56.824433 18427 ts_tablet_manager.cc:1434] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.000s
I20260709 13:16:56.829046 18427 tablet_bootstrap.cc:492] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:56.841584 18426 tablet_bootstrap.cc:492] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:56.841440 18759 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.851794 18518 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:56.854761 18312 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:56.855330 18427 tablet_bootstrap.cc:654] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.858808 18428 tablet_bootstrap.cc:492] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:56.866268 18428 ts_tablet_manager.cc:1403] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.065s	user 0.006s	sys 0.016s
I20260709 13:16:56.869625 18428 raft_consensus.cc:359] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.870352 18428 raft_consensus.cc:385] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.870796 18428 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:56.871734 18428 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.862825 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:56.874796 18428 ts_tablet_manager.cc:1434] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:56.876307 18428 tablet_bootstrap.cc:492] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:56.878342 18426 tablet_bootstrap.cc:654] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:56.885212 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:56.898857 18723 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.899742 18723 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.914191 18427 tablet_bootstrap.cc:492] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:56.914803 18427 ts_tablet_manager.cc:1403] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.000s
I20260709 13:16:56.920629 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:56.921422 18512 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:56.921854 18512 raft_consensus.cc:697] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:56.922618 18512 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.931125 18427 raft_consensus.cc:359] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.934232 18427 raft_consensus.cc:385] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.934626 18427 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
W20260709 13:16:56.933547 18351 leader_election.cc:343] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:56.933223 18202 leader_election.cc:343] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:56.935959 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:56.936321 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:56.937384 18427 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.939303 18734 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:56.939363 18233 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.938609 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:56.943005 18759 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:56.943715 18759 raft_consensus.cc:697] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:56.944918 18759 consensus_queue.cc:237] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.946183 18428 tablet_bootstrap.cc:654] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:56.950688 18202 consensus_peers.cc:597] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:56.941299 18754 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:56.956773 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:56.957409 18310 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:56.958443 18723 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:56.961769 18427 ts_tablet_manager.cc:1434] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.002s
I20260709 13:16:56.966600 18427 tablet_bootstrap.cc:492] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:56.967285 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:56.979362 18426 tablet_bootstrap.cc:492] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:56.979991 18426 ts_tablet_manager.cc:1403] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.139s	user 0.025s	sys 0.029s
I20260709 13:16:56.985649 18202 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:56.997655 18426 raft_consensus.cc:359] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:56.998379 18426 raft_consensus.cc:385] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:56.998633 18426 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.004483 18426 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.006738 18426 ts_tablet_manager.cc:1434] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:16:57.007706 18426 tablet_bootstrap.cc:492] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:57.000835 18135 catalog_manager.cc:5697] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.020815 18748 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.022483 18748 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.025648 18748 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:57.051988 18427 tablet_bootstrap.cc:654] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.057684 18754 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.091833 18428 tablet_bootstrap.cc:492] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:57.094416 18428 ts_tablet_manager.cc:1403] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.218s	user 0.024s	sys 0.025s
I20260709 13:16:57.109686 18428 raft_consensus.cc:359] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.110503 18428 raft_consensus.cc:385] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.110761 18428 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.111186 18734 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.111569 18426 tablet_bootstrap.cc:654] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.111689 18734 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.119629 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:57.125030 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:57.126564 18734 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:57.127959 18131 catalog_manager.cc:5697] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.122133 18428 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.132017 18428 ts_tablet_manager.cc:1434] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.003s
I20260709 13:16:57.133970 18426 tablet_bootstrap.cc:492] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:57.134418 18426 ts_tablet_manager.cc:1403] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.127s	user 0.009s	sys 0.002s
I20260709 13:16:57.136654 18754 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.136942 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:57.137612 18233 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:57.137205 18754 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.140065 18386 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:16:57.140358 18426 raft_consensus.cc:359] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.141084 18426 raft_consensus.cc:385] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.141330 18426 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.141994 18754 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:57.142812 18428 tablet_bootstrap.cc:492] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:57.142565 18754 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.146023 18426 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.147349 18427 tablet_bootstrap.cc:492] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:57.147775 18427 ts_tablet_manager.cc:1403] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.183s	user 0.006s	sys 0.011s
I20260709 13:16:57.148484 18426 ts_tablet_manager.cc:1434] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:16:57.150264 18427 raft_consensus.cc:359] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.150957 18427 raft_consensus.cc:385] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.150735 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:57.151240 18427 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.150283 18426 tablet_bootstrap.cc:492] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:57.153697 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:57.154450 18756 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.154780 18756 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.155113 18756 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.158089 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:57.159621 18699 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.160494 18426 tablet_bootstrap.cc:654] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.160128 18699 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.160724 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:57.163345 18699 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:57.163686 18587 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.165580 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:16:57.166431 18201 leader_election.cc:343] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.167196 18587 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:57.168443 18202 leader_election.cc:343] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.168885 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:57.170326 18760 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.170869 18756 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.172851 18427 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.174062 18310 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:57.175704 18427 ts_tablet_manager.cc:1434] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.000s
I20260709 13:16:57.181244 18756 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:57.181694 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:57.184844 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:57.185595 18427 tablet_bootstrap.cc:492] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:57.186896 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:57.187479 18304 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.185652 18310 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:57.196671 18428 tablet_bootstrap.cc:654] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.197361 18304 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:57.201896 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:57.202638 18236 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.204250 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:57.205143 18699 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.205823 18699 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:16:57.206916 18699 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.252221 18427 tablet_bootstrap.cc:654] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.263202 18428 tablet_bootstrap.cc:492] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:57.263721 18428 ts_tablet_manager.cc:1403] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.121s	user 0.009s	sys 0.005s
I20260709 13:16:57.267155 18304 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:16:57.266703 18428 raft_consensus.cc:359] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.270877 18428 raft_consensus.cc:385] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.271273 18428 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.272122 18428 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.275475 18428 ts_tablet_manager.cc:1434] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:16:57.275871 18622 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.277156 18428 tablet_bootstrap.cc:492] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:57.260308 18236 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:57.262398 18426 tablet_bootstrap.cc:492] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:57.290274 18426 ts_tablet_manager.cc:1403] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.140s	user 0.037s	sys 0.061s
I20260709 13:16:57.315210 18426 raft_consensus.cc:359] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.315909 18426 raft_consensus.cc:385] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.316172 18426 raft_consensus.cc:740] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.316803 18426 consensus_queue.cc:260] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.318295 18427 tablet_bootstrap.cc:492] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:57.318766 18426 ts_tablet_manager.cc:1434] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.000s
I20260709 13:16:57.320003 18426 tablet_bootstrap.cc:492] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:57.327816 18428 tablet_bootstrap.cc:654] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.329066 18351 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:57.330557 18699 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.331104 18426 tablet_bootstrap.cc:654] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.318842 18427 ts_tablet_manager.cc:1403] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.133s	user 0.024s	sys 0.020s
I20260709 13:16:57.336191 18427 raft_consensus.cc:359] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.341943 18310 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.353883 18428 tablet_bootstrap.cc:492] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:57.354349 18428 ts_tablet_manager.cc:1403] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.003s
I20260709 13:16:57.356899 18428 raft_consensus.cc:359] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.357543 18428 raft_consensus.cc:385] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.357813 18428 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.358390 18428 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.348558 18699 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.351998 18426 tablet_bootstrap.cc:492] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:57.360950 18426 ts_tablet_manager.cc:1403] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.007s
I20260709 13:16:57.361331 18427 raft_consensus.cc:385] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.361657 18427 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.362293 18427 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.363411 18426 raft_consensus.cc:359] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.364085 18426 raft_consensus.cc:385] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.364364 18426 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.364550 18427 ts_tablet_manager.cc:1434] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.000s
I20260709 13:16:57.365031 18426 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.367242 18426 ts_tablet_manager.cc:1434] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:57.360546 18428 ts_tablet_manager.cc:1434] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:57.368418 18428 tablet_bootstrap.cc:492] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
W20260709 13:16:57.371873 18276 consensus_peers.cc:597] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 -> Peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Couldn't send request to peer 8b4fbc44aa2649f0bcac5cd70f71951d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.374172 18428 tablet_bootstrap.cc:654] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.378919 18426 tablet_bootstrap.cc:492] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:57.384912 18426 tablet_bootstrap.cc:654] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.398741 18426 tablet_bootstrap.cc:492] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:57.399173 18426 ts_tablet_manager.cc:1403] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.004s
I20260709 13:16:57.402189 18754 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.403050 18428 tablet_bootstrap.cc:492] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:57.403494 18428 ts_tablet_manager.cc:1403] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.007s
I20260709 13:16:57.404734 18131 catalog_manager.cc:5697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:57.405999 18428 raft_consensus.cc:359] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.406598 18428 raft_consensus.cc:385] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.406855 18428 raft_consensus.cc:740] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.407665 18428 consensus_queue.cc:260] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.409664 18426 raft_consensus.cc:359] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.410295 18426 raft_consensus.cc:385] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.410552 18426 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.411163 18426 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.412868 18426 ts_tablet_manager.cc:1434] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:16:57.413930 18426 tablet_bootstrap.cc:492] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:57.414005 18427 tablet_bootstrap.cc:492] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:57.402670 18754 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.419929 18754 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:57.421200 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:57.422005 18385 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:57.422624 18428 ts_tablet_manager.cc:1434] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:16:57.423655 18428 tablet_bootstrap.cc:492] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:57.423645 18201 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:57.424974 18622 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.425549 18622 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.426069 18622 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.429679 18428 tablet_bootstrap.cc:654] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.420420 18426 tablet_bootstrap.cc:654] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:57.452297 18183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:57.464442 18734 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.465241 18734 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.557813 18756 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.558598 18756 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.602162 18427 tablet_bootstrap.cc:654] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.606957 18428 tablet_bootstrap.cc:492] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:57.607554 18428 ts_tablet_manager.cc:1403] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.184s	user 0.011s	sys 0.002s
I20260709 13:16:57.621832 18426 tablet_bootstrap.cc:492] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:57.635196 18426 ts_tablet_manager.cc:1403] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.222s	user 0.028s	sys 0.055s
I20260709 13:16:57.630330 18756 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:57.632938 18750 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.625917 18622 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.638047 18750 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.639647 18622 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:57.640123 18750 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:16:57.640285 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 185477us
I20260709 13:16:57.641990 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:57.642418 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:57.644558 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:57.644804 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:57.645149 18385 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:57.646131 18351 leader_election.cc:343] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.646514 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:57.622826 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:57.650357 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:57.650580 18428 raft_consensus.cc:359] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.644587 18723 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.651033 18382 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:57.625416 18734 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:57.651582 18723 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.652714 18276 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:57.653574 18513 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.653671 18723 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:57.654093 18513 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.654381 18587 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.654836 18587 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.655157 18587 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.655929 18513 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:57.654518 18428 raft_consensus.cc:385] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:16:57.657275 18202 leader_election.cc:343] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.657549 18428 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.658027 18760 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.658315 18428 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:57.659474 18202 leader_election.cc:343] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.660676 18428 ts_tablet_manager.cc:1434] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.010s
I20260709 13:16:57.662608 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:57.662781 18385 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:57.665107 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:16:57.649312 18351 leader_election.cc:343] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.668699 18587 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.664739 18426 raft_consensus.cc:359] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.670148 18426 raft_consensus.cc:385] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.670595 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:57.670238 18306 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:57.680152 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:16:57.702674 18202 leader_election.cc:343] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.702705 18382 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.682143 18587 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:16:57.684993 18351 leader_election.cc:343] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:57.704882 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:57.706082 18734 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:57.698213 18201 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:57.710716 18233 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:57.717036 18426 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.717854 18426 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.719385 18426 ts_tablet_manager.cc:1434] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.084s	user 0.023s	sys 0.007s
I20260709 13:16:57.673687 18428 tablet_bootstrap.cc:492] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:57.715034 18427 tablet_bootstrap.cc:492] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:57.716073 18382 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:57.722894 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:57.723426 18426 tablet_bootstrap.cc:492] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:57.716171 18513 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.724232 18513 raft_consensus.cc:697] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:57.725188 18513 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.727491 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:57.727996 18428 tablet_bootstrap.cc:654] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.723572 18386 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:57.728335 18383 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:57.733083 18760 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:57.734112 18276 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:57.735435 18426 tablet_bootstrap.cc:654] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:57.736914 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:57.737576 18233 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:57.738698 18427 ts_tablet_manager.cc:1403] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.325s	user 0.010s	sys 0.015s
I20260709 13:16:57.743991 18806 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:57.749483 18427 raft_consensus.cc:359] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.750175 18427 raft_consensus.cc:385] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:57.750454 18427 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:57.754172 18201 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:57.754971 18760 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.744503 18806 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:57.755378 18760 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.755723 18760 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.755973 18806 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.757704 18801 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.758219 18801 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.761337 18801 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:57.757053 18427 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.771090 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:57.773051 18734 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:57.773442 18734 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.773761 18734 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.776980 18131 catalog_manager.cc:5697] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.781212 18699 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:57.789899 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 89080.1us
I20260709 13:16:57.803546 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:57.804647 18236 raft_consensus.cc:2393] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:57.826699 18427 ts_tablet_manager.cc:1434] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.010s
W20260709 13:16:57.839540 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47634.6us
I20260709 13:16:57.839846 18427 tablet_bootstrap.cc:492] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:57.841758 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:57.830636 18750 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:16:57.865310 18233 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:57.866762 18428 tablet_bootstrap.cc:492] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:57.867424 18428 ts_tablet_manager.cc:1403] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.194s	user 0.012s	sys 0.015s
I20260709 13:16:57.876307 18426 tablet_bootstrap.cc:492] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:57.877081 18426 ts_tablet_manager.cc:1403] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.154s	user 0.019s	sys 0.040s
I20260709 13:16:57.884546 18734 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.892879 18734 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:16:57.932042 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 84064.7us
I20260709 13:16:57.933954 18202 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:57.885025 18760 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:57.998997 18760 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:57.943562 18750 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.001526 18750 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:58.062922 18338 tablet.cc:2406] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260709 13:16:58.081204 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 217290us
I20260709 13:16:58.113413 18750 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:58.117256 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:58.118417 18382 raft_consensus.cc:2393] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:16:58.121701 18427 tablet_bootstrap.cc:654] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.129006 18385 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.132393 18233 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:58.133814 18816 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:58.135215 18428 raft_consensus.cc:359] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.135993 18428 raft_consensus.cc:385] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.136272 18428 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.137089 18428 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.138789 18428 ts_tablet_manager.cc:1434] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.271s	user 0.009s	sys 0.001s
I20260709 13:16:58.112335 18426 raft_consensus.cc:359] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.149749 18426 raft_consensus.cc:385] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.150154 18426 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.159508 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:58.162540 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:58.162433 18426 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.150027 18760 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.189750 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:58.190603 18381 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.198518 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:58.200634 18235 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.211462 18426 ts_tablet_manager.cc:1434] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.334s	user 0.021s	sys 0.010s
I20260709 13:16:58.184604 18760 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.273393 18427 tablet_bootstrap.cc:492] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:58.273893 18427 ts_tablet_manager.cc:1403] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.444s	user 0.043s	sys 0.055s
I20260709 13:16:58.273980 18426 tablet_bootstrap.cc:492] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:58.276315 18427 raft_consensus.cc:359] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.280153 18427 raft_consensus.cc:385] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.280687 18427 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.282804 18427 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.312225 18381 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:58.316929 18427 ts_tablet_manager.cc:1434] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:16:58.334569 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:58.363183 18428 tablet_bootstrap.cc:492] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:58.486433 18818 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.487335 18818 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.498299 18815 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.498924 18815 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.499490 18818 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:58.513079 18815 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:58.518848 18426 tablet_bootstrap.cc:654] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:58.506078 18828 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:16:58.520112 18235 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:58.549141 18699 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.603883 18587 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:58.589108 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:16:58.613174 18202 leader_election.cc:343] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.588703 18699 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.629165 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:58.612844 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:58.633510 18699 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:16:58.641208 18277 leader_election.cc:343] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.645121 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:58.646845 18427 tablet_bootstrap.cc:492] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:58.651995 18822 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.658870 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:58.659910 18383 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:16:58.662647 18760 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:58.677803 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:16:58.681999 18814 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.682442 18814 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.682806 18814 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:58.684867 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:58.685838 18806 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:58.690275 18428 tablet_bootstrap.cc:654] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:58.696146 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 91328.9us
I20260709 13:16:58.696698 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:16:58.697105 18351 leader_election.cc:343] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.698108 18201 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:58.698542 18351 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:58.702055 18840 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:58.701037 18715 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.702553 18818 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:16:58.714118 18426 tablet_bootstrap.cc:492] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:58.714775 18426 ts_tablet_manager.cc:1403] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.441s	user 0.023s	sys 0.034s
I20260709 13:16:58.723657 18715 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:58.725268 18699 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:16:58.735757 18818 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.735572 18715 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.736243 18818 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.754983 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:58.760854 18427 tablet_bootstrap.cc:654] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:58.767885 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:58.756265 18822 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:58.773952 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 69688us
I20260709 13:16:58.768129 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:58.781046 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:58.783087 18426 raft_consensus.cc:359] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.783653 18426 raft_consensus.cc:385] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:58.783874 18426 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:58.773272 18818 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:58.789405 18426 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.792428 18841 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:58.794091 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:16:58.795717 18201 leader_election.cc:343] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:58.796217 18201 leader_election.cc:343] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:58.793396 18834 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:16:58.794749 18229 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:58.796908 18834 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.818656 18834 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:58.844641 18428 tablet_bootstrap.cc:492] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:58.846750 18428 ts_tablet_manager.cc:1403] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.482s	user 0.009s	sys 0.068s
I20260709 13:16:58.847254 18426 ts_tablet_manager.cc:1434] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.132s	user 0.005s	sys 0.007s
I20260709 13:16:58.848079 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:58.851718 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:58.821991 18841 raft_consensus.cc:697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:16:58.928750 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 70921.8us
I20260709 13:16:58.943444 18426 tablet_bootstrap.cc:492] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
W20260709 13:16:58.957906 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 97228.1us
I20260709 13:16:58.853892 18841 consensus_queue.cc:237] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:58.965548 18821 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:58.976224 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:58.998694 18821 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.959167 18814 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:59.024056 18845 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:16:59.018209 18821 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.069024 18428 raft_consensus.cc:359] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.070016 18428 raft_consensus.cc:385] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.070374 18428 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.071162 18428 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.082231 18427 tablet_bootstrap.cc:492] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:59.082723 18427 ts_tablet_manager.cc:1403] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.436s	user 0.015s	sys 0.012s
I20260709 13:16:59.085013 18426 tablet_bootstrap.cc:654] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.105679 18428 ts_tablet_manager.cc:1434] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.259s	user 0.008s	sys 0.000s
W20260709 13:16:59.145201 18183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:59.171540 18427 raft_consensus.cc:359] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.172425 18427 raft_consensus.cc:385] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.172756 18427 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.173357 18427 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.202975 18427 ts_tablet_manager.cc:1434] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.120s	user 0.006s	sys 0.001s
I20260709 13:16:59.152086 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:59.213925 18820 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.234284 18820 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.237073 18428 tablet_bootstrap.cc:492] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:59.248272 18825 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:16:59.248963 18825 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:59.261252 18202 leader_election.cc:343] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.261917 18202 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:16:59.263327 18351 leader_election.cc:343] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.272181 18832 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:59.276455 18202 leader_election.cc:343] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.276921 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:16:59.278054 18202 leader_election.cc:343] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.263202 18839 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.281894 18839 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.285049 18860 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.288074 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:59.322065 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:59.313562 18856 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:59.317070 18860 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:16:59.333135 18821 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.334045 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:59.336695 18235 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.337414 18382 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:16:59.341677 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:59.342013 18839 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:59.342861 18825 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:59.343786 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:59.344817 18309 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:16:59.347558 18820 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:59.348429 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:59.349164 18821 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:59.349931 18428 tablet_bootstrap.cc:654] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.350533 18381 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:59.350528 18235 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:59.357860 18428 tablet_bootstrap.cc:492] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:59.358608 18428 ts_tablet_manager.cc:1403] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.135s	user 0.015s	sys 0.000s
I20260709 13:16:59.366595 18428 raft_consensus.cc:359] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.367379 18428 raft_consensus.cc:385] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.367676 18428 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.368659 18428 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.371337 18428 ts_tablet_manager.cc:1434] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:16:59.375681 18817 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:59.381284 18426 tablet_bootstrap.cc:492] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:59.381851 18426 ts_tablet_manager.cc:1403] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.439s	user 0.025s	sys 0.011s
I20260709 13:16:59.384697 18426 raft_consensus.cc:359] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.385403 18426 raft_consensus.cc:385] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.386057 18201 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:59.385722 18426 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.387434 18201 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:59.388227 18513 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:59.388793 18817 raft_consensus.cc:2764] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:16:59.388257 18814 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:59.387974 18426 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.394302 18426 ts_tablet_manager.cc:1434] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:16:59.395790 18427 tablet_bootstrap.cc:492] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:59.400395 18201 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:59.401284 18513 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.403362 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:59.403076 18131 catalog_manager.cc:5697] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.404201 18378 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.411972 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:59.412307 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:59.412823 18232 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:59.420230 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:59.421343 18855 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.421849 18855 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.422333 18855 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.425685 18427 tablet_bootstrap.cc:654] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.427279 18426 tablet_bootstrap.cc:492] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:59.429677 18378 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:16:59.434136 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:59.434899 18814 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.437048 18814 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:16:59.436216 18513 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.441207 18814 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.445165 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:59.445775 18309 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.444664 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:59.451079 18426 tablet_bootstrap.cc:654] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.469569 18428 tablet_bootstrap.cc:492] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
W20260709 13:16:59.470422 18202 consensus_peers.cc:597] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:59.480134 18351 leader_election.cc:343] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.493721 18309 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:59.495648 18237 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:59.498731 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:16:59.499691 18839 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.501113 18839 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:16:59.502038 18839 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.504217 18428 tablet_bootstrap.cc:654] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.510686 18855 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.513033 18855 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:59.521492 18426 tablet_bootstrap.cc:492] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:59.524891 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:59.532076 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:59.535163 18426 ts_tablet_manager.cc:1403] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.108s	user 0.018s	sys 0.002s
W20260709 13:16:59.543143 18351 leader_election.cc:343] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.542042 18237 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.554350 18237 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:59.555438 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:59.552496 18426 raft_consensus.cc:359] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.556587 18800 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.555511 18427 tablet_bootstrap.cc:492] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:59.557150 18800 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:16:59.556764 18426 raft_consensus.cc:385] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.557847 18427 ts_tablet_manager.cc:1403] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.162s	user 0.018s	sys 0.016s
I20260709 13:16:59.558283 18426 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.558013 18800 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.570562 18426 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.578171 18427 raft_consensus.cc:359] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.579231 18427 raft_consensus.cc:385] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.579583 18427 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.581748 18426 ts_tablet_manager.cc:1434] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:16:59.583809 18428 tablet_bootstrap.cc:492] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:59.584532 18428 ts_tablet_manager.cc:1403] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.132s	user 0.013s	sys 0.016s
I20260709 13:16:59.586740 18428 raft_consensus.cc:359] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.587373 18428 raft_consensus.cc:385] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.589852 18428 raft_consensus.cc:740] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.590929 18428 consensus_queue.cc:260] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.598448 18426 tablet_bootstrap.cc:492] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:59.602412 18427 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.602268 18131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39284 (request call id 82) took 1170 ms. Trace:
I20260709 13:16:59.607434 18428 ts_tablet_manager.cc:1434] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.005s
I20260709 13:16:59.603133 18133 catalog_manager.cc:5697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.610059 18427 ts_tablet_manager.cc:1434] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.002s
I20260709 13:16:59.615973 18427 tablet_bootstrap.cc:492] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:59.623551 18428 tablet_bootstrap.cc:492] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:59.626461 18839 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.629968 18426 tablet_bootstrap.cc:654] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.627010 18839 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.634647 18839 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:59.637213 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:59.638211 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:59.640018 18237 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
W20260709 13:16:59.641897 18351 leader_election.cc:343] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.644088 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:59.645198 18839 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.645594 18839 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.645926 18839 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.607285 18131 rpcz_store.cc:276] 0709 13:16:58.427409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.427586 (+   177us) service_pool.cc:224] Handling call
0709 13:16:59.597817 (+1170231us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:59.435210 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:59.473768 (+ 38558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:59.473814 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:16:59.473839 (+    25us) tablet.cc:662] Decoding operations
0709 13:16:59.474197 (+   358us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:59.474269 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:59.474298 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:59.478767 (+  4469us) tablet.cc:701] Row locks acquired
0709 13:16:59.478786 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:16:59.478932 (+   146us) write_op.cc:270] Start()
0709 13:16:59.479038 (+   106us) write_op.cc:276] Timestamp: P: 1783603019478885 usec, L: 0
0709 13:16:59.479058 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:16:59.500455 (+ 21397us) log.cc:844] Serialized 543 byte log entry
0709 13:16:59.576149 (+ 75694us) op_driver.cc:464] REPLICATION: finished
0709 13:16:59.585544 (+  9395us) write_op.cc:301] APPLY: starting
0709 13:16:59.585675 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:59.585815 (+   140us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:59.586023 (+   208us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:59.586302 (+   279us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:59.586526 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:16:59.586637 (+   111us) write_op.cc:312] APPLY: finished
0709 13:16:59.586926 (+   289us) log.cc:844] Serialized 22 byte log entry
0709 13:16:59.587109 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:59.587194 (+    85us) write_op.cc:454] Released schema lock
0709 13:16:59.587230 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:59.587653 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:59.587698 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":9094,"apply.run_cpu_time_us":2023,"apply.run_wall_time_us":2111,"num_ops":1,"prepare.queue_time_us":1958,"prepare.run_cpu_time_us":6309,"prepare.run_wall_time_us":101949,"raft.queue_time_us":48853,"raft.run_cpu_time_us":6119,"raft.run_wall_time_us":22011,"replication_time_us":96934,"spinlock_wait_cycles":1411328,"thread_start_us":78355,"threads_started":4,"wal-append.queue_time_us":15710}]]}
I20260709 13:16:59.664673 18426 tablet_bootstrap.cc:492] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:59.665290 18426 ts_tablet_manager.cc:1403] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.082s	user 0.026s	sys 0.004s
I20260709 13:16:59.666505 18839 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.668023 18426 raft_consensus.cc:359] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.668902 18426 raft_consensus.cc:385] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.669209 18426 raft_consensus.cc:740] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.669764 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:59.670073 18426 consensus_queue.cc:260] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.670461 18235 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.672369 18426 ts_tablet_manager.cc:1434] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:59.672660 18427 tablet_bootstrap.cc:654] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.673378 18426 tablet_bootstrap.cc:492] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:59.678481 18428 tablet_bootstrap.cc:654] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.679901 18426 tablet_bootstrap.cc:654] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.680830 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:59.668470 18839 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:59.681354 18235 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
W20260709 13:16:59.682314 18351 leader_election.cc:343] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.683115 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:59.683879 18839 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.684883 18839 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:16:59.684334 18427 tablet_bootstrap.cc:492] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:59.685698 18427 ts_tablet_manager.cc:1403] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.000s
I20260709 13:16:59.687719 18760 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.688212 18760 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.690399 18760 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:59.693676 18428 tablet_bootstrap.cc:492] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:59.693214 18135 catalog_manager.cc:5697] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.694113 18428 ts_tablet_manager.cc:1403] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.073s	user 0.005s	sys 0.005s
I20260709 13:16:59.694567 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:16:59.696087 18201 leader_election.cc:343] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.686055 18839 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.697405 18427 raft_consensus.cc:359] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.699010 18428 raft_consensus.cc:359] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.700110 18428 raft_consensus.cc:385] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.700384 18428 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.700925 18427 raft_consensus.cc:385] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.701243 18427 raft_consensus.cc:740] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.702023 18427 consensus_queue.cc:260] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.705492 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:59.703336 18428 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.706368 18734 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.706889 18734 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.708359 18427 ts_tablet_manager.cc:1434] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 13:16:59.709390 18734 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:59.721639 18427 tablet_bootstrap.cc:492] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
W20260709 13:16:59.722286 18202 leader_election.cc:343] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.722795 18202 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:16:59.723407 18817 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.725214 18428 ts_tablet_manager.cc:1434] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.003s
I20260709 13:16:59.725267 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:59.725993 18235 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:16:59.726373 18428 tablet_bootstrap.cc:492] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3: Bootstrap starting.
I20260709 13:16:59.727450 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:59.728267 18734 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.728648 18734 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.728972 18734 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.736832 18427 tablet_bootstrap.cc:654] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.740932 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:59.743765 18426 tablet_bootstrap.cc:492] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:59.747104 18428 tablet_bootstrap.cc:654] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.747776 18426 ts_tablet_manager.cc:1403] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.021s
I20260709 13:16:59.750867 18426 raft_consensus.cc:359] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.753645 18426 raft_consensus.cc:385] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:16:59.753770 18351 leader_election.cc:343] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.754035 18426 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.752912 18734 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.759642 18427 tablet_bootstrap.cc:492] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:59.760211 18427 ts_tablet_manager.cc:1403] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.002s
I20260709 13:16:59.761958 18800 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:59.762810 18427 raft_consensus.cc:359] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.763474 18427 raft_consensus.cc:385] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.763770 18427 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.766297 18428 tablet_bootstrap.cc:492] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3: No bootstrap required, opened a new log
I20260709 13:16:59.763042 18734 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:16:59.764376 18427 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.766762 18428 ts_tablet_manager.cc:1403] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.007s
I20260709 13:16:59.763999 18426 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.771725 18426 ts_tablet_manager.cc:1434] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.004s
I20260709 13:16:59.772225 18428 raft_consensus.cc:359] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.772938 18426 tablet_bootstrap.cc:492] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d: Bootstrap starting.
I20260709 13:16:59.775529 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:16:59.772969 18428 raft_consensus.cc:385] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.776407 18428 raft_consensus.cc:740] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.776296 18235 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.777189 18428 consensus_queue.cc:260] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.778728 18428 ts_tablet_manager.cc:1434] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:16:59.775879 18427 ts_tablet_manager.cc:1434] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:16:59.780001 18427 tablet_bootstrap.cc:492] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:59.780493 18426 tablet_bootstrap.cc:654] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.784601 18427 tablet_bootstrap.cc:654] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.786578 18426 tablet_bootstrap.cc:492] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d: No bootstrap required, opened a new log
I20260709 13:16:59.787190 18426 ts_tablet_manager.cc:1403] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 13:16:59.791101 18235 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:16:59.791150 18426 raft_consensus.cc:359] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.792189 18426 raft_consensus.cc:385] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.792270 18513 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.792528 18426 raft_consensus.cc:740] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.792943 18750 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.792769 18513 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.793417 18750 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.793666 18426 consensus_queue.cc:260] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.794847 18513 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:59.795434 18750 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:59.796187 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:59.797113 18839 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.797606 18839 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:16:59.797866 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:59.798007 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:59.798512 18839 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.800256 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:59.814322 18378 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
W20260709 13:16:59.815505 18351 leader_election.cc:343] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.816829 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:16:59.818385 18817 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.818830 18817 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.819207 18817 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.821406 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:59.828238 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:16:59.833110 18202 leader_election.cc:343] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.835161 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:59.841032 18587 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:59.842113 18426 ts_tablet_manager.cc:1434] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 13:16:59.846980 18309 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.853313 18308 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.916359 18427 tablet_bootstrap.cc:492] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:59.916966 18427 ts_tablet_manager.cc:1403] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.137s	user 0.020s	sys 0.006s
I20260709 13:16:59.917868 18131 catalog_manager.cc:5697] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.919625 18513 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.920078 18513 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.922043 18513 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:59.923141 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:16:59.919822 18427 raft_consensus.cc:359] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:16:59.926887 18202 leader_election.cc:343] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.927452 18427 raft_consensus.cc:385] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.927820 18427 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.926021 18817 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.929467 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:59.930105 18380 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 0.
I20260709 13:16:59.931231 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:16:59.931339 18201 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:16:59.932605 18202 leader_election.cc:343] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.933532 18817 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:59.934113 18817 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:59.934444 18817 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.934819 18817 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.934940 18587 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.935652 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:59.935508 18587 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.936182 18378 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.939047 18587 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:59.940157 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:16:59.937441 18427 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.942301 18427 ts_tablet_manager.cc:1434] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:16:59.943167 18427 tablet_bootstrap.cc:492] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:59.946044 18800 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:59.946046 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:16:59.949927 18277 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:16:59.950630 18817 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.951297 18587 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:59.954317 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:16:59.956468 18202 leader_election.cc:343] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:59.951619 18133 catalog_manager.cc:5697] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.960973 18427 tablet_bootstrap.cc:654] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:59.953248 18378 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:59.962586 18133 catalog_manager.cc:5697] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.963333 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:59.965771 18513 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.963049 18817 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:16:59.966382 18513 raft_consensus.cc:697] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:59.967592 18513 consensus_queue.cc:237] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.970767 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:16:59.971405 18378 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:59.965428 18133 catalog_manager.cc:5697] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.978451 18378 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:16:59.979779 18201 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:16:59.981606 18427 tablet_bootstrap.cc:492] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:16:59.981496 18760 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:59.982192 18427 ts_tablet_manager.cc:1403] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.000s
I20260709 13:16:59.982280 18760 raft_consensus.cc:697] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:16:59.983551 18760 consensus_queue.cc:237] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.984983 18427 raft_consensus.cc:359] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.985742 18427 raft_consensus.cc:385] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:59.986032 18427 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:16:59.986745 18427 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:16:59.989111 18427 ts_tablet_manager.cc:1434] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:59.990217 18427 tablet_bootstrap.cc:492] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:16:59.991817 18587 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:59.996960 18427 tablet_bootstrap.cc:654] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.002020 18855 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:00.008258 18427 tablet_bootstrap.cc:492] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:17:00.013090 18427 ts_tablet_manager.cc:1403] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.001s
I20260709 13:17:00.015583 18427 raft_consensus.cc:359] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:00.018669 18427 raft_consensus.cc:385] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:00.018977 18427 raft_consensus.cc:740] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.019797 18427 consensus_queue.cc:260] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:00.021051 18855 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:00.021862 18427 ts_tablet_manager.cc:1434] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:17:00.024501 18427 tablet_bootstrap.cc:492] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:17:00.029970 18427 tablet_bootstrap.cc:654] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.035292 18310 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.044632 18427 tablet_bootstrap.cc:492] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:17:00.045156 18427 ts_tablet_manager.cc:1403] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:17:00.048976 18427 raft_consensus.cc:359] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:00.049664 18427 raft_consensus.cc:385] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:00.049957 18427 raft_consensus.cc:740] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.050599 18427 consensus_queue.cc:260] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:00.052271 18809 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:00.052759 18427 ts_tablet_manager.cc:1434] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:00.053951 18427 tablet_bootstrap.cc:492] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79: Bootstrap starting.
I20260709 13:17:00.064731 18427 tablet_bootstrap.cc:654] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:00.093739 18821 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.094372 18821 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:00.097653 18821 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:00.099031 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:00.099767 18235 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:17:00.091634 18135 catalog_manager.cc:5697] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.101042 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:00.101212 18135 catalog_manager.cc:5697] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.103966 18839 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:00.104571 18839 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.104982 18839 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.113766 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:00.114830 18304 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 0.
I20260709 13:17:00.115978 18809 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.116482 18809 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:00.121248 18809 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:00.127045 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:00.130571 18133 catalog_manager.cc:5697] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:00.131175 18800 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:00.136160 18821 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.130604 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:00.144271 18235 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 0.
I20260709 13:17:00.155988 18277 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:00.159752 18809 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:00.160267 18809 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.160723 18809 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.168380 18839 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:00.170444 18379 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:00.185894 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:00.192270 18839 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:00.199020 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:00.200568 18235 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.205037 18809 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:00.206367 18309 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 1: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:00.206918 18809 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:00.208974 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:00.209734 18379 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:00.212127 18427 tablet_bootstrap.cc:492] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79: No bootstrap required, opened a new log
I20260709 13:17:00.212601 18427 ts_tablet_manager.cc:1403] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79: Time spent bootstrapping tablet: real 0.159s	user 0.054s	sys 0.047s
I20260709 13:17:00.213632 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:00.217140 18235 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:00.219439 18277 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:00.224915 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:00.226048 18839 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:00.226794 18839 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:00.226569 18427 raft_consensus.cc:359] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:00.227677 18839 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:00.228685 18904 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:00.227339 18427 raft_consensus.cc:385] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:00.236225 18427 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Initialized, Role: FOLLOWER
I20260709 13:17:00.237097 18427 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:00.239380 18427 ts_tablet_manager.cc:1434] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:17:00.251211 18904 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.251972 18904 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:00.256157 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:00.257257 18379 raft_consensus.cc:2393] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:00.260193 18904 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:00.261883 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:00.268465 18183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:00.268409 18277 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:00.269387 18750 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.268870 18839 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:17:00.275517 18131 catalog_manager.cc:5697] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:00.276772 18750 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:00.302881 18304 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.312922 18800 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.356657 18304 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.363174 18800 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.365785 18715 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.376724 18855 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.387420 18760 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.410928 18904 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.411401 18904 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:00.414636 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:00.416194 18904 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:00.417119 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:00.417867 18378 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 1: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:00.418991 18276 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:00.419755 18904 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:00.424947 18904 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:00.467458 18760 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.483274 18715 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.681205 18800 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:00.692052 18756 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:01.415035 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:01.457118 18917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:01.456043 18916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:01.458971 18919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:01.460615 17138 server_base.cc:1061] running on GCE node
I20260709 13:17:01.462203 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:01.462558 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:01.462828 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603021462805 us; error 0 us; skew 500 ppm
I20260709 13:17:01.463539 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:01.469199 17138 webserver.cc:533] Webserver started at http://127.16.188.132:38211/ using document root <none> and password file <none>
I20260709 13:17:01.469851 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:01.470106 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:01.470533 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:01.471760 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-3-root/instance:
uuid: "e016302b7e734d74833a2bf7bab44838"
format_stamp: "Formatted at 2026-07-09 13:17:01 on dist-test-slave-2hqk"
I20260709 13:17:01.477483 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.002s
I20260709 13:17:01.481819 18924 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:01.482939 17138 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:17:01.483295 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-3-root
uuid: "e016302b7e734d74833a2bf7bab44838"
format_stamp: "Formatted at 2026-07-09 13:17:01 on dist-test-slave-2hqk"
I20260709 13:17:01.483759 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:01.502770 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:01.504371 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:01.512450 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:01.515947 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:01.516201 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:01.516497 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:01.516770 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:17:01.602039 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.132:42479
I20260709 13:17:01.602322 18986 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.132:42479 every 8 connection(s)
I20260709 13:17:01.606573 17138 auto_leader_rebalancer-test.cc:384] add a tserver: e016302b7e734d74833a2bf7bab44838
I20260709 13:17:01.622081 18987 heartbeater.cc:344] Connected to a master server at 127.16.188.190:46739
I20260709 13:17:01.622534 18987 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:01.623440 18987 heartbeater.cc:507] Master 127.16.188.190:46739 requested a full tablet report, sending...
I20260709 13:17:01.625418 18131 ts_manager.cc:194] Registered new tserver with Master: e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:01.626670 18131 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60856
I20260709 13:17:02.404582 18379 consensus_queue.cc:237] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:02.414371 18308 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:02.417320 18235 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:02.419088 18995 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.420310 18800 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.432710 18995 raft_consensus.cc:2955] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
W20260709 13:17:02.437691 18349 consensus_peers.cc:597] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9dd00413a3134a12a08e72e7925f6473. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:02.440872 18230 raft_consensus.cc:2955] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:02.444823 18304 raft_consensus.cc:2955] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:02.452325 18379 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:02.463245 18131 catalog_manager.cc:5697] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.464735 18304 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:02.465977 18349 consensus_peers.cc:597] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 610ebeb615ff40b9baae6de30d397e22. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:02.466543 18995 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:02.470623 18230 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:02.471861 18855 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.488288 18855 raft_consensus.cc:2955] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:02.501235 18235 raft_consensus.cc:2955] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:02.510119 18304 raft_consensus.cc:2955] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:02.536034 18135 catalog_manager.cc:5697] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.540266 18235 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:02.556553 18304 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:02.559501 18817 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.561554 18379 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:02.563265 19007 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.574231 18817 raft_consensus.cc:2955] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
W20260709 13:17:02.579736 18200 consensus_peers.cc:597] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7db17400d59a40a786f346aefbfbcbb0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:02.580472 18304 raft_consensus.cc:2955] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:02.583962 18378 raft_consensus.cc:2955] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:02.599941 18133 catalog_manager.cc:5697] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.622120 18308 consensus_queue.cc:237] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:02.629586 18987 heartbeater.cc:499] Master 127.16.188.190:46739 was elected leader, sending a full tablet report...
I20260709 13:17:02.643039 18232 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:02.643054 18378 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:02.644574 18750 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.645416 19001 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:02.659296 18587 raft_consensus.cc:2955] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
W20260709 13:17:02.661654 18275 consensus_peers.cc:597] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 647155b6479b4f689aca5b6c1efcc633. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:02.663877 18232 raft_consensus.cc:2955] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:02.681762 18378 raft_consensus.cc:2955] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:02.682808 18135 catalog_manager.cc:5697] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.895592 19019 ts_tablet_manager.cc:933] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:02.900728 19019 tablet_copy_client.cc:323] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.131:44265
I20260709 13:17:02.927150 18396 tablet_copy_service.cc:140] P 8b4fbc44aa2649f0bcac5cd70f71951d: Received BeginTabletCopySession request for tablet 9dd00413a3134a12a08e72e7925f6473 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:43098)
I20260709 13:17:02.927822 18396 tablet_copy_service.cc:161] P 8b4fbc44aa2649f0bcac5cd70f71951d: Beginning new tablet copy session on tablet 9dd00413a3134a12a08e72e7925f6473 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:43098: session id = e016302b7e734d74833a2bf7bab44838-9dd00413a3134a12a08e72e7925f6473
I20260709 13:17:02.933542 18396 tablet_copy_source_session.cc:215] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:02.937304 19019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd00413a3134a12a08e72e7925f6473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:02.945753 19023 ts_tablet_manager.cc:933] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:02.949867 19023 tablet_copy_client.cc:323] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.131:44265
I20260709 13:17:02.951856 18396 tablet_copy_service.cc:140] P 8b4fbc44aa2649f0bcac5cd70f71951d: Received BeginTabletCopySession request for tablet 610ebeb615ff40b9baae6de30d397e22 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:43098)
I20260709 13:17:02.952399 18396 tablet_copy_service.cc:161] P 8b4fbc44aa2649f0bcac5cd70f71951d: Beginning new tablet copy session on tablet 610ebeb615ff40b9baae6de30d397e22 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:43098: session id = e016302b7e734d74833a2bf7bab44838-610ebeb615ff40b9baae6de30d397e22
I20260709 13:17:02.958091 18396 tablet_copy_source_session.cc:215] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:02.960734 19019 tablet_copy_client.cc:806] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:02.961273 19023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 610ebeb615ff40b9baae6de30d397e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:02.961480 19019 tablet_copy_client.cc:670] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:02.968389 19019 tablet_copy_client.cc:538] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:02.977134 19019 tablet_bootstrap.cc:492] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:03.013833 19023 tablet_copy_client.cc:806] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:03.015669 19023 tablet_copy_client.cc:670] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:03.016397 19019 tablet_bootstrap.cc:492] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:03.017493 19019 tablet_bootstrap.cc:492] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:03.018164 19019 ts_tablet_manager.cc:1403] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.016s
I20260709 13:17:03.020594 19023 tablet_copy_client.cc:538] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:03.021842 19019 raft_consensus.cc:359] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:03.022763 19019 raft_consensus.cc:740] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:03.023399 19019 consensus_queue.cc:260] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:03.032156 19019 ts_tablet_manager.cc:1434] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.012s
I20260709 13:17:03.035745 18396 tablet_copy_service.cc:342] P 8b4fbc44aa2649f0bcac5cd70f71951d: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-9dd00413a3134a12a08e72e7925f6473 received from {username='slave'} at 127.0.0.1:43098
I20260709 13:17:03.036283 18396 tablet_copy_service.cc:434] P 8b4fbc44aa2649f0bcac5cd70f71951d: ending tablet copy session e016302b7e734d74833a2bf7bab44838-9dd00413a3134a12a08e72e7925f6473 on tablet 9dd00413a3134a12a08e72e7925f6473 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:03.040095 19023 tablet_bootstrap.cc:492] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:03.063185 19023 tablet_bootstrap.cc:492] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:03.064016 19023 tablet_bootstrap.cc:492] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:03.064680 19023 ts_tablet_manager.cc:1403] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.025s	user 0.024s	sys 0.000s
I20260709 13:17:03.067477 19023 raft_consensus.cc:359] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:03.068285 19023 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:03.068917 19023 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:03.071045 19023 ts_tablet_manager.cc:1434] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:03.072616 18396 tablet_copy_service.cc:342] P 8b4fbc44aa2649f0bcac5cd70f71951d: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-610ebeb615ff40b9baae6de30d397e22 received from {username='slave'} at 127.0.0.1:43098
I20260709 13:17:03.073033 18396 tablet_copy_service.cc:434] P 8b4fbc44aa2649f0bcac5cd70f71951d: ending tablet copy session e016302b7e734d74833a2bf7bab44838-610ebeb615ff40b9baae6de30d397e22 on tablet 610ebeb615ff40b9baae6de30d397e22 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:03.167845 19023 ts_tablet_manager.cc:933] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:17:03.169596 19023 tablet_copy_client.cc:323] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.129:43781
I20260709 13:17:03.182098 19019 ts_tablet_manager.cc:933] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:03.184201 19019 tablet_copy_client.cc:323] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.130:34605
I20260709 13:17:03.218842 18322 tablet_copy_service.cc:140] P 459e82ee6b564cc19be6f73186938e79: Received BeginTabletCopySession request for tablet 647155b6479b4f689aca5b6c1efcc633 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46642)
I20260709 13:17:03.219523 18322 tablet_copy_service.cc:161] P 459e82ee6b564cc19be6f73186938e79: Beginning new tablet copy session on tablet 647155b6479b4f689aca5b6c1efcc633 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46642: session id = e016302b7e734d74833a2bf7bab44838-647155b6479b4f689aca5b6c1efcc633
I20260709 13:17:03.226984 18247 tablet_copy_service.cc:140] P b52e2477fc524694967c4a16afa983e3: Received BeginTabletCopySession request for tablet 7db17400d59a40a786f346aefbfbcbb0 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46128)
I20260709 13:17:03.227722 18247 tablet_copy_service.cc:161] P b52e2477fc524694967c4a16afa983e3: Beginning new tablet copy session on tablet 7db17400d59a40a786f346aefbfbcbb0 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46128: session id = e016302b7e734d74833a2bf7bab44838-7db17400d59a40a786f346aefbfbcbb0
I20260709 13:17:03.232322 18322 tablet_copy_source_session.cc:215] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:03.236019 19019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647155b6479b4f689aca5b6c1efcc633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:03.237610 18247 tablet_copy_source_session.cc:215] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:03.241011 19023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db17400d59a40a786f346aefbfbcbb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:03.258584 19023 tablet_copy_client.cc:806] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:03.259171 19023 tablet_copy_client.cc:670] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:03.259485 19019 tablet_copy_client.cc:806] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:03.260502 19019 tablet_copy_client.cc:670] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:03.266633 19019 tablet_copy_client.cc:538] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:03.268654 19023 tablet_copy_client.cc:538] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:03.278434 19019 tablet_bootstrap.cc:492] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:03.280761 19023 tablet_bootstrap.cc:492] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:03.316259 19019 tablet_bootstrap.cc:492] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:03.317222 19019 tablet_bootstrap.cc:492] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:03.317891 19019 ts_tablet_manager.cc:1403] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.003s
I20260709 13:17:03.320943 19019 raft_consensus.cc:359] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:03.321743 19019 raft_consensus.cc:740] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:03.323701 19019 consensus_queue.cc:260] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:03.331684 19019 ts_tablet_manager.cc:1434] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 13:17:03.333339 18322 tablet_copy_service.cc:342] P 459e82ee6b564cc19be6f73186938e79: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-647155b6479b4f689aca5b6c1efcc633 received from {username='slave'} at 127.0.0.1:46642
I20260709 13:17:03.333851 18322 tablet_copy_service.cc:434] P 459e82ee6b564cc19be6f73186938e79: ending tablet copy session e016302b7e734d74833a2bf7bab44838-647155b6479b4f689aca5b6c1efcc633 on tablet 647155b6479b4f689aca5b6c1efcc633 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:03.333953 19023 tablet_bootstrap.cc:492] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:03.335315 19023 tablet_bootstrap.cc:492] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:03.335973 19023 ts_tablet_manager.cc:1403] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.055s	user 0.028s	sys 0.005s
I20260709 13:17:03.338807 19023 raft_consensus.cc:359] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:03.339512 19023 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:03.340008 19023 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:03.341753 19023 ts_tablet_manager.cc:1434] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.006s
I20260709 13:17:03.343462 18247 tablet_copy_service.cc:342] P b52e2477fc524694967c4a16afa983e3: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-7db17400d59a40a786f346aefbfbcbb0 received from {username='slave'} at 127.0.0.1:46128
I20260709 13:17:03.343974 18247 tablet_copy_service.cc:434] P b52e2477fc524694967c4a16afa983e3: ending tablet copy session e016302b7e734d74833a2bf7bab44838-7db17400d59a40a786f346aefbfbcbb0 on tablet 7db17400d59a40a786f346aefbfbcbb0 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:03.426791 18962 raft_consensus.cc:1217] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:03.430524 18962 raft_consensus.cc:1217] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:03.687681 18962 raft_consensus.cc:1217] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:03.777799 18962 raft_consensus.cc:1217] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:03.851819 18995 raft_consensus.cc:1064] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:03.854660 18995 consensus_queue.cc:237] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:03.864588 18962 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:03.866290 18308 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:03.866307 18800 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:03.868779 18800 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:03.876106 18232 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:03.878037 19027 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:17:03.900125 19038 raft_consensus.cc:2955] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:03.906062 19027 raft_consensus.cc:1064] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:03.911011 19027 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:03.906289 18235 raft_consensus.cc:2955] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:03.923746 18308 raft_consensus.cc:2955] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:03.955533 18962 raft_consensus.cc:2955] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:03.969956 18133 catalog_manager.cc:5697] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:03.989289 18962 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:03.990265 18308 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:03.990715 18800 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:03.990975 18235 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:03.992856 19044 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:03.993959 19027 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:04.013644 18800 raft_consensus.cc:2955] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.015267 18235 raft_consensus.cc:2955] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.024176 18310 raft_consensus.cc:2955] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.033666 18962 raft_consensus.cc:2955] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.061787 18378 consensus_queue.cc:237] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:04.067159 18132 catalog_manager.cc:5697] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.074517 18962 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:04.076064 19042 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:04.080297 18310 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:04.081920 18800 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:04.084198 19027 raft_consensus.cc:2955] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.087252 18962 raft_consensus.cc:2955] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.092711 18310 raft_consensus.cc:2955] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.097412 18120 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9dd00413a3134a12a08e72e7925f6473 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:04.121822 18131 catalog_manager.cc:5697] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.127894 18378 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:04.137274 18962 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:04.139340 19027 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:04.142455 18225 tablet_service.cc:1558] Processing DeleteTablet for tablet 9dd00413a3134a12a08e72e7925f6473 with delete_type TABLET_DATA_TOMBSTONED (TS b52e2477fc524694967c4a16afa983e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42512
I20260709 13:17:04.147373 18232 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:04.149016 19027 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:04.152289 19052 tablet_replica.cc:333] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:17:04.153555 19052 raft_consensus.cc:2243] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.155114 18962 raft_consensus.cc:2955] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.159474 19052 raft_consensus.cc:2272] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.152751 18800 raft_consensus.cc:2955] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.164947 19052 ts_tablet_manager.cc:1916] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:04.168041 18120 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 610ebeb615ff40b9baae6de30d397e22 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:04.171136 18587 raft_consensus.cc:1064] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:04.173481 18587 consensus_queue.cc:237] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:04.178057 18131 catalog_manager.cc:5697] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:04.187330 18235 raft_consensus.cc:2955] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.192674 18301 tablet_service.cc:1558] Processing DeleteTablet for tablet 610ebeb615ff40b9baae6de30d397e22 with delete_type TABLET_DATA_TOMBSTONED (TS 459e82ee6b564cc19be6f73186938e79 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43780
I20260709 13:17:04.195573 19052 ts_tablet_manager.cc:1929] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:04.196136 19052 log.cc:1199] T 9dd00413a3134a12a08e72e7925f6473 P b52e2477fc524694967c4a16afa983e3: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-0-root/wals/9dd00413a3134a12a08e72e7925f6473
I20260709 13:17:04.198374 19054 tablet_replica.cc:333] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:17:04.199056 18121 catalog_manager.cc:5028] TS b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): tablet 9dd00413a3134a12a08e72e7925f6473 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:17:04.202808 19054 raft_consensus.cc:2243] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.203550 19054 raft_consensus.cc:2272] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.209437 19054 ts_tablet_manager.cc:1916] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:04.225857 18380 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:04.226312 18962 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:04.227403 18750 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:04.228232 19036 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:04.229456 19054 ts_tablet_manager.cc:1929] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:04.229892 19054 log.cc:1199] T 610ebeb615ff40b9baae6de30d397e22 P 459e82ee6b564cc19be6f73186938e79: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-1-root/wals/610ebeb615ff40b9baae6de30d397e22
I20260709 13:17:04.232048 18121 catalog_manager.cc:5028] TS 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): tablet 610ebeb615ff40b9baae6de30d397e22 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:17:04.237730 18235 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:04.239585 18587 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:04.252147 18750 raft_consensus.cc:2955] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.254556 18235 raft_consensus.cc:2955] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.265882 18962 raft_consensus.cc:2955] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.270030 19007 raft_consensus.cc:1064] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:04.272559 19007 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:04.272894 18132 catalog_manager.cc:5697] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.273082 18378 raft_consensus.cc:2955] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.283671 18310 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:04.283769 18962 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:04.285416 18760 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:04.287091 18760 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:04.308658 18378 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:04.311661 19007 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:04.313377 18310 consensus_queue.cc:237] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:04.322912 18760 raft_consensus.cc:2955] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.336983 18310 raft_consensus.cc:2955] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.340679 18380 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:04.342199 19036 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:04.330648 18378 raft_consensus.cc:2955] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.345513 18131 catalog_manager.cc:5697] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:04.347489 18962 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:04.351543 18587 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:04.353241 18750 raft_consensus.cc:2955] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.358191 18961 raft_consensus.cc:2955] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.386616 18962 raft_consensus.cc:2955] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.414777 18235 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:04.425071 18378 raft_consensus.cc:2955] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.426766 18961 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:04.428895 19063 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:04.430534 18310 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:04.432790 19063 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:04.437054 18121 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 647155b6479b4f689aca5b6c1efcc633 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:04.451452 18133 catalog_manager.cc:5697] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.453208 19007 raft_consensus.cc:2955] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.457230 18961 raft_consensus.cc:2955] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.469442 18121 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7db17400d59a40a786f346aefbfbcbb0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:04.490743 18308 raft_consensus.cc:2955] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:04.493387 18135 catalog_manager.cc:5697] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:04.495450 18225 tablet_service.cc:1558] Processing DeleteTablet for tablet 647155b6479b4f689aca5b6c1efcc633 with delete_type TABLET_DATA_TOMBSTONED (TS b52e2477fc524694967c4a16afa983e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42512
I20260709 13:17:04.496420 19052 tablet_replica.cc:333] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:17:04.497581 19052 raft_consensus.cc:2243] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.498389 19052 raft_consensus.cc:2272] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.511386 19052 ts_tablet_manager.cc:1916] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:04.522619 18371 tablet_service.cc:1558] Processing DeleteTablet for tablet 7db17400d59a40a786f346aefbfbcbb0 with delete_type TABLET_DATA_TOMBSTONED (TS 8b4fbc44aa2649f0bcac5cd70f71951d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46836
I20260709 13:17:04.538888 19052 ts_tablet_manager.cc:1929] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:04.539403 19052 log.cc:1199] T 647155b6479b4f689aca5b6c1efcc633 P b52e2477fc524694967c4a16afa983e3: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-0-root/wals/647155b6479b4f689aca5b6c1efcc633
I20260709 13:17:04.540970 18121 catalog_manager.cc:5028] TS b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): tablet 647155b6479b4f689aca5b6c1efcc633 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:17:04.544836 19066 tablet_replica.cc:333] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:17:04.545653 19066 raft_consensus.cc:2243] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:04.546351 19066 raft_consensus.cc:2272] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:04.550436 19066 ts_tablet_manager.cc:1916] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:04.562080 19066 ts_tablet_manager.cc:1929] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:04.562352 19066 log.cc:1199] T 7db17400d59a40a786f346aefbfbcbb0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-2-root/wals/7db17400d59a40a786f346aefbfbcbb0
I20260709 13:17:04.563862 18120 catalog_manager.cc:5028] TS 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): tablet 7db17400d59a40a786f346aefbfbcbb0 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:17:05.725284 18230 consensus_queue.cc:237] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:05.733809 18309 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:05.734041 18378 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:05.734792 18200 consensus_peers.cc:597] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0c4cde9a14cb4fca95a288de6d075e9a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:05.735605 19073 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:05.736827 19059 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:05.747519 19063 raft_consensus.cc:2955] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:05.749536 18378 raft_consensus.cc:2955] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:05.750541 18309 raft_consensus.cc:2955] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:05.772797 18135 catalog_manager.cc:5697] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:05.776477 18309 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:05.786861 18378 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:05.787041 18275 consensus_peers.cc:597] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 715a2657f09449038e569acddbab1aea. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:05.789044 18587 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:05.794509 18235 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:05.796101 18587 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:05.800942 19064 raft_consensus.cc:2955] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:05.802873 18378 raft_consensus.cc:2955] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:05.816973 18232 raft_consensus.cc:2955] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:05.826444 18379 consensus_queue.cc:237] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
W20260709 13:17:05.837364 18349 consensus_peers.cc:597] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fbb0f3b6bc6342f0bd5d2efc5d4f6463. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:05.839231 18308 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:05.839283 18230 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:05.841657 19068 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:05.846218 19070 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:05.858525 18800 raft_consensus.cc:2955] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:05.867610 18230 raft_consensus.cc:2955] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:05.869660 18131 catalog_manager.cc:5697] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 reported cstate change: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:05.882861 18235 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:05.893994 18308 raft_consensus.cc:2955] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:05.895608 18132 catalog_manager.cc:5697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:05.903590 18379 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:05.904129 18200 consensus_peers.cc:597] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9d7e53f100fe49dea344afeea45f7cf5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:05.905074 19059 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:05.909546 18309 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:05.920202 19059 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:05.922427 19059 raft_consensus.cc:2955] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:05.929382 18379 raft_consensus.cc:2955] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:05.940760 18308 raft_consensus.cc:2955] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:05.954587 18131 catalog_manager.cc:5697] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:06.290915 19090 ts_tablet_manager.cc:933] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:17:06.293458 19090 tablet_copy_client.cc:323] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.129:43781
I20260709 13:17:06.295630 18247 tablet_copy_service.cc:140] P b52e2477fc524694967c4a16afa983e3: Received BeginTabletCopySession request for tablet 0c4cde9a14cb4fca95a288de6d075e9a from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46128)
I20260709 13:17:06.296336 18247 tablet_copy_service.cc:161] P b52e2477fc524694967c4a16afa983e3: Beginning new tablet copy session on tablet 0c4cde9a14cb4fca95a288de6d075e9a from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46128: session id = e016302b7e734d74833a2bf7bab44838-0c4cde9a14cb4fca95a288de6d075e9a
I20260709 13:17:06.305145 18247 tablet_copy_source_session.cc:215] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:06.308694 19090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4cde9a14cb4fca95a288de6d075e9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:06.322415 19090 tablet_copy_client.cc:806] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:06.322995 19090 tablet_copy_client.cc:670] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:06.326609 19090 tablet_copy_client.cc:538] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:06.332115 19090 tablet_bootstrap.cc:492] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:06.348330 19093 ts_tablet_manager.cc:933] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:06.350546 19093 tablet_copy_client.cc:323] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.130:34605
I20260709 13:17:06.351112 19090 tablet_bootstrap.cc:492] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:06.352173 19090 tablet_bootstrap.cc:492] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:06.352959 19090 ts_tablet_manager.cc:1403] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.015s
I20260709 13:17:06.353201 18322 tablet_copy_service.cc:140] P 459e82ee6b564cc19be6f73186938e79: Received BeginTabletCopySession request for tablet 715a2657f09449038e569acddbab1aea from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46642)
I20260709 13:17:06.353796 18322 tablet_copy_service.cc:161] P 459e82ee6b564cc19be6f73186938e79: Beginning new tablet copy session on tablet 715a2657f09449038e569acddbab1aea from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46642: session id = e016302b7e734d74833a2bf7bab44838-715a2657f09449038e569acddbab1aea
I20260709 13:17:06.356338 19090 raft_consensus.cc:359] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:06.357261 19090 raft_consensus.cc:740] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:06.358047 19090 consensus_queue.cc:260] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:06.361925 19090 ts_tablet_manager.cc:1434] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:17:06.365906 18247 tablet_copy_service.cc:342] P b52e2477fc524694967c4a16afa983e3: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-0c4cde9a14cb4fca95a288de6d075e9a received from {username='slave'} at 127.0.0.1:46128
I20260709 13:17:06.366380 18247 tablet_copy_service.cc:434] P b52e2477fc524694967c4a16afa983e3: ending tablet copy session e016302b7e734d74833a2bf7bab44838-0c4cde9a14cb4fca95a288de6d075e9a on tablet 0c4cde9a14cb4fca95a288de6d075e9a with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:06.377553 18322 tablet_copy_source_session.cc:215] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:06.381584 19093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 715a2657f09449038e569acddbab1aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:06.399531 19093 tablet_copy_client.cc:806] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:06.400184 19093 tablet_copy_client.cc:670] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:06.404171 19093 tablet_copy_client.cc:538] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:06.413655 19093 tablet_bootstrap.cc:492] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:06.440897 19090 ts_tablet_manager.cc:933] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:17:06.447790 19090 tablet_copy_client.cc:323] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.129:43781
I20260709 13:17:06.455469 19093 tablet_bootstrap.cc:492] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:06.456847 19093 tablet_bootstrap.cc:492] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:06.457629 19093 ts_tablet_manager.cc:1403] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.018s
I20260709 13:17:06.461577 19098 ts_tablet_manager.cc:933] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:06.462160 18247 tablet_copy_service.cc:140] P b52e2477fc524694967c4a16afa983e3: Received BeginTabletCopySession request for tablet 9d7e53f100fe49dea344afeea45f7cf5 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46128)
I20260709 13:17:06.463282 18247 tablet_copy_service.cc:161] P b52e2477fc524694967c4a16afa983e3: Beginning new tablet copy session on tablet 9d7e53f100fe49dea344afeea45f7cf5 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46128: session id = e016302b7e734d74833a2bf7bab44838-9d7e53f100fe49dea344afeea45f7cf5
I20260709 13:17:06.473788 18247 tablet_copy_source_session.cc:215] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:06.477548 19090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d7e53f100fe49dea344afeea45f7cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:06.478017 19093 raft_consensus.cc:359] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:06.478952 19093 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:06.479660 19093 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:06.488301 19093 ts_tablet_manager.cc:1434] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 13:17:06.490118 18322 tablet_copy_service.cc:342] P 459e82ee6b564cc19be6f73186938e79: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-715a2657f09449038e569acddbab1aea received from {username='slave'} at 127.0.0.1:46642
I20260709 13:17:06.490576 18322 tablet_copy_service.cc:434] P 459e82ee6b564cc19be6f73186938e79: ending tablet copy session e016302b7e734d74833a2bf7bab44838-715a2657f09449038e569acddbab1aea on tablet 715a2657f09449038e569acddbab1aea with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:06.493853 19098 tablet_copy_client.cc:323] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.131:44265
I20260709 13:17:06.496025 18396 tablet_copy_service.cc:140] P 8b4fbc44aa2649f0bcac5cd70f71951d: Received BeginTabletCopySession request for tablet fbb0f3b6bc6342f0bd5d2efc5d4f6463 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:43098)
I20260709 13:17:06.496647 18396 tablet_copy_service.cc:161] P 8b4fbc44aa2649f0bcac5cd70f71951d: Beginning new tablet copy session on tablet fbb0f3b6bc6342f0bd5d2efc5d4f6463 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:43098: session id = e016302b7e734d74833a2bf7bab44838-fbb0f3b6bc6342f0bd5d2efc5d4f6463
I20260709 13:17:06.509096 18396 tablet_copy_source_session.cc:215] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:06.515750 19098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb0f3b6bc6342f0bd5d2efc5d4f6463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:06.524293 19090 tablet_copy_client.cc:806] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:06.525308 19090 tablet_copy_client.cc:670] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:06.530957 19090 tablet_copy_client.cc:538] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:06.545634 19090 tablet_bootstrap.cc:492] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:06.545917 19098 tablet_copy_client.cc:806] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:06.546809 19098 tablet_copy_client.cc:670] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:06.553933 19098 tablet_copy_client.cc:538] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:06.562800 19098 tablet_bootstrap.cc:492] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:06.573535 19090 tablet_bootstrap.cc:492] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:06.574736 19090 tablet_bootstrap.cc:492] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:06.575677 19090 ts_tablet_manager.cc:1403] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.001s
I20260709 13:17:06.579792 19090 raft_consensus.cc:359] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:06.580927 19090 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:06.581715 19090 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:06.586913 19090 ts_tablet_manager.cc:1434] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.009s
I20260709 13:17:06.597707 19098 tablet_bootstrap.cc:492] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:06.598847 18247 tablet_copy_service.cc:342] P b52e2477fc524694967c4a16afa983e3: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-9d7e53f100fe49dea344afeea45f7cf5 received from {username='slave'} at 127.0.0.1:46128
I20260709 13:17:06.599301 19098 tablet_bootstrap.cc:492] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:06.599596 18247 tablet_copy_service.cc:434] P b52e2477fc524694967c4a16afa983e3: ending tablet copy session e016302b7e734d74833a2bf7bab44838-9d7e53f100fe49dea344afeea45f7cf5 on tablet 9d7e53f100fe49dea344afeea45f7cf5 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:06.600113 19098 ts_tablet_manager.cc:1403] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.038s	user 0.030s	sys 0.004s
I20260709 13:17:06.603224 19098 raft_consensus.cc:359] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:06.604070 19098 raft_consensus.cc:740] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:06.604730 19098 consensus_queue.cc:260] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:06.607271 19098 ts_tablet_manager.cc:1434] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:06.608968 18396 tablet_copy_service.cc:342] P 8b4fbc44aa2649f0bcac5cd70f71951d: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-fbb0f3b6bc6342f0bd5d2efc5d4f6463 received from {username='slave'} at 127.0.0.1:43098
I20260709 13:17:06.609418 18396 tablet_copy_service.cc:434] P 8b4fbc44aa2649f0bcac5cd70f71951d: ending tablet copy session e016302b7e734d74833a2bf7bab44838-fbb0f3b6bc6342f0bd5d2efc5d4f6463 on tablet fbb0f3b6bc6342f0bd5d2efc5d4f6463 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:06.836910 18961 raft_consensus.cc:1217] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:07.009815 18961 raft_consensus.cc:1217] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:07.022148 18961 raft_consensus.cc:1217] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:07.095180 18962 raft_consensus.cc:1217] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:07.385511 19105 raft_consensus.cc:1064] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:07.392042 19105 consensus_queue.cc:237] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:07.399305 18962 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.400854 19116 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:07.401448 18383 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.401664 18308 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.403205 19107 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:07.429252 19105 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:07.438045 19104 raft_consensus.cc:2955] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:07.444352 18308 raft_consensus.cc:2955] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:07.443095 18377 raft_consensus.cc:2955] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:07.454614 18962 raft_consensus.cc:2955] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:07.462028 18135 catalog_manager.cc:5697] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:07.486675 19106 raft_consensus.cc:1064] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:07.489357 19106 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:07.501008 18377 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.502264 18962 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.503391 19108 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:07.504650 18230 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.508010 19119 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:07.509950 19119 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:07.521960 18235 consensus_queue.cc:237] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:07.532086 18383 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:07.533891 18961 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:07.534521 19107 raft_consensus.cc:1064] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:07.534209 19105 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:07.536872 19107 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:07.541183 19116 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:07.549417 18383 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.558472 18961 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.558985 19104 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:07.560566 19063 raft_consensus.cc:2955] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:07.565258 18378 raft_consensus.cc:2955] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:07.568040 18308 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:07.570545 19073 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:07.572850 19073 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:07.574400 18383 raft_consensus.cc:2955] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:07.572176 19119 raft_consensus.cc:2955] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:07.587450 18961 raft_consensus.cc:2955] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:07.597208 18232 raft_consensus.cc:2955] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:07.620397 18121 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0c4cde9a14cb4fca95a288de6d075e9a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:07.661827 18135 catalog_manager.cc:5697] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:07.655656 18131 catalog_manager.cc:5697] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:17:07.667445 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 48050.8us
I20260709 13:17:07.678217 19112 raft_consensus.cc:1064] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
W20260709 13:17:07.733129 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 64880.5us
W20260709 13:17:07.688476 19130 log.cc:927] Time spent T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:17:07.689779 19112 consensus_queue.cc:237] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:07.904852 18301 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c4cde9a14cb4fca95a288de6d075e9a with delete_type TABLET_DATA_TOMBSTONED (TS 459e82ee6b564cc19be6f73186938e79 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43780
I20260709 13:17:07.920921 19141 tablet_replica.cc:333] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
W20260709 13:17:08.325197 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 591102us
I20260709 13:17:08.409801 19140 raft_consensus.cc:2955] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:08.419570 18961 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:08.426102 18962 raft_consensus.cc:2955] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:17:08.533010 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 122780us
I20260709 13:17:08.541785 19141 raft_consensus.cc:2243] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:08.542691 19141 raft_consensus.cc:2272] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:08.546751 19141 ts_tablet_manager.cc:1916] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:17:08.591389 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 120783us
I20260709 13:17:08.617316 18310 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:08.625469 19152 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:08.632718 18304 raft_consensus.cc:2955] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:08.655802 19116 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:08.663769 19118 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:08.664381 19118 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:08.666859 19118 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:08.673020 19111 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:08.656396 19116 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:08.673530 19111 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:08.675423 19111 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:08.675474 19116 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:08.677145 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:08.711385 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 71472.5us
I20260709 13:17:08.721156 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:08.652812 19149 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:17:08.830137 19141 ts_tablet_manager.cc:1929] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:08.885373 19141 log.cc:1199] T 0c4cde9a14cb4fca95a288de6d075e9a P 459e82ee6b564cc19be6f73186938e79: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-1-root/wals/0c4cde9a14cb4fca95a288de6d075e9a
I20260709 13:17:08.917285 19160 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:08.918046 19160 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:08.926424 19151 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:08.926952 19151 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:08.930778 19157 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:08.931486 19157 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:08.935272 19157 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:08.935758 19157 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:08.938078 19152 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:08.942322 19152 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:08.945876 19141 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43780 (request call id 61) took 1212 ms. Trace:
I20260709 13:17:08.946439 19141 rpcz_store.cc:276] 0709 13:17:07.760663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.904366 (+143703us) service_pool.cc:224] Handling call
0709 13:17:07.920177 (+ 15811us) ts_tablet_manager.cc:1151] Deleting tablet 0c4cde9a14cb4fca95a288de6d075e9a
0709 13:17:07.920286 (+   109us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:17:08.663818 (+743532us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:08.826171 (+162353us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:08.945759 (+119588us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":617767,"tablet-delete.queue_time_us":14406,"thread_start_us":14707,"threads_started":1}
I20260709 13:17:08.936198 19157 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:08.963656 19157 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:08.968255 19151 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:08.965951 19149 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:08.979986 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 245601us
I20260709 13:17:08.973042 19152 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:08.987814 19162 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:08.983614 19119 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:08.988445 19162 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:08.988814 19119 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:08.992930 19164 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:08.993477 19164 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:08.998883 19164 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:08.999449 19157 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:09.000032 19157 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.000694 19160 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:09.002066 19157 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:08.986477 19064 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.008816 19064 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:09.005978 19119 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:08.992347 19162 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:09.011334 19162 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:09.011778 19162 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.013983 19162 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:08.987114 19149 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.024425 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.024811 19143 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.024672 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.339398 19180 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.340322 19180 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.025496 19143 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.344123 19180 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:09.344655 19143 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:09.044916 18200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.179s	user 0.158s	sys 0.276s
I20260709 13:17:09.050132 19149 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:09.100231 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 123665us
W20260709 13:17:09.347280 18200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.481s	user 0.159s	sys 0.276s
I20260709 13:17:09.102227 19171 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.353157 19148 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:09.105371 19168 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:09.353658 19164 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:09.353952 19168 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.354372 19164 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.355876 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.356287 19168 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:09.356863 19168 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:09.357335 19168 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.358726 19140 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:09.359198 19168 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:09.359292 19140 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.359773 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.103816 19172 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:09.360828 19172 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.361348 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.362567 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.362792 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.363005 19172 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:09.363787 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.364939 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:09.366084 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.353720 19148 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.110354 19155 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:09.111021 19160 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:09.111651 19145 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:09.129464 19157 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:09.147437 19154 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:09.200068 19099 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.207619 19146 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:09.216415 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.216435 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.218727 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.230314 19170 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:09.230847 19119 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.258744 19161 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.263266 19167 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:09.272061 19064 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:09.282480 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.286834 19169 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.292196 19151 raft_consensus.cc:2955] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:09.294997 19163 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:09.297286 19118 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.304214 19174 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.304780 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:09.307439 19165 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.308362 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.309098 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.311897 19112 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.313326 19150 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.313475 19152 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.314004 19111 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.318315 19177 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:09.326203 18276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.006s	sys 0.024s
I20260709 13:17:09.327692 19175 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.328127 19176 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.370777 18135 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39270 (request call id 134) took 1637 ms. Trace:
I20260709 13:17:09.407799 19150 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:09.409682 18276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.012s	sys 0.027s
I20260709 13:17:09.352789 19171 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.106292 19162 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:17:09.410491 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 740993us
I20260709 13:17:09.406544 19112 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:09.392778 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.409029 19177 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.407953 19148 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:09.337168 19179 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.333700 19178 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.367185 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.411677 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.372781 19164 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:09.416960 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.408771 18135 rpcz_store.cc:276] 0709 13:17:07.746611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.880008 (+133397us) service_pool.cc:224] Handling call
0709 13:17:08.601541 (+721533us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b5400200490. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14f0b2 00007fa1880c8a89 00007fa188060da6 00007fa188032088 00007fa18813037e 00007fa1865f12a4 00007fa1865f1232 00007fa1865f1161 00007fa1865f10dc
0709 13:17:09.370680 (+769139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":463341,"reported_tablets":2,"spinlock_wait_cycles":1558001024}
I20260709 13:17:09.408866 19111 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.427562 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.408155 19170 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.429721 19164 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:09.370503 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.380400 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.432366 18304 raft_consensus.cc:2955] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:09.412891 19152 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.434628 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.443783 18121 catalog_manager.cc:5028] TS 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): tablet 0c4cde9a14cb4fca95a288de6d075e9a (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:17:09.407245 19119 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.407286 19118 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.408833 19165 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:09.462512 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.407799 19146 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:09.415254 19157 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.418293 19162 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.441358 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.416209 19155 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.416808 19099 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.480104 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.416056 19160 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.441720 19140 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:09.483917 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.460251 19180 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.465343 19148 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:09.411362 19174 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:09.465968 19181 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.442109 19179 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.469213 19118 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:09.465096 19168 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:09.498844 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.417511 19167 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.418859 19161 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:09.455451 19164 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:09.529480 19179 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:09.438151 19178 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.504875 19116 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:09.508610 19140 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:09.418692 19176 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.444126 19154 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.442428 19169 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.529810 19155 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:09.553212 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.465447 19163 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.502738 19180 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.441200 19145 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.505532 19148 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.503310 19181 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.437407 19175 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.586566 19112 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:09.560495 19063 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:09.561913 19116 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.570539 19140 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.581176 19161 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:17:09.520891 19168 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:09.669317 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 215138us
I20260709 13:17:09.644631 19147 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:09.644421 19158 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:09.639654 19152 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:09.677292 19158 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.599131 19177 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:09.679028 19063 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.613056 19111 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:09.618577 19170 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:09.660910 19119 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:09.600585 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.600386 19183 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.682296 19111 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:09.598392 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:09.677125 19147 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.684808 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.690995 19165 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:09.695262 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:09.696956 19171 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:09.697964 19167 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:09.719651 18133 catalog_manager.cc:5697] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:09.592133 18381 raft_consensus.cc:2955] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:09.683782 18303 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
I20260709 13:17:09.719704 19111 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.783728 19175 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:09.789276 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:09.790174 18233 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:09.791569 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:09.792179 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.599923 18959 raft_consensus.cc:2955] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:09.720255 19183 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:09.798269 19099 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:09.936180 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:09.901129 19169 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:10.028005 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:09.883880 19146 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:10.028861 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.029584 19063 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.011307 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.939988 19116 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:09.878226 18228 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:10.033897 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:09.954221 19111 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:09.934386 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.035374 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:09.875557 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:09.865368 19176 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:09.855087 19170 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:10.062572 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 193034us
I20260709 13:17:10.062776 19161 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:10.063203 19161 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:10.063572 19161 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.062604 19170 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.065913 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.066898 19170 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.067835 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.068213 19145 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.068928 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.675621 19174 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:09.846611 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:09.979741 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.070277 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.955413 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.039067 18958 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:10.071964 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.073215 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.073369 19157 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.074442 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:09.934677 19178 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:09.935144 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.075618 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.076247 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.076555 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.079289 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:09.936421 19181 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:09.935537 19150 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:10.053401 19180 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:10.041579 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.081494 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.082795 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.084903 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:09.987139 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 277734us
I20260709 13:17:10.043790 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.153344 18306 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:10.026582 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:09.904047 19165 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:10.154838 19165 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:09.894848 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.157155 19165 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:10.046335 19148 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.029417 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.047559 19160 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:10.047621 18276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.000s	sys 0.025s
I20260709 13:17:10.047761 19186 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:10.049235 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.051548 19164 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.052641 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.052294 19162 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.054185 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.059212 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.060463 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.068995 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.036449 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.164106 19161 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:09.990501 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.022944 19158 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.042265 19183 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:10.112406 18258 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8600 after lost signal to thread 17141
I20260709 13:17:10.125954 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.150665 19176 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:10.199328 19176 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:10.064627 18202 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.002s	sys 0.006s
W20260709 13:17:10.200726 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 656558us
I20260709 13:17:10.201613 19176 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:10.151170 19180 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:17:10.160540 18276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.000s	sys 0.026s
I20260709 13:17:10.161188 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.160818 19186 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.172137 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:10.178237 19165 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:10.180603 19150 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:10.150665 19170 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:10.181514 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:10.183175 19175 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:10.183660 19189 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:10.180123 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:10.077526 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.215131 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.190623 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.188613 18308 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:10.193137 18926 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.196219 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.196938 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.194711 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.198351 19168 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:10.198823 18258 debug-util.cc:398] Leaking SignalData structure 0x7b08001e6320 after lost signal to thread 18169
I20260709 13:17:10.207407 18201 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.205710 19147 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.208536 19154 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.246471 19186 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:10.247529 19140 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.236959 19169 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:10.249333 19169 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:10.249744 19169 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.249480 18135 catalog_manager.cc:5697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:10.210150 18276 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.211369 19165 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.217295 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.256075 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.256278 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.215794 18384 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:10.218478 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.258306 18383 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:10.220038 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.213027 19150 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.245059 19118 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.259310 18380 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
W20260709 13:17:10.252470 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 45127.1us
I20260709 13:17:10.257050 19165 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:10.260571 19140 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.220650 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.206892 19180 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.264003 19064 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:10.264189 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54126us
I20260709 13:17:10.265080 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.264741 19163 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.234972 19170 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.266079 19064 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.267899 19170 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.269658 19161 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:17:10.270758 18385 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:10.271515 18201 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.271953 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.273206 18201 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.277077 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.277522 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:10.278187 18308 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.278501 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.265627 19180 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:10.279719 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.281327 19163 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.220556 19175 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.286211 19150 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:10.286514 19175 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:10.287164 19163 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:10.288029 18258 debug-util.cc:398] Leaking SignalData structure 0x7b08002d5840 after lost signal to thread 18261
W20260709 13:17:10.289394 18258 debug-util.cc:398] Leaking SignalData structure 0x7b08002e67c0 after lost signal to thread 18336
W20260709 13:17:10.290737 18258 debug-util.cc:398] Leaking SignalData structure 0x7b08002e72c0 after lost signal to thread 18410
I20260709 13:17:10.291095 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:10.291621 18201 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:10.291954 18258 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc920 after lost signal to thread 18986
I20260709 13:17:10.292220 18308 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:10.292790 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.220345 19189 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:10.293617 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:10.220965 18958 raft_consensus.cc:2955] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:10.295526 19189 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:10.296128 19161 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:10.296705 19161 raft_consensus.cc:697] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 2 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:10.297091 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:10.297617 19161 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:10.248297 18311 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:10.301937 18276 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.302870 19167 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.303839 19140 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.304009 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.304747 19143 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:10.305042 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.305639 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.306479 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.305135 19143 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:10.307783 19143 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.312541 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.313434 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.313820 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:10.314770 18276 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.315506 19165 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.315425 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.316130 19189 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.316201 19181 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:10.321437 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.322561 19189 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.322486 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.322750 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.324038 19183 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.323153 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.325208 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.325557 18201 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.326109 19189 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.326388 19163 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.326823 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.327615 19163 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.328975 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.329649 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.331384 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.331938 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.332118 18303 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:10.332886 19189 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.333611 19167 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:10.283947 19169 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.334041 19167 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:10.334465 19167 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.335856 19169 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:10.342952 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.344765 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.345521 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.345629 19167 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.346670 19189 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.347640 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.347961 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.348210 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.348583 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.334041 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:10.350045 19184 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:10.350170 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.350479 19184 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:10.350183 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.350929 19184 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.351605 19189 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.353194 18351 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.353454 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.353955 19189 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.355930 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.356848 19169 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:10.357259 19169 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:10.357638 19169 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.359586 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.328325 18201 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.365031 19143 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.370311 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:10.371645 18958 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 2 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:10.374576 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 46338.3us
I20260709 13:17:10.375928 18201 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.382153 19143 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:10.374070 19163 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.390969 19184 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.393343 19184 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.378921 18310 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:10.397882 19167 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.398103 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:10.398749 18381 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.403136 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:10.403843 18382 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.405784 18958 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:10.407591 18381 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:10.407531 19064 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:10.410544 18383 consensus_queue.cc:237] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:10.419473 18135 catalog_manager.cc:5697] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 1 to 2, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 2 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.434521 18960 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:10.439638 19168 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.439688 19143 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:10.442087 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.443742 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.446523 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.446952 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.449810 18960 raft_consensus.cc:2955] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:10.447556 19150 raft_consensus.cc:2955] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:10.445717 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:10.445304 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 69454.7us
I20260709 13:17:10.463076 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:10.452675 18201 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.468925 19163 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.472226 18120 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fbb0f3b6bc6342f0bd5d2efc5d4f6463 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:10.480720 18382 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:10.487766 18132 catalog_manager.cc:5697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New cstate: current_term: 1 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.482194 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:10.493098 19118 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:10.493773 19118 raft_consensus.cc:697] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:10.494685 19118 consensus_queue.cc:237] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.495668 18276 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:10.498070 19064 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:10.498607 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.500798 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.498670 19064 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:10.492337 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:10.503191 19064 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.506937 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:10.511675 19163 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.513139 18201 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.514148 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.516619 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.517845 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.519178 18228 raft_consensus.cc:2955] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:10.521327 19167 raft_consensus.cc:2955] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:10.523757 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.525568 19169 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.527578 19163 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.532325 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.534054 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.542331 19169 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:10.526180 18960 raft_consensus.cc:2955] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:10.547602 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.554899 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.555281 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.557513 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.560819 18201 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.559105 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.559682 19163 consensus_queue.cc:1059] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:10.563438 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.566015 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.572938 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.576957 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:10.577630 19163 consensus_queue.cc:1243] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer e016302b7e734d74833a2bf7bab44838 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:10.578251 19163 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.578991 19163 raft_consensus.cc:3055] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:10.579339 19163 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:10.580355 19163 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:10.585651 19163 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.589355 18201 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.596323 19168 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.597103 18131 catalog_manager.cc:5697] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 2, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.598959 18131 catalog_manager.cc:5697] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 2, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:10.605100 18383 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:10.611117 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.609241 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.610399 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:10.610899 18201 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.618432 18135 catalog_manager.cc:5697] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:10.620057 19184 consensus_queue.cc:1059] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:10.621553 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:10.622432 19163 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.621527 19064 raft_consensus.cc:3055] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:10.623142 19064 raft_consensus.cc:740] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:10.624297 19064 consensus_queue.cc:260] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.629833 19064 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.633044 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:10.635674 18201 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:10.636479 19168 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.639307 18201 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:10.640072 19168 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:10.640445 19168 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:10.640847 19168 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.642695 18306 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:10.642956 18201 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:10.644860 19154 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:10.646950 19154 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:10.647392 19154 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.650413 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.654284 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:10.648074 18121 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 715a2657f09449038e569acddbab1aea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:10.656885 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:10.659194 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:10.663903 18381 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:10.663864 18384 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:10.666694 18384 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:10.670367 18371 tablet_service.cc:1558] Processing DeleteTablet for tablet 715a2657f09449038e569acddbab1aea with delete_type TABLET_DATA_TOMBSTONED (TS 8b4fbc44aa2649f0bcac5cd70f71951d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46836
I20260709 13:17:10.679286 19154 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:10.680029 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.685392 18310 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:10.664105 18230 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:10.688206 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.690793 18225 tablet_service.cc:1558] Processing DeleteTablet for tablet fbb0f3b6bc6342f0bd5d2efc5d4f6463 with delete_type TABLET_DATA_TOMBSTONED (TS b52e2477fc524694967c4a16afa983e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42512
I20260709 13:17:10.695396 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.697445 19184 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.697315 19167 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.701181 18927 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.705935 19161 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.707347 19154 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.710942 18230 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:10.719445 19148 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:10.704603 19168 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.720788 19154 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:10.721197 19154 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:10.696866 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.722148 19154 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.724910 19154 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.723533 19203 tablet_replica.cc:333] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:17:10.728937 19148 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:10.725684 19167 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.725270 19168 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.732579 19168 raft_consensus.cc:3055] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:10.727959 19203 raft_consensus.cc:2243] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.733948 19203 raft_consensus.cc:2272] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.731810 19204 tablet_replica.cc:333] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:17:10.732985 19168 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:10.740749 18351 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.741425 18233 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:10.742169 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.743158 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:10.744349 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:10.749539 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.750633 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.751304 19150 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.751976 19150 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.752760 19150 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.753909 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.754973 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.755667 19150 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:10.756654 19150 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.757543 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.758313 19204 raft_consensus.cc:2243] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.765013 19204 raft_consensus.cc:2272] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.766305 19140 consensus_queue.cc:1059] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:10.767345 19147 raft_consensus.cc:3055] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:10.767756 19147 raft_consensus.cc:740] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:10.768597 19147 consensus_queue.cc:260] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.769773 19147 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.770653 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:10.758533 18351 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.759029 19150 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.760154 19203 ts_tablet_manager.cc:1916] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:10.774137 19150 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.753605 19168 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.774919 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.775228 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.775302 19168 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.776996 19163 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.777705 19163 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.780329 19150 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.780560 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:10.783764 18351 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.784581 19150 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.786499 19204 ts_tablet_manager.cc:1916] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:10.790400 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.796928 19154 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.797627 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.798964 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.800230 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.800972 19160 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.801141 19154 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.801726 19160 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.803622 18202 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:10.804363 18202 raft_consensus.cc:2686] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:17:10.805760 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.806236 18311 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:10.795071 18310 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:10.806471 19148 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.807657 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:10.807974 19161 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:10.813673 18235 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:10.807947 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:10.794239 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.817320 19169 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.817708 18382 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:10.817976 18960 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:10.819279 19148 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:10.820287 19160 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:10.825778 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.829492 19169 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.830930 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.831655 19160 raft_consensus.cc:2955] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:10.834908 18383 raft_consensus.cc:2955] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:10.835265 18960 raft_consensus.cc:2955] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:10.828439 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.844277 18230 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:10.846405 19169 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.846084 19161 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:10.850108 19147 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:10.850548 19147 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:10.850957 19147 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.858523 19147 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.860363 19167 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:10.864868 18131 catalog_manager.cc:5697] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:10.849536 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.869932 19167 consensus_queue.cc:1059] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:10.870256 19169 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.871402 19184 raft_consensus.cc:3055] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:10.871399 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.871935 19184 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:10.873255 19150 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.872944 19184 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.873962 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.874439 19184 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:10.885521 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.886277 19169 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.886694 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.887400 19169 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.887825 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:10.888576 19169 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.892918 19154 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.894317 18202 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.895120 19154 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.895629 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.896612 19154 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.899946 18121 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9d7e53f100fe49dea344afeea45f7cf5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:10.908154 19147 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:10.910977 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.909201 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:10.920658 19147 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.921195 18301 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d7e53f100fe49dea344afeea45f7cf5 with delete_type TABLET_DATA_TOMBSTONED (TS 459e82ee6b564cc19be6f73186938e79 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43780
I20260709 13:17:10.922477 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.923784 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.924000 19169 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.943054 19150 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.947543 19203 ts_tablet_manager.cc:1929] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:10.948026 19203 log.cc:1199] T 715a2657f09449038e569acddbab1aea P 8b4fbc44aa2649f0bcac5cd70f71951d: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-2-root/wals/715a2657f09449038e569acddbab1aea
I20260709 13:17:10.939612 18235 raft_consensus.cc:2955] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:10.950884 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.943141 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.949735 18120 catalog_manager.cc:5028] TS 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): tablet 715a2657f09449038e569acddbab1aea (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:17:10.952641 19150 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.956264 19150 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:10.960392 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.965180 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:10.965198 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:10.968091 19143 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:10.968830 19143 raft_consensus.cc:697] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:10.969364 19148 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.970062 19150 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:10.969955 19143 consensus_queue.cc:237] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:10.990550 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:10.993834 19210 tablet_replica.cc:333] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:17:10.995134 19210 raft_consensus.cc:2243] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:10.996016 19210 raft_consensus.cc:2272] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:10.968137 19147 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:11.011577 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:11.021188 19212 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:11.027500 19210 ts_tablet_manager.cc:1916] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:11.035305 18303 raft_consensus.cc:2955] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:11.053886 19204 ts_tablet_manager.cc:1929] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:11.079448 18235 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:11.081939 18228 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.085192 19184 consensus_queue.cc:1059] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:11.086333 19184 raft_consensus.cc:3055] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:11.086704 19184 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:11.087375 19204 log.cc:1199] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P b52e2477fc524694967c4a16afa983e3: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-0-root/wals/fbb0f3b6bc6342f0bd5d2efc5d4f6463
I20260709 13:17:11.087558 19184 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:11.090759 19118 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:11.099529 18228 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.102924 19184 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.108160 18382 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.105969 19137 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:11.127138 19118 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:17:11.144164 18383 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:11.145391 18384 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.159739 18121 catalog_manager.cc:5028] TS b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): tablet fbb0f3b6bc6342f0bd5d2efc5d4f6463 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:17:11.187574 18135 catalog_manager.cc:5697] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 1 to 2, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 2 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:11.182184 19160 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:17:11.191228 19160 raft_consensus.cc:3055] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:11.191612 19160 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:11.173818 19184 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:17:11.200771 19210 ts_tablet_manager.cc:1929] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:11.201279 19210 log.cc:1199] T 9d7e53f100fe49dea344afeea45f7cf5 P 459e82ee6b564cc19be6f73186938e79: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-1-root/wals/9d7e53f100fe49dea344afeea45f7cf5
I20260709 13:17:11.203234 18121 catalog_manager.cc:5028] TS 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): tablet 9d7e53f100fe49dea344afeea45f7cf5 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:17:11.192479 19160 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:11.207628 19160 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.276975 18229 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:11.287161 19229 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:11.288755 19223 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:11.289234 19223 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:11.290304 19223 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:11.292304 19223 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:11.364984 19228 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:17:11.566555 18228 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.580616 18228 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.582182 19229 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:11.599800 18311 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:11.601416 19229 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:17:11.940002 19137 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:11.940764 19137 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:11.945326 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:11.945326 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:11.946768 18383 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 2: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:11.946713 18228 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:11.946352 19137 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:11.949014 18277 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:11.949769 19137 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:11.950484 19137 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:11.951056 19137 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:11.965792 19137 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:11.969357 19137 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:11.971643 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:11.978811 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:11.979699 18381 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 2: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:11.981094 18228 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:11.982674 18277 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:11.984223 19238 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:11.984894 19238 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:11.986267 19238 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:12.024219 18132 catalog_manager.cc:5697] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 2, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.061244 18235 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:12.080442 18381 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:12.082042 19163 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:12.088003 18311 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:12.091391 19148 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:12.109273 18200 consensus_peers.cc:597] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2cbade5381d641e9b60bcc9994ae9b51. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:12.131517 19163 raft_consensus.cc:2955] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:12.144160 18306 raft_consensus.cc:2955] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:12.138048 18381 raft_consensus.cc:2955] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:12.152138 18235 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:12.196652 18383 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:12.202769 18200 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1889d6d746545a0bdf04811a102b35b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:12.202998 19148 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:12.218523 18306 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:12.191182 18132 catalog_manager.cc:5697] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.227147 19163 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:12.239581 19160 raft_consensus.cc:2955] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:12.243256 18383 raft_consensus.cc:2955] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:12.254866 18306 raft_consensus.cc:2955] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:12.265861 18311 consensus_queue.cc:237] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:12.284144 18135 catalog_manager.cc:5697] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:12.286031 18275 consensus_peers.cc:597] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eafcec4c722f49fa90d23d1326870a82. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:12.289482 18381 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:12.290951 18230 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:12.291746 19238 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:12.293917 19118 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:12.320720 18383 raft_consensus.cc:2955] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:12.320495 19137 raft_consensus.cc:2955] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:12.321092 18230 raft_consensus.cc:2955] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:12.339159 18235 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:12.348206 18132 catalog_manager.cc:5697] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:12.353575 18383 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:12.354087 18200 consensus_peers.cc:597] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58f88ffc8ca74740b36c09a2eb312c10. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:12.356335 18311 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:12.356734 19148 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:12.358661 19148 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:12.380870 18381 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:12.384948 19238 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:12.389149 19148 raft_consensus.cc:2955] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:12.392930 18311 raft_consensus.cc:2955] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:12.406657 18383 raft_consensus.cc:2955] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:12.435036 18135 catalog_manager.cc:5697] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.464272 18235 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:12.465802 19137 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:12.611294 19160 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.611832 19160 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:12.621681 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:12.623428 18383 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:12.624550 18201 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:12.626045 19148 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:12.626484 19148 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.626859 19148 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:12.627027 19238 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.627676 19238 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:12.630052 19238 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:12.631531 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:12.632230 18235 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:12.632325 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:12.633081 18383 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:12.633729 19163 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.634167 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:12.634272 19163 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:12.637004 19163 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:12.638583 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:12.639256 18384 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:12.640547 18201 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:12.640964 19160 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:12.641541 19163 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:12.641987 19163 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.642367 19163 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:12.622141 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:12.643520 18306 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:12.644467 19238 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:12.644932 19238 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.645287 19238 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:12.646522 19260 ts_tablet_manager.cc:933] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:17:12.649017 19168 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.649595 19168 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:12.651882 19168 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:12.654942 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:12.655670 18384 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:12.657486 18201 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:12.659798 19168 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:12.660230 19168 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.660782 19168 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:12.640206 19148 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:12.677179 19148 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:12.681759 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:12.685825 18383 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:12.686364 19260 tablet_copy_client.cc:323] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.129:43781
I20260709 13:17:12.690837 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:12.692029 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:12.692402 18305 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:12.692850 19163 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:12.692790 18303 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:12.698472 18247 tablet_copy_service.cc:140] P b52e2477fc524694967c4a16afa983e3: Received BeginTabletCopySession request for tablet b1889d6d746545a0bdf04811a102b35b from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46128)
I20260709 13:17:12.699097 18247 tablet_copy_service.cc:161] P b52e2477fc524694967c4a16afa983e3: Beginning new tablet copy session on tablet b1889d6d746545a0bdf04811a102b35b from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46128: session id = e016302b7e734d74833a2bf7bab44838-b1889d6d746545a0bdf04811a102b35b
I20260709 13:17:12.699757 19163 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:12.700333 19168 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:12.702385 19168 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:12.704989 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:12.705526 18384 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:12.706458 19238 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:12.709229 19238 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:12.709393 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:12.709925 18381 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:12.711340 18247 tablet_copy_source_session.cc:215] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:12.716023 18381 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:12.720125 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:12.720847 18236 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:12.721659 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:12.728150 19221 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:12.728685 19221 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:12.729442 19221 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:12.735834 18383 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:12.738468 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:12.738989 18381 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:12.742657 18236 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:12.745114 19260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1889d6d746545a0bdf04811a102b35b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.754223 19265 ts_tablet_manager.cc:933] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:17:12.747315 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:12.756875 18303 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:12.750510 18201 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:12.751878 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:12.752949 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:12.757758 18306 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:12.758215 18305 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:12.761536 19262 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:12.762028 19262 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:12.762813 19262 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:12.791085 18303 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:12.795445 19267 ts_tablet_manager.cc:933] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:12.801692 18381 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:12.803200 18384 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:12.793664 18306 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:12.801896 18305 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:12.809311 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:12.810494 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:12.813005 19263 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:12.813644 19263 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:12.814713 19263 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:12.817116 19163 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:12.817690 19163 raft_consensus.cc:697] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:12.817821 18132 catalog_manager.cc:5697] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.818558 19163 consensus_queue.cc:237] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:12.834969 19260 tablet_copy_client.cc:806] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:12.835737 19260 tablet_copy_client.cc:670] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
W20260709 13:17:12.840142 19266 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
I20260709 13:17:12.847286 19265 tablet_copy_client.cc:323] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.129:43781
I20260709 13:17:12.849363 19267 tablet_copy_client.cc:323] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.130:34605
I20260709 13:17:12.851404 18246 tablet_copy_service.cc:140] P b52e2477fc524694967c4a16afa983e3: Received BeginTabletCopySession request for tablet 2cbade5381d641e9b60bcc9994ae9b51 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46128)
I20260709 13:17:12.852021 18246 tablet_copy_service.cc:161] P b52e2477fc524694967c4a16afa983e3: Beginning new tablet copy session on tablet 2cbade5381d641e9b60bcc9994ae9b51 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46128: session id = e016302b7e734d74833a2bf7bab44838-2cbade5381d641e9b60bcc9994ae9b51
I20260709 13:17:12.852964 18322 tablet_copy_service.cc:140] P 459e82ee6b564cc19be6f73186938e79: Received BeginTabletCopySession request for tablet eafcec4c722f49fa90d23d1326870a82 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46642)
I20260709 13:17:12.853544 18322 tablet_copy_service.cc:161] P 459e82ee6b564cc19be6f73186938e79: Beginning new tablet copy session on tablet eafcec4c722f49fa90d23d1326870a82 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46642: session id = e016302b7e734d74833a2bf7bab44838-eafcec4c722f49fa90d23d1326870a82
I20260709 13:17:12.860545 18246 tablet_copy_source_session.cc:215] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:12.863197 19260 tablet_copy_client.cc:538] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:12.865640 18132 catalog_manager.cc:5697] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.870294 19265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cbade5381d641e9b60bcc9994ae9b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.882128 19260 tablet_bootstrap.cc:492] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:12.873091 18322 tablet_copy_source_session.cc:215] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:12.888648 19267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eafcec4c722f49fa90d23d1326870a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.895216 18132 catalog_manager.cc:5697] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 3, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 3 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.897023 18132 catalog_manager.cc:5697] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 3, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 3 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:12.913300 19265 tablet_copy_client.cc:806] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:12.914079 19265 tablet_copy_client.cc:670] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:12.918063 19265 tablet_copy_client.cc:538] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:12.923960 19260 tablet_bootstrap.cc:492] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:12.924875 19260 tablet_bootstrap.cc:492] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:12.925542 19260 ts_tablet_manager.cc:1403] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.005s
I20260709 13:17:12.928347 19265 tablet_bootstrap.cc:492] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:12.928836 19260 raft_consensus.cc:359] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:12.933012 19260 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:12.933738 19260 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:12.936657 19260 ts_tablet_manager.cc:1434] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:17:12.955783 18246 tablet_copy_service.cc:342] P b52e2477fc524694967c4a16afa983e3: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-b1889d6d746545a0bdf04811a102b35b received from {username='slave'} at 127.0.0.1:46128
I20260709 13:17:12.956211 18246 tablet_copy_service.cc:434] P b52e2477fc524694967c4a16afa983e3: ending tablet copy session e016302b7e734d74833a2bf7bab44838-b1889d6d746545a0bdf04811a102b35b on tablet b1889d6d746545a0bdf04811a102b35b with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:12.961704 19260 ts_tablet_manager.cc:933] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:17:12.967142 19267 tablet_copy_client.cc:806] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:12.967901 19267 tablet_copy_client.cc:670] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:12.972476 19267 tablet_copy_client.cc:538] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:12.987780 19267 tablet_bootstrap.cc:492] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:12.995849 19260 tablet_copy_client.cc:323] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.129:43781
I20260709 13:17:12.998054 18246 tablet_copy_service.cc:140] P b52e2477fc524694967c4a16afa983e3: Received BeginTabletCopySession request for tablet 58f88ffc8ca74740b36c09a2eb312c10 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46128)
I20260709 13:17:12.998611 18246 tablet_copy_service.cc:161] P b52e2477fc524694967c4a16afa983e3: Beginning new tablet copy session on tablet 58f88ffc8ca74740b36c09a2eb312c10 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46128: session id = e016302b7e734d74833a2bf7bab44838-58f88ffc8ca74740b36c09a2eb312c10
I20260709 13:17:13.009838 18246 tablet_copy_source_session.cc:215] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:13.015003 19260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f88ffc8ca74740b36c09a2eb312c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:13.025055 19265 tablet_bootstrap.cc:492] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:13.027853 19265 tablet_bootstrap.cc:492] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:13.029635 19265 ts_tablet_manager.cc:1403] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.101s	user 0.022s	sys 0.006s
I20260709 13:17:13.034951 19265 raft_consensus.cc:359] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:13.035745 19265 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:13.036482 19265 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:13.039242 19265 ts_tablet_manager.cc:1434] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:17:13.041190 18246 tablet_copy_service.cc:342] P b52e2477fc524694967c4a16afa983e3: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-2cbade5381d641e9b60bcc9994ae9b51 received from {username='slave'} at 127.0.0.1:46128
I20260709 13:17:13.041640 18246 tablet_copy_service.cc:434] P b52e2477fc524694967c4a16afa983e3: ending tablet copy session e016302b7e734d74833a2bf7bab44838-2cbade5381d641e9b60bcc9994ae9b51 on tablet 2cbade5381d641e9b60bcc9994ae9b51 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:13.043473 19260 tablet_copy_client.cc:806] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:13.044055 19260 tablet_copy_client.cc:670] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:13.047910 19260 tablet_copy_client.cc:538] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:13.056627 19267 tablet_bootstrap.cc:492] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:13.057582 19267 tablet_bootstrap.cc:492] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:13.058446 19267 ts_tablet_manager.cc:1403] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.014s
I20260709 13:17:13.061686 19267 raft_consensus.cc:359] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:13.062513 19267 raft_consensus.cc:740] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:13.063129 19267 consensus_queue.cc:260] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:13.064109 19260 tablet_bootstrap.cc:492] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:13.066267 19267 ts_tablet_manager.cc:1434] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:13.070158 18322 tablet_copy_service.cc:342] P 459e82ee6b564cc19be6f73186938e79: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-eafcec4c722f49fa90d23d1326870a82 received from {username='slave'} at 127.0.0.1:46642
I20260709 13:17:13.070623 18322 tablet_copy_service.cc:434] P 459e82ee6b564cc19be6f73186938e79: ending tablet copy session e016302b7e734d74833a2bf7bab44838-eafcec4c722f49fa90d23d1326870a82 on tablet eafcec4c722f49fa90d23d1326870a82 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:13.118755 19260 tablet_bootstrap.cc:492] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:13.119692 19260 tablet_bootstrap.cc:492] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:13.120432 19260 ts_tablet_manager.cc:1403] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.007s
I20260709 13:17:13.125633 18384 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:13.126030 19260 raft_consensus.cc:359] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:13.127000 19260 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:13.127693 19260 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:13.132082 19238 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:13.138497 19260 ts_tablet_manager.cc:1434] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.004s
I20260709 13:17:13.153944 18246 tablet_copy_service.cc:342] P b52e2477fc524694967c4a16afa983e3: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-58f88ffc8ca74740b36c09a2eb312c10 received from {username='slave'} at 127.0.0.1:46128
I20260709 13:17:13.154426 18246 tablet_copy_service.cc:434] P b52e2477fc524694967c4a16afa983e3: ending tablet copy session e016302b7e734d74833a2bf7bab44838-58f88ffc8ca74740b36c09a2eb312c10 on tablet 58f88ffc8ca74740b36c09a2eb312c10 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:13.191748 18958 raft_consensus.cc:1217] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:13.213862 18235 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:13.215437 19238 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.222661 18384 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:13.224153 19263 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.257469 18303 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:13.268997 19262 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.270423 18303 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:13.280869 19262 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.288828 18306 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:13.293952 18958 raft_consensus.cc:1217] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:13.304298 19262 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.378687 18378 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:13.381774 18958 raft_consensus.cc:1217] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:13.386679 18384 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:13.388618 19264 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.394325 19264 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:13.491622 18958 raft_consensus.cc:1217] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:13.608604 19148 raft_consensus.cc:1064] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:13.617077 19148 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:13.630746 18381 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:13.632421 19163 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:13.633677 18305 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:13.636056 19163 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:13.636713 18958 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:13.644462 19163 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:13.664125 19263 raft_consensus.cc:2955] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:13.668956 18306 raft_consensus.cc:2955] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:13.670712 18958 raft_consensus.cc:2955] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:13.685644 18384 raft_consensus.cc:2955] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:13.688619 18135 catalog_manager.cc:5697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:13.765223 19148 raft_consensus.cc:1064] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:13.767500 19148 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:13.760123 18235 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:13.793992 18958 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:13.798715 19163 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:13.803987 18303 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:13.809602 18960 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:13.812312 18384 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:13.814265 19163 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:13.816485 19262 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:13.821007 18306 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:13.830360 19263 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:13.832444 19263 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:13.836870 19262 raft_consensus.cc:2955] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:13.852550 18958 raft_consensus.cc:2955] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:13.861294 18121 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b1889d6d746545a0bdf04811a102b35b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:13.862833 18306 raft_consensus.cc:2955] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:13.876618 19264 raft_consensus.cc:2955] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:13.877552 18133 catalog_manager.cc:5697] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:13.890138 18371 tablet_service.cc:1558] Processing DeleteTablet for tablet b1889d6d746545a0bdf04811a102b35b with delete_type TABLET_DATA_TOMBSTONED (TS 8b4fbc44aa2649f0bcac5cd70f71951d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46836
I20260709 13:17:13.902022 19304 tablet_replica.cc:333] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:17:13.905424 18306 raft_consensus.cc:2955] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:13.928337 19304 raft_consensus.cc:2243] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:13.930568 19304 raft_consensus.cc:2272] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:13.934167 19304 ts_tablet_manager.cc:1916] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:13.935986 18132 catalog_manager.cc:5697] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:13.913218 18378 raft_consensus.cc:2955] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:13.918951 18959 raft_consensus.cc:2955] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:13.979374 19304 ts_tablet_manager.cc:1929] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:13.979949 19304 log.cc:1199] T b1889d6d746545a0bdf04811a102b35b P 8b4fbc44aa2649f0bcac5cd70f71951d: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-2-root/wals/b1889d6d746545a0bdf04811a102b35b
I20260709 13:17:13.981746 18120 catalog_manager.cc:5028] TS 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): tablet b1889d6d746545a0bdf04811a102b35b (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:17:13.999177 19221 raft_consensus.cc:1064] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:14.002048 19221 consensus_queue.cc:237] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:14.026938 18235 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:14.034080 18959 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:14.035974 19306 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:14.040982 18958 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.044302 19238 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.044404 19163 raft_consensus.cc:2955] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.054067 18960 raft_consensus.cc:2955] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.057798 18306 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:14.059911 19305 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:14.065621 18306 raft_consensus.cc:2955] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.080900 19264 raft_consensus.cc:1064] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:14.083487 19264 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:14.087347 18131 catalog_manager.cc:5697] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: config changed from index 3 to 4, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.094038 18228 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.098495 18378 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.099349 18371 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cbade5381d641e9b60bcc9994ae9b51 with delete_type TABLET_DATA_TOMBSTONED (TS 8b4fbc44aa2649f0bcac5cd70f71951d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46836
I20260709 13:17:14.100540 19304 tablet_replica.cc:333] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:17:14.113049 19304 raft_consensus.cc:2243] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:14.113809 19304 raft_consensus.cc:2272] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:14.120007 19304 ts_tablet_manager.cc:1916] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:14.120455 19238 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.122309 19290 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.151051 18121 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2cbade5381d641e9b60bcc9994ae9b51 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:14.150151 19290 raft_consensus.cc:2955] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.157881 18384 raft_consensus.cc:2955] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.160504 18228 raft_consensus.cc:2955] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.203059 18381 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.203665 18960 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.202090 18958 raft_consensus.cc:2955] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.206208 19163 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.218147 18133 catalog_manager.cc:5697] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.227634 18303 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:14.244181 18303 consensus_queue.cc:237] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:14.247954 19264 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.256752 19304 ts_tablet_manager.cc:1929] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:14.257308 19304 log.cc:1199] T 2cbade5381d641e9b60bcc9994ae9b51 P 8b4fbc44aa2649f0bcac5cd70f71951d: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-2-root/wals/2cbade5381d641e9b60bcc9994ae9b51
I20260709 13:17:14.258977 18120 catalog_manager.cc:5028] TS 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): tablet 2cbade5381d641e9b60bcc9994ae9b51 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:17:14.293692 19306 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.314400 18384 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:14.315923 18958 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:14.316067 19238 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:14.318493 19221 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:14.333173 18381 raft_consensus.cc:2955] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.336711 18959 raft_consensus.cc:2955] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.325253 19308 raft_consensus.cc:2955] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:17:14.373312 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 77724us
I20260709 13:17:14.382411 18132 catalog_manager.cc:5697] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 3 to 4, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.396478 19263 raft_consensus.cc:2955] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.411419 18303 raft_consensus.cc:2955] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.413590 18121 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eafcec4c722f49fa90d23d1326870a82 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:14.420614 18959 raft_consensus.cc:2955] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.430352 18132 catalog_manager.cc:5697] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.441030 18225 tablet_service.cc:1558] Processing DeleteTablet for tablet eafcec4c722f49fa90d23d1326870a82 with delete_type TABLET_DATA_TOMBSTONED (TS b52e2477fc524694967c4a16afa983e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42512
I20260709 13:17:14.435248 18381 raft_consensus.cc:2955] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.481953 19317 tablet_replica.cc:333] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:17:14.483193 19317 raft_consensus.cc:2243] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:14.497372 19317 raft_consensus.cc:2272] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:14.503428 18232 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:14.509451 18959 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:14.512795 19263 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:14.518018 19317 ts_tablet_manager.cc:1916] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:14.527943 19264 raft_consensus.cc:2955] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.534173 18959 raft_consensus.cc:2955] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.559401 19317 ts_tablet_manager.cc:1929] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:14.559957 19317 log.cc:1199] T eafcec4c722f49fa90d23d1326870a82 P b52e2477fc524694967c4a16afa983e3: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-0-root/wals/eafcec4c722f49fa90d23d1326870a82
I20260709 13:17:14.561026 18383 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:14.562871 18121 catalog_manager.cc:5028] TS b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): tablet eafcec4c722f49fa90d23d1326870a82 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:17:14.563831 19263 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:14.571621 18121 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 58f88ffc8ca74740b36c09a2eb312c10 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:14.579493 18133 catalog_manager.cc:5697] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.587113 18381 raft_consensus.cc:2955] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:14.598027 18301 tablet_service.cc:1558] Processing DeleteTablet for tablet 58f88ffc8ca74740b36c09a2eb312c10 with delete_type TABLET_DATA_TOMBSTONED (TS 459e82ee6b564cc19be6f73186938e79 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43780
I20260709 13:17:14.616803 19318 tablet_replica.cc:333] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:17:14.618125 19318 raft_consensus.cc:2243] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:14.618911 19318 raft_consensus.cc:2272] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:14.623998 19318 ts_tablet_manager.cc:1916] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:14.660269 19318 ts_tablet_manager.cc:1929] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:14.660688 19318 log.cc:1199] T 58f88ffc8ca74740b36c09a2eb312c10 P 459e82ee6b564cc19be6f73186938e79: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-1-root/wals/58f88ffc8ca74740b36c09a2eb312c10
I20260709 13:17:14.662511 18121 catalog_manager.cc:5028] TS 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): tablet 58f88ffc8ca74740b36c09a2eb312c10 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
W20260709 13:17:15.733147 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 56002.4us
I20260709 13:17:15.881826 18306 consensus_queue.cc:237] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
W20260709 13:17:15.899617 18275 consensus_peers.cc:597] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 943649b738074d87a593c237cf998758. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.900414 18235 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:15.901093 18383 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:15.902236 19221 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:15.906663 19324 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:15.930727 19324 raft_consensus.cc:2955] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:15.938999 18230 raft_consensus.cc:2955] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:15.942102 18383 raft_consensus.cc:2955] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:15.954795 18230 consensus_queue.cc:237] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:15.957593 18132 catalog_manager.cc:5697] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:15.986387 18200 consensus_peers.cc:597] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b14d7467c934fdca91c8a466ef2d764. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:15.988631 18384 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:15.990487 18311 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:15.990592 19322 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:15.995539 19264 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:16.008002 19322 raft_consensus.cc:2955] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:16.010854 18311 raft_consensus.cc:2955] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:16.043452 18235 consensus_queue.cc:237] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:16.043599 18384 raft_consensus.cc:2955] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:16.071717 18131 catalog_manager.cc:5697] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:16.111905 18384 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:16.113919 18311 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:16.115411 19264 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:16.117220 18200 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80d0760748294d8d8cb291466766b8a5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:16.117553 19264 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:16.138346 19264 raft_consensus.cc:2955] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:16.142863 18311 raft_consensus.cc:2955] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:16.142863 18383 raft_consensus.cc:2955] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:16.174281 18133 catalog_manager.cc:5697] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index -1 to 2, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 1 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:16.178283 18306 consensus_queue.cc:237] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
W20260709 13:17:16.191728 18275 consensus_peers.cc:597] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1dea3366ee674017a0bbfc9bce0d9a73. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:16.193939 18384 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:16.195549 19238 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:16.205416 18235 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:16.213461 19221 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:16.237865 19324 raft_consensus.cc:2955] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:16.241600 18232 raft_consensus.cc:2955] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:16.258203 18383 raft_consensus.cc:2955] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:17:16.259692 18133 catalog_manager.cc:5697] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: config changed from index -1 to 3, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 2 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.445062 19344 ts_tablet_manager.cc:933] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:16.451285 19344 tablet_copy_client.cc:323] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.130:34605
I20260709 13:17:16.598141 18322 tablet_copy_service.cc:140] P 459e82ee6b564cc19be6f73186938e79: Received BeginTabletCopySession request for tablet 943649b738074d87a593c237cf998758 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46642)
I20260709 13:17:16.598872 18322 tablet_copy_service.cc:161] P 459e82ee6b564cc19be6f73186938e79: Beginning new tablet copy session on tablet 943649b738074d87a593c237cf998758 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46642: session id = e016302b7e734d74833a2bf7bab44838-943649b738074d87a593c237cf998758
I20260709 13:17:16.612581 18322 tablet_copy_source_session.cc:215] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:16.636724 19344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 943649b738074d87a593c237cf998758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.668382 19344 tablet_copy_client.cc:806] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:16.669229 19344 tablet_copy_client.cc:670] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:16.674463 19344 tablet_copy_client.cc:538] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:17:16.738276 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51051.1us
I20260709 13:17:16.763188 19352 ts_tablet_manager.cc:933] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
W20260709 13:17:16.765180 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 90348us
I20260709 13:17:16.777519 19352 tablet_copy_client.cc:323] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.129:43781
I20260709 13:17:16.792073 19354 ts_tablet_manager.cc:933] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:17:16.800823 19356 ts_tablet_manager.cc:933] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:16.804467 18246 tablet_copy_service.cc:140] P b52e2477fc524694967c4a16afa983e3: Received BeginTabletCopySession request for tablet 80d0760748294d8d8cb291466766b8a5 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46128)
I20260709 13:17:16.805086 18246 tablet_copy_service.cc:161] P b52e2477fc524694967c4a16afa983e3: Beginning new tablet copy session on tablet 80d0760748294d8d8cb291466766b8a5 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46128: session id = e016302b7e734d74833a2bf7bab44838-80d0760748294d8d8cb291466766b8a5
I20260709 13:17:16.807029 19344 tablet_bootstrap.cc:492] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:16.825098 19354 tablet_copy_client.cc:323] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.129:43781
I20260709 13:17:16.831928 18246 tablet_copy_source_session.cc:215] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:16.842168 19356 tablet_copy_client.cc:323] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.130:34605
I20260709 13:17:16.844941 18322 tablet_copy_service.cc:140] P 459e82ee6b564cc19be6f73186938e79: Received BeginTabletCopySession request for tablet 1dea3366ee674017a0bbfc9bce0d9a73 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46642)
I20260709 13:17:16.845690 18322 tablet_copy_service.cc:161] P 459e82ee6b564cc19be6f73186938e79: Beginning new tablet copy session on tablet 1dea3366ee674017a0bbfc9bce0d9a73 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46642: session id = e016302b7e734d74833a2bf7bab44838-1dea3366ee674017a0bbfc9bce0d9a73
I20260709 13:17:16.854251 18322 tablet_copy_source_session.cc:215] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:16.865890 19356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dea3366ee674017a0bbfc9bce0d9a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:16.874398 19344 tablet_bootstrap.cc:492] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:16.875802 19344 tablet_bootstrap.cc:492] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:16.876845 19344 ts_tablet_manager.cc:1403] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.073s	user 0.028s	sys 0.008s
I20260709 13:17:16.881312 19344 raft_consensus.cc:359] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:16.882383 19344 raft_consensus.cc:740] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:16.883219 19344 consensus_queue.cc:260] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:16.894026 19344 ts_tablet_manager.cc:1434] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:17:16.909977 18322 tablet_copy_service.cc:342] P 459e82ee6b564cc19be6f73186938e79: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-943649b738074d87a593c237cf998758 received from {username='slave'} at 127.0.0.1:46642
I20260709 13:17:16.917964 18322 tablet_copy_service.cc:434] P 459e82ee6b564cc19be6f73186938e79: ending tablet copy session e016302b7e734d74833a2bf7bab44838-943649b738074d87a593c237cf998758 on tablet 943649b738074d87a593c237cf998758 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:16.926829 19352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d0760748294d8d8cb291466766b8a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:16.929597 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 51217.1us
I20260709 13:17:16.938251 18246 tablet_copy_service.cc:140] P b52e2477fc524694967c4a16afa983e3: Received BeginTabletCopySession request for tablet 2b14d7467c934fdca91c8a466ef2d764 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46128)
I20260709 13:17:16.938880 18246 tablet_copy_service.cc:161] P b52e2477fc524694967c4a16afa983e3: Beginning new tablet copy session on tablet 2b14d7467c934fdca91c8a466ef2d764 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46128: session id = e016302b7e734d74833a2bf7bab44838-2b14d7467c934fdca91c8a466ef2d764
I20260709 13:17:17.456133 19356 tablet_copy_client.cc:806] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:17.456846 19356 tablet_copy_client.cc:670] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:17.457163 19352 tablet_copy_client.cc:806] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:17.457716 19352 tablet_copy_client.cc:670] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:18.338529 19372 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.339274 19372 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.341604 19372 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.350757 19374 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.350993 19372 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.351410 19374 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.351749 19372 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.353811 19377 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.354559 19377 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.355242 19372 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.356698 19377 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.359903 19376 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.360410 19376 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.361328 19374 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:18.362358 19376 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.369712 19373 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.370239 19373 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.370584 19378 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.371134 19378 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.372313 19373 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.373855 19376 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.374010 19378 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.374456 19376 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.374920 19378 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.375752 19378 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:18.378517 19382 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.379127 19382 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.381178 19382 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.381729 19382 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.382272 19382 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.382998 19378 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.383987 19378 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.384249 19382 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.384861 19382 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.384552 19378 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.385336 19382 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.376555 19376 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.377040 19379 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.387776 19382 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.388559 19379 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.389312 19382 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.389897 19382 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.391952 19382 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.391983 19379 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.394290 19378 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.395658 19373 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.396154 19373 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.396481 19372 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.396992 19372 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.398231 19373 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.398738 19373 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.399008 19372 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.399251 19373 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.401394 19373 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.401965 19373 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.402634 19374 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.402585 19373 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:18.403194 19374 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.404651 19377 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.405244 19377 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.406317 19373 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.407106 19373 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.407711 19373 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.407228 19377 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.413921 19377 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.414180 19373 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.414691 19373 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.404920 19383 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.415174 19373 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.408214 19374 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.410053 19372 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.416356 19372 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.417284 19373 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.418793 19372 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.414578 19377 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.422601 19377 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.412292 19385 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.427148 19376 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.427601 19324 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.427682 19385 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.427800 19376 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.428309 19324 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:18.430503 19324 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.430580 19376 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.415345 19383 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:18.425691 19378 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.431049 19324 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.426738 19379 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.431362 19376 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.431589 19324 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.431913 19379 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.433717 19324 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.433827 19379 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.434576 19324 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.434971 19379 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.435045 19324 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.435563 19379 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.437152 19324 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.438309 19379 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.431465 19378 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.441365 19378 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.430976 19385 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.444722 19383 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.411525 19381 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.445688 19381 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.448659 19381 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.459128 19388 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.459893 19388 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.462433 19388 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.490152 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.490558 19388 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.491046 19388 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.491699 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.492887 19388 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.463686 19326 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.493871 19326 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.432016 19376 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.496249 19326 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.497471 19326 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.498119 19376 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.471709 19383 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.509042 19383 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.509776 19375 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.510318 18229 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:18.510380 19375 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.511535 19383 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.472397 19385 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.512342 19385 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.512807 19375 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.514160 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.514446 19385 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.514717 19375 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.473282 19377 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.515276 19375 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.515689 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.476428 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.473613 19387 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.516635 19387 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.517105 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.517298 19375 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.518343 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.518950 19387 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.480451 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.519814 18310 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:18.520782 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.482008 19391 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.484377 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.522017 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.522338 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.522957 18308 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:18.523175 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.523855 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.482930 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.524829 19391 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.525408 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.525882 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:18.486886 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.487062 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.518975 18307 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:18.473269 19384 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.488570 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.489171 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.524258 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.527501 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.528558 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.528820 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.529374 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:18.529911 18350 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.323s	user 0.015s	sys 0.008s
I20260709 13:17:18.469375 19381 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.463513 19389 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.470880 19386 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:18.504738 19388 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.485574 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.505638 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.506805 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.515456 19377 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.524392 18308 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:18.498023 19326 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.488421 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.529446 18233 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:18.529765 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.492980 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.527602 19384 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.504997 18962 raft_consensus.cc:1217] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:18.527316 19391 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.526019 18303 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
W20260709 13:17:18.530402 18350 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.324s	user 0.016s	sys 0.009s
I20260709 13:17:18.544283 19378 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.544971 19378 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.530202 18229 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:18.549767 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.553900 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:18.554450 18962 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
W20260709 13:17:18.555014 18166 debug-util.cc:398] Leaking SignalData structure 0x7b0800035cc0 after lost signal to thread 17141
I20260709 13:17:18.530716 19381 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.555912 19390 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:18.556222 18166 debug-util.cc:398] Leaking SignalData structure 0x7b08000343a0 after lost signal to thread 18169
I20260709 13:17:18.556420 19390 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:18.557778 18166 debug-util.cc:398] Leaking SignalData structure 0x7b08001cd4e0 after lost signal to thread 18261
I20260709 13:17:18.558851 19390 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:18.559159 18166 debug-util.cc:398] Leaking SignalData structure 0x7b0800338740 after lost signal to thread 18336
I20260709 13:17:18.563016 19392 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.531240 19386 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.563797 19392 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.564244 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:18.565003 18955 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:18.565766 19386 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:18.531649 18311 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:18.531333 19388 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.532618 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.566941 19392 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.534237 18228 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:18.534502 18246 tablet_copy_source_session.cc:215] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:18.569399 18246 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:46128 (request call id 37) took 1641 ms. Trace:
I20260709 13:17:18.568380 19388 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.569836 18246 rpcz_store.cc:276] 0709 13:17:16.928037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.938080 (+ 10043us) service_pool.cc:224] Handling call
0709 13:17:18.569301 (+1631221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:18.570420 18275 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:18.557025 19381 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.535830 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:18.572291 19381 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.572820 19381 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.573064 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:18.573282 19381 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.574123 19238 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.574427 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:18.538550 18237 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:18.539080 19326 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.537878 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.575260 19375 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:18.576331 19375 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.576447 19387 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.576766 19375 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:18.577013 19387 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.577715 19387 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.536877 19361 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.578526 19361 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.541587 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.581044 18303 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:18.542425 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.582299 18309 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:18.542642 19380 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.583530 19380 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:18.543011 18276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.364s	user 0.006s	sys 0.016s
W20260709 13:17:18.585853 18276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.411s	user 0.006s	sys 0.016s
I20260709 13:17:18.543864 18277 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:18.589279 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 45485us
I20260709 13:17:18.561246 19315 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.590615 19315 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.591261 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:18.531919 19382 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.533596 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.530972 19389 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.593510 19382 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.593962 19382 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.527343 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.538174 19280 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.537411 18235 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:18.595468 19280 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.535564 19377 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:18.564270 18352 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.205s	user 0.000s	sys 0.014s
W20260709 13:17:18.597680 18352 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.238s	user 0.000s	sys 0.015s
I20260709 13:17:18.592768 19324 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.599650 19324 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.600033 19324 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.604202 19345 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.604833 19345 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.574604 19238 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.608263 19238 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.593868 18234 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:18.540692 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.613925 19348 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:18.614915 18351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.259s	user 0.056s	sys 0.043s
I20260709 13:17:18.614586 19348 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.540957 19384 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:18.616112 18351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.056s	sys 0.043s
I20260709 13:17:18.617144 19394 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.617789 19394 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.562271 19378 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:18.591488 19347 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.622478 19347 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.623008 19347 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.623775 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.562165 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:18.560474 18166 debug-util.cc:398] Leaking SignalData structure 0x7b080033b2a0 after lost signal to thread 18410
I20260709 13:17:18.636853 19319 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.637641 19319 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.655112 19345 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.655932 19345 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.656489 19345 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:18.658807 19345 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.659881 19361 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.661468 19280 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.661988 19319 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:18.661621 19375 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.662511 19380 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.662972 19315 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.664021 19382 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.664465 18200 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:18.733721 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.664149 19389 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.665961 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:18.669281 19348 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.753504 18307 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:18.754426 19382 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.729686 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.755774 18305 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
I20260709 13:17:18.758843 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.759107 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.759670 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.759925 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:17:18.672811 18166 debug-util.cc:398] Leaking SignalData structure 0x7b08003130a0 after lost signal to thread 18986
I20260709 13:17:18.674154 19394 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.576956 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:18.682008 19398 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.763667 19384 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.764142 19384 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.763827 19398 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.766100 19398 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.684990 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:18.686709 19347 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.767225 19384 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.767372 19356 tablet_copy_client.cc:538] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:18.768600 19347 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.691339 19387 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.770766 19387 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.694768 19381 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.772646 19381 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:18.772722 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 108319us
I20260709 13:17:18.773317 19381 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.773691 19381 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.774050 19381 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.775060 19396 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.775516 19396 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.776118 18234 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:18.777079 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 200164us
I20260709 13:17:18.777577 19396 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.777680 19385 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.778003 18202 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:18.709323 19395 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.730623 19386 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.778874 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:18.778793 19395 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.779296 19386 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:18.698635 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 106089us
I20260709 13:17:18.712584 19379 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.713488 19397 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.781909 19379 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.782318 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:18.782030 19397 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.697295 19324 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.714116 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.783519 18310 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
I20260709 13:17:18.715165 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.716310 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.717474 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.717761 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.779798 19396 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.719921 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.721295 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.727530 19238 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.750641 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.751705 19375 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.778137 19385 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.791072 19385 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.780272 19373 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.790812 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:18.713300 19378 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.798720 19386 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.779765 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:18.786211 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.787158 19395 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:18.783962 18381 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
I20260709 13:17:18.784822 18380 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
I20260709 13:17:18.785622 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.806759 18927 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:18.762264 19380 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.807185 18926 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:18.807605 19389 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.808085 19389 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.808259 18926 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:18.789736 19397 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.789853 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.790723 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.809368 19388 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.789160 19379 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:18.794708 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.811244 19388 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.788179 18385 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
I20260709 13:17:18.813252 19388 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.795351 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.796029 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.793061 19373 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.815021 19373 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.797432 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.816275 19394 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.816874 19394 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.818944 19394 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.807583 19380 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.797571 19324 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.781922 19387 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.820335 19326 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.820559 19387 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.820863 19326 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.821084 19387 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.821566 19380 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:18.821712 18926 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:18.822561 19390 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.821187 19388 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.822950 19390 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.823361 19390 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.798606 19378 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.718761 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.825495 19238 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:18.800781 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:18.825891 18384 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
I20260709 13:17:18.803544 19384 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.804643 18233 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:18.793372 19396 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.835013 19398 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.835613 19398 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.834901 19397 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.836655 19396 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.836803 19397 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.794483 18312 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 2: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:18.837703 19398 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.808578 19389 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.825508 19383 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.838829 19397 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.838907 19383 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.780031 18305 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
I20260709 13:17:18.825528 19326 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.826843 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:18.841607 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:18.842118 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.843801 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.844815 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.845206 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.833464 19384 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.833535 18926 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:18.834450 19348 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.834899 19378 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.837189 19396 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.838225 19398 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.832012 19361 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.824440 19376 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.854487 19392 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.855109 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.939703 18381 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:18.856287 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.858830 19390 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.849958 19347 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.940721 19347 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.941121 18960 raft_consensus.cc:1240] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:18.860507 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 80802.2us
I20260709 13:17:18.942091 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:18.862393 19361 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:18.942138 19390 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.864673 19375 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.856074 19348 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.808136 18927 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:18.847636 19380 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.951848 19380 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.952299 19380 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.864267 19400 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.850356 19394 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:18.914038 19356 tablet_bootstrap.cc:492] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:18.915951 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.917785 19401 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.920217 19388 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.920954 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.960162 19345 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:18.960950 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.961712 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.962870 19374 consensus_queue.cc:1059] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:18.963495 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.963948 19374 raft_consensus.cc:3055] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:18.964404 19374 raft_consensus.cc:740] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:18.965206 19374 consensus_queue.cc:260] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.966923 18957 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:18.967785 19374 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.911742 19376 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.969250 19376 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.921739 19373 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.923605 19326 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.972070 19384 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:18.855144 19383 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.885588 19396 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.929901 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:18.930935 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:18.931239 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.932255 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:18.985971 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.986135 19326 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:18.986866 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.979683 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.988420 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.863803 19398 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.932963 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.933641 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.936985 19389 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.938786 19381 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:18.941186 19347 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.850507 19395 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:19.003091 19395 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:19.003547 19395 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.003767 19398 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.949496 19361 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.950191 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:18.950629 19397 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:18.950800 19375 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:18.951308 19348 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:18.953002 19392 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:19.013938 19392 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.013618 19387 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.976316 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.977257 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.978374 18960 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:18.979343 19345 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:18.979574 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.979728 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.979362 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.980850 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.981436 18307 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:18.989939 19377 consensus_queue.cc:1059] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:17:19.020628 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.020927 19377 raft_consensus.cc:3055] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.021306 19377 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:19.021850 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:19.021903 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.022588 18307 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.981770 18312 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.023865 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:19.024694 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:18.993057 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.002036 19389 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.025141 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:19.016808 18228 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.019399 19345 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:18.948838 19372 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:18.981907 19401 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.957056 19400 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:18.971413 19394 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.010363 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:18.983629 19385 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.012677 19397 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.038944 19397 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:19.011368 19375 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.014832 18303 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
W20260709 13:17:18.992189 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 184265us
I20260709 13:17:19.018393 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.025079 18312 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:19.032074 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.036077 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.036648 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.032918 19372 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:19.041923 18379 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:19.042189 19372 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.022591 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.022881 18377 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:19.027906 19345 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.051107 19345 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.052103 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.052845 18380 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:19.053395 19394 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:19.056528 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.057204 18380 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:19.059620 18229 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.065448 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:19.022145 19377 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:19.079339 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.052120 19386 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:17:19.080775 19373 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:19.083767 18983 debug-util.cc:398] Leaking SignalData structure 0x7b080009d1e0 after lost signal to thread 17141
I20260709 13:17:19.081444 19386 raft_consensus.cc:3055] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.084388 19386 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:17:19.084861 18983 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2d20 after lost signal to thread 18169
W20260709 13:17:19.086107 18983 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5760 after lost signal to thread 18261
W20260709 13:17:19.087215 18983 debug-util.cc:398] Leaking SignalData structure 0x7b0800317b20 after lost signal to thread 18336
W20260709 13:17:19.088258 18983 debug-util.cc:398] Leaking SignalData structure 0x7b080029b6a0 after lost signal to thread 18410
I20260709 13:17:19.085448 19386 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:19.088874 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.090101 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.090724 18381 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:19.091023 19377 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.089370 19386 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.089792 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.098675 18379 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:19.091964 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.099665 19400 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:19.100414 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.112015 18385 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:19.101013 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:19.104378 19385 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.104766 19396 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:19.105562 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.106292 19392 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:19.117295 19392 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.117865 19347 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.119073 18309 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.119973 19376 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.107364 19401 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:19.108505 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.107396 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:19.111001 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.109545 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.106698 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.123131 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.127933 18377 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:19.128089 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.127351 18380 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:19.131171 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.132366 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:19.133754 19381 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:19.134428 18311 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.126590 19347 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.143605 19376 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.146348 18231 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:19.152719 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.153141 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:19.154294 19387 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.154492 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.157302 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.159866 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:19.163551 19376 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.164253 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:19.151001 18983 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7f20 after lost signal to thread 18986
W20260709 13:17:19.172233 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 179343us
I20260709 13:17:19.167930 19375 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.185103 19375 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.192504 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.195983 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:19.196677 18275 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:19.197355 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:19.201536 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.202116 19403 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.202713 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.203490 18237 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 2: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:19.206532 19354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b14d7467c934fdca91c8a466ef2d764. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:19.190913 18983 debug-util.cc:398] Leaking SignalData structure 0x7b08002f01a0 after lost signal to thread 19354
I20260709 13:17:19.211452 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:19.208355 18983 debug-util.cc:398] Leaking SignalData structure 0x7b08002e1280 after lost signal to thread 19355
W20260709 13:17:19.217487 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.218255 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.218215 19315 consensus_queue.cc:1059] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:19.218220 19352 tablet_copy_client.cc:538] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:19.219041 19372 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.222576 18228 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:19.223052 19372 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.220362 19401 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:17:19.224596 19395 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.229322 19395 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.231199 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.230155 19315 raft_consensus.cc:3055] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.215221 19345 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:17:19.232710 19315 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:19.234205 19315 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:19.235394 19315 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.232949 19401 raft_consensus.cc:3055] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.232148 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.237007 19401 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:19.245019 19345 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.245499 19345 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:19.245955 19401 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.246366 19345 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.247303 19401 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:19.249668 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.247815 19345 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.251127 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.257391 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:19.263476 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.263785 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.264719 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.264987 18957 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.265340 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.265528 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.265008 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.266460 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.267634 19375 consensus_queue.cc:1059] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:19.268715 19375 raft_consensus.cc:3055] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.268873 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.269075 19375 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:19.270020 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.269917 19375 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:19.271245 19375 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.246343 18307 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:19.275133 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:19.275660 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:19.275895 18311 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:19.276947 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:19.277271 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:19.278020 18303 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:19.278899 18229 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:19.282009 19380 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.283033 18305 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.256203 18231 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:19.286211 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.292584 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.293401 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.293896 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.294549 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.295092 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.295764 18228 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 2: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:19.294549 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.302029 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.304800 19352 tablet_bootstrap.cc:492] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:19.304865 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.307022 18379 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:19.321194 19376 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:19.321700 19376 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:19.322078 19376 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.322391 18276 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.323150 19238 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.324435 18276 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.325224 19238 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.326460 18276 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.327219 19238 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:19.328329 18276 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.296054 19380 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.329195 19238 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:19.329521 19238 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:19.329823 19238 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.330664 18382 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:19.335310 19376 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.335634 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:19.336894 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.336977 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.337565 19372 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:19.337958 19372 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:19.338160 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:19.338390 19372 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.339035 19374 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:19.345655 19372 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.346341 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.351163 19392 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:19.352277 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63608.7us
I20260709 13:17:19.352933 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.350210 18276 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.347731 19238 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.294616 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.355403 18276 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.355533 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.357940 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.358825 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.360661 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.360476 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:19.361621 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.364632 19395 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:19.365108 19395 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:19.365520 19395 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.366374 19380 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:19.366827 19380 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:19.367265 19380 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.366963 19238 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.375171 18379 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:19.377638 19380 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.380983 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:17:19.381385 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 86826.7us
I20260709 13:17:19.382498 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.383600 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.384117 19315 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.384703 19401 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:19.386554 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.383770 18927 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:19.391505 19392 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:19.391973 19392 raft_consensus.cc:697] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 2 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:19.392879 19392 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:19.393446 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.395309 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.395504 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.396250 18380 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:19.397058 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.380937 19372 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.398432 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.398976 18384 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:19.388834 18276 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.400121 18201 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.354882 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:19.406561 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 51750.8us
I20260709 13:17:19.404860 19401 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.407912 19381 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:19.407608 18201 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.410126 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.411623 18201 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.414319 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.409242 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.415333 19381 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.417565 19238 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.418380 19383 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.418684 18927 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:19.419860 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:19.420655 19389 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:19.420717 19324 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:19.421260 19389 raft_consensus.cc:697] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 2 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:19.422461 19389 consensus_queue.cc:237] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:19.424674 19326 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:19.425158 19326 raft_consensus.cc:697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 2 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:19.426000 19326 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:19.425740 18133 catalog_manager.cc:5697] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 1 to 2, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 2 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:19.421293 19324 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:19.418380 18276 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.429270 19238 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:19.429646 19238 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:19.430012 19238 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.434029 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.434262 18276 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.429941 19324 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.436039 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.437363 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.438557 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:19.439365 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 59693.2us
I20260709 13:17:19.431151 19315 consensus_queue.cc:1059] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:17:19.441015 19404 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.431175 18379 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
W20260709 13:17:19.442325 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.443428 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.444145 19397 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.444736 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.415820 19405 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:19.445811 18349 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:19.446097 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.444042 19238 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.444600 19396 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.447613 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.448326 19382 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:19.448907 18926 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.459860 19382 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:19.449679 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.462641 19392 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.464406 19404 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.449446 19395 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.466833 19395 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.445202 19394 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.468014 18304 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.454931 18305 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.445441 19400 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.444753 19397 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:17:19.429597 19356 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:17:19.462705 19382 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.487653 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.454867 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.491282 18201 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:19.492254 19404 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:19.492751 19404 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:19.493112 19404 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.494771 19377 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:19.471076 19380 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.496483 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.478504 19405 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:19.499967 19238 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.498342 18201 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:19.497157 19377 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:19.505664 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:19.517318 19377 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.518329 18201 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.519479 18201 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.520171 19372 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:19.520473 18201 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.522394 19376 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.523648 18201 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.510303 19397 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.525982 19397 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.526628 19356 tablet_bootstrap.cc:492] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:19.527678 19356 tablet_bootstrap.cc:492] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:19.511570 19381 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:19.523844 19399 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.528142 19381 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:19.528609 19381 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.505367 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.520922 19386 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:19.520741 19372 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:19.507696 19280 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.521224 19374 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.529569 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.534349 18201 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.539393 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.539814 18201 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:19.534835 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 82594.5us
I20260709 13:17:19.476487 18927 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.540833 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.542089 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.567755 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.561066 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.565838 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.563715 18311 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.546976 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.571830 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.563401 18230 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.546433 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.545307 18304 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.545002 18201 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.577745 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.578019 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.578339 18235 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.579154 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.579568 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.580004 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.580331 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:19.581302 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 48428us
I20260709 13:17:19.536001 19356 ts_tablet_manager.cc:1403] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.622s	user 0.033s	sys 0.006s
I20260709 13:17:19.536098 19385 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.592857 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.538355 19280 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:19.641536 18232 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:19.596180 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 55444.5us
W20260709 13:17:19.595932 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52206.2us
I20260709 13:17:19.642014 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.643656 18276 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.644078 18201 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.567361 19383 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.646391 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.538770 19372 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.614392 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.579157 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.649088 19280 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.533051 19375 consensus_queue.cc:1059] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.109s
I20260709 13:17:19.594836 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.590026 19324 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:19.537261 19396 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:17:19.682965 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.682158 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.570277 19387 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.683554 18276 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.684536 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.651897 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:19.685156 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.685845 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.686064 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.686259 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.644872 19403 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:17:19.675441 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 199834us
W20260709 13:17:19.693583 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 49592.6us
I20260709 13:17:19.695740 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.708339 19324 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.709869 18237 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.711174 19280 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.715569 19377 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.717067 18307 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.704434 19376 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.709650 19356 raft_consensus.cc:359] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:19.722302 19356 raft_consensus.cc:740] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:19.723095 19356 consensus_queue.cc:260] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:19.722949 19387 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.727141 19354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54004 (request call id 112) took 2976 ms. Trace:
I20260709 13:17:19.691193 19380 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.729470 18231 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.731688 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.590986 19386 consensus_queue.cc:1059] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 13:17:19.733680 19382 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:19.735638 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.735718 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.690485 19405 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.736382 19326 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:19.736810 19326 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:19.697106 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.594866 19402 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.569721 19401 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 13:17:19.701329 18276 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:19.702584 18311 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.739809 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.740983 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.596158 19389 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.687644 19400 consensus_queue.cc:1059] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:17:19.752537 19315 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.752964 19315 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:19.753846 19315 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.754887 19280 raft_consensus.cc:3055] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.755108 19315 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.755304 19280 raft_consensus.cc:740] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:19.756790 18927 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.757614 19384 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.737236 19326 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.759169 18927 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.761318 18957 raft_consensus.cc:1240] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.735837 19382 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.703785 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:19.756268 19280 consensus_queue.cc:260] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:19.742501 19403 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.742013 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:19.736917 19372 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.765803 19392 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.766470 18276 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.767282 19372 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.767925 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.768237 19380 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.769024 19380 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.769521 18276 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.770177 19380 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.745182 19401 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.746647 19396 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.727533 19354 rpcz_store.cc:276] 0709 13:17:16.750834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.750980 (+   146us) service_pool.cc:224] Handling call
0709 13:17:16.794901 (+ 43921us) ts_tablet_manager.cc:934] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
0709 13:17:19.205312 (+2410411us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:17:19.244099 (+ 38787us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:19.244220 (+   121us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:17:19.726407 (+482187us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:17:19.726708 (+   301us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:19.726998 (+   290us) ts_tablet_manager.cc:989] Replica registered.
0709 13:17:19.727052 (+    54us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":286,"tablet-copy.queue_time_us":40298,"thread_start_us":62606,"threads_started":2}
I20260709 13:17:19.655315 19399 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.703810 19404 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.776023 18957 raft_consensus.cc:1217] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:17:19.770977 18276 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.777763 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.778282 18276 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.778908 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.779146 18311 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.780494 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:19.781044 18276 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.783386 19410 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:19.783912 19410 raft_consensus.cc:697] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:19.784224 19350 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.784880 19410 consensus_queue.cc:237] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.785590 19354 tablet_copy_client.cc:806] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:19.784843 18310 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.785765 19345 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:19.786319 19354 tablet_copy_client.cc:670] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:19.776988 19404 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:19.787179 19361 raft_consensus.cc:3055] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.787568 19361 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:19.790241 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.770882 19380 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.792991 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.795825 19361 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.805353 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.809345 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.781282 19382 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.781944 19396 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.810220 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.796957 19375 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:19.815739 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.810590 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.808465 19387 raft_consensus.cc:3055] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.820343 19387 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:19.821324 19387 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.822682 19387 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.825944 18201 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.818215 19396 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.783015 19397 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:19.788451 19401 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.828469 19361 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.830451 18201 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.831673 18201 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.833437 18201 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.838142 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.838943 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.839447 19377 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.839746 19372 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.840847 19375 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.841841 19395 raft_consensus.cc:1064] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:19.841952 18201 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.843307 18201 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.848160 18235 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.848392 19395 consensus_queue.cc:237] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:19.850030 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.851393 19403 consensus_queue.cc:1059] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:19.869280 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.871505 19238 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:17:19.872342 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 67475.1us
I20260709 13:17:19.873106 18201 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:19.875465 18201 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.834789 19402 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:19.835110 19383 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:19.834499 19385 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.889289 18232 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:19.889533 19348 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.889995 19348 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:19.893774 18276 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.883375 19280 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.895787 18276 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.865418 19375 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.878129 18201 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:19.880596 18236 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.883270 19382 raft_consensus.cc:3055] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.883347 18377 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.903777 19382 raft_consensus.cc:740] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:19.904780 19382 consensus_queue.cc:260] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:19.906059 19382 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.879244 19415 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:19.853430 19381 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.898888 19324 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.910534 19381 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:19.911437 18229 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.890853 19348 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.913728 19348 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.893821 19356 ts_tablet_manager.cc:1434] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.299s	user 0.008s	sys 0.000s
I20260709 13:17:19.902040 19414 raft_consensus.cc:3055] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.902204 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.877826 19405 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:17:19.916435 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 145413us
W20260709 13:17:19.918001 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 108699us
I20260709 13:17:19.918516 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:17:19.917186 19415 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:19.921553 19376 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.879869 19387 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.917285 19418 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.925750 19280 consensus_queue.cc:1059] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:19.932941 19280 raft_consensus.cc:3055] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.933425 19280 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:19.937912 19387 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:17:19.943436 19415 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.945976 18276 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.949062 19238 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.949470 18276 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.950335 19238 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.950722 18276 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.951607 19238 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.927868 19414 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:19.934201 19381 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:19.959124 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.961830 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.964262 19280 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.927699 19375 consensus_queue.cc:1059] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:17:19.929627 19399 consensus_queue.cc:1059] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:17:19.968662 18322 tablet_copy_service.cc:342] P 459e82ee6b564cc19be6f73186938e79: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-1dea3366ee674017a0bbfc9bce0d9a73 received from {username='slave'} at 127.0.0.1:46642
I20260709 13:17:19.969177 18322 tablet_copy_service.cc:434] P 459e82ee6b564cc19be6f73186938e79: ending tablet copy session e016302b7e734d74833a2bf7bab44838-1dea3366ee674017a0bbfc9bce0d9a73 on tablet 1dea3366ee674017a0bbfc9bce0d9a73 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:19.969219 19380 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:19.970417 19389 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:19.968686 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:19.970288 19345 consensus_queue.cc:1059] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:17:19.938561 19400 consensus_queue.cc:1059] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:17:19.975729 19280 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.974845 18960 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.976989 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:19.953450 19326 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:19.979912 18962 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.980962 19326 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:19.980738 19414 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:19.975195 18957 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:19.981920 19414 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.983961 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:19.965910 19381 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:19.981861 18377 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:19.994382 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:20.008927 19402 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.009361 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:20.015013 19280 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:20.024649 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:20.030249 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:20.030045 19423 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.010039 19361 raft_consensus.cc:3055] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:20.009399 19402 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:20.042162 18351 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:20.042280 18236 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:17:20.041306 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 74671.7us
I20260709 13:17:20.032264 19423 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:20.043869 19280 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:20.031733 19315 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:20.010393 19326 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:17:20.043308 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:20.032305 19345 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:20.050838 19280 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:20.045337 18236 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:20.051065 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:20.052040 19396 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:20.028717 19401 consensus_queue.cc:1059] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:17:20.038851 19397 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:20.036808 19361 raft_consensus.cc:740] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:20.053951 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:20.054328 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:20.068259 19324 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.068429 19401 raft_consensus.cc:3055] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.068902 19420 raft_consensus.cc:3055] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.074179 19384 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:17:20.081965 19420 raft_consensus.cc:740] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:20.051967 19423 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:20.074667 19401 raft_consensus.cc:740] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:20.076421 19381 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:20.081489 19413 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.084583 18386 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.082888 19326 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:17:20.086778 19394 consensus_queue.cc:1059] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.087319 18310 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.101555 19394 raft_consensus.cc:3055] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.101962 19394 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:20.102875 19394 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:20.104386 19394 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.088742 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:20.088454 19386 consensus_queue.cc:1059] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:17:20.093221 19425 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.112560 19425 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:20.099598 19413 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:20.084977 19402 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:20.113670 19425 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:20.116075 18311 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:20.116621 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:20.089058 19315 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:20.114352 19400 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:20.133710 19361 consensus_queue.cc:260] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:20.134466 19425 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.133754 19402 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.137593 18309 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:20.136951 18311 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:20.138168 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:20.138870 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:20.147716 18962 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:20.151016 18386 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:20.153200 19403 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.140465 19423 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.162763 19352 tablet_bootstrap.cc:492] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:20.163872 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:20.142544 19361 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:20.114327 19382 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:17:20.166831 19384 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:20.114084 19420 consensus_queue.cc:260] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:20.142282 19400 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:17:20.175664 18131 catalog_manager.cc:5697] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 2, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.171680 18132 catalog_manager.cc:5697] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 2, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.170735 19396 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:20.194638 19345 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:20.200325 18311 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:20.202353 19352 tablet_bootstrap.cc:492] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:20.201840 19345 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:20.203115 19352 ts_tablet_manager.cc:1403] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.899s	user 0.030s	sys 0.018s
W20260709 13:17:20.216674 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.210340 19395 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.221758 19395 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:20.196961 19404 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:20.203953 18229 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:20.168684 19401 consensus_queue.cc:260] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:20.210028 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 256964us
I20260709 13:17:20.220592 18310 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:20.227272 19395 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:20.228938 18276 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:20.229398 19404 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:20.150913 19413 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:20.243901 18384 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:20.244786 19345 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:20.256191 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:20.234983 19403 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:20.264655 19404 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:20.265651 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:20.273994 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:20.274192 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:20.280047 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:20.295163 19404 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:20.297343 18307 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:20.303287 19403 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:20.304242 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:20.240069 19352 raft_consensus.cc:359] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:20.308066 19345 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:20.313165 18306 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:20.323695 19397 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.324229 19397 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:20.325409 19397 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:20.327181 19397 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.364706 19389 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:20.368927 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.377532 19387 raft_consensus.cc:3055] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.378067 19387 raft_consensus.cc:740] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:20.379140 19387 consensus_queue.cc:260] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:20.389835 19387 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.392130 19420 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.309618 19352 raft_consensus.cc:740] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:20.401929 19352 consensus_queue.cc:260] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:20.405746 19352 ts_tablet_manager.cc:1434] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.202s	user 0.007s	sys 0.001s
I20260709 13:17:20.410436 19418 raft_consensus.cc:3055] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.412088 18133 catalog_manager.cc:5697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 1 to 2, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 2 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:20.415680 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 152878us
W20260709 13:17:20.416971 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.415128 19418 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:20.418761 19375 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.416260 18133 catalog_manager.cc:5697] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 1 to 2, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 2 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:20.419770 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 103929us
I20260709 13:17:20.426963 19425 raft_consensus.cc:1064] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:20.427269 19395 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:20.430779 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 68920.1us
W20260709 13:17:20.430895 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 60017.4us
I20260709 13:17:20.445252 19380 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:20.458272 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.472947 18960 raft_consensus.cc:1217] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:20.486409 18379 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.419127 19418 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:20.494876 19380 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:20.503159 19418 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.501389 19347 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:17:20.519176 19401 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.505844 19380 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:20.535235 19413 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.534821 19410 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:20.577164 19380 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:20.563817 19425 consensus_queue.cc:237] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:20.578806 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:20.579646 18386 raft_consensus.cc:2393] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 2: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:20.556525 19410 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:20.597704 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 178258us
W20260709 13:17:20.602638 18201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.010s	sys 0.046s
W20260709 13:17:20.604486 18201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.010s	sys 0.046s
W20260709 13:17:20.606335 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 549365us
I20260709 13:17:20.609871 19422 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:20.611903 19418 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.613121 19415 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:20.617091 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:20.614497 19387 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.629379 18201 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:20.639829 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:20.640262 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:20.610764 19422 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:20.649912 18228 raft_consensus.cc:2393] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 2: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:20.614897 19418 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:20.652662 18234 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.652544 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:20.655462 18310 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.630590 19381 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:20.657462 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:20.632627 19387 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:20.636663 19377 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:17:20.700910 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 43599.4us
I20260709 13:17:20.706214 18310 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.717303 19372 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:20.714200 19423 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:20.717139 19381 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:20.696645 19380 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:17:20.744870 19438 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.757941 18382 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.758603 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:20.759156 19418 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:20.759433 18383 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:20.760322 19354 tablet_copy_client.cc:538] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:20.760655 19326 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:20.743885 19387 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:20.762174 18381 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:20.762718 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:20.763131 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.757985 19381 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:20.769783 18236 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:20.770555 19410 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:20.773280 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:20.775626 18236 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:20.780468 18246 tablet_copy_service.cc:342] P b52e2477fc524694967c4a16afa983e3: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-80d0760748294d8d8cb291466766b8a5 received from {username='slave'} at 127.0.0.1:46128
I20260709 13:17:20.784340 19422 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:20.785212 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:20.792838 18960 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:20.795006 18200 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:20.796379 19413 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:20.796804 19413 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.797314 19413 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:20.798679 18307 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.800264 18307 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:20.786389 19432 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.004s
I20260709 13:17:20.789628 18246 tablet_copy_service.cc:434] P b52e2477fc524694967c4a16afa983e3: ending tablet copy session e016302b7e734d74833a2bf7bab44838-80d0760748294d8d8cb291466766b8a5 on tablet 80d0760748294d8d8cb291466766b8a5 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:20.789618 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:20.803539 18380 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:20.803798 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:20.804600 18381 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:20.805594 19372 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:20.808112 19418 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:20.800768 19422 raft_consensus.cc:2955] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:20.810351 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:20.807034 18385 raft_consensus.cc:2955] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:20.814024 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:20.818579 18232 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 2: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:20.821327 18276 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:20.831121 18381 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.832093 19382 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:17:20.835764 19414 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:20.825361 19372 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:17:20.820964 19429 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:20.816339 19392 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:17:20.825408 19376 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:20.825784 19385 raft_consensus.cc:3055] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.849294 19420 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:20.855005 19385 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:20.852725 19429 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:20.890609 19429 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.869325 18236 raft_consensus.cc:2955] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:20.854708 19376 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:20.867835 19420 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:20.850790 19439 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:17:20.905511 19376 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.991276 19401 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.007144 18385 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:20.936416 19429 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:20.955909 19413 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:21.023634 19401 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.104980 19413 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:21.032168 19324 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:17:21.111114 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.112141 18228 raft_consensus.cc:2368] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:21.128605 18351 leader_election.cc:400] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:21.128979 18351 leader_election.cc:403] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:21.111698 19413 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.145730 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.143882 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 105369us
I20260709 13:17:21.174500 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:21.175300 18962 raft_consensus.cc:2393] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:17:21.176278 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:21.176852 18960 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:21.178136 19385 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.140290 19453 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:17:21.199313 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 84581.9us
I20260709 13:17:21.158747 19420 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:21.162074 19413 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.233651 19463 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.236019 18960 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:21.234385 19463 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.260596 19354 tablet_bootstrap.cc:492] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:17:21.211009 19453 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:21.271059 19453 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:21.272496 19455 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:17:21.274335 19454 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:17:21.276310 19458 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:17:21.277997 19450 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:17:21.286011 19429 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:21.288259 19413 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:21.242455 19464 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:21.243217 19420 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.292981 19420 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.295884 19420 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:21.297916 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.297833 18200 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:21.305997 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:21.318171 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:21.318581 18379 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:21.320559 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:21.314005 18232 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:21.297065 19420 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.337306 19420 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.339455 19420 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:21.341202 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 157811us
I20260709 13:17:21.314576 19324 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.318217 19383 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:21.406850 19405 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.406711 19420 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.451124 19427 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.450975 19465 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.499099 19410 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:21.499856 19410 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:21.499985 19468 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.500783 19468 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.501034 19410 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.503942 19468 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:21.510054 19464 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:21.475265 18960 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:21.476545 19401 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:21.524350 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.497167 19383 raft_consensus.cc:697] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:21.464473 19324 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:21.545433 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 215790us
I20260709 13:17:21.515074 19468 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:21.495859 19405 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:21.497689 19420 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.512012 19464 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.527331 19401 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:21.567844 19469 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:21.505998 19465 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.576498 19463 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:21.505661 19427 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.560187 19468 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.594303 19422 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.574894 19401 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.618566 19474 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.595288 19414 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.569139 19464 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.593246 19465 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:21.569797 19469 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.567878 19383 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:21.677953 19473 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.615640 19385 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:21.680037 19376 consensus_meta.cc:287] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.726s	user 0.013s	sys 0.000s
W20260709 13:17:21.695119 19456 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.584s	user 0.009s	sys 0.007s
I20260709 13:17:21.695640 19420 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:21.697259 19427 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:21.698342 19465 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.639675 19422 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.687484 19453 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.677332 19414 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.674515 19474 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.732450 19474 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:21.733353 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.736383 19474 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.739126 19474 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.742959 19475 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.701967 19420 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:21.699471 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:21.743527 19475 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.711858 19465 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:21.744084 19386 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.746768 18960 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:21.760885 19475 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:21.702147 19376 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.761111 19386 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:21.762841 19465 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:21.763003 19376 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:21.747030 19405 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:21.763813 19389 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:21.749074 19469 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:21.733260 19326 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.738245 19401 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:21.755955 19464 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:21.750900 19422 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:21.753986 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 64754.6us
I20260709 13:17:21.776788 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:21.729784 19453 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:21.765369 19468 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:21.780085 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 437328us
I20260709 13:17:21.764482 19386 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:21.706828 19324 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:21.781893 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.789666 18228 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:21.782612 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.790874 18236 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:21.767409 19474 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:21.694278 19473 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.797122 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.798493 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:21.803164 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:21.805928 18235 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 2: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:21.807089 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:21.807442 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.807761 18379 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:21.808910 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:21.809559 18960 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:21.811333 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:21.802886 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.814596 19479 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:21.814877 18237 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:21.815191 19479 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.816012 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.816613 19401 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:21.817296 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.817148 19401 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.817904 18237 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:21.818293 19375 raft_consensus.cc:1064] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:21.819268 19401 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:21.819821 19463 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:21.804863 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.820353 19463 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:21.811029 19469 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:21.821193 18233 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:21.810743 19465 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:21.771402 19326 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:21.803709 19386 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.831128 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.831831 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.831975 18349 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:21.821645 19469 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:21.795706 19468 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.788877 19464 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:21.771780 19420 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:21.849805 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.829011 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.854625 18312 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:21.855720 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.829411 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.829056 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.830462 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.829872 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.856789 18308 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:21.856993 18310 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:21.857312 18311 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:21.833626 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.835071 18384 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:21.832541 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.857020 18309 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:21.859052 18304 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:21.848920 18379 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:21.780754 19372 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:17:21.851318 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.860088 18305 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:21.868083 18379 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:21.827766 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.871002 18303 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:21.873628 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:21.874058 19483 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.872928 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:21.874716 19326 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:21.874816 19483 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:21.846408 19386 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.858374 18312 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:21.831436 19474 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:21.851908 19468 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:21.884851 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:21.885682 18382 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
I20260709 13:17:21.887490 19474 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:21.889585 19386 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:21.871359 19401 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.890754 19401 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.891530 19474 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:21.892191 18386 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:21.893115 19401 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:21.893710 19401 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:21.894093 19401 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.895161 19468 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:21.896407 19468 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:21.896821 19468 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.897207 19468 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:21.901156 19401 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:21.908483 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 851) took 1131 ms. Trace:
I20260709 13:17:21.908968 18230 rpcz_store.cc:276] 0709 13:17:20.776825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.776975 (+   150us) service_pool.cc:224] Handling call
0709 13:17:20.777285 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:20.777652 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.777681 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:20.794297 (+ 16616us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b2c000014c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:17:20.794716 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:17:20.989699 (+194983us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:20.989741 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.991392 (+  1651us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.678744 (+687352us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b2400119888. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f00c9c4 00007fa17f00aacb 00007fa17f1c5dc9 00007fa17f1c5a55 00007fa17f1c509d 00007fa181df710e 00007fa181e0e88c 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221
0709 13:17:21.907558 (+228814us) spinlock_profiling.cc:243] Waited 6.71 ms on lock 0x7b24001197f8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f00c9c4 00007fa17f00aacb 00007fa17f1c5dc9 00007fa17f1c5a55 00007fa17f1c4fb0 00007fa181e3b488 00007fa181e3bbe8 00007fa181e13398 00007fa181e0e76a 00007fa181e0dbb6
0709 13:17:21.908197 (+   639us) raft_consensus.cc:1685] finished
0709 13:17:21.908226 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.908387 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1381,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":64847744,"thread_start_us":194631,"threads_started":1,"wal-append.queue_time_us":231975}
I20260709 13:17:21.913919 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.837231 19465 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.914664 18304 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
W20260709 13:17:21.915014 19471 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:21.917896 19405 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.920465 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.920957 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.925843 18304 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:21.926426 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.927138 18311 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:21.929188 18309 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:21.930666 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.931264 18309 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:21.931416 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:21.932216 18310 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:21.856294 19464 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:21.939862 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.888180 19463 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:21.942510 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.876909 19414 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:21.946794 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.948119 18228 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:21.919791 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.919986 19372 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.895084 19375 consensus_queue.cc:237] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:21.959259 19483 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:21.959964 19372 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.961139 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.962028 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.941874 19422 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.939814 19405 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.969501 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.970360 18235 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:21.971474 18228 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:21.975445 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:21.976351 18386 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:21.977070 18230 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:21.978354 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:21.963225 19395 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.979419 19395 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:21.981835 19395 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:21.982033 19401 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:21.982553 18386 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:21.983646 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:21.984169 19401 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:21.966253 19420 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:21.991217 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:21.993392 18350 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.029s	sys 0.056s
I20260709 13:17:21.967555 18231 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
W20260709 13:17:21.994904 18350 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.030s	sys 0.056s
I20260709 13:17:21.978063 19469 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:21.989634 19453 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:21.990401 19463 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:21.972656 19422 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.009341 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:22.016788 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:22.017961 18379 raft_consensus.cc:2393] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:22.006395 19465 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:22.008114 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:22.007323 19453 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:22.024078 18926 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:22.007156 19464 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:22.008316 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:22.006557 19473 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:22.024495 18237 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:22.024608 19477 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:22.005087 19401 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:22.029102 19477 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.998212 19420 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:22.026671 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:22.041417 19480 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.042104 19480 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.043674 19324 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:22.043813 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:22.038487 19477 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:22.024752 19453 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:22.024804 19479 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:22.025987 19374 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.029755 19401 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.044267 19324 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.044332 19480 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:22.058655 18275 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.003s	sys 0.025s
W20260709 13:17:22.066709 18275 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.003s	sys 0.025s
W20260709 13:17:22.059010 19410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.004s	sys 0.035s
I20260709 13:17:22.023231 19463 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.074256 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:22.076612 18962 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:22.066201 19374 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.066430 19324 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:22.066406 19387 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.067973 19395 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:22.072589 19410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.005s	sys 0.035s
I20260709 13:17:22.048205 19420 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.087941 19420 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:22.088948 19395 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.089224 19374 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:22.089425 19395 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:22.093812 19422 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:22.095460 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:22.096392 18235 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:22.093815 19401 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:22.098654 19372 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:22.100853 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:22.103500 19461 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:22.104015 19461 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.104410 19461 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:22.109946 19453 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:22.111637 19405 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:22.116700 19463 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:22.121518 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:22.122334 18306 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:22.126430 19466 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.083791 18962 raft_consensus.cc:2955] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:22.127910 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:22.128734 18306 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
I20260709 13:17:22.130453 18277 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:22.132154 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:22.134899 18927 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:22.127465 19425 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.189972 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:22.126937 19466 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:22.190900 18385 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:22.173707 19422 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:22.225853 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:22.226390 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 54491.9us
I20260709 13:17:22.226706 18386 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:22.227447 18275 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:22.191396 19463 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:22.253450 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:22.242956 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:22.255614 18379 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
W20260709 13:17:22.259411 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 448197us
I20260709 13:17:22.261014 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:22.262118 19401 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:22.261230 19462 raft_consensus.cc:2955] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:22.263227 19401 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:22.264657 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:22.265583 18386 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:22.215628 19422 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:22.275624 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 340733us
I20260709 13:17:22.276157 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:22.279965 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:22.279441 19372 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:22.280704 18306 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:22.280771 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:22.280933 19372 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:22.201372 19425 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.307695 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:22.306442 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:22.354884 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.357600 18308 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:22.337157 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:22.358723 18235 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:22.340962 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:22.252540 19389 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:22.309958 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:22.366367 18228 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:22.305696 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:22.316728 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:22.279309 18385 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:22.287439 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:22.282629 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:22.369840 18303 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
W20260709 13:17:22.370005 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 82683.3us
I20260709 13:17:22.370751 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:22.371450 18379 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:22.290342 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:22.270131 19472 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:22.292240 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:22.372363 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:22.385968 18379 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:22.348284 19480 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.348591 19392 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:22.271551 19422 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:22.396677 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:22.355172 19478 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:22.417663 19488 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.278400 19420 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:22.259181 19461 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.419328 19420 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.421801 19461 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:22.282472 18957 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 2 LEARNER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:22.269532 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 48) took 1153 ms. Trace:
I20260709 13:17:22.376196 19389 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.418515 19488 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.444087 19488 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:22.408337 18382 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:22.389431 19350 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:22.282898 19395 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.435763 19392 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.422142 19420 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:22.414515 19382 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:22.425725 19425 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:22.426860 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:22.253474 19463 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.404292 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:22.417961 19478 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.383147 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:22.448205 19389 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:22.459357 19401 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:22.456909 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:22.498366 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 115328us
I20260709 13:17:22.499079 18233 raft_consensus.cc:2393] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 2: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:22.463811 19383 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:22.465128 19350 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.476248 19466 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:22.489516 19392 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:22.506279 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:22.510639 19426 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:22.511061 19476 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:22.495771 19420 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:22.435648 19472 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:22.546330 18201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.010s	sys 0.037s
I20260709 13:17:22.537055 18202 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:22.493481 19382 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.480460 19480 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.503845 19506 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:22.515647 18377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.019s	sys 0.038s
I20260709 13:17:22.515275 19383 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:22.551975 18201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.010s	sys 0.037s
I20260709 13:17:22.525158 19405 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:22.550755 18306 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:22.508487 19350 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:22.546550 18926 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.019s	sys 0.027s
I20260709 13:17:22.523754 19426 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.561194 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:22.559260 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 615248us
I20260709 13:17:22.545514 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:22.557005 18377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.019s	sys 0.039s
W20260709 13:17:22.548789 19438 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.002s	sys 0.044s
I20260709 13:17:22.527769 19420 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.567593 18385 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:22.552688 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:22.576529 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:22.559937 19476 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.577805 18202 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:22.549777 19427 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:17:22.561836 19405 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:22.563321 18926 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.020s	sys 0.027s
I20260709 13:17:22.582880 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:22.589974 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:22.590363 19386 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:22.576783 19438 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.002s	sys 0.046s
I20260709 13:17:22.562852 19494 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:22.567301 19413 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:22.593755 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:22.568997 19372 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:22.578408 19508 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.567209 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:22.606523 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:22.563462 19426 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:22.586735 19476 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:22.615942 19507 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:22.590518 19486 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
W20260709 13:17:22.666251 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 88545.9us
W20260709 13:17:22.650331 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 48363.1us
W20260709 13:17:23.125943 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.198258 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:22.852166 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 60) took 1387 ms. Trace:
W20260709 13:17:22.825704 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 219229us
W20260709 13:17:23.136349 19422 consensus_meta.cc:287] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.000s
I20260709 13:17:22.597656 19405 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:23.202446 19478 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:23.202806 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:23.202114 19422 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:23.203199 19478 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:23.204056 18304 raft_consensus.cc:2393] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:23.203814 19478 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:23.204178 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:17:23.205204 19422 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:22.846834 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:23.205905 19478 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:22.824416 19472 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:22.883672 19477 consensus_meta.cc:287] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.837s	user 0.009s	sys 0.000s
I20260709 13:17:23.207315 19477 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.591642 19493 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:23.208856 19493 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.209262 19493 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.209444 19477 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:22.823432 19382 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:22.964733 19462 consensus_meta.cc:287] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.701s	user 0.014s	sys 0.000s
I20260709 13:17:22.974561 18135 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39288 (request call id 175) took 1917 ms. Trace:
I20260709 13:17:23.212546 18135 rpcz_store.cc:276] 0709 13:17:21.059895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.063867 (+  3972us) service_pool.cc:224] Handling call
0709 13:17:22.974302 (+1910435us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46741,"reported_tablets":3,"spinlock_wait_cycles":29056}
I20260709 13:17:22.618018 19401 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:23.213757 19401 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.214154 19401 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.214890 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1161) took 1423 ms. Trace:
I20260709 13:17:23.215509 18377 rpcz_store.cc:276] 0709 13:17:21.790995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.803544 (+ 12549us) service_pool.cc:224] Handling call
0709 13:17:21.846578 (+ 43034us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.880766 (+ 34188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.888723 (+  7957us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.964161 (+ 75438us) log.cc:844] Serialized 26 byte log entry
0709 13:17:22.577321 (+613160us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:22.582102 (+  4781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.598354 (+ 16252us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:23.214589 (+616235us) raft_consensus.cc:1685] finished
0709 13:17:23.214628 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.214789 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":669,"raft.queue_time_us":98909,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5559,"thread_start_us":572313,"threads_started":1,"wal-append.queue_time_us":786981}
I20260709 13:17:23.219579 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:17:22.609215 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 586609us
W20260709 13:17:22.821527 19324 consensus_meta.cc:287] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.000s
I20260709 13:17:22.609388 19413 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:22.900838 19387 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.807s	user 0.003s	sys 0.008s
I20260709 13:17:23.223860 19238 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:23.224498 19238 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:22.655449 19508 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:23.163317 18133 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 77) took 1924 ms. Trace:
I20260709 13:17:22.808118 19463 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:23.308694 19238 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:22.601060 19386 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.242077 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1168) took 1441 ms. Trace:
W20260709 13:17:23.286630 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 86216.7us
W20260709 13:17:23.287525 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 89330.1us
W20260709 13:17:22.826581 19468 consensus_meta.cc:287] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.910s	user 0.005s	sys 0.008s
W20260709 13:17:23.132447 19350 consensus_meta.cc:287] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.000s
I20260709 13:17:22.602044 19496 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:23.201463 18232 rpcz_store.cc:276] 0709 13:17:21.465122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.465291 (+   169us) service_pool.cc:224] Handling call
0709 13:17:21.465689 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.587335 (+121646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.587392 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.589913 (+  2521us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.792204 (+202291us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:22.193693 (+401489us) log.cc:844] Serialized 14 byte log entry
0709 13:17:22.194004 (+   311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.851733 (+657729us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540037dcd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:22.851787 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.851838 (+    51us) raft_consensus.cc:1685] finished
0709 13:17:22.851942 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.852101 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8192,"prepare.queue_time_us":294029,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":11279,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":11685,"spinlock_wait_cycles":256567552,"thread_start_us":536534,"threads_started":2,"wal-append.queue_time_us":431191}
I20260709 13:17:23.317111 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:22.436360 18307 rpcz_store.cc:276] 0709 13:17:21.105394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.105557 (+   163us) service_pool.cc:224] Handling call
0709 13:17:21.108072 (+  2515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.127712 (+ 19640us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:21.181219 (+ 53507us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.732683 (+551464us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b18000120a0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f183455 00007fa18226b060 00007fa18227d716 00007fa18228e287 00007fa18228e208
0709 13:17:22.199344 (+466661us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:22.206115 (+  6771us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:22.215353 (+  9238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.225949 (+ 10596us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.253726 (+ 27777us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22447,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":49097,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"spinlock_wait_cycles":5377280,"thread_start_us":445490,"threads_started":1}
I20260709 13:17:23.315095 18133 rpcz_store.cc:276] 0709 13:17:21.238924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.239066 (+   142us) service_pool.cc:224] Handling call
0709 13:17:23.163211 (+1924145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":508071,"reported_tablets":3}
W20260709 13:17:23.180094 19476 consensus_meta.cc:287] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.513s	user 0.004s	sys 0.005s
W20260709 13:17:23.288328 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 68798.4us
W20260709 13:17:23.289229 19392 consensus_meta.cc:287] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.761s	user 0.011s	sys 0.001s
W20260709 13:17:22.846215 19502 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:17:22.611016 19494 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:22.760695 19395 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:23.346969 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:23.435448 18312 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:23.321514 19383 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:23.319363 18958 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:17:23.225911 19389 consensus_meta.cc:287] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.722s	user 0.012s	sys 0.000s
I20260709 13:17:23.318609 19410 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.320170 19498 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:23.403496 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:23.405861 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 61182.4us
I20260709 13:17:23.588973 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:23.589740 18382 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.347620 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:23.346913 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:22.672859 19479 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:23.375677 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:23.409111 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:23.345346 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:23.610495 18304 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.347283 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:23.346814 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:23.611665 18306 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:23.375478 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:22.760425 19372 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:23.261837 19413 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:22.898528 19480 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:22.879518 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:23.233925 19324 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:23.327906 19387 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:22.885037 19420 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:23.343189 18383 rpcz_store.cc:276] 0709 13:17:21.800252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.801381 (+  1129us) service_pool.cc:224] Handling call
0709 13:17:21.814669 (+ 13288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.176031 (+361362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.176081 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:22.195777 (+ 19696us) log.cc:844] Serialized 26 byte log entry
0709 13:17:22.608576 (+412799us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:22.608622 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.608692 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:23.241789 (+633097us) raft_consensus.cc:1685] finished
0709 13:17:23.241818 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.242007 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45992,"raft.queue_time_us":133332,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":13933,"thread_start_us":674351,"threads_started":2,"wal-append.queue_time_us":1009504}
I20260709 13:17:23.235682 19439 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.318712 19463 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:23.308166 19521 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:23.438581 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:23.609161 19479 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:23.440327 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 64821.3us
I20260709 13:17:23.613020 19440 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:23.616184 19374 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:23.616001 19385 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:23.443990 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:23.666608 18303 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:23.449397 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:23.449580 18957 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:23.575762 19389 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:23.451984 19438 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.452884 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:23.453619 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:23.454315 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:23.455051 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:23.597618 19410 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:23.456862 19453 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.297915 19507 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:23.457329 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:23.457844 19508 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:23.432163 19392 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:23.458891 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:23.458986 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:23.429502 18959 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:23.392202 19386 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.318516 19347 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:23.574020 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:23.365839 19468 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:23.348281 19519 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.220s
I20260709 13:17:23.592525 18311 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:23.595508 18230 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.608793 18380 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.407469 19496 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.613483 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:23.573137 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:23.406154 19350 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:23.588488 19354 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:17:23.415802 19476 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:23.645097 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:23.588044 19472 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:23.608917 19478 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:23.608434 19382 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:23.657874 18385 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:23.348913 19489 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:23.616441 19372 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.438651 18381 raft_consensus.cc:2955] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:23.673429 18382 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:23.657802 19517 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:23.449913 19518 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:23.644781 19387 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:23.686388 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 76464.2us
I20260709 13:17:23.455778 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:23.668174 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:23.661031 19463 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.614914 19401 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:23.613297 19520 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:23.620965 19498 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:24.035463 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 164538us
I20260709 13:17:24.057075 18312 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:24.058102 19526 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:24.058459 19496 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.058866 19526 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.022262 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:23.858381 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 449285us
W20260709 13:17:24.063252 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52859.5us
W20260709 13:17:23.888829 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 262556us
I20260709 13:17:24.107987 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:23.949183 18304 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:23.742395 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:23.664342 19479 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.112818 18379 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:24.117254 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:24.118232 18380 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:24.112109 18383 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
I20260709 13:17:24.119692 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:24.120194 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51176us
I20260709 13:17:24.113958 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:24.076665 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:24.112082 18384 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:23.658977 19521 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.116379 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:24.112921 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:23.668637 19420 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:24.113348 18232 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.087352 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:24.111618 18276 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:24.125667 18382 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:24.129287 18237 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:17:23.928535 19516 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.275s	user 0.000s	sys 0.000s
I20260709 13:17:24.139348 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:24.009217 18956 raft_consensus.cc:2368] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:24.133647 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:24.136816 18309 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.142369 18236 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:24.141000 18308 raft_consensus.cc:2368] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:23.677541 19524 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:24.090776 19463 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.020088 19477 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:23.659824 19439 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.112269 19478 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.116626 19387 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.035259 19487 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:23.998368 19324 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.154943 18310 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:24.122424 19403 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.116092 19480 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.019737 19474 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:23.926719 19497 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:24.115899 19372 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.161069 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 935) took 1835 ms. Trace:
W20260709 13:17:23.697736 18229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 810) took 1378 ms (client timeout 1505 ms). Trace:
I20260709 13:17:23.685052 19374 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.126463 18377 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.830751 18233 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:23.866582 19525 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:23.677451 19385 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:24.141098 18927 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.129:43781 timed out after 2.013s (SENT) [suppressed 4 similar messages]
I20260709 13:17:23.678309 19440 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.133033 19494 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:23.739012 19501 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.418s
I20260709 13:17:24.127565 19521 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.199023 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:24.222301 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 110738us
I20260709 13:17:24.199831 18378 rpcz_store.cc:276] 0709 13:17:22.326076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.326303 (+   227us) service_pool.cc:224] Handling call
0709 13:17:22.847333 (+521030us) spinlock_profiling.cc:243] Waited 998 us on lock 0x7b5800050198. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:17:22.847551 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.587013 (+739462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.587043 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:23.587090 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:23.587119 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.160789 (+573670us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b540027fbd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:24.160851 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.160998 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1615748736}
I20260709 13:17:24.121098 19347 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.122205 19382 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.122612 19453 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:24.122036 19472 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.229823 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:24.122347 19518 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:24.165452 19429 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:24.238749 18383 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:24.130035 19420 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.225811 18955 raft_consensus.cc:2393] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:17:24.233349 18231 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:24.237416 19497 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:24.122766 19520 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:23.734781 19438 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.267185 18236 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.181629 19478 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:24.205127 19462 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:24.268678 18276 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:24.278441 19494 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:24.186302 19477 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:24.281418 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 170213us
I20260709 13:17:24.186101 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:24.292188 18305 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:24.121227 19489 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:24.204140 18229 rpcz_store.cc:269] 0709 13:17:22.307675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.879095 (+571420us) service_pool.cc:224] Handling call
0709 13:17:23.685721 (+806626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.227888 19474 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.310847 19518 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:24.315630 18232 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:24.368125 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:24.368903 18232 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.204659 19403 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.164639 19524 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.321516 19374 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.304919 19389 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.321800 19347 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.226464 19480 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.331964 18236 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:24.279356 19526 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:24.337738 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 69137.5us
I20260709 13:17:24.390631 18276 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:24.108986 19517 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:24.358872 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 217776us
I20260709 13:17:24.403728 18927 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:24.355798 19529 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:24.366506 18234 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:24.321807 19440 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.287380 19429 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:24.362874 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 63648.8us
I20260709 13:17:24.334062 19462 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.376574 19422 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:24.196326 19487 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.432953 18379 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:24.261608 19525 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:24.376459 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:24.371706 18961 raft_consensus.cc:2393] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 2: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:17:24.429363 19389 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:24.417073 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 50469.9us
I20260709 13:17:24.434265 19462 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.359324 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:24.470613 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:24.430927 19529 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:24.426733 19524 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:24.377741 19494 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:24.370335 18307 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:24.448436 18232 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
W20260709 13:17:24.362139 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47925.5us
W20260709 13:17:24.456900 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 80509.3us
I20260709 13:17:24.402029 19498 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:24.474390 19426 consensus_meta.cc:287] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.187s	user 0.010s	sys 0.001s
I20260709 13:17:24.416822 19548 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.427821 19392 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.360790 18958 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:24.476908 19420 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:24.420993 19347 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:24.465881 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:24.513542 18382 raft_consensus.cc:2393] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:24.428287 19410 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.421635 19350 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.430680 19401 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:24.473728 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 824) took 1098 ms. Trace:
I20260709 13:17:24.448553 19377 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.438135 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:24.428851 19535 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:24.509655 19524 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:24.480980 19494 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.483698 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:24.461556 19389 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.380666 19518 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:17:24.488638 19547 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:24.489444 19497 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.471597 19527 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:17:24.567060 18925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.000s	sys 0.043s
W20260709 13:17:24.567440 18925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.000s	sys 0.043s
I20260709 13:17:24.447795 19532 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:24.471294 19415 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:24.469951 19501 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:24.463289 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 823) took 1080 ms. Trace:
I20260709 13:17:24.439189 19528 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:24.508080 19553 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:24.474942 19529 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:24.512115 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 944) took 1078 ms. Trace:
I20260709 13:17:24.453691 19531 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:24.518730 19489 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.479140 18233 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:24.550700 19377 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.529753 19519 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:24.538255 18310 rpcz_store.cc:276] 0709 13:17:23.375284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.375391 (+   107us) service_pool.cc:224] Handling call
0709 13:17:24.473513 (+1098122us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b5400350f54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:24.473660 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1254009728}
W20260709 13:17:24.515177 19405 consensus_meta.cc:287] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.312s	user 0.005s	sys 0.008s
I20260709 13:17:24.531213 19472 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.543000 19403 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.481422 19530 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.481603 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:24.594117 18307 raft_consensus.cc:2393] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:24.543988 19382 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.504308 19426 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.552563 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:24.527128 19521 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.491403 19537 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:24.559998 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:24.563539 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:24.565428 19474 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.600788 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:24.555050 19453 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:24.553704 18229 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.561342 19389 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.578290 18308 rpcz_store.cc:276] 0709 13:17:23.374966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.375112 (+   146us) service_pool.cc:224] Handling call
0709 13:17:24.442848 (+1067736us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54000bd1d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:24.455694 (+ 12846us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1196905344}
I20260709 13:17:24.589246 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:24.590682 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 171001us
I20260709 13:17:24.629173 18276 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:17:24.629603 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 69667.9us
I20260709 13:17:24.582717 18381 rpcz_store.cc:276] 0709 13:17:23.433471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.437656 (+  4185us) service_pool.cc:224] Handling call
0709 13:17:23.438088 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.438413 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:24.246057 (+807644us) log.cc:844] Serialized 14 byte log entry
0709 13:17:24.511741 (+265684us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.511811 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:24.511857 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.511934 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.512051 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":176739,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":5448,"thread_start_us":264999,"threads_started":2,"wal-append.queue_time_us":326759}
I20260709 13:17:24.478873 19507 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:24.593086 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:24.589633 19532 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.595379 19517 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:24.633109 18962 raft_consensus.cc:2368] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:24.596653 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:24.578299 19497 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.569222 19477 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.567378 19527 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.605151 19438 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.502091 19525 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:24.611599 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 130045us
I20260709 13:17:24.749823 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:24.549963 19548 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.600682 19524 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.540872 19347 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:24.581660 19534 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.582007 19415 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.632651 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:24.635675 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:24.615960 18961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54020 (request call id 109) took 1206 ms. Trace:
I20260709 13:17:24.764369 18961 rpcz_store.cc:276] 0709 13:17:23.402155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.408493 (+  6338us) service_pool.cc:224] Handling call
0709 13:17:24.598091 (+1189598us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400858ed4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:24.607023 (+  8932us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435862016}
W20260709 13:17:24.765864 19413 consensus_meta.cc:287] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.119s	user 0.008s	sys 0.002s
I20260709 13:17:24.766396 19413 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
W20260709 13:17:24.767241 19496 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.708s	user 0.006s	sys 0.002s
I20260709 13:17:24.769567 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:24.770783 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:24.771410 19494 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:24.775310 19387 consensus_meta.cc:287] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.000s
I20260709 13:17:24.638542 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:24.639559 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:24.637709 18349 leader_election.cc:400] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:24.606478 19405 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.696969 18276 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:24.618785 19557 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:24.751286 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:17:24.781066 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 84208.1us
I20260709 13:17:24.781741 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:24.782790 18276 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:24.783543 18276 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:24.783748 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:24.599805 19501 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:24.760870 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 128291us
I20260709 13:17:24.747206 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:24.604104 19519 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.763582 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:24.797156 18380 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:24.775830 19387 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.798061 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:24.780423 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 143624us
I20260709 13:17:24.599159 19553 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:24.771462 18303 raft_consensus.cc:2393] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:24.561563 19535 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:24.799510 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:17:24.801175 19539 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:24.801640 19539 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:24.802239 19535 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:24.643697 19403 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:24.803706 19403 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.803794 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:24.802191 19539 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:24.804248 19403 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:24.755376 19493 consensus_meta.cc:287] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 1.546s	user 0.012s	sys 0.002s
I20260709 13:17:24.808871 19493 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.811614 19493 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:24.812373 19539 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:24.804265 19553 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:24.799582 19487 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.815876 19539 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:24.816221 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:17:24.819952 18351 connection.cc:256] RPC call timeout handler was delayed by -1.1883282369999506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260709 13:17:24.820087 19539 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:24.821033 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:24.824811 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:24.825831 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:24.823729 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:24.756502 19517 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:24.872468 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 48799.6us
I20260709 13:17:24.583096 19547 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:24.768329 18959 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54020 (request call id 108) took 2284 ms (client timeout 2697 ms). Trace:
W20260709 13:17:24.747731 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 109878us
I20260709 13:17:24.788808 19438 raft_consensus.cc:2764] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:17:24.876629 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:24.821127 19539 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.760421 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:24.757089 18956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53364 (request call id 100) took 2374 ms (client timeout 1620 ms). Trace:
I20260709 13:17:24.795696 19401 raft_consensus.cc:2764] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:17:24.832571 19354 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:17:24.794216 19420 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:24.828182 19350 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:24.626642 19537 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.596782 19531 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.643287 19497 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:24.760870 19524 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.829604 19534 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.627046 19530 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:24.597561 19528 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.767657 19496 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:24.870512 19493 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:24.878705 19553 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:24.895169 18235 raft_consensus.cc:2368] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:24.899401 19238 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:25.113159 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:24.956681 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:25.125242 18385 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:25.126202 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:25.122507 19238 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:24.962059 18276 connection.cc:256] RPC call timeout handler was delayed by -1.014916668999831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 13:17:25.144412 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:25.218182 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 43640.1us
I20260709 13:17:24.871376 19526 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:24.875204 19486 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:25.238327 18385 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:25.275331 18380 raft_consensus.cc:2368] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3.
I20260709 13:17:25.275482 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:25.276248 19564 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:17:25.277042 18200 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:25.278204 19427 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:24.875469 19535 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:17:24.878342 18959 rpcz_store.cc:269] 0709 13:17:22.483965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.487756 (+  3791us) service_pool.cc:224] Handling call
0709 13:17:24.768126 (+2280370us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54004a9a54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:24.768262 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1908136704}
I20260709 13:17:25.279191 19535 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:25.123348 19350 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.279767 19535 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.280038 19350 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:25.280777 19541 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.128166 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 892) took 1541 ms. Trace:
I20260709 13:17:25.114939 19553 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.284535 19238 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.293962 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:25.294570 18381 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:17:25.217103 18377 consensus_meta.cc:287] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.887s	user 0.005s	sys 0.005s
I20260709 13:17:24.950568 19347 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:24.957147 19562 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
W20260709 13:17:24.960330 19386 consensus_meta.cc:287] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.900s	user 0.007s	sys 0.002s
I20260709 13:17:25.220774 19489 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.288796 18230 rpcz_store.cc:276] 0709 13:17:23.587264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.132954 (+545690us) service_pool.cc:224] Handling call
0709 13:17:24.133256 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.144467 (+ 11211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.144494 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.144564 (+    70us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:24.144594 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.127894 (+983300us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b540005ad54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:25.127948 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.128092 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25377536}
I20260709 13:17:24.880005 19525 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:24.955650 19543 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:24.955255 19405 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.109675 19563 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.931713 19548 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.149075 19493 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:25.215538 19415 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.955550 19377 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.961133 19413 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.241639 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:24.957046 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:24.956132 19550 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:24.885859 19372 consensus_meta.cc:287] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.652s	user 0.011s	sys 0.003s
I20260709 13:17:24.952772 19494 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:25.128607 19439 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.110817 19547 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:25.237461 19422 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:25.116235 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 48112.4us
I20260709 13:17:25.274276 19486 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:25.111428 18956 rpcz_store.cc:269] 0709 13:17:22.337125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.349145 (+ 12020us) service_pool.cc:224] Handling call
0709 13:17:24.613541 (+2264396us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400630e54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:24.640069 (+ 26528us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3067432704}
I20260709 13:17:25.319522 18381 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:25.292642 19521 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:25.334257 19527 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.321372 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:25.358110 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:25.358875 18230 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:25.299796 19526 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:17:25.312925 19463 consensus_meta.cc:287] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 1.143s	user 0.006s	sys 0.005s
I20260709 13:17:25.151510 19403 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.362080 19532 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.384709 19403 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.326539 19558 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.498s
I20260709 13:17:25.385682 18230 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:25.302160 18377 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:25.386487 19542 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:25.316200 19525 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:25.386996 18377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 946) took 1951 ms (client timeout 1717 ms). Trace:
I20260709 13:17:25.387339 19525 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.344889 19534 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:24.955947 19561 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.439s
I20260709 13:17:25.332187 19493 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:24.960448 18229 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:25.314332 19386 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.297246 19553 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:25.312938 19541 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:25.359970 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:25.380221 19537 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:25.381341 19463 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:25.381769 19496 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:25.387076 19526 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.346447 19528 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.335460 19543 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.388973 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:17:25.315883 19489 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.354355 19486 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:25.392141 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:25.387737 19479 consensus_meta.cc:287] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 1.258s	user 0.005s	sys 0.003s
W20260709 13:17:25.395938 18351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.002s	sys 0.011s
I20260709 13:17:25.393903 19519 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:25.407855 18351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.002s	sys 0.011s
W20260709 13:17:25.409221 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 583423us
I20260709 13:17:25.339056 19563 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:25.387463 18377 rpcz_store.cc:269] 0709 13:17:23.435046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.441259 (+  6213us) service_pool.cc:224] Handling call
0709 13:17:25.386893 (+1945634us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.391826 18233 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 2: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:25.357537 19422 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.353365 19372 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.359164 19494 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:25.404907 19539 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:25.405546 18228 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:25.396806 19354 tablet_bootstrap.cc:492] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:25.398463 18381 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:25.398742 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 907) took 1137 ms. Trace:
I20260709 13:17:25.438041 18386 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:25.437844 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:17:25.438315 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:25.485852 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:25.486565 18381 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:25.410126 19534 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:25.500138 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:25.501276 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:25.502182 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:25.502313 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:25.502893 18381 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:25.407809 19479 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:25.506639 19478 consensus_meta.cc:287] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 1.149s	user 0.005s	sys 0.005s
I20260709 13:17:25.441033 19386 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:25.612026 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 202180us
I20260709 13:17:25.618193 19422 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.519889 19478 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.620456 19478 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:25.528375 19530 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:25.499719 18229 rpcz_store.cc:276] 0709 13:17:24.261323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.387975 (+126652us) service_pool.cc:224] Handling call
0709 13:17:25.396677 (+1008702us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.502820 19534 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:25.612875 19354 tablet_bootstrap.cc:492] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:17:25.611032 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:25.557581 19497 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.632169 19530 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:25.615789 19539 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:25.616356 19519 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.627313 19534 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:25.611168 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:25.642099 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:25.636868 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:25.644626 19386 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:25.645102 18233 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:25.645239 19386 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:25.646023 19567 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:17:25.646229 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:25.647462 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:25.648005 18233 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:25.649466 18377 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
W20260709 13:17:25.649763 19529 consensus_meta.cc:287] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 1.052s	user 0.006s	sys 0.006s
I20260709 13:17:25.650151 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 1198) took 1015 ms. Trace:
I20260709 13:17:25.650241 19529 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:25.650660 18377 rpcz_store.cc:276] 0709 13:17:24.634734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.500133 (+865399us) service_pool.cc:224] Handling call
0709 13:17:25.650082 (+149949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.652679 18384 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:25.646400 19389 consensus_meta.cc:287] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 1.005s	user 0.017s	sys 0.000s
I20260709 13:17:25.652397 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1194) took 1018 ms. Trace:
I20260709 13:17:25.651845 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:25.653802 18382 rpcz_store.cc:276] 0709 13:17:24.633693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.634335 (+   642us) service_pool.cc:224] Handling call
0709 13:17:24.757626 (+123291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.761559 (+  3933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.761586 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:24.761987 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.333644 (+571657us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:25.333688 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.333762 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.652189 (+318427us) raft_consensus.cc:1685] finished
0709 13:17:25.652210 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.652337 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11367,"raft.queue_time_us":4200,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":50542,"thread_start_us":454641,"threads_started":1,"wal-append.queue_time_us":563455}
I20260709 13:17:25.643426 19478 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:25.656663 19563 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.656600 19478 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.659633 19496 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:25.660210 19496 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:25.657584 19389 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:25.652693 19354 ts_tablet_manager.cc:1403] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 4.412s	user 0.054s	sys 0.050s
I20260709 13:17:25.659842 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:25.640686 19489 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.663560 18382 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
W20260709 13:17:25.660471 19462 consensus_meta.cc:287] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 1.183s	user 0.008s	sys 0.002s
I20260709 13:17:25.647945 19571 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:25.652267 19539 raft_consensus.cc:697] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:25.640413 19530 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.643394 19519 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.675305 18384 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:25.679804 19462 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.686965 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1189) took 1617 ms. Trace:
I20260709 13:17:25.687300 18378 rpcz_store.cc:276] 0709 13:17:24.070025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.271279 (+201254us) service_pool.cc:224] Handling call
0709 13:17:24.271658 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.478008 (+206350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.478045 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.478092 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:24.478149 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.686797 (+1208648us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400081954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:25.686830 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.686922 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474024192}
I20260709 13:17:25.680166 19478 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:25.690811 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1189) took 1555 ms. Trace:
I20260709 13:17:25.692770 19530 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:25.686288 18377 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:25.693389 19462 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.693974 18953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54020 (request call id 110) took 2291 ms. Trace:
I20260709 13:17:25.694412 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 1196) took 1060 ms. Trace:
I20260709 13:17:25.695012 18377 rpcz_store.cc:276] 0709 13:17:24.634265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.651558 (+1017293us) service_pool.cc:224] Handling call
0709 13:17:25.694222 (+ 42664us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b54000cdad4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:25.694342 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67662080}
I20260709 13:17:25.696588 19494 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:25.690922 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1191) took 1572 ms. Trace:
W20260709 13:17:25.664619 18958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53364 (request call id 104) took 2045 ms (client timeout 1942 ms). Trace:
I20260709 13:17:25.662379 19389 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.696377 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:25.661155 19496 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:25.812813 18235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 817) took 2349 ms (client timeout 1823 ms). Trace:
W20260709 13:17:25.705284 18234 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 814) took 2239 ms (client timeout 1862 ms). Trace:
I20260709 13:17:25.691200 18312 rpcz_store.cc:276] 0709 13:17:24.135087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.135228 (+   141us) service_pool.cc:224] Handling call
0709 13:17:24.135543 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.382758 (+247215us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:17:24.564048 (+181290us) log.cc:844] Serialized 14 byte log entry
0709 13:17:24.619760 (+ 55712us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.619802 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:24.619857 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.690620 (+1070763us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54000ca8d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:25.690664 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.690761 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":194181,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":30,"raft.queue_time_us":1432,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":114179,"spinlock_wait_cycles":568036736,"thread_start_us":201167,"threads_started":2,"wal-append.queue_time_us":350926}
W20260709 13:17:25.737215 18379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 1185) took 1671 ms (client timeout 2115 ms). Trace:
I20260709 13:17:25.697512 18383 rpcz_store.cc:276] 0709 13:17:24.118650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.286416 (+167766us) service_pool.cc:224] Handling call
0709 13:17:24.286756 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.444289 (+157533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.444321 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.444362 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:24.444398 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.690715 (+1246317us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54003bcc54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:25.690750 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.690877 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361838336}
I20260709 13:17:25.800936 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 898) took 1573 ms. Trace:
W20260709 13:17:25.824082 18235 rpcz_store.cc:269] 0709 13:17:23.456609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.457047 (+   438us) service_pool.cc:224] Handling call
0709 13:17:25.801543 (+2344496us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b540005a854. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:25.801703 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780889856}
I20260709 13:17:25.661165 19541 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.736398 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1187) took 1601 ms. Trace:
I20260709 13:17:25.661371 19463 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:25.698558 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:25.724675 19573 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.098s	user 0.001s	sys 0.001s
I20260709 13:17:25.852561 18378 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:25.854605 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:25.856424 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 960) took 1030 ms. Trace:
I20260709 13:17:25.821000 19372 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.856575 18383 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:25.689519 19531 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:25.856835 18378 rpcz_store.cc:276] 0709 13:17:24.826253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.698255 (+872002us) service_pool.cc:224] Handling call
0709 13:17:25.856351 (+158096us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.725694 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:25.683818 19571 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.706483 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:25.734899 19350 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.735682 19539 consensus_queue.cc:237] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:25.827210 18955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53364 (request call id 103) took 3302 ms (client timeout 2037 ms). Trace:
W20260709 13:17:25.822247 18958 rpcz_store.cc:269] 0709 13:17:23.617946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.625692 (+  7746us) service_pool.cc:224] Handling call
0709 13:17:25.662716 (+2037024us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b540047cf54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:25.662822 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504269568}
W20260709 13:17:25.871800 19535 consensus_meta.cc:287] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.001s
I20260709 13:17:25.872247 19529 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:25.871917 19525 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.872980 19519 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.872864 19476 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:25.875152 19354 raft_consensus.cc:359] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:25.881086 19468 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:25.879456 18959 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 2 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:25.888868 19486 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.889587 19525 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:25.889973 19480 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:25.890655 19486 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.885851 19354 raft_consensus.cc:740] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:17:25.883736 19535 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:25.913551 19553 consensus_meta.cc:287] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.002s
I20260709 13:17:25.914232 19553 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:25.916739 19571 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:25.705569 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 895) took 2075 ms. Trace:
I20260709 13:17:25.749703 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 906) took 1492 ms. Trace:
I20260709 13:17:25.865477 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:25.956034 18956 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:17:25.857960 18377 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:25.958760 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 954) took 1133 ms. Trace:
W20260709 13:17:25.827191 18234 rpcz_store.cc:269] 0709 13:17:23.451725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.454072 (+  2347us) service_pool.cc:224] Handling call
0709 13:17:25.691363 (+2237291us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b5400329454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:25.691474 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548820352}
I20260709 13:17:25.959409 18377 rpcz_store.cc:276] 0709 13:17:24.824601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.696061 (+871460us) service_pool.cc:224] Handling call
0709 13:17:25.958356 (+262295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.694386 18953 rpcz_store.cc:276] 0709 13:17:23.402628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.404185 (+  1557us) service_pool.cc:224] Handling call
0709 13:17:23.404619 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.169709 (+765090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.181034 (+ 11325us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.192805 (+ 11771us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:24.200585 (+  7780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.693704 (+1493119us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b540056fc54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:25.693751 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.693899 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1693094784}
I20260709 13:17:25.843283 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:25.963639 19354 consensus_queue.cc:260] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:25.967530 19385 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.969576 19501 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:25.971385 18231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 883) took 3963 ms (client timeout 2309 ms). Trace:
W20260709 13:17:25.973402 18305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 822) took 2625 ms (client timeout 2239 ms). Trace:
I20260709 13:17:25.974234 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:25.963745 18235 raft_consensus.cc:2376] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3. Re-sending same reply.
I20260709 13:17:25.953724 18236 rpcz_store.cc:276] 0709 13:17:24.257586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.431209 (+173623us) service_pool.cc:224] Handling call
0709 13:17:24.618718 (+187509us) spinlock_profiling.cc:243] Waited 8.73 ms on lock 0x7b5800002a98. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:17:24.618914 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.779056 (+160142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.779103 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.779161 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:24.779205 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.749411 (+970206us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540001aed4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:25.749481 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.749633 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387812992}
W20260709 13:17:25.881346 18955 rpcz_store.cc:269] 0709 13:17:22.551266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.556168 (+  4902us) service_pool.cc:224] Handling call
0709 13:17:25.820569 (+3264401us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54006301d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:25.825655 (+  5086us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3480549248}
I20260709 13:17:25.951484 18228 rpcz_store.cc:276] 0709 13:17:23.615691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.139144 (+523453us) service_pool.cc:224] Handling call
0709 13:17:25.690373 (+1551229us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540001bdd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:25.690494 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2903346048}
I20260709 13:17:26.000656 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.001749 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.002259 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.002892 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 914) took 1107 ms. Trace:
I20260709 13:17:26.003250 18228 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:26.003403 18235 rpcz_store.cc:276] 0709 13:17:24.895490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.001298 (+1105808us) service_pool.cc:224] Handling call
0709 13:17:26.002810 (+  1512us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.004010 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 916) took 1100 ms. Trace:
I20260709 13:17:26.004351 18228 rpcz_store.cc:276] 0709 13:17:24.903190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.001836 (+1098646us) service_pool.cc:224] Handling call
0709 13:17:26.003922 (+  2086us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.005478 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:25.825893 18237 rpcz_store.cc:276] 0709 13:17:24.227508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.227646 (+   138us) service_pool.cc:224] Handling call
0709 13:17:24.233429 (+  5783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.242672 (+1009243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.242718 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.242773 (+    55us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:25.242815 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.800609 (+557794us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540001a9d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:25.800677 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.800859 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2320472448}
I20260709 13:17:26.006940 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.007477 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.007923 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 917) took 1086 ms. Trace:
I20260709 13:17:26.008319 18228 rpcz_store.cc:276] 0709 13:17:24.921846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.006480 (+1084634us) service_pool.cc:224] Handling call
0709 13:17:26.007865 (+  1385us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.009513 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.010207 19386 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:25.824793 18379 rpcz_store.cc:269] 0709 13:17:24.065949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.161291 (+ 95342us) service_pool.cc:224] Handling call
0709 13:17:25.737027 (+1575736us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540019ad54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:25.737152 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392259456}
I20260709 13:17:26.010991 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.012195 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:26.012562 18228 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:26.013125 18379 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.013983 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.015507 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.016533 18228 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:26.017467 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.018766 18228 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:26.020816 19414 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:26.021399 19426 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:26.021701 19414 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:26.008972 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:25.961433 19350 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.995114 19410 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:25.983788 18305 rpcz_store.cc:269] 0709 13:17:23.347204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.347357 (+   153us) service_pool.cc:224] Handling call
0709 13:17:25.972646 (+2625289us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b54000bdbd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:25.972992 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1609786752}
I20260709 13:17:25.984292 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 965) took 1145 ms. Trace:
I20260709 13:17:25.996830 19553 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:25.998571 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:25.999104 19535 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:26.020996 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 910) took 1227 ms. Trace:
I20260709 13:17:26.025861 18383 rpcz_store.cc:276] 0709 13:17:24.839113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.973341 (+1134228us) service_pool.cc:224] Handling call
0709 13:17:25.984208 (+ 10867us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.961591 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.027698 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 920) took 1084 ms. Trace:
I20260709 13:17:26.030014 18236 rpcz_store.cc:276] 0709 13:17:24.943240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.997988 (+1054748us) service_pool.cc:224] Handling call
0709 13:17:26.027597 (+ 29609us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.850189 18304 rpcz_store.cc:276] 0709 13:17:24.134523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.152297 (+ 17774us) service_pool.cc:224] Handling call
0709 13:17:24.152657 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.292972 (+140315us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:17:24.538547 (+245575us) log.cc:844] Serialized 14 byte log entry
0709 13:17:24.609944 (+ 71397us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.609994 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:24.610034 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.736070 (+1126036us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400170554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:25.736138 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.736317 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25816,"prepare.queue_time_us":283685,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":22757,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3812,"spinlock_wait_cycles":322042752,"thread_start_us":260985,"threads_started":2,"wal-append.queue_time_us":60752}
I20260709 13:17:26.001617 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:26.029438 18228 rpcz_store.cc:276] 0709 13:17:24.794033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.019541 (+1225508us) service_pool.cc:224] Handling call
0709 13:17:26.020197 (+   656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.020616 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.020647 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.020717 (+    70us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:26.020745 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.020808 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.020910 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:25.984850 18231 rpcz_store.cc:269] 0709 13:17:22.007910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.008026 (+   116us) service_pool.cc:224] Handling call
0709 13:17:25.970722 (+3962696us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54001888d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:25.971013 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5002534272}
I20260709 13:17:26.034462 19571 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:26.035568 18234 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:26.038096 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:26.039258 18381 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:26.040977 19429 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:26.042366 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:17:26.044893 18380 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 957) took 1206 ms (client timeout 1559 ms). Trace:
I20260709 13:17:26.045351 18926 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:26.046643 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 911) took 1224 ms. Trace:
I20260709 13:17:26.047108 18236 rpcz_store.cc:276] 0709 13:17:24.822555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.032488 (+1209933us) service_pool.cc:224] Handling call
0709 13:17:26.045803 (+ 13315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.046237 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.046267 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.046338 (+    71us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:26.046372 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.046432 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.046558 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.035559 19571 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:26.049646 19579 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:17:26.050333 18237 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
W20260709 13:17:26.045382 18380 rpcz_store.cc:269] 0709 13:17:24.825442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.876278 (+ 50836us) service_pool.cc:224] Handling call
0709 13:17:26.031489 (+1155211us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b540019bc54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:26.032269 (+   780us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278540032}
I20260709 13:17:26.054019 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.058650 18377 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.062443 19571 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:26.066462 19414 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:26.067850 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1190) took 1932 ms. Trace:
I20260709 13:17:26.111747 18306 rpcz_store.cc:276] 0709 13:17:24.135372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.135510 (+   138us) service_pool.cc:224] Handling call
0709 13:17:24.135864 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.245004 (+1109140us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b1800188f80. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181e1b4bc 00007fa17f16948b 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f183455 00007fa18226b060 00007fa18226bbfb 00007fa18227664b
0709 13:17:25.245116 (+   112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.245141 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.974385 (+729244us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b2c0010c0c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:17:25.975463 (+  1078us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.994448 (+ 18985us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:25.994527 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.995649 (+  1122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:26.067421 (+ 71772us) raft_consensus.cc:1685] finished
0709 13:17:26.067442 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.067623 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11996,"raft.queue_time_us":63383,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":33174,"spinlock_wait_cycles":107248768,"thread_start_us":121911,"threads_started":2,"wal-append.queue_time_us":19077}
I20260709 13:17:26.075764 18380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1202) took 1440 ms. Trace:
I20260709 13:17:26.081260 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 912) took 1209 ms. Trace:
I20260709 13:17:26.114610 18228 rpcz_store.cc:276] 0709 13:17:24.871367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.054996 (+1183629us) service_pool.cc:224] Handling call
0709 13:17:26.080303 (+ 25307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.080815 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.080850 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.080920 (+    70us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:26.080971 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.081042 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.081160 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.085261 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1199) took 1450 ms. Trace:
I20260709 13:17:26.097306 18379 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:26.116480 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 956) took 1291 ms. Trace:
I20260709 13:17:26.097872 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:26.116895 18379 rpcz_store.cc:276] 0709 13:17:24.825163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.011627 (+1186464us) service_pool.cc:224] Handling call
0709 13:17:26.116379 (+104752us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.060060 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1200) took 1417 ms. Trace:
W20260709 13:17:26.114095 19515 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 2.489s	user 0.001s	sys 0.014s
I20260709 13:17:26.117717 18383 rpcz_store.cc:276] 0709 13:17:24.634959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.043741 (+1408782us) service_pool.cc:224] Handling call
0709 13:17:26.044343 (+   602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.084849 (+ 40506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.084886 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.084934 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:26.084991 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.085056 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.085170 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.120977 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:26.122987 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:26.123566 18386 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 949) took 2640 ms (client timeout 2697 ms). Trace:
I20260709 13:17:26.123839 18379 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:26.118510 18380 rpcz_store.cc:276] 0709 13:17:24.635748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.073950 (+1438202us) service_pool.cc:224] Handling call
0709 13:17:26.074564 (+   614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.075184 (+   620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.075219 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.075306 (+    87us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:26.075431 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.075514 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.075668 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.125090 18382 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:26.118206 18381 rpcz_store.cc:276] 0709 13:17:24.635251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.048970 (+1413719us) service_pool.cc:224] Handling call
0709 13:17:26.049629 (+   659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.050061 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.050109 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.050197 (+    88us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:26.050239 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.052297 (+  2058us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.052410 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.128309 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:26.129191 18305 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
I20260709 13:17:26.129276 19520 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:26.131153 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:26.131563 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.131922 18377 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:26.133651 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:26.135629 18382 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.138094 19387 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:26.138748 19517 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:26.124143 18386 rpcz_store.cc:269] 0709 13:17:23.483407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.613195 (+129788us) service_pool.cc:224] Handling call
0709 13:17:26.123045 (+2509850us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540012b954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:26.123329 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2982701952}
I20260709 13:17:26.139766 19517 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:26.141191 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:26.143028 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1203) took 1506 ms. Trace:
I20260709 13:17:26.143396 18386 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:26.136641 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:26.134667 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:26.104468 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 65) took 1569 ms. Trace:
I20260709 13:17:26.143510 18385 rpcz_store.cc:276] 0709 13:17:24.635972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.141271 (+1505299us) service_pool.cc:224] Handling call
0709 13:17:26.141908 (+   637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.142395 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.142428 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.142515 (+    87us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:26.142558 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.142625 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.142780 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.147119 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:26.148363 18959 raft_consensus.cc:2368] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:26.150740 18349 leader_election.cc:400] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:26.151494 18349 leader_election.cc:403] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:17:26.152472 19524 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:26.157421 19524 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
W20260709 13:17:26.157879 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 112909us
I20260709 13:17:26.117439 19535 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:26.157526 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:26.167817 18960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54004 (request call id 136) took 4142 ms. Trace:
I20260709 13:17:26.170282 18961 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:26.174566 18379 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:26.152786 19517 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:26.159934 19535 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:26.185777 18305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:26.178298 18229 raft_consensus.cc:2368] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:26.189954 18383 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:26.191056 18349 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:26.196425 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:26.187793 18305 raft_consensus.cc:606] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:26.202893 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1194) took 2065 ms. Trace:
I20260709 13:17:26.208280 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:26.209290 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:26.210453 18235 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.212615 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 819) took 1080 ms. Trace:
I20260709 13:17:26.213380 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43098 (request call id 39) took 1793 ms. Trace:
I20260709 13:17:26.168314 18960 rpcz_store.cc:276] 0709 13:17:22.047899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.052032 (+  4133us) service_pool.cc:224] Handling call
0709 13:17:22.052438 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.429527 (+377089us) spinlock_profiling.cc:243] Waited 81.3 ms on lock 0x7b18000235c0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181e1b4bc 00007fa17f16948b 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f183455 00007fa18226b060 00007fa18226bbfb 00007fa18227664b
0709 13:17:22.429667 (+   140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.429696 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:22.430206 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:17:22.604192 (+173986us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:23.368600 (+764408us) log.cc:844] Serialized 14 byte log entry
0709 13:17:23.368889 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.368994 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.069414 (+1700420us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b18000235c0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1542a6 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db
0709 13:17:26.112936 (+1043522us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:17:26.165351 (+ 52415us) raft_consensus.cc:1685] finished
0709 13:17:26.165378 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.165639 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1012662,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":203263,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":49947,"spinlock_wait_cycles":206345088,"thread_start_us":572185,"threads_started":3,"wal-append.queue_time_us":978256}
I20260709 13:17:26.209404 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:26.218408 19389 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:26.219856 19389 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:26.220810 18276 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:26.222754 19472 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:26.223237 19472 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:26.223399 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.223691 19472 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:26.224682 19524 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:26.225198 19524 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:26.225668 19524 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:26.226217 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:26.228688 19410 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:26.229182 19410 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.204487 18309 rpcz_store.cc:276] 0709 13:17:24.137734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.156151 (+ 18417us) service_pool.cc:224] Handling call
0709 13:17:25.976879 (+1820728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.977704 (+   825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.977741 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.977827 (+    86us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:25.977906 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.978038 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.202497 (+224459us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54000bdbd0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:26.202697 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4185892224}
I20260709 13:17:26.224164 19543 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:26.213109 18229 rpcz_store.cc:276] 0709 13:17:25.125193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.636444 (+511251us) service_pool.cc:224] Handling call
0709 13:17:26.131219 (+494775us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b5800002a98. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa1872390a0 00007fa187238984 00007fa1807b36d4 00007fa1807b3662
0709 13:17:26.203458 (+ 72239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3749632}
I20260709 13:17:26.233314 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.213873 18384 rpcz_store.cc:276] 0709 13:17:24.419311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.453937 (+ 34626us) service_pool.cc:224] Handling call
0709 13:17:26.212944 (+1759007us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400080054. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:26.213129 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2717008768}
I20260709 13:17:26.145288 18232 rpcz_store.cc:276] 0709 13:17:24.534698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.636671 (+101973us) service_pool.cc:224] Handling call
0709 13:17:24.754930 (+118259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.365090 (+610160us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:25.440154 (+ 75064us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.507500 (+ 67346us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.507552 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:25.507598 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.101278 (+593680us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b1800331f60. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1542a6 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419
0709 13:17:26.103979 (+  2701us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b540001b3d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:26.104027 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.104235 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":267429,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":126,"raft.run_cpu_time_us":671,"raft.run_wall_time_us":96030,"spinlock_wait_cycles":1489409536,"thread_start_us":110875,"threads_started":2,"wal-append.queue_time_us":79204}
I20260709 13:17:26.237676 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.239969 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:26.240172 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:26.240788 18234 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.238112 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.220465 19389 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:26.250089 18379 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:26.257862 18276 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:26.264586 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:26.265710 18228 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:26.257241 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:26.268685 18230 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.273610 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.275748 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 969) took 1434 ms. Trace:
I20260709 13:17:26.276201 18381 rpcz_store.cc:276] 0709 13:17:24.871850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.167502 (+1295652us) service_pool.cc:224] Handling call
0709 13:17:26.197931 (+ 30429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.270657 (+ 72726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.270692 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.274301 (+  3609us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:26.274329 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.274384 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.274481 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.276667 18386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 968) took 1436 ms. Trace:
I20260709 13:17:26.277426 18386 rpcz_store.cc:276] 0709 13:17:24.839781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.167438 (+1327657us) service_pool.cc:224] Handling call
0709 13:17:26.203942 (+ 36504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.273984 (+ 70042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.274026 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.276364 (+  2338us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:26.276401 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.276466 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.276606 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.279253 18306 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.280093 19539 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:26.280905 18926 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:26.284950 19497 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:26.285593 19497 raft_consensus.cc:697] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:26.286916 19497 consensus_queue.cc:237] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:26.280921 19539 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:26.292258 19539 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:26.295617 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.296397 18237 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:26.296931 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.297377 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.297852 18231 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:26.298715 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.298946 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:26.299304 19493 consensus_meta.cc:287] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.866s	user 0.010s	sys 0.011s
I20260709 13:17:26.299682 18237 raft_consensus.cc:2368] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:26.299866 18231 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:26.300401 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:26.300910 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.301857 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:26.302246 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.298817 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:26.305775 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:26.307286 18230 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:26.309863 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 953) took 1484 ms. Trace:
I20260709 13:17:26.299896 19493 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:26.310346 18377 rpcz_store.cc:276] 0709 13:17:24.824280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.000783 (+1176503us) service_pool.cc:224] Handling call
0709 13:17:26.275964 (+275181us) spinlock_profiling.cc:243] Waited 7.21 ms on lock 0x7b540012af54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:26.308760 (+ 32796us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16589056}
W20260709 13:17:26.314385 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 76116.8us
I20260709 13:17:26.316002 18382 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:26.324857 19543 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:26.327299 19543 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:26.328727 18378 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 2: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:26.442063 18235 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:26.446396 18237 raft_consensus.cc:2368] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:26.364898 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 971) took 1086 ms. Trace:
I20260709 13:17:26.460062 18383 rpcz_store.cc:276] 0709 13:17:25.278080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.199642 (+921562us) service_pool.cc:224] Handling call
0709 13:17:26.274250 (+ 74608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.363745 (+ 89495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.363794 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.363863 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:26.363914 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.364474 (+   560us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.364768 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.328843 19543 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:26.341467 19580 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:17:26.343650 18384 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:26.422426 18276 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:26.323716 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1205) took 1437 ms. Trace:
I20260709 13:17:26.381369 18202 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:26.343392 18927 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:26.455389 18305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:26.347200 18380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 955) took 1522 ms. Trace:
I20260709 13:17:26.474102 18380 rpcz_store.cc:276] 0709 13:17:24.824881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.167140 (+1342259us) service_pool.cc:224] Handling call
0709 13:17:26.230236 (+ 63096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.346697 (+116461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.346742 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.346814 (+    72us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:26.346864 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.346954 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.347125 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.478617 18379 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:26.460068 18306 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:26.360399 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:26.492327 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 70154.9us
I20260709 13:17:26.425416 19493 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:26.504120 19518 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:26.505273 19238 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:26.505721 19238 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:26.506114 19238 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:26.506220 18231 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
W20260709 13:17:26.349922 18233 consensus_meta.cc:287] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.695s	user 0.006s	sys 0.014s
W20260709 13:17:26.509001 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 127935us
I20260709 13:17:26.511696 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.512957 18234 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:26.473115 18305 raft_consensus.cc:606] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:26.339447 19354 ts_tablet_manager.cc:1434] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.677s	user 0.020s	sys 0.000s
I20260709 13:17:26.426977 19387 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:26.509804 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 42) took 1075 ms. Trace:
I20260709 13:17:26.518169 18379 rpcz_store.cc:276] 0709 13:17:25.404016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.452359 (+1048343us) service_pool.cc:224] Handling call
0709 13:17:26.473056 (+ 20697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.479204 (+  6148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.479407 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.370465 19535 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:26.514685 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 256922us
I20260709 13:17:26.513638 18305 raft_consensus.cc:614] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:26.329705 19479 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:26.469746 18385 rpcz_store.cc:276] 0709 13:17:24.874430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.147519 (+1273089us) service_pool.cc:224] Handling call
0709 13:17:26.147964 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.148558 (+   594us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:17:26.179347 (+ 30789us) log.cc:844] Serialized 14 byte log entry
0709 13:17:26.279826 (+100479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.309522 (+ 29696us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:26.309628 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.311862 (+  2234us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.312044 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4276,"prepare.queue_time_us":51291,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":6817,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":89395,"threads_started":2}
I20260709 13:17:26.519536 18232 raft_consensus.cc:2368] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:26.508558 19389 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:26.524747 18957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54004 (request call id 142) took 1388 ms. Trace:
I20260709 13:17:26.527529 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.529917 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.530166 19583 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:26.530774 18237 raft_consensus.cc:2368] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:26.531062 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.531642 18960 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:26.531867 18231 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:26.533049 18276 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:26.534978 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 972) took 1249 ms. Trace:
I20260709 13:17:26.535975 18381 rpcz_store.cc:276] 0709 13:17:25.285642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.446676 (+1161034us) service_pool.cc:224] Handling call
0709 13:17:26.469063 (+ 22387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.482603 (+ 13540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.482645 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.482706 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:26.482746 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.482818 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.534822 (+ 52004us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b5400080550. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:26.534927 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49631104}
W20260709 13:17:26.519735 19354 ts_tablet_manager.cc:1467] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Tablet startup took 853ms
I20260709 13:17:26.522169 18233 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:26.545423 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.545642 19474 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:26.556821 19389 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:26.548491 19474 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:26.557669 19474 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:26.533511 19387 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:26.568557 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:26.569358 18234 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:26.573215 18383 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:26.525210 18957 rpcz_store.cc:276] 0709 13:17:25.124469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.128871 (+  4402us) service_pool.cc:224] Handling call
0709 13:17:25.276847 (+147976us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.277302 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.277337 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.158155 (+880818us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b2c00047988. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:17:26.159000 (+   845us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.199834 (+ 40834us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:26.199904 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.207259 (+  7355us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:26.466413 (+259154us) raft_consensus.cc:1685] finished
0709 13:17:26.466461 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.511327 (+ 44866us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1228,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":12398464,"thread_start_us":37758,"threads_started":1,"wal-append.queue_time_us":152549}
W20260709 13:17:26.570863 18378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 961) took 1744 ms (client timeout 2247 ms). Trace:
I20260709 13:17:26.583639 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:26.570000 19387 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:26.581847 18378 rpcz_store.cc:269] 0709 13:17:24.826519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.865135 (+1038616us) service_pool.cc:224] Handling call
0709 13:17:26.570638 (+705503us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b540012a054. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:26.570788 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823027072}
I20260709 13:17:26.570643 19517 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:17:26.586324 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:26.562237 18233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 827) took 1435 ms (client timeout 1654 ms). Trace:
I20260709 13:17:26.596647 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:26.592029 19534 consensus_meta.cc:287] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.866s	user 0.010s	sys 0.010s
I20260709 13:17:26.600009 18276 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:26.589797 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.598675 19389 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:26.628926 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:26.612329 19536 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:26.633744 19238 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:26.638520 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:26.639338 18379 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:26.640165 19543 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.640988 19543 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:26.645627 18381 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:26.646881 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:26.647531 18385 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.619472 19389 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.652777 19389 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.656904 18378 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:26.659317 18384 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:26.666123 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.671792 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:26.672811 18383 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:26.675246 18234 raft_consensus.cc:2368] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
W20260709 13:17:26.676375 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 79893.3us
W20260709 13:17:26.677717 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 93224.3us
W20260709 13:17:26.594028 18233 rpcz_store.cc:269] 0709 13:17:25.127049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.647200 (+520151us) service_pool.cc:224] Handling call
0709 13:17:26.549805 (+902605us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.680810 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:26.682108 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:26.684928 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:26.685544 18378 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.685606 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.686651 18235 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:26.692133 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:26.691673 18385 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:26.694525 19238 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:26.613708 19534 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:26.696470 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.697961 18234 raft_consensus.cc:2368] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:26.696436 18237 raft_consensus.cc:2376] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3. Re-sending same reply.
I20260709 13:17:26.700796 18232 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:26.705818 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:26.706584 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:26.708693 18386 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:26.705024 18927 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:26.712082 18276 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:26.712893 19238 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:26.716091 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:26.716660 18377 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:26.719885 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:26.713210 19238 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:26.712106 18384 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:26.721570 19238 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:26.723464 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:26.711807 18231 raft_consensus.cc:2393] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:26.709549 19543 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:26.737535 18379 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.737640 18378 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:26.742422 18381 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:26.723654 19518 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:26.730674 19536 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:26.718436 19520 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.747352 18276 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:17:26.753670 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 76642.6us
I20260709 13:17:26.727131 19410 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:26.753088 19553 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:26.759133 19524 consensus_meta.cc:287] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.533s	user 0.013s	sys 0.000s
I20260709 13:17:26.754436 18927 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:26.765972 19589 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:26.757323 19553 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:26.754706 19518 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:26.757349 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:26.751757 19497 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 13:17:26.789644 19472 consensus_meta.cc:287] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.009s
W20260709 13:17:26.539464 19354 ts_tablet_manager.cc:1469] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Trace:
0709 13:17:16.750834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.750980 (+   146us) service_pool.cc:224] Handling call
0709 13:17:16.794901 (+ 43921us) ts_tablet_manager.cc:934] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
0709 13:17:19.205312 (+2410411us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:17:19.244099 (+ 38787us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:19.244220 (+   121us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:17:19.726407 (+482187us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:17:19.726708 (+   301us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:19.726998 (+   290us) ts_tablet_manager.cc:989] Replica registered.
0709 13:17:19.727052 (+    54us) inbound_call.cc:177] Queueing success response
0709 13:17:21.226969 (+1499917us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:17:25.662599 (+4435630us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:17:25.696931 (+ 34332us) tablet_replica.cc:261] Starting instrumentation
0709 13:17:25.850604 (+153673us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":286,"mutex_wait_us":1492,"raft.queue_time_us":127425,"raft.run_cpu_time_us":507,"raft.run_wall_time_us":5013,"tablet-copy.queue_time_us":40298,"tablet-download-pool.queue_time_us":1712,"tablet-download-pool.run_cpu_time_us":1306,"tablet-download-pool.run_wall_time_us":955298,"thread_start_us":62606,"threads_started":2}
I20260709 13:17:26.809382 19534 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:26.809837 19474 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:26.810432 19588 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:26.812613 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 58267.3us
I20260709 13:17:26.768656 19589 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:26.824443 19474 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:26.785949 19520 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:26.796172 18961 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 2 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:26.815120 19472 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:26.782358 19524 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:26.835474 19520 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:26.811513 19387 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.857975 19238 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:26.847141 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 45336us
I20260709 13:17:26.860571 18379 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:26.863618 19238 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:26.815593 19588 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.873147 19588 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.866556 18133 catalog_manager.cc:5697] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 1 to 2, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:26.874284 19387 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:26.874773 19583 raft_consensus.cc:3055] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:26.875254 19583 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:26.874603 18133 catalog_manager.cc:5697] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:26.858599 19534 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.877157 19534 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:26.876904 18133 catalog_manager.cc:5697] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 1 to 3, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 3 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:26.827816 19536 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:26.879134 19536 raft_consensus.cc:697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:26.869834 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.866504 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:26.832973 19410 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:26.879185 19534 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:26.838896 19472 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:26.842479 19589 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:26.882831 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 68005.2us
I20260709 13:17:26.840139 19553 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:26.885818 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.890424 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.892381 18232 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:26.894634 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.876397 19387 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:26.899497 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.900286 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:26.901950 19524 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:26.876242 19583 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:26.907949 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:26.908221 19583 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.904486 19536 consensus_queue.cc:237] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:26.890764 19518 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:26.898357 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.911525 18234 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:26.904726 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.912647 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:26.913033 18233 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:26.905923 18232 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:26.906111 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.916471 18237 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:26.907150 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:26.920449 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:26.920791 18276 leader_election.cc:400] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3.
I20260709 13:17:26.921063 18276 leader_election.cc:403] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:26.921228 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 135779us
W20260709 13:17:26.921741 19585 log.cc:927] Time spent T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:17:26.922040 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:26.918457 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.923910 18237 raft_consensus.cc:2393] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:26.912962 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:26.897635 18377 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:17:26.926542 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.927115 18230 raft_consensus.cc:2368] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4.
I20260709 13:17:26.928643 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:26.929627 18231 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:26.930563 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:26.927502 19479 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:26.932804 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:26.933027 19479 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:26.906435 19387 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:26.935544 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:26.936311 18228 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:26.898833 19389 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:26.937744 18959 raft_consensus.cc:2368] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3.
I20260709 13:17:26.933506 19479 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:26.935890 19387 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:26.942674 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:26.944350 18232 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:26.950127 19387 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:26.952126 19410 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.953130 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:26.954159 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:26.954907 19493 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:26.955262 19493 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.955562 19493 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:26.957053 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:26.960731 19517 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:26.961184 19517 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:26.939185 19524 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:26.963059 19410 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3.
I20260709 13:17:26.961560 19517 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:26.965123 18926 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:26.950918 18955 raft_consensus.cc:2955] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:26.972864 19596 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:26.973407 19596 raft_consensus.cc:697] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:26.974385 19596 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:26.963297 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:27.004053 18306 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:27.007094 19535 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:27.017990 18276 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:27.019169 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:27.021055 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:27.023895 18953 raft_consensus.cc:2393] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:17:27.025036 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:27.025776 18961 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:27.022708 18275 leader_election.cc:400] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3.
I20260709 13:17:27.028752 18275 leader_election.cc:403] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:27.029682 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 66502.8us
I20260709 13:17:27.034624 19493 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.041617 18351 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:27.026945 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:27.045123 19536 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:17:27.048615 18955 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:27.049666 19535 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:27.050024 19589 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.051061 19238 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.057570 19594 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:27.058118 19594 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:27.059311 19594 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.068881 19238 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3.
I20260709 13:17:27.075083 18233 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
W20260709 13:17:27.051101 18277 connection.cc:256] RPC call timeout handler was delayed by -1.6093215879998297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3007s for a response
W20260709 13:17:27.077747 18277 connection.cc:256] RPC call timeout handler was delayed by -1.5507256710000092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260709 13:17:27.080880 18277 connection.cc:256] RPC call timeout handler was delayed by -1.1141219910000473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260709 13:17:27.081238 18277 connection.cc:256] RPC call timeout handler was delayed by -1.1133256709999841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 13:17:27.091146 18306 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:27.091928 19410 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:27.098031 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 67446.6us
I20260709 13:17:27.046371 19517 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.098680 19410 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.101107 18276 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:27.102530 19410 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.101846 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.103893 19410 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:27.105944 19472 raft_consensus.cc:993] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:17:27.107133 19472 raft_consensus.cc:1081] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:17:27.105818 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:27.108331 18379 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:27.104029 18306 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:27.111119 19389 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:27.113068 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:27.114045 18383 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:27.116025 19517 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:27.116798 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:27.117300 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:27.117630 18379 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:27.119407 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:27.120203 18379 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:27.123852 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:27.097826 18377 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:27.125887 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:27.126495 18233 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:27.127584 18306 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:27.127816 19493 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:27.129184 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:27.131127 19536 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:27.138478 19536 raft_consensus.cc:697] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:27.139603 19536 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:27.141731 19479 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.136864 18383 raft_consensus.cc:2376] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3. Re-sending same reply.
I20260709 13:17:27.153903 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:27.155696 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.155292 18383 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:27.149075 19583 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:17:27.153653 18200 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:17:27.160419 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 120352us
I20260709 13:17:27.130055 19606 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:27.185811 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:27.185937 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.165681 19479 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:27.186640 18377 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:27.186919 19606 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:27.165886 19387 consensus_queue.cc:1059] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:17:27.192677 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:27.192884 19387 consensus_queue.cc:1243] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer e016302b7e734d74833a2bf7bab44838 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:27.193508 19387 raft_consensus.cc:3055] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:27.193890 19387 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:27.194938 19387 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:27.189491 19606 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:27.190095 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.184298 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:27.186702 18306 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:27.197218 18383 raft_consensus.cc:2393] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:27.154376 19410 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:27.191956 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:27.199162 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:27.168326 19520 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:27.203325 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.205590 19520 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:27.210250 18306 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:27.212669 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:27.206597 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:27.214526 18305 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:27.196290 19387 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:27.216261 18383 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:27.209990 19520 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.221370 19479 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:27.221104 19588 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.223832 19589 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.232160 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.234905 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:27.211477 18233 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
I20260709 13:17:27.213867 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:27.233076 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:27.235276 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.225692 19410 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.228825 18351 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:27.228006 19479 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:27.230659 18235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4300927be0384401aa46050bd5996d2f"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:17:27.231149 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.245460 18312 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:27.248853 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:27.244912 18235 raft_consensus.cc:606] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:27.250332 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:27.251111 18381 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:27.252820 18235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49c6a2a19b90491f9336362305339eca"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:17:27.253221 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:27.253690 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.255124 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.255499 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.256385 18307 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:27.256991 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:27.257548 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.244757 19479 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.253913 18386 raft_consensus.cc:2368] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4.
I20260709 13:17:27.231577 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:27.237957 18306 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:17:27.257962 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.257004 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:27.261473 18378 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.259631 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:27.260085 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:27.262632 18310 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:27.265903 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:27.258791 18235 raft_consensus.cc:606] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:27.269670 19606 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.270006 18233 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:27.270193 19606 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.272171 19493 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:27.275051 18378 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:27.276759 18305 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:27.281126 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 62342.6us
I20260709 13:17:27.281896 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:27.282073 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:27.283073 19493 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:27.283483 19493 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:27.264222 19605 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:27.283921 19493 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.284067 19605 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.286331 19605 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.287580 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:27.234124 19588 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.292086 19606 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.283085 18351 leader_election.cc:400] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:27.298022 18351 leader_election.cc:403] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:27.298137 18312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "943649b738074d87a593c237cf998758"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:27.298668 18312 raft_consensus.cc:606] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:27.298969 19517 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:27.301503 18246 tablet_copy_service.cc:342] P b52e2477fc524694967c4a16afa983e3: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-2b14d7467c934fdca91c8a466ef2d764 received from {username='slave'} at 127.0.0.1:46128
I20260709 13:17:27.302039 18246 tablet_copy_service.cc:434] P b52e2477fc524694967c4a16afa983e3: ending tablet copy session e016302b7e734d74833a2bf7bab44838-2b14d7467c934fdca91c8a466ef2d764 on tablet 2b14d7467c934fdca91c8a466ef2d764 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:17:27.302278 18201 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:27.303694 18201 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:27.303835 19534 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:27.304335 19534 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:27.304483 19553 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:27.304876 19534 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:27.306048 18378 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:27.306576 18385 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:27.304900 19553 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:27.308612 18306 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:27.308704 19553 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.309960 18305 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:27.297223 19479 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:27.304883 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:27.310945 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.312089 18235 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.312108 18306 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:27.300644 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:27.313848 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:27.315018 19605 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:27.315557 19605 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.317818 19605 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.319078 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:27.321957 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:27.326356 19517 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:27.326985 19517 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:27.328331 19605 consensus_queue.cc:1059] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:27.327903 19517 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.329016 18312 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:27.330168 19605 raft_consensus.cc:3055] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:27.330664 19605 raft_consensus.cc:740] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:27.330801 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:27.331432 18311 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.332908 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:27.333413 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:27.334543 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.335700 18385 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:27.336581 18304 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:27.338043 18381 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:27.331887 19605 consensus_queue.cc:260] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:27.339541 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:27.339882 19605 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.346514 19535 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:27.347045 19535 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:27.347360 18232 raft_consensus.cc:2410] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:17:27.351823 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.347934 19535 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.356201 18312 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:27.358124 18304 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:27.359361 18309 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:27.361907 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:27.363531 18351 leader_election.cc:400] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:27.364794 18351 leader_election.cc:403] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:17:27.366253 18235 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:27.379547 18379 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:27.380417 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.377166 18276 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:27.379428 18201 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:27.377967 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.381812 18309 raft_consensus.cc:2393] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:17:27.377794 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:27.388198 19589 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:27.389716 18276 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:27.390650 19589 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:27.391196 19589 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:27.392145 19589 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.392298 19520 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:27.418874 19536 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:27.415738 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.420329 19536 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:27.420889 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:27.417176 18305 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:27.394915 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.423905 18377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:17:27.426851 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:27.427423 18377 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.427616 18382 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:27.427896 18377 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.428076 19520 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:27.429262 18926 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:27.393786 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.424296 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:27.430683 18386 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:27.430994 19596 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:27.424641 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:27.431421 19596 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:27.431864 19596 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.433079 18312 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:27.423489 18310 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:27.434188 19238 raft_consensus.cc:993] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:17:27.394073 19595 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:27.425971 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:27.434688 19238 raft_consensus.cc:1081] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:17:27.426661 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:27.396165 19553 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:27.422900 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 43551.4us
I20260709 13:17:27.434871 18381 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.425981 19536 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.424491 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.424486 18303 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:27.435636 18379 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 2: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:27.371884 19534 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.453398 18311 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:27.378862 19524 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
W20260709 13:17:27.463049 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 90564.7us
I20260709 13:17:27.463912 18385 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:27.466135 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.470927 18312 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:27.476874 18310 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:27.380759 19479 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:27.479178 19536 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:27.479732 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:27.481312 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:27.483788 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.440748 19595 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:27.486617 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:27.484306 18309 raft_consensus.cc:2376] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4. Re-sending same reply.
I20260709 13:17:27.418344 19493 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.495972 19534 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.497308 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.498288 18304 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:27.498376 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:27.500038 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.486042 19595 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.501632 19553 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.508400 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.508939 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.507488 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:27.510360 18309 raft_consensus.cc:2376] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3. Re-sending same reply.
I20260709 13:17:27.510735 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.510389 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:27.512893 19238 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:27.513171 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:27.513828 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.514977 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:27.515304 18351 leader_election.cc:400] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:27.515641 18351 leader_election.cc:403] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:27.516080 19520 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:27.516609 18351 leader_election.cc:400] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:27.516649 19520 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.517397 19520 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.517688 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:27.519968 19493 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:27.521023 19524 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:27.521952 19524 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:27.515470 19479 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:27.520932 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:27.525038 18311 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:27.526867 19479 raft_consensus.cc:697] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:27.489033 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:27.528661 19605 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:27.528136 19479 consensus_queue.cc:237] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.532331 19534 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:27.532960 19534 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.533393 19534 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.523417 18377 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.539831 18377 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:27.546844 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:27.548043 19238 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:27.551309 18201 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:27.553236 18201 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:27.553727 18312 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:27.554872 18381 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:27.556746 18276 leader_election.cc:400] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4.
I20260709 13:17:27.557088 18276 leader_election.cc:403] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:27.557905 19553 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:27.560954 19553 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.561321 19553 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.561381 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:27.562244 19387 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:27.563791 19238 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4.
I20260709 13:17:27.563983 18276 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:27.564430 19626 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:27.565831 19626 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:27.566259 19626 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.558060 19389 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:17:27.571066 19520 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.571971 19589 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:27.572484 19589 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:27.572640 19534 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.573731 19589 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.575037 19534 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.576431 19588 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:27.577605 19605 raft_consensus.cc:3055] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:27.577328 19595 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.577960 19605 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:27.578953 18377 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:27.579668 18381 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:27.572499 19553 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.578840 19605 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.604437 19497 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:27.579380 19595 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.611989 19621 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:27.612609 19621 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:27.613034 19621 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.614238 19626 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.601581 19474 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:17:27.621865 19626 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.607487 19387 raft_consensus.cc:697] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:27.600873 19535 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:27.619874 19605 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:27.648751 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 46124.7us
I20260709 13:17:27.586410 19543 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:17:27.600663 19472 consensus_queue.cc:1059] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:17:27.651194 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 50086.2us
I20260709 13:17:27.629153 19497 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:17:27.692973 19594 raft_consensus.cc:3055] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:27.688377 19493 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:27.690145 19520 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.652132 19535 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.724502 19238 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:27.721848 19493 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.729295 19493 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:27.714756 19553 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.730630 19621 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.730947 19387 consensus_queue.cc:237] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:27.735121 19631 raft_consensus.cc:3055] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:27.735992 19631 raft_consensus.cc:740] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:17:27.723852 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 159005us
I20260709 13:17:27.747244 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:27.720109 19594 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:17:27.795115 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 112172us
I20260709 13:17:27.765376 19520 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:27.737784 19631 consensus_queue.cc:260] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:27.802294 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:27.722641 19596 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:27.811614 19520 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:27.860236 19410 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:27.869078 19520 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.869594 19410 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:27.871012 19410 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.877779 18135 catalog_manager.cc:5697] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 3, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 3 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:27.879786 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 78023.7us
I20260709 13:17:27.883703 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:17:27.818125 19626 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:17:27.888028 19635 consensus_queue.cc:1059] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:27.889533 19635 raft_consensus.cc:3055] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:27.889971 19635 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:27.890990 19635 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.861263 19631 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.866221 19596 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.867412 19621 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:27.868614 19535 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:27.904191 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 50373.3us
I20260709 13:17:27.880362 18135 catalog_manager.cc:5697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 2, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:27.914052 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 219520us
I20260709 13:17:27.914896 18276 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:27.915699 19238 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:27.916044 19238 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:27.916358 19238 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.901306 19635 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:27.943146 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 59584.8us
I20260709 13:17:27.906414 19636 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:27.903666 18955 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:27.948480 18276 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:27.951203 18201 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:27.952268 18135 catalog_manager.cc:5697] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 2, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:17:27.958366 19642 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:27.958878 19642 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:27.959707 19642 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.896435 19594 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.961570 19594 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.964545 19628 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:27.964926 19628 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:27.965731 19628 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.966849 19628 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.955685 19472 consensus_queue.cc:1059] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:17:27.967830 19520 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.969070 19472 raft_consensus.cc:3055] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:27.969470 19472 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:27.970261 19472 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.970770 19520 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:27.971654 19472 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:27.947197 19636 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:27.975500 19636 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:27.988729 18382 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:27.996037 18381 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "943649b738074d87a593c237cf998758"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:17:27.996198 19238 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:27.996592 18381 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:27.996942 18381 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:27.993567 18135 catalog_manager.cc:5697] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 2, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.999344 18200 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:28.000064 19238 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:28.004290 18201 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:27.994751 19520 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:28.011343 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.000038 18135 catalog_manager.cc:5697] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: config changed from index 3 to 4, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:28.011920 18385 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:28.013283 18382 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:17:28.018920 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 498432us
I20260709 13:17:28.019845 18351 leader_election.cc:400] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:28.020169 18351 leader_election.cc:403] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:28.021135 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:17:28.021413 19493 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:28.022431 18201 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:28.023806 18201 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:28.024642 19595 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:28.025563 19626 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:28.026019 19626 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:28.026439 19626 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:28.028709 19553 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:28.010645 19520 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:28.034376 19520 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.039888 18381 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:28.040230 18385 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:28.042240 18201 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:28.050309 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:28.044684 19387 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:28.051995 19623 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:28.051837 19641 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:28.050593 18276 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:28.058216 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.058851 18386 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:28.057519 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:28.082082 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:28.085922 18381 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:28.048362 19621 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:28.088526 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:28.094146 18382 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:28.095053 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.088830 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:28.096282 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:28.089108 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:28.091073 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:28.098223 18385 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:28.081179 19410 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:28.057642 19623 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:28.106812 18351 leader_election.cc:400] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:28.118265 18351 leader_election.cc:403] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:28.111553 18382 raft_consensus.cc:2393] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:28.087724 19635 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:28.106773 19524 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:28.112739 18233 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:28.127926 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:28.113749 19606 raft_consensus.cc:2955] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:28.131999 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:28.132980 18957 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.115625 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:28.050478 19633 consensus_queue.cc:1059] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:17:28.101385 19621 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:28.120561 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.121814 18232 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:28.122740 18927 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:28.148813 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:28.091774 19553 raft_consensus.cc:697] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:28.084810 19387 raft_consensus.cc:697] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:28.085206 19474 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:28.116452 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:28.166816 18380 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:28.167155 18383 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:28.127148 18385 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:28.121198 19410 raft_consensus.cc:697] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:28.127601 19635 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:28.125023 18201 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:28.168665 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 43722.7us
I20260709 13:17:28.169713 18201 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:28.093305 19595 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:28.122917 19623 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:28.178735 19635 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:28.144879 19535 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:28.152921 19493 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:28.184580 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:28.184774 19633 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:28.185165 19633 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:28.185570 19633 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.186233 19651 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:28.186685 19651 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.187014 19651 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:28.188771 19637 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:28.189214 19637 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:28.189754 19637 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:28.189160 19410 consensus_queue.cc:237] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:28.190122 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:28.190989 18232 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:17:28.192317 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 76804.1us
I20260709 13:17:28.124279 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.136628 19524 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:28.119812 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.086668 19626 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:28.151285 19621 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:28.172001 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.183223 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:28.183900 19652 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:28.169773 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:28.171562 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.197002 18383 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:28.196862 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:28.194001 18382 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:28.178932 18955 raft_consensus.cc:2955] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:28.196141 18233 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:28.197790 18235 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:28.200883 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.198441 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.199338 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:28.199416 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.205127 18383 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:28.201859 18384 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:28.205989 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:28.206724 18232 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:28.209023 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:17:28.209427 18351 connection.cc:256] RPC call timeout handler was delayed by -1.4402374860001146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
I20260709 13:17:28.197521 19652 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.210826 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:28.210915 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:28.210242 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:28.211611 18237 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.211690 18236 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.215018 18228 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:28.214998 18381 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:28.213940 19652 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:28.220026 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:28.220299 18230 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:28.217519 19493 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:28.178972 19595 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:28.217114 19534 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:17:28.322432 18386 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:28.390708 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:28.456629 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 245851us
I20260709 13:17:28.364923 18237 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:28.478431 18236 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:28.481094 19658 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:28.482684 19658 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:28.485152 18380 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3. Ops: []
W20260709 13:17:28.486310 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 278788us
W20260709 13:17:28.497107 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 385901us
W20260709 13:17:28.467835 19594 consensus_meta.cc:287] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.000s
I20260709 13:17:28.426067 19632 raft_consensus.cc:3055] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:28.390398 19628 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:17:28.496917 19472 consensus_meta.cc:287] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.525s	user 0.014s	sys 0.000s
I20260709 13:17:28.521533 18386 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:28.529212 19628 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.529665 19628 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:28.518813 19636 consensus_meta.cc:287] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.543s	user 0.020s	sys 0.004s
I20260709 13:17:28.531014 19636 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:28.332592 19524 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:28.533488 18312 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:28.533667 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:17:28.537434 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.537894 19636 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:28.539386 19652 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:28.540791 19628 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:28.543083 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 64797.8us
I20260709 13:17:28.332918 19626 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:28.512933 18202 leader_election.cc:336] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.506s (SENT)
I20260709 13:17:28.552361 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:28.257615 19493 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:28.601577 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 55369.6us
I20260709 13:17:28.604035 18201 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:28.559623 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 280196us
I20260709 13:17:28.542819 19628 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:28.513629 19536 consensus_queue.cc:1059] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
W20260709 13:17:28.616809 18351 connection.cc:256] RPC call timeout handler was delayed by -1.3835374860000229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
I20260709 13:17:28.258476 19553 consensus_queue.cc:237] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:28.516458 19596 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
W20260709 13:17:28.621399 18351 connection.cc:256] RPC call timeout handler was delayed by -1.3637374859999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
I20260709 13:17:28.543584 19632 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:28.280485 19387 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:28.610392 19657 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:28.634956 18379 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:28.518898 19643 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
W20260709 13:17:28.641227 18351 connection.cc:256] RPC call timeout handler was delayed by -1.1448010899998735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 13:17:28.641975 18351 connection.cc:256] RPC call timeout handler was delayed by -1.0528629409998302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260709 13:17:28.642390 18351 connection.cc:256] RPC call timeout handler was delayed by -1.0086851569999453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 13:17:28.644654 18351 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.505s (SENT)
W20260709 13:17:28.647819 18351 leader_election.cc:336] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.538s (SENT)
I20260709 13:17:28.648412 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:28.653461 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 110427us
I20260709 13:17:28.558331 19637 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:28.655409 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 51407.3us
W20260709 13:17:28.657632 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 144756us
I20260709 13:17:28.543413 18926 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:28.608635 19583 consensus_queue.cc:1059] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:17:28.660988 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.666980 18379 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:28.662730 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:28.668448 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.669138 18386 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:28.605522 19623 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:28.637814 19657 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:17:28.672254 18351 leader_election.cc:336] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.545s (SENT)
I20260709 13:17:28.692875 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:28.696851 18386 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:28.691568 19652 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:28.720880 18957 consensus_meta.cc:287] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.001s
I20260709 13:17:28.721282 18957 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:28.723457 19623 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:28.664727 19659 consensus_queue.cc:1059] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:17:28.724637 19536 raft_consensus.cc:3055] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:28.724992 19536 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:28.725648 18379 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:28.725865 19536 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:28.726425 19672 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:28.726845 19672 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.727061 19536 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:28.727164 19672 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:28.732579 19648 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.382s	user 0.000s	sys 0.001s
I20260709 13:17:28.734211 19493 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:28.736294 18955 consensus_meta.cc:287] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.004s
I20260709 13:17:28.698589 19626 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:28.694505 19649 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.699870 19632 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:28.737592 19643 consensus_queue.cc:1175] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "459e82ee6b564cc19be6f73186938e79" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:17:28.739657 19497 raft_consensus.cc:2764] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:17:28.740073 19637 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:28.740834 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 227730us
W20260709 13:17:28.742561 18351 leader_election.cc:336] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.601s (SENT)
I20260709 13:17:28.692304 19624 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:28.751242 18277 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:28.705515 19535 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:28.759620 18351 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.654s (SENT)
I20260709 13:17:28.741706 19652 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.790951 19670 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:28.791580 19670 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:28.792536 19670 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:28.781522 19641 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.794914 19641 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:28.797413 18351 leader_election.cc:336] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.823s (SENT)
W20260709 13:17:28.798748 18351 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.856s (SENT)
I20260709 13:17:28.799165 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:28.799479 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 94669.5us
I20260709 13:17:28.801304 19474 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:28.804730 18953 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:28.806535 18202 leader_election.cc:336] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.606s (SENT)
I20260709 13:17:28.806959 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:28.805991 18384 raft_consensus.cc:2955] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:17:28.810638 19633 consensus_meta.cc:287] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.625s	user 0.004s	sys 0.005s
I20260709 13:17:28.811033 19633 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:28.811626 19606 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:28.812244 19606 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:28.812709 19606 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:28.814739 19606 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:28.816248 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:28.818920 18957 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 1 LEARNER]: Advancing to term 3
I20260709 13:17:28.821026 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:28.821738 18381 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:28.807972 19624 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:28.823542 19636 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:28.825987 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:28.826310 19657 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:28.830147 19520 consensus_meta.cc:287] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.746s	user 0.012s	sys 0.003s
I20260709 13:17:28.783165 19632 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:28.832563 19651 consensus_meta.cc:287] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.645s	user 0.012s	sys 0.010s
I20260709 13:17:28.832777 19633 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:28.832995 19658 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:28.834761 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:28.835134 19595 raft_consensus.cc:3055] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:28.836232 19643 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:28.835734 19652 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:28.840233 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 181397us
I20260709 13:17:28.846431 19520 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:28.858475 19520 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:28.859360 18233 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:28.846645 19657 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:28.860575 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:28.840378 18202 leader_election.cc:336] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.612s (SENT)
W20260709 13:17:28.863857 18202 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.658s (SENT)
I20260709 13:17:28.867081 19472 consensus_queue.cc:1059] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:28.848071 19642 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:28.868122 19633 raft_consensus.cc:3055] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:28.868670 19633 raft_consensus.cc:740] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:17:28.875568 18202 leader_election.cc:336] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.678s (SENT)
W20260709 13:17:28.850550 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.896556 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.848764 19595 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:28.904721 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.905632 18383 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:28.909927 18383 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:28.912791 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:28.915732 18381 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:28.919848 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:28.920738 18201 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:28.928360 19652 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:28.869802 19633 consensus_queue.cc:260] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:28.931635 19633 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.935029 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:28.937929 19671 raft_consensus.cc:3055] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:28.938390 19671 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:28.921973 18379 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:28.949986 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:28.950670 18381 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:28.951710 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:28.954373 18381 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:28.955495 18381 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:28.957885 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.958688 19474 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:28.847206 19651 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:28.964273 18381 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:17:28.965063 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 44417.9us
I20260709 13:17:28.966354 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:28.979550 19553 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:28.854338 19643 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:28.982142 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 78613.3us
I20260709 13:17:28.998821 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:28.998983 18351 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.239s (SENT)
I20260709 13:17:28.999730 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:28.917650 19642 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:29.000317 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.963562 19636 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:29.005576 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.019707 18202 leader_election.cc:336] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.810s (SENT)
I20260709 13:17:28.943378 19641 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:28.967931 19652 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:28.967778 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:29.007184 19677 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:29.033758 18277 leader_election.cc:400] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4.
I20260709 13:17:29.035614 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:29.036890 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:29.005833 19624 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:29.005127 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:29.005718 19410 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:29.042363 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:29.030532 19594 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:29.072353 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.073010 18277 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:29.043447 19535 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:29.053257 18953 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 1.
I20260709 13:17:29.096601 19474 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:29.040052 19524 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:17:29.098518 19524 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.098991 19524 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:29.050734 19536 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:29.100806 19536 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:29.111361 19682 consensus_queue.cc:1059] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:17:29.021642 19595 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:29.030339 19672 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:29.054023 19641 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:29.058790 19410 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:29.125119 19651 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:29.058466 18959 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:29.085309 18377 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:29.093586 19624 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:17:29.137447 19621 consensus_meta.cc:287] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.933s	user 0.007s	sys 0.005s
I20260709 13:17:29.050122 19677 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:17:29.145186 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 72268us
I20260709 13:17:29.188220 18277 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:29.167819 19472 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.165856 19649 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:29.178925 18955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54004 (request call id 156) took 1005 ms. Trace:
I20260709 13:17:29.190325 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:29.168054 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 125781us
I20260709 13:17:29.184939 19595 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.187031 19624 raft_consensus.cc:697] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:29.197011 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:29.187335 18957 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 LEARNER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:29.198909 19632 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:29.198617 18277 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:29.193166 19641 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:29.211704 19695 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:29.212344 19695 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:17:29.213205 19662 log.cc:927] Time spent T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.511s	user 0.001s	sys 0.004s
I20260709 13:17:29.214977 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 877) took 1006 ms. Trace:
I20260709 13:17:29.216719 19410 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:29.218005 18233 rpcz_store.cc:276] 0709 13:17:28.208640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.208775 (+   135us) service_pool.cc:224] Handling call
0709 13:17:29.214761 (+1005986us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b540029c7d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:29.214909 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493602048}
I20260709 13:17:29.197844 19524 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:29.219388 19636 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:29.217191 18202 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.880s (SENT) [suppressed 91 similar messages]
I20260709 13:17:29.215061 19682 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 13:17:29.220700 18202 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.859s (SENT)
W20260709 13:17:29.221827 18202 leader_election.cc:336] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.717s (SENT)
I20260709 13:17:29.213565 19642 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:29.222965 18202 leader_election.cc:336] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.504s (SENT)
I20260709 13:17:29.223264 19642 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:29.225847 19672 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:29.229013 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.229949 18303 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:29.234308 18275 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:29.253018 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:29.190948 19621 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:29.254511 18927 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:29.193887 19472 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:29.258440 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.259867 19640 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:29.260352 19640 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:29.260838 19472 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:29.213322 19695 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:29.260808 19640 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:29.269850 19692 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:17:29.270579 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.274132 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.273643 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:29.275871 18230 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:17:29.277729 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.279811 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.255353 18382 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:29.211143 19632 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:29.231031 19677 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:29.284200 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 61521.1us
I20260709 13:17:29.286442 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.289691 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.302081 18312 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:29.302456 18311 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:29.302353 19641 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:29.292426 18303 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:29.303357 19641 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:29.294025 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:29.303757 19641 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:29.284781 19410 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:29.304859 19410 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.305341 19410 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.306123 18385 raft_consensus.cc:1240] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:29.306370 19664 raft_consensus.cc:3055] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:29.306691 19664 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:29.307502 19664 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:29.308038 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 57) took 1192 ms. Trace:
W20260709 13:17:29.295260 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.308390 18385 rpcz_store.cc:276] 0709 13:17:28.115870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.315874 (+200004us) service_pool.cc:224] Handling call
0709 13:17:28.477377 (+161503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.306572 (+829195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.307828 (+  1256us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54003bdb54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:29.307982 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1905516288}
W20260709 13:17:29.310936 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.296686 18309 raft_consensus.cc:2368] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:29.315057 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.335112 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.336259 18311 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:29.340808 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:29.347620 18385 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:29.329509 19664 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.350597 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:29.342738 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.378648 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:29.380951 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:29.381409 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:29.381819 18380 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:29.388101 18276 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:29.326424 19632 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:17:29.345155 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:29.396412 18237 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:29.388688 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.400323 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:29.398813 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.401096 18306 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:29.401526 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.402364 18310 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:29.397550 18201 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:29.418210 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:29.409016 18202 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.925s (SENT)
I20260709 13:17:29.422173 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:29.409430 18304 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:29.424608 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:29.426764 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:29.427402 18381 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:29.429656 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:29.430291 18382 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:29.388496 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:29.451915 19676 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:29.469614 19676 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:29.470201 19676 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.470901 18310 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
W20260709 13:17:29.453117 19700 log.cc:927] Time spent T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:29.454643 19702 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:29.458029 19688 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.255s	user 0.000s	sys 0.004s
I20260709 13:17:29.337826 19641 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:29.384598 19631 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:17:29.460952 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:29.460129 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.406745 19594 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:29.387899 19642 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:17:29.480710 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.351486 19624 consensus_queue.cc:237] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:29.598778 18381 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:29.488166 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:29.422830 18957 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
W20260709 13:17:29.657140 18351 leader_election.cc:336] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.813s (SENT)
I20260709 13:17:29.565099 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.633580 19536 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:29.660334 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.660470 19640 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:29.663131 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 231372us
I20260709 13:17:29.556608 19679 consensus_queue.cc:1059] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:17:29.474773 19628 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:29.663883 19640 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:29.621904 18382 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:29.672066 18310 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:29.668659 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:29.663158 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:29.433943 19701 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:29.666558 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 257569us
I20260709 13:17:29.663904 18381 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:29.594704 19671 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:29.676635 18202 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.993s (SENT)
I20260709 13:17:29.681042 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:29.682245 19595 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:29.566506 18377 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:29.194684 18955 rpcz_store.cc:276] 0709 13:17:28.161083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.170819 (+  9736us) service_pool.cc:224] Handling call
0709 13:17:28.178583 (+  7764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.178802 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:28.754870 (+576068us) log.cc:844] Serialized 14 byte log entry
0709 13:17:29.048684 (+293814us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:29.053383 (+  4699us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:29.071506 (+ 18123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.095654 (+ 24148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.166527 (+ 70873us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1713,"raft.queue_time_us":5252,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":7105,"thread_start_us":229447,"threads_started":1,"wal-append.queue_time_us":419650}
W20260709 13:17:29.678206 19705 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:17:29.678460 18232 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:17:29.683629 18202 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.054s (SENT)
I20260709 13:17:29.664942 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:29.693257 18382 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:29.696538 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:29.592541 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.683575 19595 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.700299 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:29.700627 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:29.509507 19702 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:29.664657 19536 raft_consensus.cc:3055] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:29.729779 19536 raft_consensus.cc:740] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:29.731045 19536 consensus_queue.cc:260] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:29.702145 18310 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:29.656705 19641 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.706446 18311 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:29.708382 18308 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:29.705140 18201 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:29.737402 18201 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:29.655582 19410 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:29.739939 19658 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:29.741601 19410 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:29.742314 19672 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:29.742729 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.743141 19635 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:29.744294 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.745193 18308 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:29.745393 19635 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.745894 19635 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:29.748152 19635 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:29.748762 18303 raft_consensus.cc:2368] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:29.749101 19410 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:29.749797 19410 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:29.750568 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.752658 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.753383 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.752331 19410 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:29.716957 18307 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:29.754159 18309 raft_consensus.cc:2410] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:29.720121 18383 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:29.721514 18228 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:29.726949 18312 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:29.709834 19595 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:29.753825 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.710592 19657 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:29.762182 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:29.746055 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:29.755039 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:29.704221 19387 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:17:29.765004 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 105084us
I20260709 13:17:29.761634 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:29.767500 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:29.768115 18379 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.768245 18312 raft_consensus.cc:2368] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:29.765839 18309 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.767244 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.769858 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.770987 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.684939 19701 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:29.775799 18312 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:29.762326 19635 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.765419 19536 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.789636 18306 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:29.791216 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:29.805833 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:29.867170 18202 leader_election.cc:336] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.905s (SENT)
I20260709 13:17:29.867830 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:29.906111 18379 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:29.779376 19695 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.909358 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.807210 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:29.897982 19658 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:29.912686 18304 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:29.921603 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.922899 18312 raft_consensus.cc:2410] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:17:29.923079 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 55950.2us
W20260709 13:17:29.924242 18202 leader_election.cc:336] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.182s (SENT)
I20260709 13:17:29.924849 18202 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:29.912864 19626 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:29.805190 19635 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:29.958880 18237 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:29.926708 18957 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.963234 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:29.919298 19695 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:29.929780 19714 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:29.970070 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.967281 19497 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:29.968022 19640 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.065620 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.019408 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.067408 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.068497 18308 raft_consensus.cc:2368] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:30.068609 19724 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:30.003456 19640 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:30.069298 19724 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:29.999979 19497 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:29.970695 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.067473 18304 raft_consensus.cc:2376] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3. Re-sending same reply.
I20260709 13:17:30.070825 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:30.080051 19640 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:30.070909 19595 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:30.081534 19664 consensus_meta.cc:287] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.702s	user 0.010s	sys 0.001s
I20260709 13:17:30.084882 18230 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:30.005016 19621 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:30.085940 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:30.086855 18378 raft_consensus.cc:2393] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:30.087324 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 1268) took 1187 ms. Trace:
I20260709 13:17:30.088459 18303 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:30.091563 19635 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:30.092029 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.092931 18305 raft_consensus.cc:2368] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:30.011832 19702 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:30.093825 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.053848 19626 raft_consensus.cc:1064] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
W20260709 13:17:30.095117 19626 raft_consensus.cc:1068] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Unable to promote non-voter e016302b7e734d74833a2bf7bab44838: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:17:30.061080 19672 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:30.096014 18383 raft_consensus.cc:2368] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 2. Current term is 3.
I20260709 13:17:30.087670 18378 rpcz_store.cc:276] 0709 13:17:28.899613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.907325 (+  7712us) service_pool.cc:224] Handling call
0709 13:17:29.386151 (+478826us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5800050198. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa1872390a0 00007fa187238984 00007fa1807b36d4 00007fa1807b3662
0709 13:17:30.085767 (+699616us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b5800050198. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14ee9c 00007fa17f14ea5b 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa1872390a0 00007fa187238984 00007fa1807b36d4 00007fa1807b3662
0709 13:17:30.087256 (+  1489us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48842880}
I20260709 13:17:30.084220 18309 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:30.098163 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.103370 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:30.095611 19701 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:29.997460 19658 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:30.107721 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.115792 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.121215 18382 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:30.177426 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.129372 18312 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:17:30.125458 18202 leader_election.cc:336] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.984s (SENT)
I20260709 13:17:30.125981 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:30.178478 18305 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:30.205814 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.145814 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:30.210841 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 85433.5us
W20260709 13:17:30.211899 18202 leader_election.cc:336] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.225s (SENT)
I20260709 13:17:30.212422 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:30.212412 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.214021 18312 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:30.214501 18310 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:30.219586 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.221374 18308 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:30.198289 19671 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:30.222760 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:30.222842 18202 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.236s (SENT)
W20260709 13:17:30.222932 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.223410 18305 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:30.223757 18305 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:17:30.223832 18202 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.258s (SENT)
I20260709 13:17:30.224249 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:30.224483 18305 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:30.153265 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.172392 18957 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:30.229171 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.230446 18307 raft_consensus.cc:2368] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:30.227787 19664 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:30.231150 18955 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:30.226989 19643 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:30.231792 19718 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.154s	user 0.001s	sys 0.001s
I20260709 13:17:30.233690 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.235436 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.250036 18308 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:30.106194 19640 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
W20260709 13:17:30.243980 19676 consensus_meta.cc:287] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.773s	user 0.012s	sys 0.000s
I20260709 13:17:30.243351 19672 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:30.252988 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.243352 18305 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.245316 19682 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.246466 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:30.250911 18202 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.532s (SENT)
I20260709 13:17:30.265365 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:30.251668 18926 leader_election.cc:400] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 2. Current term is 3.
I20260709 13:17:30.245970 18309 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:30.270306 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.271239 18309 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:17:30.272316 18202 leader_election.cc:336] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.600s (SENT)
I20260709 13:17:30.254673 18308 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:30.271049 18310 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:30.281244 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.269635 18926 leader_election.cc:403] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:17:30.288260 18305 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:30.289013 18308 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:30.291311 19626 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:17:30.295674 19497 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:30.297415 18310 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:30.298816 18304 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:30.276351 19635 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.258204 19676 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:30.284471 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.311801 18305 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:30.306043 18309 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:30.309218 19724 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:30.310011 19640 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 2. Current term is 3.
W20260709 13:17:30.310614 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 74248us
I20260709 13:17:30.354805 18307 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:30.373927 18308 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:17:30.375402 19536 consensus_meta.cc:287] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.566s	user 0.013s	sys 0.000s
I20260709 13:17:30.377040 19676 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:30.381527 19730 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:17:30.383461 19727 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.091s	user 0.001s	sys 0.003s
I20260709 13:17:30.392679 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:30.395583 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.404405 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:30.405450 18378 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:30.411351 19695 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:30.413244 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:30.413657 19583 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.414333 19583 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:30.415550 19626 raft_consensus.cc:1064] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
W20260709 13:17:30.416069 19626 raft_consensus.cc:1068] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Unable to promote non-voter e016302b7e734d74833a2bf7bab44838: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:17:30.403755 19701 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:30.417341 19701 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:30.419925 19701 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:30.429349 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:30.431543 18276 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:30.432485 19641 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:30.432634 19649 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:30.433059 19649 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.434828 19649 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:30.442075 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.442823 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.443269 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.433483 19701 consensus_queue.cc:1059] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:17:30.447752 19701 raft_consensus.cc:3055] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:30.447650 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:30.448278 19701 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:30.448647 18228 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:30.449136 19701 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:30.449781 19658 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:30.450325 19701 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:30.451138 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:30.452550 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.452731 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.452908 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.453540 18303 raft_consensus.cc:2376] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2. Re-sending same reply.
I20260709 13:17:30.454054 18306 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:30.455515 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.455617 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:30.456210 18309 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:30.456786 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.466429 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 885) took 1071 ms. Trace:
I20260709 13:17:30.480080 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.477555 18236 rpcz_store.cc:276] 0709 13:17:29.395079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.395630 (+   551us) service_pool.cc:224] Handling call
0709 13:17:29.411247 (+ 15617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:29.429053 (+ 17806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.429091 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:30.366391 (+937300us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b2c000014c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:17:30.366846 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:17:30.421385 (+ 54539us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:30.421436 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.421734 (+   298us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:30.444200 (+ 22466us) raft_consensus.cc:1685] finished
0709 13:17:30.444218 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.466354 (+ 22136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24906,"raft.queue_time_us":36006,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":150,"spinlock_wait_cycles":4282752,"thread_start_us":53711,"threads_started":1,"wal-append.queue_time_us":67411}
I20260709 13:17:30.480994 18309 raft_consensus.cc:2410] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:17:30.481168 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.482735 18202 leader_election.cc:336] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.126s (SENT)
I20260709 13:17:30.483438 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:30.485558 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.486119 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.479576 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.483853 19493 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:30.497745 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:30.492843 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:30.481980 19626 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:17:30.472637 19641 raft_consensus.cc:697] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:30.480029 19676 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.526007 19583 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:30.529188 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:30.530679 19726 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.231s	user 0.004s	sys 0.000s
I20260709 13:17:30.531318 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.554807 18309 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
I20260709 13:17:30.554962 18308 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:30.533664 19722 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:30.556663 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:30.557291 18384 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:30.558789 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.559442 18380 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:30.533864 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.534478 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:30.535763 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:30.536903 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:30.561220 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:30.541514 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:30.541342 18131 catalog_manager.cc:5697] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 2, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.486213 19671 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.504602 19621 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:17:30.503718 19624 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:17:30.489830 18307 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:30.569792 19724 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:30.544974 19493 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:30.581516 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 147955us
I20260709 13:17:30.545470 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:30.503104 19677 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:30.546231 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:30.564039 18236 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:30.565459 18131 catalog_manager.cc:5697] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.561455 18233 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
W20260709 13:17:30.567287 18202 leader_election.cc:336] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.727s (SENT)
I20260709 13:17:30.568969 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:30.504395 19658 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.574489 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:30.547158 19695 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.597823 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:30.572290 18228 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:30.573691 18135 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39284 (request call id 171) took 3687 ms. Trace:
I20260709 13:17:30.593070 18379 raft_consensus.cc:2368] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 2. Current term is 3.
I20260709 13:17:30.594995 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:30.593650 18380 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:30.615090 19664 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:30.618654 18383 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
I20260709 13:17:30.621249 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.577773 19724 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:30.637550 18926 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:30.557132 19676 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:30.643908 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:17:30.662600 18202 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.646s (SENT)
I20260709 13:17:30.662833 18383 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.663043 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:30.669988 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.672171 18378 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:17:30.588791 19640 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:17:30.574118 19671 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:30.628690 19632 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.675961 19658 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.679518 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:30.692787 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.695770 19493 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:30.602664 19535 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:17:30.677757 19670 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:30.699906 18201 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:30.725570 18312 raft_consensus.cc:2376] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2. Re-sending same reply.
I20260709 13:17:30.641693 19724 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:30.641531 19643 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:30.661562 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.570389 19723 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:30.598261 19737 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:30.733546 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 185857us
I20260709 13:17:30.641921 19725 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.767922 19725 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:30.770959 19725 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:30.748633 19682 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:30.771836 19682 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.772277 19682 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:30.635910 19649 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:30.676441 19387 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.728200 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.754379 18201 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:30.660956 19641 consensus_queue.cc:237] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:30.666290 19695 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:17:30.758800 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.783074 18312 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:30.760669 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:30.766825 19676 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:30.727108 19632 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:30.777671 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.723976 19536 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.723729 19624 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.786296 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:30.793947 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 189080us
I20260709 13:17:30.748853 19643 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.604799 18135 rpcz_store.cc:276] 0709 13:17:26.878492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.878744 (+   252us) service_pool.cc:224] Handling call
0709 13:17:30.565256 (+3686512us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:28.258638 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:28.516304 (+257666us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:28.519266 (+  2962us) write_op.cc:435] Acquired schema lock
0709 13:17:28.524801 (+  5535us) tablet.cc:662] Decoding operations
0709 13:17:28.549436 (+ 24635us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:28.549537 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:28.549579 (+    42us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:17:28.550162 (+   583us) tablet.cc:701] Row locks acquired
0709 13:17:28.550185 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:17:28.550359 (+   174us) write_op.cc:270] Start()
0709 13:17:28.550502 (+   143us) write_op.cc:276] Timestamp: P: 1783603048550308 usec, L: 0
0709 13:17:28.550526 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:17:28.630903 (+ 80377us) log.cc:844] Serialized 2167 byte log entry
0709 13:17:29.040990 (+410087us) op_driver.cc:464] REPLICATION: finished
0709 13:17:29.271629 (+230639us) write_op.cc:301] APPLY: starting
0709 13:17:29.271703 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:29.271927 (+   224us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:29.272052 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:29.282738 (+ 10686us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:29.282925 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:17:29.282970 (+    45us) write_op.cc:312] APPLY: finished
0709 13:17:29.290584 (+  7614us) log.cc:844] Serialized 46 byte log entry
0709 13:17:29.290841 (+   257us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:29.290997 (+   156us) write_op.cc:454] Released schema lock
0709 13:17:29.291055 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:29.291553 (+   498us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:29.291592 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":591,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":196116,"apply.run_cpu_time_us":2976,"apply.run_wall_time_us":19865,"num_ops":5,"prepare.queue_time_us":129894,"prepare.run_cpu_time_us":32513,"prepare.run_wall_time_us":627857,"raft.queue_time_us":35672,"raft.run_cpu_time_us":13270,"raft.run_wall_time_us":172362,"replication_time_us":470292,"thread_start_us":377232,"threads_started":4,"wal-append.queue_time_us":280607,"wal-append.run_cpu_time_us":4226,"wal-append.run_wall_time_us":1378269}]]}
I20260709 13:17:30.805290 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:30.804199 18306 raft_consensus.cc:2376] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3. Re-sending same reply.
W20260709 13:17:30.807713 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 225627us
I20260709 13:17:30.808476 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:30.808781 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.809578 18308 raft_consensus.cc:2368] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4.
W20260709 13:17:30.752740 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 115373us
W20260709 13:17:30.815702 18351 leader_election.cc:336] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.506s (SENT)
I20260709 13:17:30.818074 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:30.818666 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.819303 18303 raft_consensus.cc:2376] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3. Re-sending same reply.
I20260709 13:17:30.774462 18957 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:30.803025 19672 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:30.752360 19626 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:17:30.836154 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.839248 18312 raft_consensus.cc:2368] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:30.808202 19643 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:30.848896 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:30.802804 19387 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:30.837914 19672 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.779122 19737 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:30.830686 19621 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.889334 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.890340 18303 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:30.816398 19624 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:30.896694 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 88721.2us
I20260709 13:17:30.897745 18351 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:30.813503 19536 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:30.898663 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 90837.6us
W20260709 13:17:30.899210 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.880697 19677 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.888428 19672 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:30.912842 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:30.918661 18303 raft_consensus.cc:2376] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3. Re-sending same reply.
W20260709 13:17:30.913183 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 104609us
I20260709 13:17:30.903558 19701 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.914547 19742 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:30.938580 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.939976 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.931514 19701 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:30.947005 19701 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:30.936053 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:31.213933 18202 leader_election.cc:336] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.971s (SENT)
W20260709 13:17:31.306386 18383 consensus_meta.cc:287] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.005s
I20260709 13:17:31.306653 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:31.307098 18383 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:31.006161 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.309717 18305 raft_consensus.cc:2376] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2. Re-sending same reply.
W20260709 13:17:31.149806 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 229713us
W20260709 13:17:30.968703 18351 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.568s (SENT)
I20260709 13:17:31.320727 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:30.958564 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.322561 18312 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:31.318395 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.319129 18276 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:31.331120 19635 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:17:31.331337 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 117486us
I20260709 13:17:31.331683 19635 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:31.045097 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.339600 18230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.003s	sys 0.013s
W20260709 13:17:31.340101 18230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.003s	sys 0.014s
W20260709 13:17:31.348181 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 379476us
W20260709 13:17:31.348902 18351 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.594s (SENT)
I20260709 13:17:31.349400 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:31.228781 19747 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:17:31.308593 19664 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.361126 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.364985 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:31.365792 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:31.365934 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:31.366236 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:31.122139 19649 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:30.963732 19632 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:31.006455 19699 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:30.954991 19671 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:17:30.956736 19536 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:30.947223 19624 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:31.331554 19553 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.368848 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.414911 18312 raft_consensus.cc:2376] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4. Re-sending same reply.
I20260709 13:17:31.369166 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.416057 18310 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:31.369678 18305 raft_consensus.cc:2368] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:31.372232 18379 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:31.392395 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.417732 18308 raft_consensus.cc:2368] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 4.
I20260709 13:17:30.961337 19387 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:31.371220 18380 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:30.932289 18926 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:30.963338 19737 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:31.348619 19742 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.015334 19740 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.267997 19724 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:31.337932 19680 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.347836 19745 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:31.356264 19621 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.347833 18307 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:31.102425 19751 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.381s
W20260709 13:17:31.394614 19670 consensus_meta.cc:287] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.001s
W20260709 13:17:31.425288 18201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.010s	sys 0.003s
W20260709 13:17:31.457052 18201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.011s	sys 0.003s
I20260709 13:17:31.231163 19643 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:31.367309 19765 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:31.390343 19716 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:31.435508 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 103434us
I20260709 13:17:31.447777 18312 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:31.419546 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:31.442446 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:31.395087 19664 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:31.455984 19762 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:17:31.457532 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 556289us
I20260709 13:17:31.407685 19699 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:31.498911 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 150034us
I20260709 13:17:31.495110 19670 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.501559 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.535483 18308 raft_consensus.cc:2376] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4. Re-sending same reply.
I20260709 13:17:31.513025 19765 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.536722 19765 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:31.536988 18960 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:31.538542 19699 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:31.462699 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.450137 19536 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:31.505668 18379 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:31.498051 19635 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:31.533627 18351 leader_election.cc:336] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.598s (SENT)
I20260709 13:17:31.532131 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:31.542403 19536 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:31.542861 19536 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.543861 19536 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:31.543355 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:31.545820 19699 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.546826 19765 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:31.549129 19765 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:31.549701 18310 raft_consensus.cc:2376] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2. Re-sending same reply.
W20260709 13:17:31.462343 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 535920us
I20260709 13:17:31.451433 19621 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:31.445904 19680 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:31.560858 18202 leader_election.cc:336] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.815s (SENT)
W20260709 13:17:31.558477 19682 consensus_meta.cc:287] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.786s	user 0.008s	sys 0.005s
I20260709 13:17:31.438248 19740 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:31.560848 18351 leader_election.cc:336] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.667s (SENT)
W20260709 13:17:31.565719 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 172861us
I20260709 13:17:31.568598 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:31.569811 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:31.570344 18236 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:31.573141 18201 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:31.534125 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:31.576408 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.578004 19776 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.579298 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.579398 18312 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:17:31.582027 18351 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.696s (SENT)
I20260709 13:17:31.580413 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.583142 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:31.583365 18310 raft_consensus.cc:2376] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2. Re-sending same reply.
I20260709 13:17:31.449427 19745 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:31.586673 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:31.586812 18351 leader_election.cc:336] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.748s (SENT)
I20260709 13:17:31.587222 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.588233 18306 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:17:31.589347 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.589444 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:31.589824 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.590078 18312 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:31.592454 19764 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.594349 19753 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:31.594925 19753 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:31.579612 19635 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.597102 19635 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:31.597673 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.598412 18310 raft_consensus.cc:2376] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3. Re-sending same reply.
I20260709 13:17:31.599241 19635 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:31.599378 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.600059 18310 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:31.601051 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.602002 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.602681 18304 raft_consensus.cc:2376] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3. Re-sending same reply.
I20260709 13:17:31.601676 18312 raft_consensus.cc:2376] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2. Re-sending same reply.
I20260709 13:17:31.600378 19764 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:31.588762 19632 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.609357 19764 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:31.609995 19632 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:17:31.612191 19632 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:31.606783 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.609790 19664 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:31.609372 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.617656 18304 raft_consensus.cc:2368] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4.
I20260709 13:17:31.618113 18312 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:31.593134 18926 leader_election.cc:400] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 2. Current term is 3.
I20260709 13:17:31.618337 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.613106 18306 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:31.610396 19745 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:31.615888 18351 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.776s (SENT)
I20260709 13:17:31.618938 18310 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:31.619297 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:31.597162 19753 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:31.621902 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:31.623080 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:31.624318 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:31.627235 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.627831 18275 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:17:31.633265 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.635484 18351 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.831s (SENT)
I20260709 13:17:31.636025 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:31.574070 19682 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:31.639891 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:31.641669 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:31.644877 19643 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:31.645331 19682 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:31.646057 18235 raft_consensus.cc:2368] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3.
I20260709 13:17:31.639278 19753 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:31.646490 19753 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:31.646857 19753 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:31.649127 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:31.651208 18275 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:17:31.634071 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.653704 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.578526 19776 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:31.638481 19760 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:17:31.655602 18957 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:31.656064 19760 raft_consensus.cc:3055] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:31.627348 19699 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.656255 19776 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:31.646093 19621 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:31.657143 18234 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:31.658756 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.658881 19680 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:31.659533 18305 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:31.663832 18228 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:31.656499 19760 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:31.638851 19724 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:31.642048 19716 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:17:31.681520 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 46082us
W20260709 13:17:31.724332 18351 leader_election.cc:336] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.858s (SENT)
I20260709 13:17:31.724810 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:31.681226 19621 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.640050 19536 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:31.685711 19763 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:31.686549 19652 consensus_queue.cc:1059] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.687170 18308 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:31.646068 19740 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:31.688701 19626 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:31.688925 19772 consensus_queue.cc:1059] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:17:31.693518 19780 log.cc:927] Time spent T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:17:31.640923 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 66776.4us
I20260709 13:17:31.650554 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.731223 19745 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.669054 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:17:31.703274 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 70147.1us
I20260709 13:17:31.681548 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:31.748850 18236 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:31.704063 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:31.750319 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:31.750898 18228 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:31.727841 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:31.724114 19672 consensus_meta.cc:287] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.788s	user 0.004s	sys 0.007s
I20260709 13:17:31.758095 18308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:31.758272 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:31.730819 19664 consensus_queue.cc:1059] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:17:31.708765 19776 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:31.761040 19699 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:31.761385 19536 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:17:31.762212 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.764252 19772 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:31.764643 19772 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:31.765496 19772 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:31.766603 19772 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:31.760156 19695 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:31.768487 19695 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:31.770689 19695 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:31.772017 19635 raft_consensus.cc:3055] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.772432 19635 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:31.774608 19682 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:31.775024 19682 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:31.758687 18308 raft_consensus.cc:606] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:31.760288 19672 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:31.780145 18386 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:17:31.780570 18230 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:17:31.782258 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.699661 19753 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:31.782958 18306 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:31.784283 19753 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:31.784845 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:31.752789 18927 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:31.754434 18926 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:31.785806 18308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:31.786162 18305 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:31.755318 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:31.787963 18308 raft_consensus.cc:606] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:31.788137 18235 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:31.743046 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:31.756858 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:31.758859 18236 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:17:31.731938 18351 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.870s (SENT)
I20260709 13:17:31.795918 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:31.796020 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:31.760462 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:31.797164 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:31.782528 18230 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:31.756699 18237 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:31.786073 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:31.795207 18305 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:17:31.789969 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:31.799279 18378 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:17:31.789846 19670 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:31.800649 18384 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:31.807668 18306 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:17:31.809278 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:17:31.809499 18202 leader_election.cc:336] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.498s (SENT)
I20260709 13:17:31.811302 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:17:31.811846 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 79921.8us
I20260709 13:17:31.813491 19583 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:31.814091 19583 raft_consensus.cc:697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:31.815353 18960 raft_consensus.cc:2368] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4.
I20260709 13:17:31.818476 18230 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:31.819656 18236 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:17:31.821463 18237 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:31.828766 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:31.829391 18378 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:31.801157 19670 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:31.823100 18275 leader_election.cc:400] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4.
I20260709 13:17:31.830165 18275 leader_election.cc:403] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:17:31.830703 18236 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:31.831168 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.831534 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.801319 19497 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:31.831959 18306 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:31.831962 18232 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
W20260709 13:17:31.834847 18202 leader_election.cc:336] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.752s (SENT)
I20260709 13:17:31.843291 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.843477 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:31.832396 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.844728 18311 raft_consensus.cc:2393] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:31.845700 18234 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:31.846086 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.846868 18230 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.841136 18308 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:31.847023 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.848847 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.849391 18237 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:31.849865 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.850263 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.850586 18310 raft_consensus.cc:2410] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:31.850642 18957 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:31.851217 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.851485 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.852072 18310 raft_consensus.cc:2368] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4.
I20260709 13:17:31.848111 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.857146 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.819983 19621 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.847816 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.860600 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:31.852267 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:31.861132 18351 leader_election.cc:336] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.501s (SENT)
I20260709 13:17:31.861357 18380 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:31.860968 18311 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:17:31.862241 18351 leader_election.cc:336] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.929s (SENT)
I20260709 13:17:31.862182 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.863174 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.863499 18232 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:31.864185 18311 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:31.862838 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:31.841560 18231 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
W20260709 13:17:31.875065 18202 leader_election.cc:336] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.525s (SENT)
I20260709 13:17:31.876238 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:31.840788 19670 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.842136 19497 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.877467 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:31.880066 18351 leader_election.cc:336] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.942s (SENT)
W20260709 13:17:31.881199 18351 leader_election.cc:336] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.945s (SENT)
I20260709 13:17:31.883071 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.883697 18303 raft_consensus.cc:2376] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2. Re-sending same reply.
I20260709 13:17:31.884198 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:31.889410 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.843030 19769 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4.
I20260709 13:17:31.891530 18384 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:17:31.859097 19716 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:31.894186 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.915695 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:31.918496 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.919126 18303 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:31.878010 19695 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:31.882568 19497 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:31.878295 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.928020 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.937069 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.937346 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:31.937676 18304 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:31.937902 18378 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:31.938105 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:31.895350 19652 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.865548 19753 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:17:31.943918 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:31.938930 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 57760.5us
W20260709 13:17:31.945927 18351 leader_election.cc:336] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.991s (SENT)
I20260709 13:17:31.930768 18201 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:31.946439 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:31.939086 18384 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:31.896385 19716 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:31.952016 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.954527 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.927026 19621 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.921326 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:31.957260 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:31.958679 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.958962 18304 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:31.872318 19583 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:31.924793 19677 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:17:31.950788 19716 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.952595 19772 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:31.967660 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.961838 18307 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:31.971532 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:31.958282 19742 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.972867 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.986514 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:31.970721 19772 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.968701 19769 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.990592 18310 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:31.966400 19664 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:17:32.002980 18378 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
W20260709 13:17:32.010970 19797 log.cc:927] Time spent T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:17:31.991991 19772 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:32.014990 18926 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:32.055151 19742 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:17:32.055785 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 61757.1us
I20260709 13:17:32.005075 19769 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.062302 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.062971 18308 raft_consensus.cc:2376] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3. Re-sending same reply.
I20260709 13:17:32.063859 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.066586 19640 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:32.073468 19635 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.075047 19635 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.077221 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:32.078092 18306 raft_consensus.cc:2368] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4.
I20260709 13:17:32.079079 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.079759 18306 raft_consensus.cc:2410] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:17:32.080720 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.088047 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.089147 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.089712 18311 raft_consensus.cc:2368] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4.
I20260709 13:17:32.090363 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:32.091372 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:32.095346 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.095964 18308 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:32.080439 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:32.097524 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:32.109009 18311 raft_consensus.cc:2410] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:32.108803 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:32.116921 18309 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:32.117574 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 921) took 1151 ms. Trace:
I20260709 13:17:32.117938 18309 rpcz_store.cc:276] 0709 13:17:30.966266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.143557 (+177291us) service_pool.cc:224] Handling call
0709 13:17:32.101346 (+957789us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b58000e1398. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa1872390a0 00007fa187238984 00007fa1807b36d4 00007fa1807b3662
0709 13:17:32.117500 (+ 16154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33506560}
I20260709 13:17:32.120536 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.124642 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.126641 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:32.129060 18304 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:32.134187 18309 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:32.055784 19742 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:32.137743 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.173977 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.174777 18304 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:32.153781 19795 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:17:32.182478 18303 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:32.186225 18304 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:32.190340 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:32.190923 18380 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:32.191277 18304 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:32.197943 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.198863 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.205413 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.222318 18311 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:32.206074 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:32.225942 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:17:32.227116 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.227020 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:32.228111 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:32.229051 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:32.229373 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:32.229972 18303 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:32.230108 18276 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:17:32.205900 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 149301us
W20260709 13:17:32.236176 18121 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 943649b738074d87a593c237cf998758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 459e82ee6b564cc19be6f73186938e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:32.236884 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.237601 18303 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:32.238302 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.238960 18303 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:32.235147 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.242710 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:32.245533 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.246675 18304 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:32.246690 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:17:32.249136 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 303245us
I20260709 13:17:32.222649 19737 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:32.249848 18351 leader_election.cc:336] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.010s (SENT)
I20260709 13:17:32.251487 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:32.251705 18311 raft_consensus.cc:2368] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4.
I20260709 13:17:32.253631 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:32.254058 18276 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:32.257030 19756 raft_consensus.cc:993] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:17:32.243851 19738 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:32.287878 19776 raft_consensus.cc:1081] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:17:32.288008 19738 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.288379 19738 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:32.288475 19725 raft_consensus.cc:3055] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.260002 19737 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.260742 19809 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:32.265053 19742 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:32.265429 19769 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:32.244688 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:32.268623 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.310309 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:32.271219 18229 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:32.277026 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:32.313874 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 59888.5us
I20260709 13:17:32.278384 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.279107 19716 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.280040 19497 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:32.259544 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.292093 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:32.331561 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:32.298149 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 48322.8us
I20260709 13:17:32.332238 18310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "943649b738074d87a593c237cf998758"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
W20260709 13:17:32.333055 18351 leader_election.cc:336] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.015s (SENT)
I20260709 13:17:32.333458 18310 raft_consensus.cc:606] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:32.333940 18310 raft_consensus.cc:614] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:32.334013 18351 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.017s (SENT)
I20260709 13:17:32.335688 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:32.336179 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:32.297288 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 340781us
I20260709 13:17:32.337256 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:32.337522 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:32.307124 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.341077 18232 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:32.342253 18236 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:32.343660 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:32.323307 18304 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:32.327582 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:32.344463 18234 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:32.297318 19725 raft_consensus.cc:740] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:17:32.348459 18351 leader_election.cc:336] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.021s (SENT)
I20260709 13:17:32.351147 19768 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:32.351848 19768 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:32.339347 19632 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:32.355599 18308 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:17:32.353518 18351 leader_election.cc:336] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.022s (SENT)
I20260709 13:17:32.356336 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:32.356575 18306 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:17:32.357306 18306 pending_rounds.cc:85] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 1
I20260709 13:17:32.357345 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:32.358421 18305 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:32.359741 18312 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:17:32.360553 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.302748 19803 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:32.362428 18308 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:32.362818 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:32.363193 18304 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:32.364260 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:32.367671 18308 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:32.368634 18235 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:32.368803 18351 leader_election.cc:336] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.044s (SENT)
I20260709 13:17:32.369380 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:32.315515 19809 raft_consensus.cc:697] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:32.338593 19553 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:32.375681 18351 leader_election.cc:336] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.053s (SENT)
I20260709 13:17:32.330508 19753 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:32.376232 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:32.377202 18305 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:32.365566 18307 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:32.373974 18312 raft_consensus.cc:2955] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:32.385749 18304 raft_consensus.cc:3055] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:32.386144 18304 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:32.353212 19652 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:32.397570 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:32.386886 18304 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.399426 18304 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:32.385533 18306 pending_rounds.cc:107] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:17:32.371488 19699 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:32.405182 18306 raft_consensus.cc:2889] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:32.372788 19756 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.375500 19695 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.375660 18308 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.410017 18308 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:32.391173 19635 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.411986 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 81509.7us
I20260709 13:17:32.431799 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:32.433182 18235 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:32.396464 19624 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:32.439293 18379 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.439702 18383 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:32.441606 18380 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:32.442370 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:32.443027 18382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:17:32.447664 18382 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:32.448032 18382 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:32.397675 19742 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.447041 18384 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:32.452705 19632 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.409497 19769 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.461829 18386 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:32.462967 18304 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:17:32.390625 19772 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.465126 18306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:32.474112 18306 raft_consensus.cc:606] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:32.474493 18306 raft_consensus.cc:614] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:32.467602 18383 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:32.475800 18308 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:17:32.476183 18308 pending_rounds.cc:85] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 1
I20260709 13:17:32.476413 18308 pending_rounds.cc:107] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:17:32.470525 18304 pending_rounds.cc:85] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 1
I20260709 13:17:32.477952 18304 pending_rounds.cc:107] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:17:32.478308 18304 raft_consensus.cc:2889] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:32.476719 18308 raft_consensus.cc:2889] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:32.470255 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 142741us
I20260709 13:17:32.454424 18231 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:32.395080 19670 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:32.502992 18277 leader_election.cc:400] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3.
I20260709 13:17:32.516074 18277 leader_election.cc:403] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:32.469317 18382 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:32.510668 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 134974us
I20260709 13:17:32.405274 19652 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.411613 19699 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:32.445137 19635 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.525252 18382 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:32.512844 19753 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.435182 19725 consensus_queue.cc:260] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.551744 18235 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:32.555042 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:32.556912 18235 raft_consensus.cc:2393] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:32.533162 19764 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.472344 19632 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:32.563465 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 59753.4us
I20260709 13:17:32.472540 19738 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:32.544636 19818 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:17:32.478416 19769 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:32.568902 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 66083.7us
I20260709 13:17:32.574442 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:32.581928 19772 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:32.586241 18311 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 5: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:32.472812 19809 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:32.561755 19753 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.593024 19753 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:32.576473 19497 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:32.597885 18384 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:32.568328 19716 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:32.600975 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:32.642251 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:32.647920 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:32.662462 18228 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:32.662595 18378 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:32.653803 19811 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:17:32.589023 19737 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:32.654600 19820 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.657155 19817 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:17:32.658564 19699 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:32.659586 19632 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:32.594221 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:32.660431 19635 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:32.681869 19755 raft_consensus.cc:3055] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:17:32.683734 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 110399us
I20260709 13:17:32.565215 19764 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.695708 18228 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
W20260709 13:17:32.736032 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.751474 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.598850 19768 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:32.659644 19652 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:32.754675 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:32.701102 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:32.759081 18378 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:17:32.748010 19755 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:17:32.754910 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.761245 19827 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.690126 19820 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.761294 18228 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:32.770332 19825 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:17:32.742530 19737 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3.
I20260709 13:17:32.771150 18229 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.696134 19753 consensus_queue.cc:1059] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
W20260709 13:17:32.798825 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 49714.7us
I20260709 13:17:32.804781 18228 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:32.802430 18276 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:32.764503 18307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:32.814719 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:32.816231 18228 raft_consensus.cc:2368] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4.
I20260709 13:17:32.773147 19672 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:32.765197 19830 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:32.844214 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:32.836175 19738 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:32.796937 19827 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.796260 19756 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:17:32.838776 19820 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:32.822335 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:32.801026 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:32.770710 19834 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:17:32.836028 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:32.845201 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:32.857424 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.857388 18382 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
W20260709 13:17:32.857957 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.844491 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:32.771787 19682 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.845932 18379 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.833513 18307 raft_consensus.cc:606] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:32.860464 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:32.862201 18377 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:32.836028 19836 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:32.859031 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:32.864975 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:32.866918 18386 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:32.854194 19769 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:32.861361 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 286979us
W20260709 13:17:32.866252 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.869609 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:32.871289 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:32.871399 18378 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:32.848914 19737 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:17:32.872869 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:32.873400 18228 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:32.874063 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:32.875252 19832 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.877468 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:32.877730 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:32.861783 19670 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:32.878638 18228 raft_consensus.cc:2410] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:32.867805 19836 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.892920 19836 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:32.893214 19814 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.369s	user 0.003s	sys 0.000s
I20260709 13:17:32.900368 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.901302 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 1267) took 1067 ms. Trace:
I20260709 13:17:32.901646 18303 rpcz_store.cc:276] 0709 13:17:31.833704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.243589 (+409885us) service_pool.cc:224] Handling call
0709 13:17:32.900200 (+656611us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b58000e1398. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa1872390a0 00007fa187238984 00007fa1807b36d4 00007fa1807b3662
0709 13:17:32.901236 (+  1036us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2458368}
I20260709 13:17:32.903510 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:32.905019 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:32.907483 19632 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:32.907940 19632 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.908289 19632 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:32.908478 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:17:32.910725 19822 log.cc:927] Time spent T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:17:32.910840 19737 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.911648 19737 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.910763 19738 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:32.912806 19738 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.912875 19829 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:32.914377 19829 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:32.915642 19837 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:32.921216 19769 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.921623 19769 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:32.922550 19769 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.879935 19682 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:32.876227 18229 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:32.882674 19760 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.883628 19827 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:32.936646 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.864078 18231 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:32.937752 18228 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:32.952775 19826 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.953222 19826 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:32.953989 19826 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.955173 19826 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.955720 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:32.958397 19632 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.960947 18237 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:32.966984 19833 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:17:32.969018 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:32.887624 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:32.889772 19835 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:17:32.901993 18386 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:32.914243 19836 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:32.880465 19816 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:17:32.881295 19756 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.848112 19755 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:32.970770 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:32.996858 18378 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 5: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:32.971504 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:32.975039 18303 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:32.997738 18379 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:32.975435 18383 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.981901 18232 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:32.975750 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:32.982983 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:33.001303 18237 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:32.875814 19832 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.014274 19755 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.014593 19832 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:32.987112 18201 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:32.989077 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:33.008813 19764 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:33.016724 19760 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:33.025519 19664 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:17:33.031502 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.027725 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 116447us
I20260709 13:17:33.037493 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:33.038622 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 899) took 2227 ms. Trace:
I20260709 13:17:33.039057 18233 rpcz_store.cc:276] 0709 13:17:30.807158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.809240 (+  2082us) service_pool.cc:224] Handling call
0709 13:17:30.809558 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.771410 (+961852us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b180034e940. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181e1b4bc 00007fa17f16948b 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f183455 00007fa18226b060 00007fa18226bbfb 00007fa18227664b
0709 13:17:31.771538 (+   128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.771570 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:32.563663 (+792093us) spinlock_profiling.cc:243] Waited 9.36 ms on lock 0x7b2c000014c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:17:32.576749 (+ 13086us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.746260 (+169511us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:32.746295 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.746359 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.034753 (+288394us) raft_consensus.cc:1685] finished
0709 13:17:33.034783 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.034972 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163229,"raft.queue_time_us":128209,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":5320,"spinlock_wait_cycles":30038656,"thread_start_us":387620,"threads_started":2,"wal-append.queue_time_us":203206}
I20260709 13:17:33.043170 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:33.048631 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 83034.3us
W20260709 13:17:33.049742 18202 leader_election.cc:336] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.542s (SENT)
I20260709 13:17:33.050388 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:33.048700 19832 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:33.052837 19827 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:33.029218 18926 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:17:33.061892 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.061223 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 148771us
I20260709 13:17:33.053207 19836 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:33.051281 19776 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:17:33.045086 19834 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:17:33.054453 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:33.059773 18202 leader_election.cc:336] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.647s (SENT)
I20260709 13:17:33.045420 19664 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:33.065510 18201 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:33.066591 18202 leader_election.cc:336] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.746s (SENT)
I20260709 13:17:33.063009 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:33.062973 19672 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.074326 18237 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:17:33.069123 19819 raft_consensus.cc:993] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:17:33.072127 19658 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:33.081296 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:33.089172 19664 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.095297 19658 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:33.096267 19658 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:33.097757 18351 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.087s (SENT)
W20260709 13:17:33.098716 18351 leader_election.cc:336] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.115s (SENT)
I20260709 13:17:33.071204 19799 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:17:33.115242 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52315.8us
W20260709 13:17:33.114606 18351 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.127s (SENT)
I20260709 13:17:33.118741 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:33.072299 19832 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:33.126969 19844 raft_consensus.cc:1081] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:17:33.129112 19832 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:33.132746 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51570us
I20260709 13:17:33.133525 18277 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:17:33.135382 18277 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:33.125008 18202 leader_election.cc:336] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.769s (SENT)
I20260709 13:17:33.125677 19632 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:33.125973 19836 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:33.136439 18202 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:33.143937 18276 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:33.138329 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:33.128324 19844 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:17:33.211599 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 67757.4us
I20260709 13:17:33.213047 19632 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:33.213670 19632 raft_consensus.cc:697] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:33.214514 19632 consensus_queue.cc:237] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.218357 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:33.220009 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:33.220773 18385 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:33.221354 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:33.223629 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:33.224413 18381 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:33.141646 19827 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:33.141438 19826 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:33.143070 19624 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.231678 18383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:17:33.243659 18383 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:33.145598 19834 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:17:33.239804 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 114843us
W20260709 13:17:33.240727 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 102515us
I20260709 13:17:33.252629 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:33.136940 19799 raft_consensus.cc:697] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:33.144132 19836 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:33.244181 18383 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:33.247776 18202 leader_election.cc:336] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.793s (SENT)
I20260709 13:17:33.250701 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:33.147558 19840 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:33.216248 19844 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.259580 18381 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:33.264698 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:33.147178 19819 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 13:17:33.244095 19763 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.243839 19805 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:33.211102 19737 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:17:33.274096 19844 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:33.295147 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 61107.7us
I20260709 13:17:33.266577 19834 raft_consensus.cc:697] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:33.327250 18385 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:33.261175 19772 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:17:33.261358 19536 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:17:33.336952 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 86317.9us
I20260709 13:17:33.334113 19643 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:17:33.343314 19848 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:17:33.351886 18383 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.294435 19849 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:33.324272 19664 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:17:33.397294 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 261944us
I20260709 13:17:33.399119 18277 leader_election.cc:400] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4.
W20260709 13:17:33.400305 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 260356us
W20260709 13:17:33.401245 18351 leader_election.cc:336] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.144s (SENT)
W20260709 13:17:33.408640 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.412226 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:17:33.402289 18351 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.173s (SENT)
I20260709 13:17:33.414299 18383 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:33.415230 18351 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.207s (SENT)
I20260709 13:17:33.415693 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:33.421831 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.424153 18133 catalog_manager.cc:5697] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 3 to 4, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 4 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:33.457551 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.473701 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 53333.1us
I20260709 13:17:33.415083 19849 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:33.415406 19768 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:33.415272 19805 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:33.479166 19774 raft_consensus.cc:476] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:17:33.478253 19850 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:33.521334 18277 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:33.520994 18133 catalog_manager.cc:5697] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 1 to 3, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 3 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:33.521347 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 109167us
I20260709 13:17:33.536667 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:33.538496 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:33.413606 19664 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:33.552007 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 214159us
I20260709 13:17:33.553280 18277 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:33.346575 19799 consensus_queue.cc:237] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:33.558669 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:33.559792 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 144576us
W20260709 13:17:33.562633 18351 leader_election.cc:336] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.229s (SENT)
W20260709 13:17:33.562642 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.532173 19763 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.549163 19774 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:33.567132 19831 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
I20260709 13:17:33.525184 19866 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.574952 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:33.563318 19829 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:33.563762 19819 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:33.543625 19768 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.509312 19834 consensus_queue.cc:237] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:33.607234 19774 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:33.608072 19768 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:33.608428 19774 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.608899 19774 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:33.609923 19774 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.611249 19774 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.576411 19755 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:33.612584 19868 consensus_queue.cc:1059] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:17:33.613447 19839 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:33.573026 19850 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.603127 19840 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.606575 19854 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.085s	user 0.002s	sys 0.000s
I20260709 13:17:33.534312 19849 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.620260 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 987) took 1118 ms. Trace:
I20260709 13:17:33.620720 18228 rpcz_store.cc:276] 0709 13:17:32.502349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.894352 (+392003us) service_pool.cc:224] Handling call
0709 13:17:32.937447 (+ 43095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.938074 (+   627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.620047 (+681973us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b54000d1950. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:33.620190 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98482560}
I20260709 13:17:33.622037 19809 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:33.617385 19840 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:33.616247 19850 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:33.575081 19658 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:33.642364 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:33.644201 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:33.634464 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 59589.3us
I20260709 13:17:33.653964 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:33.599164 19829 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.554497 19805 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:33.604722 19830 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.627424 19682 consensus_meta.cc:287] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.693s	user 0.005s	sys 0.008s
I20260709 13:17:33.704860 19850 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.701967 19829 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:33.575773 19763 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.703667 19805 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:33.705263 19830 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:33.704149 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 162406us
I20260709 13:17:33.708324 19763 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:33.709602 19830 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:33.705864 19850 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.620271 19849 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:33.646519 19843 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:33.598071 19753 raft_consensus.cc:3055] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:17:33.747964 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 158121us
I20260709 13:17:33.713549 18202 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:33.717623 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.722436 19844 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.725284 19840 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:33.725184 19874 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:33.738806 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:33.755283 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:33.740182 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:33.646723 19624 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:17:33.743337 19725 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.744684 19664 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:33.746007 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:33.757102 18380 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:33.759246 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:33.761722 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:33.762377 18303 raft_consensus.cc:2376] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3. Re-sending same reply.
I20260709 13:17:33.790248 18228 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:33.792273 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:33.794878 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:33.795581 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:33.801154 18311 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:33.747910 19753 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:33.808411 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:33.814853 19749 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:33.760922 19843 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.760861 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 135111us
W20260709 13:17:33.821630 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 62471.6us
I20260709 13:17:33.822034 18303 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:33.822386 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:33.793182 18201 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:33.760494 19840 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.760617 19856 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.823979 19664 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:17:33.828879 19760 consensus_meta.cc:287] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.794s	user 0.012s	sys 0.000s
I20260709 13:17:33.834702 19836 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.836216 19836 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:33.838653 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:33.843066 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 49978.3us
I20260709 13:17:33.845057 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:33.848249 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:33.848938 18233 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:33.850718 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:33.851137 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:33.851910 18233 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:33.851805 18236 raft_consensus.cc:2410] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:33.854349 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:33.855150 18234 raft_consensus.cc:2410] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:33.860486 18234 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:33.845757 18228 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:33.863183 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:33.863943 18228 raft_consensus.cc:2410] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:17:33.865073 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.866504 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:33.867239 18234 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:33.837558 19664 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:33.828410 19840 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.861161 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:33.861795 19878 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:33.828575 19856 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.871137 19682 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.869194 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:33.908665 18235 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
W20260709 13:17:33.909160 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 45284.3us
I20260709 13:17:33.877490 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:33.878126 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:33.878618 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:33.881220 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:33.916585 18384 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:33.882755 19738 raft_consensus.cc:3055] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:33.885396 19769 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.886746 19875 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.844632 19830 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:17:33.888226 19844 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:33.889384 19805 raft_consensus.cc:1064] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:33.889995 19850 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:33.843750 19879 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:17:33.935564 19842 raft_consensus.cc:3055] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:33.936055 19842 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:33.925786 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:33.937121 19857 log.cc:927] Time spent T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.396s	user 0.008s	sys 0.004s
I20260709 13:17:33.937507 18229 raft_consensus.cc:2410] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 13:17:33.891024 18121 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 943649b738074d87a593c237cf998758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 459e82ee6b564cc19be6f73186938e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:17:33.943221 18121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 52271.8us
W20260709 13:17:33.924467 19751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.013s	sys 0.000s
I20260709 13:17:33.892992 19839 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.877547 19624 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 13:17:33.894932 19852 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.550s	user 0.003s	sys 0.000s
I20260709 13:17:33.895032 19840 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:33.827174 19843 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.876925 18233 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:33.904790 18234 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:33.927891 18231 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:33.864744 19749 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:33.913378 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:33.956086 18235 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:33.915241 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:33.907274 19868 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.956858 18381 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:33.956962 19868 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:33.959295 19868 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:33.920190 18312 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:33.871639 19849 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.960395 19849 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.960767 18235 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:33.962036 18235 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:33.962371 19849 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:33.900118 19837 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.963044 19837 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.907565 19632 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.964418 19632 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.917892 19738 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:33.966064 19738 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.966954 19738 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:33.968588 19749 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.968997 18235 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:33.935601 18957 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:33.926316 19877 log.cc:927] Time spent T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:17:33.951054 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:33.920739 18953 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:33.874063 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:33.954324 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:33.972506 18234 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
W20260709 13:17:33.972787 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 98786.6us
I20260709 13:17:33.973294 18233 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:33.974332 18202 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:33.944653 19751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.013s	sys 0.000s
W20260709 13:17:34.001195 19873 log.cc:927] Time spent T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:17:34.001885 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 50913.8us
I20260709 13:17:34.002543 19837 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.003089 19837 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:34.003211 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.007112 19856 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.007750 19856 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:34.008315 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:33.944482 19756 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.994616 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:33.994513 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:33.921736 19875 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.951390 19866 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:17:33.998322 19850 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.025247 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.011524 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:34.026271 19868 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:34.011050 18201 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:34.027558 19751 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:34.027750 18277 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.028004 19751 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.028455 19751 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:34.028577 19868 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:34.030833 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.031747 19868 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:34.022116 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47870.5us
I20260709 13:17:33.976096 19749 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:34.032567 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:34.033677 19664 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:17:34.023537 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 379377us
W20260709 13:17:33.979708 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.035638 18229 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:34.014776 19842 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.036634 19842 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.022580 19756 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:34.038290 19756 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.024992 19837 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:17:34.039343 19756 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.041502 19805 consensus_queue.cc:237] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:34.044322 19643 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.034627 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:34.045022 19643 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:34.046267 19866 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:34.046638 19866 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:34.023885 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:34.046983 19866 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:34.048202 19643 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.023399 19878 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:34.053153 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:34.054081 18231 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:17:34.059206 19851 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.734s	user 0.000s	sys 0.001s
I20260709 13:17:34.062779 19843 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.069069 18276 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:34.069819 19826 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:34.070308 19826 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:34.071105 19826 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.071503 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:34.073892 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:34.075551 18303 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:34.077698 18927 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.034638 18277 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:34.078285 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:34.080703 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 46123.2us
I20260709 13:17:34.081406 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:34.080054 19843 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:34.082402 19843 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:34.082850 19871 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:34.083197 19843 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:33.951275 19839 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.084693 19738 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:34.080404 19497 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:34.099334 18378 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:34.088613 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 53603.4us
I20260709 13:17:34.102491 18382 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:34.081791 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:34.103551 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:34.105161 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:34.105818 18379 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:34.160984 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 57024.4us
I20260709 13:17:34.162676 18277 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:34.084764 19829 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.166531 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:34.090385 19875 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.094020 19850 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:17:34.213719 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51132.7us
I20260709 13:17:34.234619 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:17:34.188607 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 74073.8us
I20260709 13:17:34.173823 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:34.237210 18380 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:34.157902 19837 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:34.157732 19774 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:34.197351 19887 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:17:34.246170 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:34.254582 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:34.261849 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:34.262549 18232 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:34.264912 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:34.265858 18237 raft_consensus.cc:2410] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:34.208792 19883 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:17:34.270925 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 168327us
I20260709 13:17:34.272478 18378 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.241663 19840 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:34.273976 18351 leader_election.cc:400] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:34.274703 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:34.275454 18351 leader_election.cc:400] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 4.
I20260709 13:17:34.277173 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:34.160504 19635 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 13:17:34.288784 19755 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:34.289917 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:34.291347 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:34.293152 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:34.294000 18385 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:34.229967 18379 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
W20260709 13:17:34.282505 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.107650 19881 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.171s
I20260709 13:17:34.295567 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:34.294857 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:34.259574 19837 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.298731 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:34.299753 18378 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:34.300263 18385 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:34.300344 18380 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:34.262459 19878 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:34.168430 19745 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 13:17:34.168589 19856 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 13:17:34.259023 19763 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:17:34.258827 19672 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:17:34.305948 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.314414 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60164 (request call id 7) took 1561 ms. Trace:
I20260709 13:17:34.318351 18307 rpcz_store.cc:276] 0709 13:17:32.754461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.760721 (+  6260us) service_pool.cc:224] Handling call
0709 13:17:33.320741 (+560020us) spinlock_profiling.cc:243] Waited 59.1 ms on lock 0x7b54001d2f20. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821f0520 00007fa18226d652 00007fa18723b60a 00007fa1807c17d4 00007fa1807c1762 00007fa1807c1691 00007fa1807c160c 00007fa1807c08c2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:34.314171 (+993430us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b4c0011f700. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18053fa20 00007fa180550a29 00007fa180516644 00007fa18053df2d 00007fa18053db93 00007fa18226dc92 00007fa18226d84a 00007fa18723b60a 00007fa1807c17d4 00007fa1807c1762 00007fa1807c1691
0709 13:17:34.314311 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148568064}
I20260709 13:17:34.316138 19820 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:34.319802 19820 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:34.252966 19875 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:17:34.322726 19834 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.323231 19834 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.297003 19844 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:17:34.258693 19664 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:17:34.313669 19895 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.325064 19895 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:34.326604 18229 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:34.327890 19682 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.313493 19836 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:34.329499 19836 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.329880 19836 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:34.188745 19676 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 13:17:34.293192 19755 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:17:34.314872 19829 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.334640 19759 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:34.335546 19755 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:34.336050 19755 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:34.336314 18201 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:34.279707 19840 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.340526 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.344448 18228 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:34.345949 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.263010 19774 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.258324 19751 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.347275 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.347100 18133 catalog_manager.cc:5697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 1 to 3, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 3 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:34.309919 19652 raft_consensus.cc:1064] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:17:34.326695 19839 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.336424 19755 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:34.359915 19682 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:17:34.327937 19859 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.986s	user 0.002s	sys 0.000s
I20260709 13:17:34.372885 18386 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:34.302606 19837 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.355600 19849 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:34.364833 18955 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 LEARNER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:34.308387 18231 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:34.358615 19745 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:17:34.385190 19745 raft_consensus.cc:2764] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:17:34.385823 19751 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.387841 19737 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:34.359766 19624 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:34.335587 19632 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.353041 19840 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.340746 19874 raft_consensus.cc:2764] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:17:34.346374 19895 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:34.392376 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:34.315582 19749 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.338600 19881 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:17:34.286300 19883 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:34.383401 19849 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.359882 19858 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:17:34.383723 19832 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:34.385823 19745 raft_consensus.cc:2764] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:17:34.389890 19676 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:17:34.336556 19820 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.497007 19820 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:34.430099 19842 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:17:34.473623 19892 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:17:34.475284 19883 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:34.476836 19725 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:34.478070 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:34.484678 19895 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:34.486130 19759 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:34.491519 19497 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:34.463454 19652 raft_consensus.cc:1068] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Unable to promote non-voter e016302b7e734d74833a2bf7bab44838: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }.
  Pending config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:34.494949 19753 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.498978 18133 catalog_manager.cc:5697] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:34.388355 19737 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:34.390511 19682 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.455659 19849 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:34.517604 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 226338us
I20260709 13:17:34.552681 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:34.553344 18236 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.553493 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:34.455900 19832 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:17:34.541852 19756 consensus_meta.cc:287] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.502s	user 0.015s	sys 0.000s
I20260709 13:17:34.414012 19866 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:34.535063 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 237293us
W20260709 13:17:34.538942 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 191734us
I20260709 13:17:34.514443 19643 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:34.554796 18306 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.522351 18131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39270 (request call id 184) took 7564 ms. Trace:
I20260709 13:17:34.555372 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:34.556530 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:34.578246 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:34.578446 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:34.578979 18309 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:34.579146 18312 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:34.558056 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:34.580504 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:34.581233 18305 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:34.559126 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:34.555287 19899 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:17:34.544379 19635 consensus_queue.cc:1243] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer 459e82ee6b564cc19be6f73186938e79 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:17:34.573555 18351 leader_election.cc:400] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4.
I20260709 13:17:34.577157 18311 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:34.585248 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.568790 18277 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:34.583209 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:34.534866 19895 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.585158 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:34.581503 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:34.528919 19834 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.595645 18236 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:34.612455 18310 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:34.611403 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:34.612495 18312 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:34.614073 18306 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:34.613965 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:34.616385 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47668us
I20260709 13:17:34.617807 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.618090 18276 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:34.623159 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.581666 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:34.670113 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 53679.5us
W20260709 13:17:34.670791 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 53014.6us
I20260709 13:17:34.670025 18305 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:34.569466 18961 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:34.673846 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:17:34.674166 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54218.8us
I20260709 13:17:34.592651 19753 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.592531 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:34.684422 18310 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:34.592890 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:34.575466 18131 rpcz_store.cc:276] 0709 13:17:26.950545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.950819 (+   274us) service_pool.cc:224] Handling call
0709 13:17:34.514621 (+7563802us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:30.830996 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:30.938515 (+107519us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:30.940023 (+  1508us) write_op.cc:435] Acquired schema lock
0709 13:17:30.944019 (+  3996us) tablet.cc:662] Decoding operations
0709 13:17:31.101938 (+157919us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:31.102026 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:31.102058 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:17:31.122784 (+ 20726us) tablet.cc:701] Row locks acquired
0709 13:17:31.122826 (+    42us) write_op.cc:260] PREPARE: finished
0709 13:17:31.123053 (+   227us) write_op.cc:270] Start()
0709 13:17:31.123239 (+   186us) write_op.cc:276] Timestamp: P: 1783603051122993 usec, L: 0
0709 13:17:31.123277 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:17:31.124339 (+  1062us) log.cc:844] Serialized 929 byte log entry
0709 13:17:31.737629 (+613290us) op_driver.cc:464] REPLICATION: finished
0709 13:17:31.921530 (+183901us) write_op.cc:301] APPLY: starting
0709 13:17:31.929352 (+  7822us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:31.949180 (+ 19828us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:31.964216 (+ 15036us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:31.993599 (+ 29383us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:32.007526 (+ 13927us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:17:32.007577 (+    51us) write_op.cc:312] APPLY: finished
0709 13:17:32.007804 (+   227us) log.cc:844] Serialized 28 byte log entry
0709 13:17:32.007988 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:32.008094 (+   106us) write_op.cc:454] Released schema lock
0709 13:17:32.008136 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:32.008554 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:32.008581 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":945950,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":153622,"apply.run_cpu_time_us":2788,"apply.run_wall_time_us":114499,"num_ops":2,"prepare.queue_time_us":189680,"prepare.run_cpu_time_us":35098,"prepare.run_wall_time_us":637769,"raft.queue_time_us":141210,"raft.run_cpu_time_us":24689,"raft.run_wall_time_us":78707,"replication_time_us":614181,"thread_start_us":563806,"threads_started":4,"wal-append.queue_time_us":433450,"wal-append.run_cpu_time_us":38492,"wal-append.run_wall_time_us":1454392}]]}
I20260709 13:17:34.728616 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.669322 19745 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:34.668725 19774 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:34.731509 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 113514us
I20260709 13:17:34.585091 19643 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:34.673555 19749 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.736317 18306 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:34.739545 19901 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:34.740099 19898 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:17:34.740938 19843 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:34.732056 18307 raft_consensus.cc:2376] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3. Re-sending same reply.
I20260709 13:17:34.677809 19632 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:34.728341 19834 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:17:34.744002 19888 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.344s	user 0.002s	sys 0.000s
I20260709 13:17:34.727304 19907 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:34.726908 19874 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.749080 19839 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:34.749521 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 80509.9us
I20260709 13:17:34.619519 19881 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:17:34.753443 19903 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:17:34.755425 19897 log.cc:927] Time spent T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:17:34.820281 19776 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:34.758104 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.762846 19737 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:34.776784 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 48256.4us
I20260709 13:17:34.786552 18384 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:34.882625 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.883175 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:34.787518 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:34.788173 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:34.788779 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:34.884171 18378 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:34.884792 18385 raft_consensus.cc:2410] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:34.802134 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:34.803951 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:34.805516 19819 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.684492 19756 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 13:17:34.781618 19896 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:34.677263 19832 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.671571 19883 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:17:34.900427 19868 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:34.800169 19755 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.902954 19755 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:34.904588 19909 log.cc:927] Time spent T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.135s	user 0.000s	sys 0.002s
I20260709 13:17:34.904950 18377 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:34.905892 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 106) took 1350 ms. Trace:
I20260709 13:17:34.833038 19895 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:34.883852 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.886384 18379 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:34.887851 18276 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.840165 19632 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:34.906288 18230 rpcz_store.cc:276] 0709 13:17:33.555502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.555677 (+   175us) service_pool.cc:224] Handling call
0709 13:17:33.556077 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.557611 (+  1534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.557643 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.340687 (+783044us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b2c000014c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:17:34.341066 (+   379us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.514957 (+173891us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:34.514995 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.515065 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:34.905592 (+390527us) raft_consensus.cc:1685] finished
0709 13:17:34.905610 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.905808 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10684,"raft.queue_time_us":38345,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":9366,"spinlock_wait_cycles":7835008,"thread_start_us":173510,"threads_started":1,"wal-append.queue_time_us":390288}
I20260709 13:17:34.913033 18276 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:34.885185 19745 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.815834 19901 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.886740 19881 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:34.825419 19907 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:34.917462 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:34.873931 19839 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.930192 18378 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
W20260709 13:17:34.935876 19624 consensus_meta.cc:287] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.003s
I20260709 13:17:34.936424 19624 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:34.937222 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:34.937243 18386 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:34.907408 19682 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.955158 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:34.922981 19918 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.956732 19632 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.957546 18957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54004 (request call id 176) took 1118 ms. Trace:
I20260709 13:17:34.957957 18957 rpcz_store.cc:276] 0709 13:17:33.839163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.841208 (+  2045us) service_pool.cc:224] Handling call
0709 13:17:33.871115 (+ 29907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.995140 (+124025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.957266 (+962126us) spinlock_profiling.cc:243] Waited 60.2 ms on lock 0x7b54007ae254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:34.957471 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138507008}
I20260709 13:17:34.960770 18233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:17:34.960247 18386 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:34.971580 19901 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.939611 19907 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:34.959650 19883 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.977268 19883 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:34.977732 19883 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.979310 19643 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.887059 19776 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.906780 19840 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.966089 19881 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.990166 19840 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.990574 19677 raft_consensus.cc:3055] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:34.990525 19881 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:34.991216 19677 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:34.992180 19839 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:34.928762 19866 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.002943 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:34.835306 19874 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.898298 19819 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:34.992362 19677 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:35.007365 19913 log.cc:927] Time spent T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:17:35.017756 18382 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:34.926381 19745 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.003866 19829 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:35.003664 19725 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.964339 19895 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:35.029153 19881 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:35.031635 18308 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:35.030718 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:35.033921 19677 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.008090 19901 consensus_queue.cc:1059] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:17:35.048760 18385 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:35.051374 18378 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:17:35.053563 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 219420us
I20260709 13:17:35.056051 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:35.063828 18384 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:17:35.065378 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.071261 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:35.072113 18378 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:35.072858 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:35.074011 18276 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:35.074573 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:35.077471 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:35.078958 18276 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:35.079761 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:35.082015 18379 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:35.082475 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:35.062053 19837 consensus_meta.cc:287] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.000s
I20260709 13:17:35.086516 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:17:35.086848 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.087212 18230 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.088105 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:35.046226 19836 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.716s	user 0.013s	sys 0.000s
I20260709 13:17:35.086246 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:35.089700 19864 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:35.089831 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:35.090404 19769 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:35.091378 19820 consensus_meta.cc:287] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.005s
I20260709 13:17:35.091698 18229 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:35.092433 18307 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:35.093024 19830 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.093220 18237 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:35.090571 18231 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:35.094117 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:35.099350 18306 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:35.093402 19864 raft_consensus.cc:697] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:35.100454 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:35.102415 18306 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.073050 19737 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.046738 19725 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.076220 19866 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:35.052608 19895 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:35.106005 18384 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:35.107754 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:35.137534 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:35.080870 19387 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:35.150233 18276 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:35.141183 19863 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:17:35.165313 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:35.166282 18312 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.167357 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:35.170277 19745 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:35.140334 18306 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:35.096063 19676 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:35.086320 19753 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:35.088317 19672 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:35.094552 19755 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:35.102077 19901 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:35.148444 18230 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:35.138680 19643 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:17:35.156584 19725 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.147315 19737 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:35.179136 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 71451us
W20260709 13:17:35.185396 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.145485 19843 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:35.099520 19836 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.155470 19658 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:35.099773 19837 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.199414 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:35.175963 19753 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.202330 19753 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.202582 19906 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:35.175454 19676 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:35.182132 19755 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.105121 19830 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.190038 19902 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:35.146102 19635 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:17:35.194981 19843 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.171547 19866 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:35.183472 19901 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:35.182233 19672 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:35.200392 19826 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:17:35.183264 19827 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:35.217684 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:35.233548 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:35.234179 18305 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:35.215544 19906 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:35.235076 19836 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.235234 19906 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.235918 19737 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.222709 19755 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:35.238683 19776 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.239225 19843 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.163235 19895 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.242893 19866 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:35.243765 19760 raft_consensus.cc:3055] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:35.214632 19907 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.244246 19760 raft_consensus.cc:740] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:35.212433 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:35.245959 19907 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:35.249616 19901 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.252333 18237 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:35.252856 18304 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:35.217706 19676 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.209664 19837 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:35.209302 19926 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:35.234301 18231 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.220362 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:35.273653 19819 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.257861 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:35.258944 18235 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:35.259497 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:35.260198 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:35.291127 18234 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.215965 18312 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:35.218171 19658 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:35.255715 18927 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:35.264318 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.295207 18351 connection.cc:256] RPC call timeout handler was delayed by -1.3605384319998848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 13:17:35.203267 19923 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
W20260709 13:17:35.295953 18351 connection.cc:256] RPC call timeout handler was delayed by -1.3344384319998426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
W20260709 13:17:35.296496 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 97160.4us
I20260709 13:17:35.242916 19832 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:35.299190 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 43568.6us
I20260709 13:17:35.243781 19672 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.307933 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:35.300972 18351 connection.cc:256] RPC call timeout handler was delayed by -1.1607384320000165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
I20260709 13:17:35.295015 19774 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.245311 19760 consensus_queue.cc:260] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:35.305519 19881 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:35.317199 19635 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.312990 19682 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:35.320878 19874 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:35.299063 19643 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:35.261135 19864 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.290807 19745 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:35.329859 18234 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:35.315480 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:35.334460 18377 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:35.334617 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:35.333397 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:35.335310 18384 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.334981 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:35.335217 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:35.336187 18234 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:35.337423 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:35.321094 19682 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:35.315275 19774 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.352638 18234 raft_consensus.cc:2393] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:35.322868 19881 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.358635 19624 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:35.361364 19849 consensus_meta.cc:287] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.790s	user 0.012s	sys 0.003s
I20260709 13:17:35.356699 19874 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:35.368444 19755 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.385596 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:35.385258 19677 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:17:35.389531 19874 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:35.373706 19624 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:35.426096 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 203700us
I20260709 13:17:35.427381 18384 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:35.428566 18201 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:35.352551 19745 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.305794 19658 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.369122 19907 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:35.423550 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:35.386746 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:35.428846 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:35.376041 19849 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.442150 18233 raft_consensus.cc:606] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:35.442651 18233 raft_consensus.cc:614] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:35.442951 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 82848.4us
I20260709 13:17:35.442981 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:35.446189 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:35.447079 18384 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:35.464597 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:35.465602 18237 raft_consensus.cc:2368] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:35.469637 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:35.471568 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:35.473562 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:35.474385 18383 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:35.476104 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:35.476948 18383 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:35.478802 19934 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:17:35.481639 19902 raft_consensus.cc:697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:35.481905 19676 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.482872 19902 consensus_queue.cc:237] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.490967 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:35.493944 18311 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:35.494323 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:35.493940 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:35.487102 19672 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.496256 19677 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:35.496910 19677 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.498490 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:35.484589 19863 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:35.499505 19863 raft_consensus.cc:697] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:35.445343 19753 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.500733 18229 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:35.503743 18312 raft_consensus.cc:2368] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:35.504956 18383 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:35.506055 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:35.507424 18383 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:35.456955 19933 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:35.465728 19830 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.415649 19682 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.517714 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:35.518623 18306 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:35.522953 19755 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.523500 19624 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:35.524410 19936 log.cc:927] Time spent T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:35.510871 19842 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:35.511907 19883 consensus_meta.cc:287] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.007s
I20260709 13:17:35.527966 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:35.488968 19676 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.525270 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:35.538499 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:35.539386 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:35.540207 19932 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:17:35.527432 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:35.546243 19910 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.799s	user 0.006s	sys 0.000s
W20260709 13:17:35.554284 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 44062us
I20260709 13:17:35.547220 19906 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.561858 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:35.563441 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:35.563859 18381 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:35.543582 19881 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:35.500455 19863 consensus_queue.cc:237] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.562099 19632 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.564133 18305 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:35.559844 18276 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:35.557214 18237 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:35.561264 18229 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:35.576458 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:35.576799 18380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1380) took 1086 ms. Trace:
I20260709 13:17:35.541251 19774 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:35.577883 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:35.579041 19921 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:35.547484 19842 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.579569 19921 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:35.580106 19921 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.582230 19842 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.583803 18276 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:35.577476 18380 rpcz_store.cc:276] 0709 13:17:34.489956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.490103 (+   147us) service_pool.cc:224] Handling call
0709 13:17:34.490644 (+   541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.511009 (+ 20365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.511042 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.543152 (+ 32110us) log.cc:844] Serialized 572 byte log entry
0709 13:17:34.580712 (+ 37560us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:34.580749 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.580829 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.545242 (+964413us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:17:35.576286 (+ 31044us) raft_consensus.cc:1685] finished
0709 13:17:35.576326 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.576682 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69880064,"thread_start_us":37187,"threads_started":1,"wal-append.queue_time_us":203562}
I20260709 13:17:35.584885 19842 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:35.585768 19842 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:35.586987 19842 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.591120 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:35.592657 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:35.605110 18237 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:35.593585 18276 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:35.607439 19830 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:35.607793 19830 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.608108 19830 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.595086 18229 raft_consensus.cc:2410] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:17:35.595474 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 284295us
I20260709 13:17:35.609206 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:35.606321 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:35.616086 18237 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.558470 19849 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.565546 19753 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:35.620198 19899 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:17:35.648411 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:35.649235 18381 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.516607 19933 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.624909 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:35.547151 19883 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.626991 18231 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
W20260709 13:17:35.665918 19928 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:17:35.521786 19874 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.622290 18202 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:35.658497 19883 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:35.658959 18383 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:35.631963 19906 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.610056 19632 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.621155 19774 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:17:35.680528 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 58335.4us
I20260709 13:17:35.681550 19676 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:35.693770 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:35.709859 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:35.715939 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1356) took 1153 ms. Trace:
I20260709 13:17:35.718498 18383 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:35.705534 19843 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.716342 18309 rpcz_store.cc:276] 0709 13:17:34.562389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.669120 (+106731us) service_pool.cc:224] Handling call
0709 13:17:34.685219 (+ 16099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.877461 (+192242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.877493 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.043951 (+166458us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b2c0010c0c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:17:35.044370 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:17:35.179854 (+135484us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:35.193436 (+ 13582us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.425516 (+232080us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b1800472fc0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa18226b060 00007fa18227d716 00007fa18228e287 00007fa18228e208
0709 13:17:35.425732 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.698762 (+273030us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54001702d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:35.698833 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.715721 (+ 16888us) raft_consensus.cc:1685] finished
0709 13:17:35.715741 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.715873 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161035,"prepare.queue_time_us":13595,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":270553,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":26186,"spinlock_wait_cycles":370091008,"thread_start_us":134825,"threads_started":1,"wal-append.queue_time_us":359171}
I20260709 13:17:35.725069 18237 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:35.728828 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:35.727694 19843 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.730374 19632 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.753717 19943 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:35.749006 18383 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:17:35.695189 19676 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.730891 18231 raft_consensus.cc:2955] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:35.753857 19900 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:17:35.802641 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.715214 19933 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.763329 19676 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.824617 19895 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:35.825397 19895 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.828315 19895 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:35.708945 19774 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.832237 18378 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
W20260709 13:17:35.812347 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.763866 19943 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:17:35.836880 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 392659us
W20260709 13:17:35.839475 19901 consensus_meta.cc:287] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.587s	user 0.013s	sys 0.000s
I20260709 13:17:35.839933 19901 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.842622 19943 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.843415 19677 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.845252 19901 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.845647 19745 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:35.847432 19921 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.889303 19725 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.893095 19725 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:35.895737 19725 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:35.916132 19921 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:35.937857 18202 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.553s (SENT) [suppressed 35 similar messages]
W20260709 13:17:35.964632 18351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.007s	sys 0.027s
W20260709 13:17:35.965090 18351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.007s	sys 0.027s
W20260709 13:17:35.965739 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 630556us
I20260709 13:17:35.966713 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:35.968178 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:35.979153 19883 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:35.979647 19883 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:35.980108 19883 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:35.927904 19643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.004s	sys 0.008s
W20260709 13:17:36.020839 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 52746.3us
I20260709 13:17:36.021986 19946 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.022886 19946 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:36.023458 19883 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.026441 19883 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:36.027143 19946 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:35.938482 19896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.013s
I20260709 13:17:35.988189 19745 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:17:36.002146 19643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.005s	sys 0.008s
I20260709 13:17:36.062031 18383 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:35.939802 19832 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:36.063326 18381 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:36.067667 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:36.068457 18381 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:36.065758 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:36.070029 18383 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:36.062634 19896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.004s	sys 0.013s
I20260709 13:17:36.059957 19907 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:36.049808 19895 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:36.063508 19933 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.028946 19827 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:36.029337 19819 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:36.057646 19774 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:36.115797 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:36.077666 19832 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:36.082669 18307 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:36.086866 19895 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:36.124766 19830 consensus_meta.cc:287] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.516s	user 0.004s	sys 0.009s
I20260709 13:17:36.135344 19830 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.138208 19830 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:36.086357 19907 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.140344 19907 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:36.094079 19933 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.132028 19901 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.097365 19819 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:36.096045 19827 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:36.155334 19832 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:36.192953 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:36.199920 18308 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 1347) took 1642 ms (client timeout 2005 ms). Trace:
W20260709 13:17:36.200395 18308 rpcz_store.cc:269] 0709 13:17:34.557828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.558896 (+  1068us) service_pool.cc:224] Handling call
0709 13:17:36.199702 (+1640806us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b54000bccd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:36.199817 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029035264}
I20260709 13:17:36.201644 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:36.202316 18308 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:36.203903 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:36.204556 18308 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:36.212695 18383 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:36.214017 18383 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:36.156378 19901 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.228150 18308 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:36.259045 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:36.259578 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.262009 19827 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:36.265419 19682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.025s	sys 0.030s
W20260709 13:17:36.282739 19902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.009s	sys 0.034s
W20260709 13:17:36.262589 19858 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.000s	sys 0.053s
W20260709 13:17:36.287015 19497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.009s	sys 0.030s
W20260709 13:17:36.297375 19682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.025s	sys 0.031s
W20260709 13:17:36.304498 19749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.056s	sys 0.085s
W20260709 13:17:36.304889 19902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.010s	sys 0.035s
W20260709 13:17:36.307018 19858 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.000s	sys 0.054s
W20260709 13:17:36.310531 19863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.000s	sys 0.018s
W20260709 13:17:36.327450 19863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.000s	sys 0.018s
W20260709 13:17:36.312652 19497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.010s	sys 0.030s
W20260709 13:17:36.318761 19861 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.007s	sys 0.027s
W20260709 13:17:36.328773 19861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.007s	sys 0.028s
I20260709 13:17:36.310680 19895 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:36.345050 19819 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:36.308141 19938 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.020s	sys 0.023s
W20260709 13:17:36.349296 19842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.020s	sys 0.049s
W20260709 13:17:36.316879 19749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.057s	sys 0.085s
W20260709 13:17:36.356652 19938 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.021s	sys 0.023s
W20260709 13:17:36.348811 19840 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.002s	sys 0.019s
W20260709 13:17:36.359179 19842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.020s	sys 0.049s
I20260709 13:17:36.358985 19901 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:36.372432 19931 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 1.002s	user 0.009s	sys 0.015s
I20260709 13:17:36.363502 19933 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:36.430666 18201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.012s	sys 0.023s
W20260709 13:17:36.431746 18201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.012s	sys 0.023s
W20260709 13:17:36.432212 18305 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.002s	sys 0.005s
W20260709 13:17:36.433038 18305 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.003s	sys 0.005s
W20260709 13:17:36.379423 19943 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.004s	sys 0.017s
W20260709 13:17:36.432212 18306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.012s	sys 0.029s
W20260709 13:17:36.455663 18306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.013s	sys 0.029s
W20260709 13:17:36.448580 19874 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.006s	sys 0.015s
W20260709 13:17:36.364995 19840 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.004s	sys 0.019s
W20260709 13:17:36.361516 19676 consensus_meta.cc:287] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.004s
I20260709 13:17:36.265272 18308 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:36.467684 19874 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.006s	sys 0.016s
W20260709 13:17:36.473531 19755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.014s	sys 0.017s
W20260709 13:17:36.484087 19755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.014s	sys 0.018s
W20260709 13:17:36.470346 18309 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.008s	sys 0.016s
W20260709 13:17:36.486858 18309 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.008s	sys 0.016s
W20260709 13:17:36.488812 18278 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.000s	sys 0.015s
W20260709 13:17:36.489297 18278 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.000s	sys 0.015s
W20260709 13:17:36.492899 19658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.005s	sys 0.018s
W20260709 13:17:36.493618 19658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.005s	sys 0.018s
I20260709 13:17:36.494195 19840 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:36.495508 19840 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:36.498436 18311 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.000s	sys 0.019s
W20260709 13:17:36.499053 18311 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.000s	sys 0.019s
W20260709 13:17:36.470841 18310 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.025s	sys 0.014s
W20260709 13:17:36.507932 18310 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.025s	sys 0.015s
W20260709 13:17:36.508057 18234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.005s	sys 0.004s
W20260709 13:17:36.508502 18234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.005s	sys 0.004s
I20260709 13:17:36.510098 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1131) took 1453 ms. Trace:
I20260709 13:17:36.510186 19840 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:36.510831 18382 rpcz_store.cc:276] 0709 13:17:35.048073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.048877 (+   804us) service_pool.cc:224] Handling call
0709 13:17:35.049317 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.049621 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.049645 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.050122 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:17:35.229371 (+179249us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:35.229410 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.229477 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.346851 (+1117374us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:17:36.467489 (+120638us) raft_consensus.cc:1685] finished
0709 13:17:36.469146 (+  1657us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.501353 (+ 32207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6523264,"thread_start_us":135645,"threads_started":1,"wal-append.queue_time_us":181160}
I20260709 13:17:36.520900 19676 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.524143 19676 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:36.527700 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:36.527778 19967 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:36.528546 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:36.530432 19874 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:36.537041 19874 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:36.540457 19943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.005s	sys 0.017s
W20260709 13:17:36.531143 18228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.003s	sys 0.001s
I20260709 13:17:36.540896 19967 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:36.541842 18228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.004s	sys 0.001s
I20260709 13:17:36.474026 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:36.531508 18229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.000s	sys 0.003s
W20260709 13:17:36.544736 18202 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.003s	sys 0.002s
W20260709 13:17:36.545274 18202 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.003s	sys 0.002s
W20260709 13:17:36.545832 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 607969us
W20260709 13:17:36.546638 18229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.000s	sys 0.004s
I20260709 13:17:36.548393 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 917) took 1290 ms. Trace:
I20260709 13:17:36.548612 19943 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.549417 19943 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.548887 18229 rpcz_store.cc:276] 0709 13:17:35.258057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.644448 (+386391us) service_pool.cc:224] Handling call
0709 13:17:35.677415 (+ 32967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:35.677750 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:35.678215 (+   465us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.547579 (+869364us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:36.547749 (+   170us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:36.547852 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.548015 (+   163us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.548236 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":805,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"thread_start_us":868653,"threads_started":1,"wal-append.queue_time_us":850748}
I20260709 13:17:36.551025 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:36.552867 19861 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:36.554548 19973 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:36.555529 19973 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:36.557399 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 522586us
I20260709 13:17:36.560958 19624 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:36.562107 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:36.563372 19967 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:36.562337 19624 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:36.563582 19973 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:36.570436 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 954) took 1078 ms. Trace:
I20260709 13:17:36.564412 19861 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:36.575047 19907 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:36.579653 19951 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.581771 19951 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.578814 19658 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:17:36.577862 18304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 1346) took 2020 ms (client timeout 1553 ms). Trace:
I20260709 13:17:36.552338 19943 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:36.584061 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 959) took 1080 ms. Trace:
I20260709 13:17:36.567046 19840 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:36.544301 19874 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:36.581875 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 949) took 1091 ms. Trace:
I20260709 13:17:36.587990 18309 rpcz_store.cc:276] 0709 13:17:35.504026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.800822 (+296796us) service_pool.cc:224] Handling call
0709 13:17:35.809557 (+  8735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.810059 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.810099 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.810629 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.489565 (+678936us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:36.489675 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.489784 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.583691 (+ 93907us) raft_consensus.cc:1685] finished
0709 13:17:36.583712 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.583980 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116293,"raft.queue_time_us":192,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"thread_start_us":587656,"threads_started":1,"wal-append.queue_time_us":693676}
I20260709 13:17:36.589392 18312 rpcz_store.cc:276] 0709 13:17:35.490421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.490591 (+   170us) service_pool.cc:224] Handling call
0709 13:17:36.580777 (+1090186us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b54001bb054. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:36.581647 (+   870us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26998528}
I20260709 13:17:36.593046 19840 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.592365 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:36.592705 19861 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:36.599179 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:36.600750 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:36.601624 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:36.603876 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:36.603750 19658 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:36.605227 18382 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:17:36.607565 19658 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:36.611701 19951 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:36.615340 19755 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:36.618307 19755 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:36.571118 18311 rpcz_store.cc:276] 0709 13:17:35.492201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.495182 (+  2981us) service_pool.cc:224] Handling call
0709 13:17:35.495559 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.543301 (+ 47742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.543346 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.566414 (+ 23068us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.499943 (+933529us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:36.544565 (+ 44622us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.569656 (+ 25091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.569818 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.569910 (+    92us) raft_consensus.cc:1685] finished
0709 13:17:36.569928 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.570178 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49321,"raft.queue_time_us":50025,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":9982,"thread_start_us":914371,"threads_started":2,"wal-append.queue_time_us":770002}
I20260709 13:17:36.624840 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1127) took 1831 ms. Trace:
I20260709 13:17:36.625355 18385 rpcz_store.cc:276] 0709 13:17:34.793021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.885622 (+ 92601us) service_pool.cc:224] Handling call
0709 13:17:34.885967 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:35.049271 (+163304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.624085 (+1574814us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400075154. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:36.624612 (+   527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373362176}
I20260709 13:17:36.627101 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:36.627542 18309 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:36.565016 19624 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:36.624233 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:36.630263 19624 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.634075 18311 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 1.
W20260709 13:17:36.611961 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.586035 18304 rpcz_store.cc:269] 0709 13:17:34.557536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.557728 (+   192us) service_pool.cc:224] Handling call
0709 13:17:36.577384 (+2019656us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b5400234e54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:36.577602 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1545891712}
I20260709 13:17:36.636658 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 960) took 1124 ms. Trace:
I20260709 13:17:36.637132 18309 rpcz_store.cc:276] 0709 13:17:35.504259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.626207 (+1121948us) service_pool.cc:224] Handling call
0709 13:17:36.626992 (+   785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.628149 (+  1157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.628437 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:36.638209 18306 raft_consensus.cc:2368] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3.
I20260709 13:17:36.638861 18308 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:36.643267 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:36.616506 19840 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:36.656199 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:36.657614 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1038) took 1227 ms. Trace:
I20260709 13:17:36.658213 18231 rpcz_store.cc:276] 0709 13:17:35.429703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.665184 (+235481us) service_pool.cc:224] Handling call
0709 13:17:35.665729 (+   545us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.721201 (+ 55472us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:36.198337 (+477136us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.487837 (+289500us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.490446 (+  2609us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.490698 (+   252us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:36.490734 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.490910 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.655395 (+164485us) raft_consensus.cc:1685] finished
0709 13:17:36.655746 (+   351us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.657396 (+  1650us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30615,"raft.queue_time_us":12248,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":5652,"thread_start_us":287503,"threads_started":1,"wal-append.queue_time_us":418362}
I20260709 13:17:36.667309 18385 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.670069 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 955) took 1177 ms. Trace:
I20260709 13:17:36.661579 19624 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:36.674661 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:36.683746 19842 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:36.677773 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1041) took 1226 ms. Trace:
I20260709 13:17:36.684702 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:36.685252 18234 rpcz_store.cc:276] 0709 13:17:35.451170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.711160 (+259990us) service_pool.cc:224] Handling call
0709 13:17:35.711498 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.720124 (+  8626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.720155 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.720696 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.509252 (+788556us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:36.509387 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.509502 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.677496 (+167994us) raft_consensus.cc:1685] finished
0709 13:17:36.677515 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.677700 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8222,"raft.queue_time_us":11110,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":27525,"thread_start_us":787835,"threads_started":1,"wal-append.queue_time_us":888015}
I20260709 13:17:36.686581 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:17:36.680176 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 118412us
I20260709 13:17:36.695102 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:36.696568 18384 raft_consensus.cc:2368] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3.
I20260709 13:17:36.699393 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:36.678401 19755 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:36.671837 18310 rpcz_store.cc:276] 0709 13:17:35.492492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.506088 (+ 13596us) service_pool.cc:224] Handling call
0709 13:17:35.506400 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.545317 (+ 38917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.545366 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.546049 (+   683us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.508885 (+962836us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:36.636777 (+127892us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.645610 (+  8833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.652557 (+  6947us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.652626 (+    69us) raft_consensus.cc:1685] finished
0709 13:17:36.652634 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.669982 (+ 17348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55231,"prepare.queue_time_us":115839,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":56583,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":1693,"spinlock_wait_cycles":3484416,"thread_start_us":1048306,"threads_started":2,"wal-append.queue_time_us":818153}
I20260709 13:17:36.711721 19635 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:36.713567 19635 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.684643 19842 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.721863 19842 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:36.722862 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35652 (request call id 2) took 1762 ms. Trace:
I20260709 13:17:36.716204 19755 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:36.726961 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:36.738698 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43780 (request call id 70) took 1898 ms. Trace:
I20260709 13:17:36.739230 18303 rpcz_store.cc:276] 0709 13:17:34.839666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.911680 (+ 72014us) service_pool.cc:224] Handling call
0709 13:17:36.737891 (+1826211us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b5400234e54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182279735 00007fa1822719fa 00007fa1872394c9 00007fa1807b5c54 00007fa1807b5be2 00007fa1807b5b11 00007fa1807b5a8c 00007fa1807b4d42 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:36.738380 (+   489us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":785286016}
I20260709 13:17:36.739938 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:36.735312 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1389) took 1401 ms. Trace:
I20260709 13:17:36.740700 18377 rpcz_store.cc:276] 0709 13:17:35.333921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.335389 (+  1468us) service_pool.cc:224] Handling call
0709 13:17:35.335662 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:35.455923 (+120261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.455972 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:35.456034 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:35.456080 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.734675 (+1278595us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000023d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:36.734774 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.735083 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275952384}
I20260709 13:17:36.742324 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:36.743525 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:36.743906 18957 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:36.746580 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:36.736725 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1145) took 1126 ms. Trace:
I20260709 13:17:36.733983 18233 rpcz_store.cc:276] 0709 13:17:34.960420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.960609 (+   189us) service_pool.cc:224] Handling call
0709 13:17:36.722409 (+1761800us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b540001ccd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa18226d853 00007fa18723b60a 00007fa1807c17d4 00007fa1807c1762 00007fa1807c1691 00007fa1807c160c 00007fa1807c08c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:36.722588 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105184640}
I20260709 13:17:36.734562 19755 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.746928 19672 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:36.747766 18307 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 948) took 1242 ms (client timeout 1642 ms). Trace:
I20260709 13:17:36.735873 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:36.750134 18378 rpcz_store.cc:276] 0709 13:17:35.609948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.624495 (+ 14547us) service_pool.cc:224] Handling call
0709 13:17:36.736344 (+1111849us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400080554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:36.736536 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414463232}
I20260709 13:17:36.759112 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 957) took 1255 ms. Trace:
I20260709 13:17:36.769618 19755 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:36.771142 19982 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:17:36.763008 18307 rpcz_store.cc:269] 0709 13:17:35.490056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.502132 (+ 12076us) service_pool.cc:224] Handling call
0709 13:17:36.732148 (+1230016us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54000bc7d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:36.732472 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293342464}
I20260709 13:17:36.763525 18305 rpcz_store.cc:276] 0709 13:17:35.503490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.612337 (+108847us) service_pool.cc:224] Handling call
0709 13:17:35.633146 (+ 20809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.437476 (+804330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.453029 (+ 15553us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.532193 (+ 79164us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.636891 (+104698us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:36.648376 (+ 11485us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.671999 (+ 23623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.676339 (+  4340us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.758810 (+ 82471us) raft_consensus.cc:1685] finished
0709 13:17:36.758836 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.759050 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47149,"prepare.queue_time_us":12451,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":84,"raft.queue_time_us":40372,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":15525,"thread_start_us":894786,"threads_started":2,"wal-append.queue_time_us":141785}
I20260709 13:17:36.776719 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:36.777036 19632 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:36.781183 19745 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:36.781845 19745 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:36.783131 19760 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.783442 19881 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.784216 19881 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.786702 19881 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:36.796182 18377 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:36.799125 18927 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:36.802836 18308 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:36.811523 19948 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:36.812098 19948 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.812573 19948 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:36.815083 19914 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:36.817898 18384 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:36.826730 19682 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.827613 19682 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.830560 19682 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:36.831986 18386 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 1378) took 2440 ms (client timeout 2103 ms). Trace:
W20260709 13:17:36.835398 18386 rpcz_store.cc:269] 0709 13:17:34.390986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.392053 (+  1067us) service_pool.cc:224] Handling call
0709 13:17:36.831525 (+2439472us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b540033d954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:36.831735 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1202753408}
I20260709 13:17:36.783151 19745 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:36.856384 19949 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.512s	user 0.003s	sys 0.000s
I20260709 13:17:36.865929 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:17:36.866722 18121 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 943649b738074d87a593c237cf998758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 459e82ee6b564cc19be6f73186938e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:36.893738 19756 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:36.897595 19756 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.886257 19881 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:36.906827 18385 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:36.913530 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:36.914582 19863 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:17:36.917418 19935 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 1.485s	user 0.008s	sys 0.006s
I20260709 13:17:36.919224 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1137) took 1813 ms. Trace:
I20260709 13:17:36.909572 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:36.920205 19682 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.922716 19682 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:36.917297 19677 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:17:36.916213 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.928361 19863 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:36.928939 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:36.930477 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:36.930944 19863 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:36.931669 19677 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:36.919759 18379 rpcz_store.cc:276] 0709 13:17:35.105739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.105886 (+   147us) service_pool.cc:224] Handling call
0709 13:17:35.150707 (+ 44821us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.151113 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.151154 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.155435 (+  4281us) log.cc:844] Serialized 26 byte log entry
0709 13:17:35.212917 (+ 57482us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b180028fb40. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:17:35.228831 (+ 15914us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:35.228892 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.228999 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.897935 (+1668936us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:17:36.918691 (+ 20756us) raft_consensus.cc:1685] finished
0709 13:17:36.918721 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.918991 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":176,"spinlock_wait_cycles":28036224,"thread_start_us":15679,"threads_started":1,"wal-append.queue_time_us":210959}
I20260709 13:17:36.934079 19677 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:36.944296 18382 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:36.948714 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:36.949988 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1039) took 1513 ms. Trace:
I20260709 13:17:36.950524 18228 rpcz_store.cc:276] 0709 13:17:35.432124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.704397 (+272273us) service_pool.cc:224] Handling call
0709 13:17:35.704898 (+   501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.705355 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.705396 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.705986 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.555094 (+849108us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:36.555198 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.555328 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.933763 (+378435us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b180041c0e0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:17:36.936798 (+  3035us) raft_consensus.cc:1685] finished
0709 13:17:36.936823 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.945642 (+  8819us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6290,"raft.queue_time_us":2123,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"spinlock_wait_cycles":31017216,"thread_start_us":835980,"threads_started":1,"wal-append.queue_time_us":836816}
I20260709 13:17:36.953163 19677 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:36.953830 19881 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:36.954645 19881 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:36.965327 18133 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 79) took 9076 ms. Trace:
I20260709 13:17:36.927716 19682 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:36.980695 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 146128us
I20260709 13:17:36.982743 18351 leader_election.cc:400] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:36.983052 18351 leader_election.cc:403] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:36.983839 19883 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:36.984714 19635 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:36.985005 18351 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:36.985378 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:36.986138 18377 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.992461 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:36.953899 19677 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:36.943214 19756 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:37.000984 18377 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:37.001242 19973 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:37.002422 19973 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:37.002887 19973 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:37.005769 19677 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.007100 18201 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:37.008348 19635 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:37.011943 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.013068 19940 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:37.013540 19874 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:37.013784 19940 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.014256 19874 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:37.016096 19940 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:36.982903 18132 catalog_manager.cc:5697] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:37.023134 18202 leader_election.cc:400] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3.
I20260709 13:17:37.023563 18202 leader_election.cc:403] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:36.992456 19881 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:36.997181 19883 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:37.025503 19635 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.025666 19874 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:37.004236 19973 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.027485 19973 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:36.997498 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:17:36.997212 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 59725.1us
I20260709 13:17:37.034276 18236 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:37.035208 19863 consensus_queue.cc:1059] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:37.036361 19863 raft_consensus.cc:3055] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:37.036768 19863 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:37.037909 19863 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:37.038554 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 90955.5us
I20260709 13:17:37.038990 19863 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:37.039310 18276 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:37.040637 19840 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:37.040930 19756 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:37.041308 19840 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:37.041625 19756 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:37.043752 19948 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.042459 19676 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:17:37.045960 19387 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:37.046087 19948 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:37.046432 19387 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:37.049681 19387 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.050105 18202 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:37.051122 19387 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.051429 19755 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:37.052076 19755 raft_consensus.cc:697] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:37.054590 19755 consensus_queue.cc:237] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:36.998764 19994 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:17:37.040328 18276 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:37.042438 19840 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.042075 18201 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:37.061529 18236 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:37.065521 18382 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:37.070237 18377 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:37.043995 19756 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.089200 19738 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.089855 19738 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.092058 19738 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:37.092852 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52641.5us
I20260709 13:17:37.093057 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:37.093729 18276 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:37.094369 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.095294 19842 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:37.095557 19964 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:37.095913 19842 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.096400 19842 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:37.096664 19830 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:37.098258 19830 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:37.098610 19830 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:37.099689 19830 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.100674 19632 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:37.080760 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:37.069393 19672 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:37.103502 19672 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:37.075479 19940 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:37.103991 19672 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:37.096333 18961 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:37.104485 19940 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.082965 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:37.106832 19940 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:37.084860 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:37.083441 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:37.100339 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 58375.3us
I20260709 13:17:37.096302 19964 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:37.108824 18201 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:37.109815 19682 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:37.109457 19964 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.110486 18201 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:37.100893 19676 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:37.125588 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:37.125803 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:37.074004 19836 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.083843 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:37.087186 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.095582 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.132030 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.134316 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.103513 19830 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:37.146600 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 71707.2us
I20260709 13:17:37.132661 18276 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:37.153653 18232 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:37.132453 19738 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:37.161664 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:17:37.165433 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 55045.6us
I20260709 13:17:37.166312 18201 leader_election.cc:400] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3.
I20260709 13:17:37.131728 19967 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:37.151660 19940 raft_consensus.cc:2764] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:17:37.176502 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.177754 18234 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.196774 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:37.198185 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.202620 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1152) took 1287 ms. Trace:
I20260709 13:17:37.203445 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.204173 18383 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:37.204617 19819 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.205267 19819 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.207463 19819 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:37.210225 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:37.144714 19836 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:37.212651 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.213081 19836 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:37.213726 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:37.214206 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.203572 19866 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:37.215595 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.217378 19753 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:37.217527 19998 log.cc:927] Time spent T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:17:37.227622 18236 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:37.215667 18277 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:37.220304 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54139.7us
I20260709 13:17:37.204027 19933 consensus_queue.cc:1059] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:17:37.228881 18201 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:37.232326 18382 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:37.233851 19951 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.234563 19951 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:37.236392 18237 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:37.236757 18231 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:36.970082 18133 rpcz_store.cc:276] 0709 13:17:27.888547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.888746 (+   199us) service_pool.cc:224] Handling call
0709 13:17:36.965050 (+9076304us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:34.804034 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:34.907687 (+103653us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:34.911531 (+  3844us) write_op.cc:435] Acquired schema lock
0709 13:17:34.914832 (+  3301us) tablet.cc:662] Decoding operations
0709 13:17:34.988756 (+ 73924us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:34.988856 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:34.988886 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:17:34.989318 (+   432us) tablet.cc:701] Row locks acquired
0709 13:17:34.989340 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:17:34.989499 (+   159us) write_op.cc:270] Start()
0709 13:17:34.989643 (+   144us) write_op.cc:276] Timestamp: P: 1783603054989454 usec, L: 0
0709 13:17:34.989672 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:17:35.007889 (+ 18217us) log.cc:844] Serialized 1697 byte log entry
0709 13:17:35.497990 (+490101us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b54002ae254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa18226ee28 00007fa185ca9581 00007fa185ca8d58 00007fa185cad9f1 00007fa185cad9a9 00007fa185cad939 00007fa185cad901 00007fa185cacb2d 000000000038f354 000000000038f199
0709 13:17:35.584171 (+ 86181us) op_driver.cc:464] REPLICATION: finished
0709 13:17:36.381698 (+797527us) write_op.cc:301] APPLY: starting
0709 13:17:36.383998 (+  2300us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:36.384229 (+   231us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:36.384258 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:36.385148 (+   890us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:36.385424 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:17:36.385494 (+    70us) write_op.cc:312] APPLY: finished
0709 13:17:36.385831 (+   337us) log.cc:844] Serialized 40 byte log entry
0709 13:17:36.386036 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:36.386217 (+   181us) write_op.cc:454] Released schema lock
0709 13:17:36.386279 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:36.386835 (+   556us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:36.386877 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1137452,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":791924,"apply.run_cpu_time_us":3042,"apply.run_wall_time_us":7119,"num_ops":4,"prepare.queue_time_us":246239,"prepare.run_cpu_time_us":59414,"prepare.run_wall_time_us":694178,"raft.queue_time_us":251673,"raft.run_cpu_time_us":45390,"raft.run_wall_time_us":778602,"replication_time_us":594365,"spinlock_wait_cycles":40164736,"thread_start_us":1308275,"threads_started":4,"wal-append.queue_time_us":315797}]]}
I20260709 13:17:37.240715 18378 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:17:37.198499 19756 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:37.203063 18381 rpcz_store.cc:276] 0709 13:17:35.840532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.132674 (+292142us) service_pool.cc:224] Handling call
0709 13:17:36.134408 (+  1734us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.155119 (+ 20711us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:17:36.725903 (+570784us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b18003b69e0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f183455 00007fa185c6b3c7 00007fa18227d9a7 00007fa18228d0bf 00007fa18228d038
0709 13:17:36.800746 (+ 74843us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.869481 (+ 68735us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.921789 (+ 52308us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.921890 (+   101us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:36.921909 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.940764 (+ 18855us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:37.112012 (+171248us) raft_consensus.cc:1685] finished
0709 13:17:37.128129 (+ 16117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.128279 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20154,"prepare.queue_time_us":220691,"prepare.run_cpu_time_us":503,"prepare.run_wall_time_us":504,"raft.queue_time_us":22116,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":24741,"spinlock_wait_cycles":8854272,"thread_start_us":58985,"threads_started":2,"wal-append.queue_time_us":85580}
I20260709 13:17:37.216346 18229 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:37.199282 19943 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:37.260186 19753 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:37.264833 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.265681 18379 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 2: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:37.266532 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:37.267328 18959 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:17:37.266219 19755 raft_consensus.cc:2955] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:37.268121 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:37.268350 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:37.269361 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.270062 19946 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:37.252959 19866 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:37.270679 19946 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:37.272615 19776 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:37.273236 19776 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.231638 19682 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:37.274924 19682 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:37.219414 19738 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:37.278020 19943 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.250283 19756 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.280239 19756 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:37.285226 18236 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:37.253901 19967 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.289057 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 963) took 1784 ms. Trace:
W20260709 13:17:37.293717 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 78152.3us
W20260709 13:17:37.295224 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 50848.6us
W20260709 13:17:37.306833 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 75323.7us
I20260709 13:17:37.289417 18309 rpcz_store.cc:276] 0709 13:17:35.505087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.639571 (+1134484us) service_pool.cc:224] Handling call
0709 13:17:36.661976 (+ 22405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.708740 (+ 46764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.708772 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.719859 (+ 11087us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.996344 (+276485us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:37.077734 (+ 81390us) log.cc:844] Serialized 14 byte log entry
0709 13:17:37.114281 (+ 36547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.114390 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:37.288877 (+174487us) raft_consensus.cc:1685] finished
0709 13:17:37.288894 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.289004 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1120,"prepare.queue_time_us":80310,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":21525,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":4802,"thread_start_us":196002,"threads_started":1,"wal-append.queue_time_us":380668}
I20260709 13:17:37.313081 19745 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:37.313871 19745 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:37.314440 19745 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:37.319034 19760 raft_consensus.cc:3055] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:37.319510 19760 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:37.324445 19635 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3.
I20260709 13:17:37.336022 19738 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:37.336788 18201 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:37.338081 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:37.338507 18201 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:37.340070 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:37.340091 19933 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:37.378167 19933 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:37.378660 19933 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.379130 19933 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:37.340953 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:37.381204 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:37.381933 18381 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.342499 19676 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:37.343055 19624 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:37.385808 19624 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.344311 18233 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:17:37.350066 19967 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:37.350425 18957 raft_consensus.cc:2955] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:37.354403 19842 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.357647 19682 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:37.357930 19672 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:37.359490 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:37.432806 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.359807 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.360549 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.361084 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.361403 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.362485 19943 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:37.363277 18230 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:37.363633 19946 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:37.364282 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:37.366379 19951 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:37.368369 19776 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:37.369370 18232 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:37.369967 19760 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.375348 18228 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:37.377022 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.385226 18236 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:37.391144 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.392745 18382 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:37.447554 18378 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:37.406056 18381 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:37.388474 19624 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:37.423864 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:37.432579 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 319552us
I20260709 13:17:37.432040 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.441660 18306 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:37.455493 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.441701 18386 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:37.456413 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.444403 18234 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:37.389503 19840 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:37.452066 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.460464 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.463016 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:37.464826 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.463207 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.461977 19760 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:37.470719 19672 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:37.471114 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:37.471446 18229 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:37.465762 18231 raft_consensus.cc:2393] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:37.472301 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.478166 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.472963 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.493110 18234 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:37.499550 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.500856 18381 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:37.486125 18380 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:37.502208 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.504139 18378 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 4: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:37.502791 18379 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:37.505813 18382 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:17:37.513504 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.475889 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:37.517139 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.485857 18953 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:37.519629 18379 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:37.525278 18385 raft_consensus.cc:2410] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:37.526736 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.526969 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.528115 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.528916 18384 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:37.507421 19840 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:37.535688 19387 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:37.537717 18201 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:37.538619 19387 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:37.538976 19387 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.539275 19387 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:37.547067 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.474054 19776 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:17:37.540784 20009 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:37.549726 18201 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:37.550840 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.480691 19745 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:37.556850 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:37.562266 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.562318 18236 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:37.563970 19677 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:37.564574 19677 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:37.565645 19677 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.519381 19967 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:17:37.577056 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:37.577903 18382 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:37.586042 18276 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:37.558145 20009 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.589972 20009 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:37.561638 19842 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:37.591406 19672 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:37.601394 18236 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:37.608623 18235 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:37.611397 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.612794 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.582451 19967 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:17:37.617313 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.619012 18231 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:37.619788 18380 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:37.574913 19682 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:17:37.627352 18386 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:37.617657 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:37.622862 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:37.631560 18385 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:37.631984 18385 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:37.603930 19738 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:37.634418 18236 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:37.635434 18201 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:37.647128 19387 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.649739 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.649945 18235 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:37.650497 18236 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:37.652175 18201 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:37.653841 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 78672.5us
I20260709 13:17:37.656234 18201 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:37.642680 18378 raft_consensus.cc:2955] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:37.658901 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.659746 18276 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:37.636633 19672 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:37.661705 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:37.664090 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 137991us
I20260709 13:17:37.653142 20011 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.658252 19940 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:37.658802 19658 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:37.672142 19760 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:37.664917 19676 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:17:37.673010 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:37.654769 19635 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:37.655113 19632 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:37.656461 19863 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:37.612458 19840 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.665151 18385 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.681985 19387 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:37.679848 19658 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.692239 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:37.680030 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:37.665791 19933 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:37.728040 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.743438 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.751518 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 70280.8us
I20260709 13:17:37.752301 19387 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.752465 18276 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:37.686110 19635 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:37.755015 19635 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:37.755424 19864 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:37.691956 18229 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:37.773103 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:37.776189 18276 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:17:37.777336 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.781199 18232 raft_consensus.cc:2368] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4.
I20260709 13:17:37.785281 19387 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.703869 19973 consensus_queue.cc:1059] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:17:37.793467 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:37.797581 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 112847us
I20260709 13:17:37.799015 19387 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:37.688141 20011 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.751228 19776 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:17:37.808008 19776 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:37.773022 19756 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.808534 19776 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:37.809078 19776 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:37.810336 19756 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:37.811086 19756 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:37.811757 19756 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:37.817200 19942 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:37.817709 19942 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.818096 19942 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.772119 19842 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:17:37.784970 19864 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:17:37.822345 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 55329us
I20260709 13:17:37.822135 19864 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.823237 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:37.784859 19830 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:37.824836 19830 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:37.825531 19830 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.826237 19933 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:37.713614 19940 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.828366 19940 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:37.784132 19948 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:37.800369 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 138992us
I20260709 13:17:37.751430 19738 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:17:37.824982 19745 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:37.833909 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 164577us
I20260709 13:17:37.834615 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:37.840345 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:37.843335 18382 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:37.847692 18377 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:37.828956 19940 raft_consensus.cc:2764] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:17:37.768179 19658 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.856556 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:37.862164 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:37.865600 18383 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:17:37.869123 18927 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:37.878296 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:17:37.880656 20010 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:17:37.861790 19745 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:37.902395 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 98410.6us
I20260709 13:17:37.880753 18229 raft_consensus.cc:2410] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:37.898075 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:37.927731 18382 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:37.934062 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:37.912710 19836 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:37.938424 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:37.939368 18309 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:37.937847 19836 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:37.949661 19836 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:37.957862 19942 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:37.909245 19635 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.962096 19635 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:37.965121 20011 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:37.965329 20019 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:37.967619 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:37.971498 19830 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:37.973037 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:37.945145 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:37.948554 18305 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:37.976922 18306 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3. Ops: []
W20260709 13:17:37.980835 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 110492us
I20260709 13:17:37.981370 18303 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.936982 20015 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:37.975566 18383 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:37.913821 20023 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:17:37.974694 18307 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:37.994167 18309 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.002763 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.003927 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:38.010016 18308 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.016506 19776 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.018849 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.019186 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:37.986919 20011 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.021224 19776 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:38.021068 20011 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.022874 19830 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:38.021391 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.008486 19942 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:38.023866 20011 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:38.027843 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.028162 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.027989 19658 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:38.029587 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:38.029798 20007 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.598s	user 0.003s	sys 0.010s
W20260709 13:17:38.030824 20021 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:17:37.463773 19866 consensus_queue.cc:1175] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" responder_term: 4 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:38.028798 18311 raft_consensus.cc:2410] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:38.036899 18385 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.032159 18307 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:37.986918 20015 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:38.039093 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:38.045282 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 125884us
I20260709 13:17:38.047415 18303 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:38.047680 18236 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:38.047678 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:38.050364 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.050014 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:17:38.051513 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 227027us
I20260709 13:17:38.053360 18276 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:38.053333 19840 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:38.056017 19842 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:38.061367 18385 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:38.045560 20015 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.065749 18304 raft_consensus.cc:2955] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:38.067304 19658 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:38.054607 19776 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:38.053654 19830 consensus_queue.cc:1059] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:17:38.070801 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:38.071172 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:38.071758 20028 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:38.072149 18229 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:38.073076 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:38.073870 20028 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:38.074746 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.075367 18312 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:38.057453 19842 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.076905 19842 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:38.077105 18308 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:38.079129 18351 leader_election.cc:400] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:38.079461 18351 leader_election.cc:403] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:17:38.079900 18237 raft_consensus.cc:2410] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:38.080034 19745 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:38.056288 19840 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:38.080812 19840 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.102064 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:38.115854 18377 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:17:38.098850 19836 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:38.117470 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 55869.5us
I20260709 13:17:38.121095 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:38.159739 18308 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:38.126417 19830 raft_consensus.cc:3055] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:38.095659 20023 consensus_queue.cc:1059] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:17:38.173123 19830 raft_consensus.cc:740] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:38.173537 20039 consensus_queue.cc:1059] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:17:38.174154 19830 consensus_queue.cc:260] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.175341 19830 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:38.181094 18377 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:38.181607 19836 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:38.122532 18121 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 943649b738074d87a593c237cf998758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 459e82ee6b564cc19be6f73186938e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:38.113628 19840 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.200964 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:38.202425 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.202346 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:17:38.205598 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.215684 18377 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 4: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:38.168262 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:38.223497 18377 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:38.223721 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:38.224000 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.229252 18311 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:38.231156 18304 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:38.197086 20024 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:17:38.234519 18202 leader_election.cc:336] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.553s (SENT)
I20260709 13:17:38.274952 18202 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:38.220117 18121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 101020us
I20260709 13:17:38.227078 19973 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:38.204483 19842 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:38.276472 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 92752.1us
I20260709 13:17:38.279247 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.272188 19836 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:38.281606 19836 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:38.282752 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:38.283766 20011 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:38.286958 18201 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:38.287804 19635 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:38.287949 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:38.289081 19933 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:38.289371 19755 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:38.289675 19933 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:38.278093 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:38.292965 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:38.293541 18383 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.289981 19755 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:38.284201 19836 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:38.300778 18303 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:38.317829 18308 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:38.322794 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:17:38.323977 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 45997.3us
I20260709 13:17:38.325345 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:38.244092 20024 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.336993 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:17:38.317129 18277 connection.cc:256] RPC call timeout handler was delayed by -1.3268166929999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
I20260709 13:17:38.280355 19973 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.309113 20020 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:17:38.355470 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:38.356345 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 121872us
I20260709 13:17:38.358799 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:38.356345 18276 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:17:38.373411 20041 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:17:38.375257 18383 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:38.376164 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:38.376813 18383 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:38.343384 19745 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:38.377755 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:38.379094 18381 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:38.348163 19940 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:38.381726 18309 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:38.398401 19842 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:38.399399 18378 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:38.400941 19840 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:38.401049 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 175797us
I20260709 13:17:38.393599 19738 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:17:38.407372 18377 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:38.390775 19776 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:17:38.411022 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 65132.1us
I20260709 13:17:38.409300 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:38.415280 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.416927 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.416647 20015 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:38.419212 20015 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:38.419610 20024 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:38.419872 18957 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:38.394606 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.391572 19940 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:38.425127 18202 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:38.416008 18309 raft_consensus.cc:2368] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:38.432729 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:38.433586 18377 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:17:38.436004 19635 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:38.436506 19635 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.437029 19635 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:38.426643 19951 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:38.428930 19940 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.433004 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:38.393942 19933 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.407105 19755 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.444253 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:38.435153 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.453097 18309 raft_consensus.cc:2368] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:17:38.468322 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.447578 19776 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:38.481906 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.485404 20020 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:38.484359 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 59355.6us
I20260709 13:17:38.489140 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:38.493680 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.467188 19745 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:38.495012 19951 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:38.512669 20055 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:17:38.514379 19624 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:38.517953 18312 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:38.519170 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.522038 18926 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:38.522868 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.523917 20050 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:38.486964 20020 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.530171 20020 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:38.532617 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:38.533838 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:38.492923 19753 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.010s	sys 0.011s
I20260709 13:17:38.502897 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:38.524276 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.536759 18309 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:17:38.520445 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.550165 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:38.551848 19387 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:38.552242 19387 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:38.552995 19387 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.554278 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:38.555023 18312 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:38.537773 19753 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.010s	sys 0.012s
W20260709 13:17:38.558470 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 143275us
I20260709 13:17:38.560578 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.552229 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:38.537963 19866 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:38.541956 20020 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:38.537621 18307 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:38.550449 20050 raft_consensus.cc:697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:38.569273 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:38.590865 20064 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:38.538091 19951 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:17:38.598263 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.599704 18304 raft_consensus.cc:2393] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:17:38.606783 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 121515us
W20260709 13:17:38.619454 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 50276us
I20260709 13:17:38.509063 19776 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.622000 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:38.627013 18312 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:17:38.628680 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.629426 18312 raft_consensus.cc:2393] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:38.630203 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.631562 18927 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:38.634061 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:38.636945 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.637368 20065 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:38.637669 18312 raft_consensus.cc:2368] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4.
I20260709 13:17:38.638037 20055 consensus_queue.cc:1059] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:38.638172 20065 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:38.638520 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:38.639120 20059 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:38.639498 19632 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.618767 19933 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:17:38.649976 19745 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.653923 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:38.655970 18312 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 2: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:38.664583 18309 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:38.668558 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:38.621174 19635 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.656745 20009 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.677137 19387 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.673547 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:38.678274 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.685079 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.688304 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.690009 19387 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:38.672544 20020 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:38.696911 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:38.669225 19632 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.681005 19951 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:38.680574 19863 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:17:38.714115 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:38.726018 19939 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:38.726660 19939 raft_consensus.cc:697] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:38.727577 19939 consensus_queue.cc:237] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:38.729554 20058 log.cc:927] Time spent T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:17:38.730015 19635 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:38.730829 20061 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:38.731232 20072 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:38.731914 20072 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:38.733734 20072 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.735479 20072 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.680752 20009 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.736855 20066 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.737720 20009 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:38.711308 19951 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.738518 19951 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:38.718066 20062 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:38.701086 20055 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:38.737421 20066 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.731257 20061 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:38.715617 20059 raft_consensus.cc:3055] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:38.684967 20011 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:17:38.695832 20050 consensus_queue.cc:237] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:38.772312 20062 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:38.780376 20062 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.782236 19940 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.732430 20069 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.084s
W20260709 13:17:38.778141 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.784430 19940 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:38.784976 20061 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.786754 20061 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.790244 20066 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:38.794872 19951 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.818360 19632 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:38.778090 20059 raft_consensus.cc:740] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:38.828469 20059 consensus_queue.cc:260] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.830252 20059 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.838544 19943 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.839313 19943 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.841619 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:38.842324 19864 raft_consensus.cc:3055] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:38.842728 19864 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:38.843881 19756 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:38.843607 19864 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.868687 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.844584 20038 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:38.845299 20009 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:38.865526 20017 raft_consensus.cc:3055] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:38.870926 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:38.872253 20045 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.592s	user 0.007s	sys 0.000s
I20260709 13:17:38.873889 19864 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.875207 19973 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:38.876549 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.923729 18308 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:38.878077 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:38.925287 18306 raft_consensus.cc:2410] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:38.878909 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.925348 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:38.881276 20034 raft_consensus.cc:3055] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:38.211826 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:38.884479 19951 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:38.884260 18309 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:38.887068 20062 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.880411 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:38.951308 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 108324us
I20260709 13:17:38.898205 20065 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:38.963135 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:38.963915 18235 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 4: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:38.963518 20065 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:38.899403 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 232633us
I20260709 13:17:38.965056 18351 leader_election.cc:400] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:38.965348 18351 leader_election.cc:403] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:38.904345 18201 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:38.966396 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 65348.1us
I20260709 13:17:38.967900 19866 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:38.845134 19776 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:38.970055 20069 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:38.918087 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:38.927373 19387 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:38.973003 18312 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:38.973686 20020 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:38.974112 20020 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:38.879305 19943 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:38.943445 20034 raft_consensus.cc:740] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:17:38.948308 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.975054 20020 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:38.976336 20020 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.979121 18201 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:38.981913 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:38.982174 18381 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:17:38.982491 18381 pending_rounds.cc:85] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 1
I20260709 13:17:38.982527 18386 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:38.982847 18381 pending_rounds.cc:107] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:17:38.983134 18381 raft_consensus.cc:2889] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:38.983675 18351 leader_election.cc:400] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:17:38.983987 18351 leader_election.cc:403] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:38.929243 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:38.950492 18307 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:38.955726 19760 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.949760 19672 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:38.956149 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:38.956439 20064 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:38.957513 18305 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:38.957644 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:38.958081 20062 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:38.958014 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:38.916775 20017 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:38.959044 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:38.960116 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:38.961141 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:38.962160 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:38.962853 18303 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:38.966459 18304 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:17:38.968317 19866 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:38.909754 19658 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:38.979822 20066 consensus_queue.cc:1059] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:38.980646 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:38.981228 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:38.985404 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:38.985471 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:38.953205 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:38.984205 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:38.984820 19943 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:17:38.993238 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64068.8us
I20260709 13:17:38.996600 20071 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:38.997108 18312 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:38.997918 18230 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:39.176200 18382 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.177479 18228 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
W20260709 13:17:39.156450 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.178442 18381 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:39.178987 20017 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:39.179704 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:39.127591 20034 consensus_queue.cc:260] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:38.999640 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:38.989446 20055 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3.
I20260709 13:17:39.177757 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:39.180354 20017 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:39.127485 20062 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.117877 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:39.190972 20034 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:39.191161 19866 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:39.118995 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:39.191953 19658 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:39.018765 18310 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:39.195398 20009 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:17:39.119805 18132 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39288 (request call id 176) took 11770 ms (client timeout 15000 ms). Trace:
I20260709 13:17:39.193035 20062 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:38.988888 19948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.021s	sys 0.034s
I20260709 13:17:39.191129 18380 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:38.987289 19819 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.214308 20076 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.212391 18377 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:39.213001 18236 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 4: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:38.998299 19672 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.221717 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:39.310434 18233 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:38.991946 20028 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:17:39.174324 20069 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:39.317396 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 331959us
I20260709 13:17:39.192485 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:39.358103 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:39.344388 18230 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:39.215813 19635 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:39.361294 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:39.311163 19943 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.352418 18381 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:39.016882 19760 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:39.064018 20064 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:39.316095 19948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.036s	sys 0.061s
I20260709 13:17:39.343011 19755 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.316756 19973 raft_consensus.cc:3055] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:17:39.386221 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.366485 18384 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:17:39.355309 19672 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:39.310616 20074 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:39.227110 20011 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.131s
I20260709 13:17:39.379681 18276 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:39.360888 19635 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.384927 18380 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:17:39.388729 20073 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:17:39.388928 19658 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:39.390439 19760 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:39.391608 20031 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:17:39.392135 20064 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:39.394621 18377 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:39.351491 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:39.415835 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:17:39.418326 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.392738 18121 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 943649b738074d87a593c237cf998758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 459e82ee6b564cc19be6f73186938e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:39.354023 20076 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:39.368887 19866 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:39.377959 20061 consensus_meta.cc:287] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.000s
I20260709 13:17:39.400830 18382 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:39.410420 19756 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:39.376590 18229 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:17:39.413273 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 348498us
I20260709 13:17:39.353658 19819 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:39.401695 18386 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:39.400728 19635 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:39.369415 18135 catalog_manager.cc:5697] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 2 to 3, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 3 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.385701 20081 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:39.393134 19973 raft_consensus.cc:740] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:39.409762 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:39.375331 19943 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:39.217921 18132 rpcz_store.cc:269] 0709 13:17:27.349376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.349679 (+   303us) service_pool.cc:224] Handling call
0709 13:17:39.119710 (+11770031us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:37.278968 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:37.279693 (+   725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:37.279750 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:17:37.279772 (+    22us) tablet.cc:662] Decoding operations
0709 13:17:37.280188 (+   416us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:37.280282 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:37.280309 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:37.286260 (+  5951us) tablet.cc:701] Row locks acquired
0709 13:17:37.286307 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:17:37.286483 (+   176us) write_op.cc:270] Start()
0709 13:17:37.286649 (+   166us) write_op.cc:276] Timestamp: P: 1783603057286420 usec, L: 0
0709 13:17:37.286684 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:17:37.287421 (+   737us) log.cc:844] Serialized 543 byte log entry
0709 13:17:37.623620 (+336199us) op_driver.cc:464] REPLICATION: finished
0709 13:17:37.883914 (+260294us) write_op.cc:301] APPLY: starting
0709 13:17:37.905219 (+ 21305us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:37.919692 (+ 14473us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:37.945399 (+ 25707us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:37.972391 (+ 26992us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:37.972726 (+   335us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:37.972803 (+    77us) write_op.cc:312] APPLY: finished
0709 13:17:37.973045 (+   242us) log.cc:844] Serialized 22 byte log entry
0709 13:17:37.973248 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:37.973332 (+    84us) write_op.cc:454] Released schema lock
0709 13:17:37.973394 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:37.973771 (+   377us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:37.973801 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13880,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":238049,"apply.run_cpu_time_us":3921,"apply.run_wall_time_us":89853,"num_ops":1,"prepare.queue_time_us":86152,"prepare.run_cpu_time_us":3485,"prepare.run_wall_time_us":77115,"replication_time_us":306383,"spinlock_wait_cycles":32128,"thread_start_us":162869,"threads_started":2}]]}
I20260709 13:17:39.476850 19387 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.513208 19387 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:39.478569 18382 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:17:39.466351 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.394972 20069 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:39.495715 19819 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:39.496876 18135 catalog_manager.cc:5697] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 3, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 3 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.510393 20076 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:39.524039 18233 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:39.448691 20065 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:39.396081 19755 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:39.466892 19756 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:39.533058 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1458) took 1118 ms. Trace:
I20260709 13:17:39.537235 18237 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:17:39.537457 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 137999us
I20260709 13:17:39.541252 18383 rpcz_store.cc:276] 0709 13:17:38.414456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.422075 (+  7619us) service_pool.cc:224] Handling call
0709 13:17:38.433393 (+ 11318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.671429 (+238036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.671467 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:38.684908 (+ 13441us) log.cc:844] Serialized 26 byte log entry
0709 13:17:38.918835 (+233927us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:38.918888 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.918983 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.532841 (+613858us) raft_consensus.cc:1685] finished
0709 13:17:39.532862 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.532997 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46009,"raft.queue_time_us":164328,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":5424,"thread_start_us":385671,"threads_started":2,"wal-append.queue_time_us":316640}
I20260709 13:17:39.529166 20081 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:39.547417 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:39.538694 18135 catalog_manager.cc:5697] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.552569 18232 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:39.560817 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:39.562698 18135 catalog_manager.cc:5697] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 3, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 3 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:39.565958 18135 catalog_manager.cc:5697] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:39.568166 18135 catalog_manager.cc:5697] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 3, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 3 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:39.569721 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.569978 18135 catalog_manager.cc:5697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 3, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 3 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.543593 19756 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:39.577193 18351 leader_election.cc:400] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4.
I20260709 13:17:39.577605 18351 leader_election.cc:403] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:39.578480 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.563824 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:39.571950 18135 catalog_manager.cc:5697] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 2 to 3, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 3 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.559679 19635 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:39.554041 20061 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.588685 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 990) took 1199 ms. Trace:
I20260709 13:17:39.590135 18383 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:39.601436 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:39.592763 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:39.544752 20062 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:39.600281 18309 rpcz_store.cc:276] 0709 13:17:38.389307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.950457 (+561150us) service_pool.cc:224] Handling call
0709 13:17:38.950766 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.986583 (+ 35817us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:17:39.357003 (+370420us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.588143 (+231140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.588231 (+    88us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:39.588299 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.588406 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.588609 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5163,"prepare.queue_time_us":459321,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":44,"raft.queue_time_us":11549,"thread_start_us":553193,"threads_started":2,"wal-append.queue_time_us":225008}
I20260709 13:17:39.593539 20081 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4.
I20260709 13:17:39.591291 19819 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:39.625556 19819 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:39.626889 18386 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:39.627741 19819 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:39.633098 19943 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:39.633497 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:39.634070 18232 raft_consensus.cc:2376] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3. Re-sending same reply.
I20260709 13:17:39.634868 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:39.637965 20089 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.171s	user 0.002s	sys 0.000s
I20260709 13:17:39.624837 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:39.643711 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 51044.2us
I20260709 13:17:39.646343 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 991) took 1253 ms. Trace:
I20260709 13:17:39.644646 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:17:39.651392 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.617327 19753 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:39.620657 20099 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.646876 18306 rpcz_store.cc:276] 0709 13:17:38.394330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.951492 (+557162us) service_pool.cc:224] Handling call
0709 13:17:38.951768 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.956376 (+  4608us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:17:39.341336 (+384960us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.645923 (+304587us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.645990 (+    67us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:39.646048 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.646132 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.646267 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":436431,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"thread_start_us":657614,"threads_started":2}
I20260709 13:17:39.640827 20062 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:39.685828 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:39.687829 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:39.588763 19973 consensus_queue.cc:260] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:39.656694 18229 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:39.690568 20099 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:39.687613 19753 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:39.747014 19943 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.765976 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:17:39.771232 20090 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:17:39.773307 20098 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:17:39.774449 20101 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:17:39.776448 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:39.777525 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:39.781191 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:39.782104 18229 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 2: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:39.782518 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:39.780124 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:17:39.798225 20034 consensus_meta.cc:287] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.005s
I20260709 13:17:39.800590 19635 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:39.779528 19943 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:39.801441 20099 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:39.802367 18235 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:39.803463 18230 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 4: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:39.807374 18230 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:39.851890 18230 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
W20260709 13:17:39.798250 19864 consensus_meta.cc:287] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.855s	user 0.009s	sys 0.001s
I20260709 13:17:39.860255 18308 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:39.860649 18230 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:39.864671 18230 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:39.786316 19755 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:39.906477 20093 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:39.947453 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:39.949108 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:39.950446 18202 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:39.951045 19755 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:39.950992 20071 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:39.952332 20099 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:39.953073 20099 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:39.954358 19635 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:39.954908 19635 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:39.955731 19635 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:39.956538 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.954348 20099 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:39.957290 18201 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:39.957885 20099 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:39.959368 18201 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:39.959360 20064 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:39.964740 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:39.965543 20034 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.966326 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:39.966261 20034 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:39.967640 20062 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:39.917366 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:39.968631 20062 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:39.970139 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 325572us
I20260709 13:17:39.971180 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:39.972185 20082 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:39.979202 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:39.980163 18377 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
W20260709 13:17:39.862725 20020 consensus_meta.cc:287] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.886s	user 0.011s	sys 0.001s
I20260709 13:17:39.929628 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1438) took 1020 ms. Trace:
I20260709 13:17:39.990365 19387 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:39.988909 18305 rpcz_store.cc:276] 0709 13:17:38.909130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.221239 (+312109us) service_pool.cc:224] Handling call
0709 13:17:39.312541 (+ 91302us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:39.529807 (+217266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.529849 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:39.539667 (+  9818us) log.cc:844] Serialized 52 byte log entry
0709 13:17:39.695647 (+155980us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:39.695690 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.875235 (+179545us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54001de554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:39.875306 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.929269 (+ 53963us) raft_consensus.cc:1685] finished
0709 13:17:39.929297 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.929556 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13465,"raft.queue_time_us":14011,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":6381,"spinlock_wait_cycles":428101376,"thread_start_us":130811,"threads_started":1,"wal-append.queue_time_us":311842}
I20260709 13:17:39.965615 19864 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:39.994503 20082 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:39.996008 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:39.972843 20009 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:39.968214 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:39.996994 20082 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:39.974490 20070 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:39.998284 20070 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.000993 20070 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:39.974565 19948 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:40.001778 19948 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.003989 19948 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:39.973233 20055 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:39.916213 19753 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:40.004716 20055 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:39.977219 20081 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:40.005721 20081 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.007162 20055 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:39.976624 20034 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:40.007795 20081 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:39.967094 20052 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:40.008359 20052 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:40.009271 20052 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:39.997285 20009 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.010600 20009 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:40.012677 19864 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:39.973225 19745 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:40.013499 19933 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:40.013712 20094 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:40.014204 20094 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.014580 20094 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:40.015280 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 52009.5us
W20260709 13:17:40.014593 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 53096.5us
I20260709 13:17:40.020298 19387 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.013936 20064 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:40.020356 18351 connection.cc:256] RPC call timeout handler was delayed by -1.2197296339998047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 13:17:40.031975 19387 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:40.034837 18351 connection.cc:256] RPC call timeout handler was delayed by -1.071229633999792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 13:17:40.035925 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.036186 19387 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:40.021919 18232 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:40.038879 20052 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:39.803220 19943 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:40.044291 20082 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:40.045342 20082 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:39.939998 19672 consensus_meta.cc:287] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260709 13:17:40.048481 19672 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.048817 20082 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:40.049863 18234 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 7. Ops: []
I20260709 13:17:40.050431 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:40.054184 19672 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:40.054512 20082 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:40.054924 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1073) took 1036 ms. Trace:
I20260709 13:17:40.055912 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:40.133531 18234 rpcz_store.cc:276] 0709 13:17:39.018956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.079048 (+ 60092us) service_pool.cc:224] Handling call
0709 13:17:39.185331 (+106283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.050355 (+865024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.052448 (+  2093us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b5400104ad4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:40.054845 (+  2397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1987747584}
W20260709 13:17:40.134315 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 78518.8us
I20260709 13:17:40.135565 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:40.135754 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.136844 19948 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:40.137912 19948 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.139669 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:40.057399 20112 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.130s	user 0.002s	sys 0.000s
I20260709 13:17:40.036967 19745 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:40.064879 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1441) took 1153 ms. Trace:
I20260709 13:17:40.141446 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1075) took 1041 ms. Trace:
I20260709 13:17:40.069895 19819 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:40.142310 19819 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:40.142023 19745 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:40.143572 19819 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:40.071637 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 75717.3us
I20260709 13:17:40.148897 20082 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:40.149654 19864 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:40.150674 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:40.151775 19864 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:40.077504 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:40.152752 20082 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.153795 20034 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:40.154110 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:40.154404 20034 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:40.155586 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.077870 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.155761 20034 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.156917 18233 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:40.158000 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.159096 20082 raft_consensus.cc:476] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 13:17:40.159252 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.158571 18351 leader_election.cc:400] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 3 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4.
I20260709 13:17:40.160944 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.161675 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:40.163177 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.163352 20082 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.165161 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:40.013774 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52778.1us
I20260709 13:17:40.103823 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:40.167645 20082 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:40.103915 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:40.168232 20082 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:40.171487 20082 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:40.180601 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:40.181306 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:40.181804 19948 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:40.182634 19948 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:40.183809 20078 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:40.184296 20078 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:40.109081 20081 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:40.185281 20081 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.185555 20078 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.187139 20078 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:40.187942 20081 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:40.189533 20034 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.192734 19948 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:40.193470 19948 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:40.195195 20113 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:17:40.110657 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.032083 20069 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:40.027709 19973 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.203325 19948 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:39.935153 19756 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.207465 19756 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:40.131558 20055 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.250110 20055 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:40.070813 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 102667us
I20260709 13:17:40.253535 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:40.254582 20034 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.255422 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:40.256960 19753 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.258095 20055 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:40.141604 18310 rpcz_store.cc:276] 0709 13:17:38.911458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.389852 (+478394us) service_pool.cc:224] Handling call
0709 13:17:39.390247 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:39.398429 (+  8182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.398477 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:39.411834 (+ 13357us) log.cc:844] Serialized 52 byte log entry
0709 13:17:39.612620 (+200786us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:39.673552 (+ 60932us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.673795 (+   243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.673887 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.870906 (+197019us) spinlock_profiling.cc:243] Waited 7.69 ms on lock 0x7b18003d2400. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:17:39.963614 (+ 92708us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b18003d2400. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1542a6 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1
0709 13:17:39.964010 (+   396us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b18003d2400. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:17:40.064611 (+100601us) raft_consensus.cc:1685] finished
0709 13:17:40.064639 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.064811 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7591,"prepare.queue_time_us":64741,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":8937,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":20763,"spinlock_wait_cycles":39543808,"thread_start_us":134997,"threads_started":1,"wal-append.queue_time_us":225220}
I20260709 13:17:40.141812 18228 rpcz_store.cc:276] 0709 13:17:39.100395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.189947 (+ 89552us) service_pool.cc:224] Handling call
0709 13:17:39.190349 (+   402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:39.198491 (+  8142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.198526 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:39.214988 (+ 16462us) log.cc:844] Serialized 52 byte log entry
0709 13:17:39.572151 (+357163us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b1800363280. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:17:39.692640 (+120489us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:39.701440 (+  8800us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.721938 (+ 20498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.722037 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.141152 (+419115us) raft_consensus.cc:1685] finished
0709 13:17:40.141257 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.141391 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132621,"prepare.queue_time_us":8401,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":16672,"raft.queue_time_us":28383,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":21523,"spinlock_wait_cycles":3533056,"thread_start_us":120247,"threads_started":1,"wal-append.queue_time_us":628812}
I20260709 13:17:40.259866 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.260177 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:40.261574 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:40.262238 18228 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:40.151996 19745 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:40.263103 19864 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:40.130801 20031 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.264742 19864 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:40.265012 20031 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:40.124696 19866 consensus_meta.cc:287] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.675s	user 0.008s	sys 0.003s
I20260709 13:17:40.210072 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:40.208271 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.220857 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.224263 20078 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:40.292914 20078 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:40.296581 20078 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:40.228962 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 100738us
I20260709 13:17:40.297143 19943 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.298367 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:40.272461 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.300067 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.284597 20031 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:40.247694 20015 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:40.303931 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:40.304373 20015 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:40.306561 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:40.309088 20031 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:40.309587 20031 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.309998 20031 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:40.313234 20081 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:40.314116 20081 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:40.315980 20034 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.317277 18384 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:40.318697 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:40.319095 18378 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3. Ops: []
W20260709 13:17:40.319252 18231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.041s	sys 0.177s
W20260709 13:17:40.324326 18231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.041s	sys 0.177s
I20260709 13:17:40.326406 20009 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:40.320472 18381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.060s	sys 0.129s
W20260709 13:17:40.374068 18381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.060s	sys 0.129s
I20260709 13:17:40.327687 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:40.298125 19943 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.329897 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:40.371943 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:40.435565 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.440289 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.441874 18228 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:40.445139 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:40.449039 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:40.449952 18310 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:40.451900 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.442874 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1203) took 1430 ms. Trace:
I20260709 13:17:40.454376 18381 rpcz_store.cc:276] 0709 13:17:39.012933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.393133 (+380200us) service_pool.cc:224] Handling call
0709 13:17:39.393406 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.413376 (+ 19970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.413409 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.413818 (+   409us) log.cc:844] Serialized 26 byte log entry
0709 13:17:39.639240 (+225422us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b180028f4e0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:17:40.374644 (+735404us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:40.374711 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.374820 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.374889 (+    69us) raft_consensus.cc:1685] finished
0709 13:17:40.374910 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.442784 (+ 67874us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2432,"raft.queue_time_us":10882,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":46707,"spinlock_wait_cycles":4345472,"thread_start_us":735138,"threads_started":1,"wal-append.queue_time_us":870800}
W20260709 13:17:40.461141 20117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.058s	sys 0.074s
W20260709 13:17:40.461629 20117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.058s	sys 0.074s
I20260709 13:17:40.463924 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.464563 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:40.465551 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.466892 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.436901 19753 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.467543 18231 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:40.467885 19753 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.474516 18379 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:40.477900 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:40.479068 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:40.493072 18236 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:40.375761 20015 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:40.493721 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.498685 19973 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:40.499372 19973 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:40.500630 18230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.010s	sys 0.013s
W20260709 13:17:40.501169 18230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.010s	sys 0.013s
I20260709 13:17:40.494081 19745 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:40.511443 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:40.513592 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.513800 18351 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:40.473297 20078 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:17:40.496795 18229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.015s	sys 0.007s
I20260709 13:17:40.501682 19973 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:40.517601 20078 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.508426 19745 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.523524 20009 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:40.494791 20066 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.523329 20031 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.491710 20093 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:40.532454 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:40.525820 18229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.016s	sys 0.007s
I20260709 13:17:40.516176 20055 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.516028 19948 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:40.533007 19745 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.527253 20078 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:40.332577 20094 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.527438 19753 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:40.553668 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:40.554157 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:40.554396 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:40.555238 18377 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:40.556262 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:40.560108 18232 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 5: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:40.560212 18379 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:40.561791 18381 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:17:40.562559 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.557186 20094 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:40.547739 20093 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:40.571831 20093 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:40.573150 19948 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:40.573864 19948 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:40.577836 20120 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:17:40.577613 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:40.600953 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 407527us
I20260709 13:17:40.603547 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:40.612464 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:40.614019 20009 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.614308 20031 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:40.587224 19948 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:40.619985 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:40.620946 18233 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:40.606633 20062 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.006s	sys 0.032s
W20260709 13:17:40.615453 18307 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.018s	sys 0.018s
I20260709 13:17:40.614758 20009 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:40.623219 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 361708us
I20260709 13:17:40.697630 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:40.632046 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1084) took 1233 ms. Trace:
W20260709 13:17:40.615656 20052 consensus_meta.cc:287] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.000s
I20260709 13:17:40.649477 20094 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:40.651122 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:40.653357 18303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.016s	sys 0.027s
W20260709 13:17:40.700695 18303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.016s	sys 0.027s
I20260709 13:17:40.699232 18236 rpcz_store.cc:276] 0709 13:17:39.398665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.399896 (+  1231us) service_pool.cc:224] Handling call
0709 13:17:40.631803 (+1231907us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b5400329454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:40.631938 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1972487040}
W20260709 13:17:40.694063 20062 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.006s	sys 0.032s
I20260709 13:17:40.686807 19387 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:40.705134 18384 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
W20260709 13:17:40.693979 18307 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.018s	sys 0.019s
W20260709 13:17:40.652637 20020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.012s	sys 0.029s
W20260709 13:17:40.709508 18237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.012s	sys 0.042s
I20260709 13:17:40.706617 19387 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:40.710144 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.710140 18237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.012s	sys 0.043s
I20260709 13:17:40.716331 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:40.718143 18378 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:40.651948 18276 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:17:40.721501 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 69650.5us
W20260709 13:17:40.723106 18235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.005s	sys 0.034s
W20260709 13:17:40.723464 18235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.005s	sys 0.034s
I20260709 13:17:40.728416 18233 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
W20260709 13:17:40.706840 19635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.015s	sys 0.043s
I20260709 13:17:40.731246 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:40.713970 20020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.013s	sys 0.029s
I20260709 13:17:40.706365 19866 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:40.716820 20034 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.712692 19943 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:40.729614 19776 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.028s
W20260709 13:17:40.737035 19635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.016s	sys 0.043s
I20260709 13:17:40.735651 19756 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.741153 20066 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:17:40.756050 19776 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.007s	sys 0.028s
I20260709 13:17:40.746968 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1086) took 1300 ms. Trace:
I20260709 13:17:40.706502 20094 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:40.759572 19387 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:40.765574 19756 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.796746 18229 rpcz_store.cc:276] 0709 13:17:39.446900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.782912 (+336012us) service_pool.cc:224] Handling call
0709 13:17:39.783364 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.783857 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.783907 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.784480 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:17:40.550567 (+766087us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:40.552473 (+  1906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.563367 (+ 10894us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.746672 (+183305us) raft_consensus.cc:1685] finished
0709 13:17:40.746704 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.746898 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14836,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":584797,"threads_started":1,"wal-append.queue_time_us":857987}
I20260709 13:17:40.799073 20094 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:40.759146 20133 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.800266 20009 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:40.782948 20020 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:40.800731 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:40.801486 18959 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:40.801178 20020 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:40.805119 20066 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:40.806777 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:40.790405 20034 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:40.790174 20078 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.786161 18378 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:17:40.783641 19745 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:40.809338 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 312855us
I20260709 13:17:40.805135 20020 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:40.753113 19866 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.798646 19756 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:40.824285 20125 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:40.827679 18383 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:40.829535 18381 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:40.837414 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.838114 18230 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:17:40.816669 19864 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:40.845147 18379 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:40.847309 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:40.848156 18311 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:17:40.852099 20020 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.906733 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:40.907644 18383 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:40.848593 20066 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.911815 20093 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.904789 20094 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:40.929060 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:40.930435 20093 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:40.932394 20094 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.935042 20094 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:40.936331 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:40.937047 18229 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:40.939254 18383 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:40.940987 20078 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:40.925737 20062 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:40.942260 20062 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:40.943434 20093 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:40.944914 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1435) took 2037 ms. Trace:
I20260709 13:17:40.945493 18307 rpcz_store.cc:276] 0709 13:17:38.907441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.120796 (+213355us) service_pool.cc:224] Handling call
0709 13:17:39.979685 (+858889us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b58000e1398. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14ee9c 00007fa17f14ea5b 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:17:39.979925 (+   240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.980404 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.980457 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.981045 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:17:40.729770 (+748725us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:40.767470 (+ 37700us) log.cc:844] Serialized 14 byte log entry
0709 13:17:40.811205 (+ 43735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.814852 (+  3647us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.840542 (+ 25690us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b18003dada0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:17:40.857021 (+ 16479us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b18003dada0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:17:40.871466 (+ 14445us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b18003dada0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:17:40.944604 (+ 73138us) raft_consensus.cc:1685] finished
0709 13:17:40.944636 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.944835 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1683,"prepare.queue_time_us":30079,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":47532,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":803,"spinlock_wait_cycles":104528640,"thread_start_us":728144,"threads_started":1,"wal-append.queue_time_us":807363}
I20260709 13:17:40.872988 20020 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:40.985392 18202 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.772s (SENT)
I20260709 13:17:40.986063 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:40.993575 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.994488 18230 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 1.
I20260709 13:17:40.996382 20094 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.997246 19866 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:41.001080 20031 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:41.001891 20031 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.022204 18229 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:41.026258 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:40.995644 20078 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:41.027129 20078 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:40.974378 20124 log.cc:927] Time spent T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.099s	user 0.001s	sys 0.001s
I20260709 13:17:41.029742 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:41.030073 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:41.030510 18383 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:41.030711 18379 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:17:41.033342 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 302847us
I20260709 13:17:41.033740 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:41.052915 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:41.054252 18277 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:41.055505 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:41.072012 19387 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.072609 19387 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.053262 20052 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:41.126952 19387 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:41.129691 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:41.130496 18383 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
W20260709 13:17:41.095407 18201 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.131:44265 timed out after 1.704s (SENT) [suppressed 4 similar messages]
I20260709 13:17:41.056914 19864 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:41.056828 20009 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.121822 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 957) took 1040 ms. Trace:
I20260709 13:17:41.054585 20031 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:41.061654 19948 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:41.128878 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1090) took 1622 ms. Trace:
I20260709 13:17:41.067215 20062 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:41.065644 20055 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:41.142666 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1437) took 2234 ms. Trace:
I20260709 13:17:41.061992 20133 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
W20260709 13:17:41.174201 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 451912us
I20260709 13:17:41.176867 18303 rpcz_store.cc:276] 0709 13:17:38.908553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.217902 (+309349us) service_pool.cc:224] Handling call
0709 13:17:39.341714 (+123812us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.351160 (+  9446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.351194 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:40.002578 (+651384us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b2c0010c0c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:17:40.003058 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:17:40.701161 (+698103us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:41.051231 (+350070us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.069552 (+ 18321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.069666 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.069704 (+    38us) raft_consensus.cc:1685] finished
0709 13:17:41.142397 (+ 72693us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.142589 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48699,"prepare.queue_time_us":11164,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":76625,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":24882,"spinlock_wait_cycles":6587136,"thread_start_us":1036855,"threads_started":2,"wal-append.queue_time_us":769758}
I20260709 13:17:41.079201 20057 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:41.143661 18237 rpcz_store.cc:276] 0709 13:17:40.081405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.081531 (+   126us) service_pool.cc:224] Handling call
0709 13:17:40.081852 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:40.086817 (+  4965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:40.086871 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:40.087777 (+   906us) log.cc:844] Serialized 52 byte log entry
0709 13:17:40.715017 (+627240us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:41.121004 (+405987us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.121361 (+   357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.121485 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.121541 (+    56us) raft_consensus.cc:1685] finished
0709 13:17:41.121559 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.121744 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4470,"raft.queue_time_us":25393,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":12808,"thread_start_us":1004784,"threads_started":2,"wal-append.queue_time_us":835520}
I20260709 13:17:41.125968 20052 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:41.184157 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:17:41.143067 20127 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:17:41.181200 20128 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:41.175773 20031 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:41.139003 19756 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:17:41.182859 20052 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:41.203516 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 281333us
I20260709 13:17:41.179946 20062 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:41.141956 20137 consensus_queue.cc:1059] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:17:41.150502 20034 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:17:41.215181 18927 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:41.178413 19948 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.181631 19819 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:17:41.208617 20113 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:41.183321 20055 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.207571 19973 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.210842 20078 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:41.240756 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 170046us
I20260709 13:17:41.215097 19635 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.242693 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:41.211114 20031 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.185408 18235 rpcz_store.cc:276] 0709 13:17:39.506074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.804278 (+298204us) service_pool.cc:224] Handling call
0709 13:17:39.805117 (+   839us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.805483 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.805520 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.805981 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:17:40.006585 (+200604us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b18001c5be0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:17:40.723830 (+717245us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:41.065504 (+341674us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.067223 (+  1719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.067317 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.072991 (+  5674us) raft_consensus.cc:1685] finished
0709 13:17:41.128481 (+ 55490us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.128826 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15528,"raft.queue_time_us":887,"raft.run_cpu_time_us":463,"raft.run_wall_time_us":63722,"spinlock_wait_cycles":11905920,"thread_start_us":1030101,"threads_started":2,"wal-append.queue_time_us":1050751}
I20260709 13:17:41.234791 20113 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.252044 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.226311 20066 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:41.258025 20066 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.265105 20066 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:41.216224 20062 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.267406 20062 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:41.248950 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:41.254958 19635 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.271852 19635 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:41.238909 19973 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:41.273830 20137 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:41.274289 20137 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:41.276147 20133 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:41.273691 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:41.280501 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 140517us
I20260709 13:17:41.276655 20137 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.297928 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:41.300206 20162 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:41.300906 20162 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:41.302661 20141 log.cc:927] Time spent T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:41.303722 20138 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:41.304100 20138 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:41.304421 20138 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:41.253307 20078 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:41.324739 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.325001 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.326093 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.326704 18304 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:41.274500 20009 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:41.278457 20113 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.327533 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.274868 19973 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:41.330470 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 234685us
I20260709 13:17:41.349575 18312 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.358695 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.359556 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.359746 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:41.360225 18306 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:17:41.362109 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.362820 18304 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:41.363732 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.364347 18312 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:41.308641 19864 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:41.366071 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.360186 18308 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:41.329488 20133 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:17:41.374259 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 159194us
I20260709 13:17:41.374442 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.379967 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:41.384433 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:41.428763 18310 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:41.372401 20137 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.429252 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.429858 20066 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:17:41.380553 20140 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:17:41.368937 20009 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:41.430790 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.431682 20009 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.307796 20155 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:17:41.374004 19866 consensus_queue.cc:1059] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:17:41.376305 19973 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:41.427006 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 51087us
I20260709 13:17:41.375095 18308 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
W20260709 13:17:41.429471 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.430438 20066 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.438608 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:41.433236 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 972) took 1056 ms. Trace:
I20260709 13:17:41.433509 18229 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:17:41.338788 20078 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.441095 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.442413 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:41.432695 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 57724.7us
I20260709 13:17:41.448158 18231 rpcz_store.cc:276] 0709 13:17:40.391114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.468290 (+ 77176us) service_pool.cc:224] Handling call
0709 13:17:40.475037 (+  6747us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:40.475646 (+   609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:40.475698 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:40.493979 (+ 18281us) log.cc:844] Serialized 26 byte log entry
0709 13:17:40.889648 (+395669us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:40.889707 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.889809 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.432996 (+543187us) raft_consensus.cc:1685] finished
0709 13:17:41.433022 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.433184 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4977,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":12147,"thread_start_us":373699,"threads_started":1,"wal-append.queue_time_us":552971}
I20260709 13:17:41.455551 19948 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:41.456110 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.457695 18308 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:41.459434 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:41.442739 20163 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.445852 20146 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:41.469645 18308 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:41.472267 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:41.473057 18383 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:41.473313 18311 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:17:41.473694 18311 pending_rounds.cc:85] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 1
I20260709 13:17:41.447022 20133 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:41.473969 18311 pending_rounds.cc:107] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:17:41.474275 18311 raft_consensus.cc:2889] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:41.474756 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:41.456259 19948 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:41.476431 18383 raft_consensus.cc:2410] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:41.477281 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:41.478888 18382 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:17:41.478912 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 292948us
I20260709 13:17:41.443902 19973 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.489802 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:41.489672 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:17:41.505048 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.505861 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:41.506407 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:41.504886 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:41.508153 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:41.509061 18378 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 7: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:41.511425 18385 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:17:41.519378 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:41.522100 18382 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:41.473153 20146 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.531095 20146 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:41.530755 20133 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.542675 20176 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:41.543670 20160 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:17:41.543282 20176 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.544662 19387 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.545133 19387 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:41.517707 20139 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:41.546965 20139 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.547216 20176 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:41.547382 20139 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:41.549978 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.522660 20162 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:41.556006 20171 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:41.558647 20066 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:41.562781 18306 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:41.587808 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.562477 19387 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.475085 20167 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:17:41.578473 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.581365 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:41.590164 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 137170us
I20260709 13:17:41.611385 18304 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:41.584311 18310 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
W20260709 13:17:41.659230 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 158821us
I20260709 13:17:41.668583 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:41.669593 18233 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:41.568137 20020 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:41.677385 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:41.678700 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.678233 18231 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:41.678772 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:41.683024 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.683274 18306 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:17:41.684906 18306 pending_rounds.cc:85] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 1
I20260709 13:17:41.685150 18306 pending_rounds.cc:107] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:17:41.685374 18306 raft_consensus.cc:2889] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:41.480748 20163 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:41.687368 18926 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:41.686900 18233 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:41.689236 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:41.689895 18236 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:41.693938 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:41.694547 18236 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:41.694470 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:41.696846 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:41.697499 18233 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:41.701591 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.702310 18308 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:41.673063 20176 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:41.703055 18231 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:41.704739 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.710445 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.743130 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:41.745381 18229 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.742690 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:41.748072 18237 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:41.750012 18231 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:41.750738 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:41.751739 18230 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:41.752421 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:41.753383 18235 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:41.753587 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:41.754544 18236 raft_consensus.cc:2368] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5.
I20260709 13:17:41.716653 20015 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:41.762074 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 67682us
I20260709 13:17:41.763561 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:41.772571 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:41.772662 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:41.746461 20135 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:41.686851 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:41.784315 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:41.687422 20094 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:17:41.791227 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:41.793143 18237 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 7: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:41.694736 19948 raft_consensus.cc:697] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:41.777693 20078 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:41.823488 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 59994.6us
I20260709 13:17:41.826318 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:41.825234 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:41.827389 18234 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:41.754459 20176 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:41.804215 20066 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.842772 20066 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.843459 20187 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:41.845108 20185 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:41.845486 20185 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:41.845829 20185 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:41.845891 20173 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:41.850713 20194 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:41.851112 20163 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:41.852592 20170 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:41.853297 20170 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:41.837603 19973 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:41.783375 18229 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:41.812870 19942 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:41.858870 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:41.839474 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:41.866773 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:41.789549 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 120748us
W20260709 13:17:41.856679 20180 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:17:41.876178 18201 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:41.846328 20173 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:17:41.855860 20052 consensus_meta.cc:287] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.000s
W20260709 13:17:41.892587 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 148418us
I20260709 13:17:41.897922 18201 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:41.947216 18234 raft_consensus.cc:2410] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:41.851117 20194 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:41.911705 20182 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:41.943614 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:41.942451 20066 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:41.872357 19942 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:41.976928 19387 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.953313 20194 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.906303 20052 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.855860 20185 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.842036 19948 consensus_queue.cc:237] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:41.965915 20182 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.021276 18379 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:42.028658 18237 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:17:42.052608 18383 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:42.057559 19387 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:42.013622 20182 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.074316 19387 raft_consensus.cc:697] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:42.060847 20193 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:42.089895 19387 consensus_queue.cc:237] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.080802 20066 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.972560 20173 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.129791 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:42.146575 19942 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:42.088261 20193 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:42.149552 20201 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:42.150281 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:42.151081 18312 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:42.154458 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:42.128273 20186 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:17:42.142288 20137 consensus_meta.cc:287] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.001s
I20260709 13:17:42.128350 20176 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:42.109143 20066 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.198557 20066 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:42.180127 18305 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
W20260709 13:17:42.181532 20195 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 13:17:42.200248 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 374025us
W20260709 13:17:42.182075 20196 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:17:42.183990 20055 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:42.188297 20031 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:42.187903 20194 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.190253 19745 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:42.201050 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:42.210165 20182 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.109179 20147 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:42.215378 20139 consensus_meta.cc:287] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.667s	user 0.006s	sys 0.005s
I20260709 13:17:42.215961 20052 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:42.100167 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 202447us
W20260709 13:17:42.222525 20113 consensus_meta.cc:287] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.861s	user 0.012s	sys 0.000s
I20260709 13:17:42.236881 18201 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:42.240202 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 410154us
I20260709 13:17:42.242198 18201 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:42.243887 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 296096us
W20260709 13:17:42.240641 20138 consensus_meta.cc:287] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.936s	user 0.008s	sys 0.005s
I20260709 13:17:42.249424 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:42.282481 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:42.284718 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:42.247597 20204 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:17:42.244102 20181 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:42.295032 20020 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:42.246929 20206 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:42.239679 20147 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.240810 20113 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.239288 20139 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:42.312234 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 56118.3us
I20260709 13:17:42.320677 20192 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:42.293640 20188 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:42.286391 20202 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:17:42.299998 20020 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.337741 18307 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:42.337966 18959 raft_consensus.cc:2393] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 6: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:17:42.321344 20176 raft_consensus.cc:2764] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:17:42.287674 20138 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:42.364007 20113 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:42.365371 20138 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:42.345124 20193 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:42.351066 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:42.359611 20147 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:42.361095 20182 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:42.361171 20139 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:42.322824 20222 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:42.341888 20188 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:42.362394 20194 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:42.370641 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:42.377727 18312 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:17:42.374522 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:42.375366 18383 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.376082 18380 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.379721 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:42.380309 18379 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:42.377746 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 95380.1us
I20260709 13:17:42.385082 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:42.385648 18386 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:42.402688 18379 raft_consensus.cc:2410] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:42.405520 18310 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:17:42.409819 18312 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
W20260709 13:17:42.410288 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 125658us
I20260709 13:17:42.410490 18201 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:42.374104 20222 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:42.411696 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:42.349398 19819 consensus_queue.cc:1059] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:17:42.380014 20176 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:17:42.384760 18121 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 943649b738074d87a593c237cf998758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 459e82ee6b564cc19be6f73186938e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:17:42.430846 18121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 48143.2us
W20260709 13:17:42.432174 20213 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:17:42.433005 18383 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:42.439622 20210 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:42.440083 20210 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.441984 20188 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.443089 20231 raft_consensus.cc:2764] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:17:42.444334 20020 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:42.396664 20206 raft_consensus.cc:697] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:17:42.457607 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.456079 18380 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:42.466810 18276 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:42.414492 20222 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.461066 20210 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.470325 20226 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:42.462384 20176 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:42.489194 20173 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.491195 20206 consensus_queue.cc:237] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.471889 20225 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:17:42.492769 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 81172.8us
I20260709 13:17:42.471302 20113 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:17:42.471503 20034 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:17:42.499800 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:42.497596 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:42.493672 20020 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.494421 20225 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.508165 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:42.509696 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:42.511817 18229 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.514451 20176 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:42.516270 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:42.516906 18237 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:42.510546 20232 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:42.518172 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:42.495405 20182 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.526937 18229 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:17:42.532917 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:42.534050 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:42.535701 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:42.487672 20226 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:42.521349 20225 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.536338 20232 raft_consensus.cc:2764] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:17:42.549343 20176 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:42.535817 19635 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:42.520967 20020 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.539091 20094 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:42.562039 20176 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:42.574965 18237 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:17:42.569207 20176 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.580399 18202 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:42.583110 20230 raft_consensus.cc:2764] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:17:42.587636 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:42.587888 19864 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.588100 20234 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:17:42.588577 20230 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:42.588431 19864 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.590680 19864 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:42.592374 20234 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:42.592880 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:42.598163 18379 raft_consensus.cc:2410] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:42.538012 20182 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.621686 18927 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:42.557583 20231 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:17:42.614413 18959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54004 (request call id 206) took 1008 ms. Trace:
I20260709 13:17:42.616295 20020 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:42.622891 18959 rpcz_store.cc:276] 0709 13:17:41.605861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.659042 (+ 53181us) service_pool.cc:224] Handling call
0709 13:17:42.614195 (+955153us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54006c8ed4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:42.614328 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268991360}
I20260709 13:17:42.626089 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:42.627058 20139 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:42.627588 20139 raft_consensus.cc:697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:42.628784 20139 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:42.626245 20015 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:17:42.662365 20236 log.cc:927] Time spent T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:17:42.610579 20094 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.665917 20094 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.668740 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1453) took 1343 ms. Trace:
I20260709 13:17:42.669127 18309 rpcz_store.cc:276] 0709 13:17:41.325217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.326857 (+  1640us) service_pool.cc:224] Handling call
0709 13:17:41.327202 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.321805 (+994603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:42.321836 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:42.321878 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:42.321914 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.668480 (+346566us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b5400355054. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:42.668565 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.668688 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2286958848}
I20260709 13:17:42.669983 20182 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:42.670454 20226 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:42.671597 20015 raft_consensus.cc:697] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:42.693445 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:42.694662 20062 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.695281 20062 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.668215 20094 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:42.656687 20231 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.702363 20183 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:42.702884 20062 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:42.704165 20015 consensus_queue.cc:237] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:42.706521 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 505519us
I20260709 13:17:42.707283 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:42.708154 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:42.716581 19745 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:42.716856 20052 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:42.717118 19745 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:42.717461 20052 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:42.717667 19745 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.717991 20052 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.721397 20231 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.723730 20231 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:42.738790 20176 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.742841 20225 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.744939 19948 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:42.746543 20210 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.703012 20183 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:42.756742 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 82487us
W20260709 13:17:42.762398 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54317.5us
I20260709 13:17:42.763787 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:42.761839 19948 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:42.772883 20210 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:42.773939 19948 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:42.749783 20222 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.776615 20222 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:42.775887 19745 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.780191 18926 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:42.782704 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:42.783167 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 152374us
I20260709 13:17:42.783447 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:42.786064 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:42.790143 18385 raft_consensus.cc:2410] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:42.790663 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:42.790901 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:42.791292 18379 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.791584 18385 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:42.795077 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:42.795356 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:42.788149 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.805217 18379 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:42.808426 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:42.780972 20055 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:17:42.816984 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 53310.1us
I20260709 13:17:42.817044 18201 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:42.823414 18385 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:42.825928 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:42.826563 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:42.861073 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:42.861364 18201 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:42.840173 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.869777 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:42.870501 18234 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:42.870774 18232 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:42.871373 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:42.871445 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:42.872150 18236 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:42.872339 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:42.873338 18232 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:42.873751 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:42.828233 20188 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:42.827381 20052 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.875418 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:42.883715 20216 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:42.862226 20206 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:42.884274 20216 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:42.880249 19948 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:42.885480 20170 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:42.886205 20219 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:17:42.886607 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:42.887192 20216 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:42.887818 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:42.888036 20218 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.886229 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:42.888733 20218 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:42.885511 19948 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:42.890578 20169 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:42.890784 19948 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.891230 20169 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:42.886489 20181 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:42.814605 18309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:42.898666 18309 raft_consensus.cc:606] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:42.899156 18309 raft_consensus.cc:614] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:42.814677 20139 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.816428 20066 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:42.900540 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:42.896610 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1455) took 1570 ms. Trace:
I20260709 13:17:42.901885 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:42.902348 18307 rpcz_store.cc:276] 0709 13:17:41.325836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.431974 (+106138us) service_pool.cc:224] Handling call
0709 13:17:41.432316 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:42.338248 (+905932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.896249 (+558001us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54000cadd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:42.896530 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081649024}
I20260709 13:17:42.825309 20055 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:42.878176 20031 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:42.833178 20194 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:42.875623 20094 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:17:42.901576 20172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.015s	sys 0.043s
I20260709 13:17:42.902113 20181 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.910233 20055 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:42.920814 20172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.018s	sys 0.045s
I20260709 13:17:42.913436 20194 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:42.959780 20194 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.964738 20176 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:42.966914 19745 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:42.967198 20169 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:42.969144 20242 log.cc:927] Time spent T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:42.970867 20052 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:42.973151 20225 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:42.928750 20057 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:42.973918 20057 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.974814 20218 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:42.927255 20094 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:42.920951 20031 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:42.922394 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:42.984858 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:42.907999 20066 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:42.983551 20031 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:43.005003 20241 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:17:43.008898 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:43.009341 18309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:42.986893 20094 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.010124 18309 raft_consensus.cc:606] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:43.010551 18309 raft_consensus.cc:614] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:43.009069 20194 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:43.011543 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 134957us
W20260709 13:17:43.013916 18351 connection.cc:256] RPC call timeout handler was delayed by -1.0340491810000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
I20260709 13:17:42.987320 20057 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:43.019320 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.020605 19745 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:43.020839 20052 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:43.021469 20052 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.021343 19745 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:43.022840 20183 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:43.023829 18228 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:43.023928 20052 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:43.026415 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:43.029523 20137 raft_consensus.cc:3055] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:43.030128 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:43.033937 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:43.034860 18228 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:43.036453 20066 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:43.037034 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:43.038231 20066 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:43.038718 20066 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:43.039636 20066 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:43.040176 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 134) took 1570 ms. Trace:
I20260709 13:17:43.040607 18384 rpcz_store.cc:276] 0709 13:17:41.470226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.470626 (+   400us) service_pool.cc:224] Handling call
0709 13:17:41.480151 (+  9525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.893407 (+413256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.893458 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:41.894159 (+   701us) log.cc:844] Serialized 26 byte log entry
0709 13:17:42.013060 (+118901us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:42.025312 (+ 12252us) log.cc:844] Serialized 14 byte log entry
0709 13:17:42.025595 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.677091 (+651496us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b18000ae280. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa18614758f 00007fa17f186571 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd
0709 13:17:43.039860 (+362769us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540012b454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:43.039925 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:43.039973 (+    48us) raft_consensus.cc:1685] finished
0709 13:17:43.039987 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.040118 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56920,"prepare.queue_time_us":11414,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":125397,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":3680,"spinlock_wait_cycles":651577856,"thread_start_us":184065,"threads_started":2,"wal-append.queue_time_us":200155}
I20260709 13:17:43.047880 20218 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:43.009222 20148 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:43.049592 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:43.057677 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1231) took 1552 ms. Trace:
I20260709 13:17:43.058084 18378 rpcz_store.cc:276] 0709 13:17:41.505637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.509510 (+  3873us) service_pool.cc:224] Handling call
0709 13:17:41.509875 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.752163 (+242288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.752199 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:41.777029 (+ 24830us) log.cc:844] Serialized 26 byte log entry
0709 13:17:41.908037 (+131008us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:41.908081 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.048975 (+1140894us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b54000f2654. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:43.049023 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:43.049070 (+    47us) raft_consensus.cc:1685] finished
0709 13:17:43.049083 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.057609 (+  8526us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":160526,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3492,"spinlock_wait_cycles":23647488,"thread_start_us":336679,"threads_started":2,"wal-append.queue_time_us":221981}
I20260709 13:17:43.061221 18312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:43.062052 18312 raft_consensus.cc:606] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:43.062505 18312 raft_consensus.cc:614] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:43.056110 20218 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:43.063450 20218 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:43.063663 20052 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:43.064234 20052 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:43.064802 20052 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:43.064384 20218 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.065419 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:43.065752 20218 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:43.063755 19745 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:43.074210 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.074862 18303 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:43.075644 20216 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.075986 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.076390 18305 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:43.076759 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:43.076882 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:43.077474 18312 raft_consensus.cc:2368] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:17:43.076122 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.057948 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:43.030047 20137 raft_consensus.cc:740] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:43.083633 18308 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:43.075690 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.099813 18351 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:43.044114 20181 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.100170 18303 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:43.101779 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:43.103521 20169 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:43.104686 20169 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:43.107627 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.108868 18306 raft_consensus.cc:2410] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:43.109318 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:43.109833 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:43.119540 18306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "943649b738074d87a593c237cf998758"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:43.120456 18306 raft_consensus.cc:606] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:43.121318 18306 raft_consensus.cc:614] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:43.120354 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:43.048941 20148 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.124715 18309 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:43.102537 19745 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:43.126045 19745 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.126538 19745 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:43.129724 20057 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:43.115221 20066 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.130324 20057 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.102145 20183 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:43.135842 20181 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:43.136766 20192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.024s	sys 0.008s
I20260709 13:17:43.076233 20216 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:43.150547 20192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.025s	sys 0.008s
I20260709 13:17:43.165133 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:43.151249 20066 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:43.173318 18310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef83aa6f9534403ebe38156348430345"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:43.201148 18310 raft_consensus.cc:606] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:43.201547 18310 raft_consensus.cc:614] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:43.178771 20057 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:43.182636 18312 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:43.172049 20216 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:43.158396 20137 consensus_queue.cc:260] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.187552 18306 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:43.213451 18237 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:17:43.214640 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 46736.9us
I20260709 13:17:43.180011 20031 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:43.222651 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.217818 20055 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.224072 20227 consensus_queue.cc:1059] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:43.192835 19745 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.247000 20185 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:43.248551 19745 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:43.249740 20052 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.251905 20052 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:43.244807 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:43.253094 18382 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 2: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:43.255245 18382 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:43.260062 20031 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:43.233337 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:43.262097 18386 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 6: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:43.233954 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:43.234887 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:43.235282 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:43.263273 18377 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:17:43.235591 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:43.264127 18379 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:43.236938 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:43.269192 18383 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:43.270301 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:43.239405 18380 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:43.242492 20055 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:43.243122 20258 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:43.229115 20148 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:43.293517 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 78318.6us
I20260709 13:17:43.275417 18380 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:43.282922 18383 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:43.295325 18381 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:43.297441 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:43.298274 18384 raft_consensus.cc:2393] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 6: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:43.302968 18201 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:43.303865 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:43.304209 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:43.307253 18236 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:43.305922 18386 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
W20260709 13:17:43.307770 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 67488.3us
I20260709 13:17:43.306143 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:43.313546 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:43.239797 19819 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.244982 20137 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.319695 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:43.319797 18378 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:43.321015 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:43.321967 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:43.320762 18386 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:43.322793 18228 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:43.292892 20258 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:17:43.317134 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 53331.7us
I20260709 13:17:43.328715 18377 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:43.324604 18379 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:43.315228 20176 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:43.296909 20194 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:43.293488 20031 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:43.328773 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:43.320706 18235 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:43.430007 18231 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:43.430063 18381 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:43.442941 18383 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:43.320114 19819 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.445703 20258 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.447165 20258 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:43.449935 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.451102 18303 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:43.460029 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:43.388617 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:43.468685 20173 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:43.469257 18386 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:43.470975 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.389421 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:43.472189 18233 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:43.388824 18377 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:43.416289 18307 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:43.385177 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:43.417642 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:43.481884 18230 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:43.482450 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.483951 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.484027 20093 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:43.484496 18307 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:43.331173 20139 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:17:43.486030 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.486613 18306 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
W20260709 13:17:43.387519 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 57314.3us
W20260709 13:17:43.410307 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.407064 18236 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:43.343022 18385 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:43.444108 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:43.488428 18230 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:43.488768 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.494750 18312 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
W20260709 13:17:43.495666 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 107168us
I20260709 13:17:43.462924 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.466770 18310 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:17:43.471187 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.416175 18229 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:43.492033 19819 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:43.488066 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:43.467437 20251 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.308s	user 0.000s	sys 0.002s
I20260709 13:17:43.408416 20206 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 13:17:43.420747 18228 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
W20260709 13:17:43.388293 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 60249.4us
I20260709 13:17:43.498988 18236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:17:43.542951 18235 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:43.572397 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:43.499187 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:43.573156 18312 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:43.551033 18276 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:43.574504 18307 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:43.538391 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:43.498613 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:43.575937 18381 raft_consensus.cc:2368] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6.
I20260709 13:17:43.525666 18233 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:43.577134 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:43.579674 18236 raft_consensus.cc:606] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:43.580155 18236 raft_consensus.cc:614] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:43.578899 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:43.589141 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:43.590241 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:43.582276 18201 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:43.424022 20113 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:43.598238 18384 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:43.594046 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:43.594758 20055 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:43.594871 20052 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:43.601390 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:43.644445 20133 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:17:43.416886 20148 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:43.603350 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:43.656399 18307 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:43.603998 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:43.604908 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.608150 20170 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:43.591818 20078 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:43.580104 20234 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:17:43.614316 20232 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:17:43.616624 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.616987 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.618327 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.620038 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.691313 18311 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:43.691666 18303 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:43.692471 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.625785 18231 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:43.626346 20176 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:43.586063 20194 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:43.697058 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.697742 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.536597 20219 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:43.540797 20173 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:17:43.569228 20202 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:17:43.491186 20139 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 13:17:43.635499 19864 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:17:43.435175 20031 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:43.599727 19819 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:43.662138 20055 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:43.705617 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:43.647205 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 53272.3us
I20260709 13:17:43.712636 18201 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:43.647805 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 57647.6us
I20260709 13:17:43.713840 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:43.650980 18312 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:43.663585 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:43.659394 20218 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:43.666379 18276 leader_election.cc:400] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6.
I20260709 13:17:43.689416 20225 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:43.695267 18307 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:43.635684 20034 consensus_queue.cc:1059] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:17:43.634583 20113 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.699384 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.658406 20052 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:43.658595 20206 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:43.708292 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.716445 18276 leader_election.cc:403] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:43.722888 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.723371 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.727957 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:43.728823 18135 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39284 (request call id 172) took 11673 ms (client timeout 15000 ms). Trace:
I20260709 13:17:43.662273 20057 consensus_queue.cc:1059] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:17:43.690073 20078 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:43.700479 20232 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:43.731594 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.662453 20137 consensus_queue.cc:1059] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:17:43.735208 18311 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:43.736388 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:43.730417 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.725142 20225 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:43.662775 20148 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.748448 18303 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:43.733165 20194 raft_consensus.cc:697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:43.747812 18312 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:43.751212 18305 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:43.750535 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:43.727581 20170 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:17:43.751902 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 88340.8us
I20260709 13:17:43.751982 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.729090 20190 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:43.786123 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.765645 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:43.751652 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:43.729241 18135 rpcz_store.cc:269] 0709 13:17:32.055243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.056356 (+  1113us) service_pool.cc:224] Handling call
0709 13:17:43.728761 (+11672405us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:39.766841 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:39.777040 (+ 10199us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:39.777076 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:17:39.777092 (+    16us) tablet.cc:662] Decoding operations
0709 13:17:39.777945 (+   853us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:39.777998 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:39.778031 (+    33us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:17:39.778756 (+   725us) tablet.cc:701] Row locks acquired
0709 13:17:39.778774 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:17:39.778906 (+   132us) write_op.cc:270] Start()
0709 13:17:39.779024 (+   118us) write_op.cc:276] Timestamp: P: 1783603059778862 usec, L: 0
0709 13:17:39.779052 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:17:39.781246 (+  2194us) log.cc:844] Serialized 3276 byte log entry
0709 13:17:41.193396 (+1412150us) op_driver.cc:464] REPLICATION: finished
0709 13:17:41.322303 (+128907us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa17f1690ac 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa185ca9ef0
0709 13:17:41.551685 (+229382us) write_op.cc:301] APPLY: starting
0709 13:17:41.568637 (+ 16952us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:41.685895 (+117258us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:41.687161 (+  1266us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:41.984545 (+297384us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:41.984831 (+   286us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:17:41.984897 (+    66us) write_op.cc:312] APPLY: finished
0709 13:17:41.985254 (+   357us) log.cc:844] Serialized 64 byte log entry
0709 13:17:42.750014 (+764760us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa17f1690ac 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b
0709 13:17:42.963008 (+212994us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:42.963165 (+   157us) write_op.cc:454] Released schema lock
0709 13:17:42.963223 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:42.963664 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:42.963695 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1378259,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":316132,"apply.run_cpu_time_us":67600,"apply.run_wall_time_us":1430124,"num_ops":8,"prepare.queue_time_us":60478,"prepare.run_cpu_time_us":137103,"prepare.run_wall_time_us":695375,"raft.queue_time_us":547076,"raft.run_cpu_time_us":14298,"raft.run_wall_time_us":301076,"replication_time_us":1395827,"spinlock_wait_cycles":101301760,"thread_start_us":2254124,"threads_started":5,"wal-append.queue_time_us":1678401,"wal-append.run_cpu_time_us":43819,"wal-append.run_wall_time_us":1452327}]]}
I20260709 13:17:43.799670 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:43.831310 18307 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2.
I20260709 13:17:43.749298 19745 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:43.838847 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 45603.7us
I20260709 13:17:43.749140 20161 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:43.742822 20206 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:43.784389 20034 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:43.776461 19819 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:17:43.858932 18303 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:43.844666 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:43.777086 20170 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:43.854099 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.742127 20218 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:43.848830 20161 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:43.856647 20034 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:43.750299 20167 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:17:43.785091 20190 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.749967 20078 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.748808 20052 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.749517 20225 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.887606 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.842932 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.858747 19745 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:43.900633 18312 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:43.900981 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.894490 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:43.893610 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.901618 18311 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
W20260709 13:17:43.906311 20263 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:17:43.866190 20133 consensus_queue.cc:1059] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:17:43.913293 20133 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:43.913916 20133 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.923480 18308 raft_consensus.cc:2368] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:17:43.924064 18303 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:43.930547 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.898838 20190 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:43.985848 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.986738 18303 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:43.862130 20055 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.996367 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:43.989781 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.997287 18310 raft_consensus.cc:2376] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4. Re-sending same reply.
I20260709 13:17:43.997629 18303 raft_consensus.cc:2376] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5. Re-sending same reply.
W20260709 13:17:43.999243 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.925763 20133 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:44.000100 19387 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.009s	sys 0.053s
W20260709 13:17:44.001106 19387 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.009s	sys 0.053s
I20260709 13:17:44.001713 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.983506 20225 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.008941 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.013190 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:44.016553 19776 raft_consensus.cc:3055] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:44.017119 19776 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:43.988143 20161 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.021596 20161 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.029187 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.024106 20113 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:43.886693 20232 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:43.899600 20194 consensus_queue.cc:237] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.030196 18310 raft_consensus.cc:2376] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5. Re-sending same reply.
I20260709 13:17:44.034848 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.052879 18312 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:44.053718 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:44.054637 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:44.055244 18312 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:44.055871 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.037900 20113 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:44.040783 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:44.042987 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.057416 18311 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:44.052258 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:44.012727 20206 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:44.044724 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.012007 20031 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:44.026357 20148 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:44.045194 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:44.055785 18133 catalog_manager.cc:5697] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index 2 to 3, term changed from 1 to 3, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to <none>, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:44.045730 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:44.063242 18307 raft_consensus.cc:2376] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5. Re-sending same reply.
I20260709 13:17:44.063903 19387 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:44.065253 19387 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:44.065191 18133 catalog_manager.cc:5697] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 2 to 3, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 3 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.068480 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:44.070930 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:44.069972 18133 catalog_manager.cc:5697] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:44.002524 20034 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.048951 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:43.931697 20170 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.059917 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:44.074688 19387 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:44.058393 20113 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:44.074545 18303 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:44.048414 18277 leader_election.cc:400] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5.
I20260709 13:17:44.074472 18133 catalog_manager.cc:5697] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 2 to 3, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 3 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:44.076495 18277 leader_election.cc:403] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:17:44.068804 20227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.039s	sys 0.059s
I20260709 13:17:44.078068 18133 catalog_manager.cc:5697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:44.083309 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.094237 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 45955.4us
I20260709 13:17:44.012570 20218 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:44.096886 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 383130us
I20260709 13:17:44.101876 18234 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:44.097610 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:44.096006 18133 catalog_manager.cc:5697] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 2, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 2 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:44.102483 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:44.084091 20227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.039s	sys 0.059s
I20260709 13:17:44.064607 19745 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:44.114483 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.114926 20188 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.106884 20170 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.124574 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:44.101171 20034 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.129812 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1004) took 1040 ms. Trace:
I20260709 13:17:44.132124 18133 catalog_manager.cc:5697] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 3 to 4, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 4 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.158389 18133 catalog_manager.cc:5697] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:44.105476 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:44.099592 20148 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5.
I20260709 13:17:44.107789 20133 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:17:44.150954 19864 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:44.177532 19819 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6.
I20260709 13:17:44.178356 19864 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:44.074334 19776 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.182513 19776 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:44.186309 20066 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.186902 20066 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:44.160562 18202 leader_election.cc:336] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.565s (SENT)
I20260709 13:17:44.135361 20185 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:44.159960 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54605.8us
I20260709 13:17:44.191414 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:44.192281 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 404438us
I20260709 13:17:44.192714 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:44.165365 18133 catalog_manager.cc:5697] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 3 to 4, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 4 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.194427 18133 catalog_manager.cc:5697] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 2 to 3, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 3 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:17:44.157451 18305 rpcz_store.cc:276] 0709 13:17:43.089082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.449614 (+360532us) service_pool.cc:224] Handling call
0709 13:17:44.129627 (+680013us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400234954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:44.129742 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691216768}
I20260709 13:17:44.174388 20015 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:44.201056 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:44.202474 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:44.197207 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:44.204414 18308 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:44.196148 18133 catalog_manager.cc:5697] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index 2 to 4, term changed from 1 to 3, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.213030 18133 catalog_manager.cc:5697] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 3, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 3 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.216817 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:44.219340 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:44.215355 18133 catalog_manager.cc:5697] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 3 to 4, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 4 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.223176 18133 catalog_manager.cc:5697] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.224965 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:44.232502 18133 catalog_manager.cc:5697] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 2 to 4, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 4 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.238436 18382 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:44.188932 20202 raft_consensus.cc:3055] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:44.249159 18386 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:44.237737 18133 catalog_manager.cc:5697] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 2, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.211266 20148 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:44.211412 19864 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:44.152205 20188 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.289733 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:44.291877 18133 catalog_manager.cc:5697] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 3, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 3 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:17:44.156267 20113 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.222337 20185 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:44.301931 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:44.303903 18377 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:44.309286 18233 raft_consensus.cc:2410] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:44.306473 18379 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:44.304369 18228 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:17:44.310529 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.307775 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.311698 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.243897 20202 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:44.310698 18133 catalog_manager.cc:5697] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.317672 18233 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:44.318591 18228 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:44.319360 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:44.326540 18235 raft_consensus.cc:2410] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:44.320170 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:44.322569 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:44.324155 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:44.286196 20281 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:44.329623 18231 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:44.330376 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:44.345269 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:44.339977 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:44.327826 20137 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.023s
W20260709 13:17:44.358551 20137 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.000s	sys 0.023s
I20260709 13:17:44.327713 18133 catalog_manager.cc:5697] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 4, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 4 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.342490 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:44.360424 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:44.329844 20113 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:44.362238 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:44.365675 20227 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:44.364199 18133 catalog_manager.cc:5697] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.366288 20227 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:44.358601 18233 raft_consensus.cc:2368] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6.
I20260709 13:17:44.358865 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:44.338742 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:44.369230 20227 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:44.372066 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 79733.9us
I20260709 13:17:44.341717 20258 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:44.373200 20258 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.337198 18235 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:44.378324 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:44.297013 19635 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:17:44.374082 18133 catalog_manager.cc:5697] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 2 to 5, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 5 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:17:44.393579 18133 catalog_manager.cc:5697] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:44.407641 18133 catalog_manager.cc:5697] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:44.411780 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1016) took 1109 ms. Trace:
I20260709 13:17:44.412243 18237 rpcz_store.cc:276] 0709 13:17:43.302836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.311337 (+  8501us) service_pool.cc:224] Handling call
0709 13:17:43.327716 (+ 16379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.660257 (+332541us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:17:43.697733 (+ 37476us) log.cc:844] Serialized 14 byte log entry
0709 13:17:44.109543 (+411810us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.113396 (+  3853us) log.cc:844] Serialized 26 byte log entry
0709 13:17:44.113533 (+   137us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:44.113563 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.113621 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:44.411574 (+297953us) raft_consensus.cc:1685] finished
0709 13:17:44.411591 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.411720 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10861,"prepare.queue_time_us":37183,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":6504,"raft.queue_time_us":31072,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":8827,"thread_start_us":614407,"threads_started":2,"wal-append.queue_time_us":693495}
I20260709 13:17:44.410030 18133 catalog_manager.cc:5697] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 3, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 3 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:17:44.377311 20066 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:44.431953 18383 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.006s	sys 0.077s
W20260709 13:17:44.433038 18383 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.006s	sys 0.077s
W20260709 13:17:44.447207 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 134696us
I20260709 13:17:44.424649 20173 raft_consensus.cc:3055] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:44.443651 20185 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.460026 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:44.464761 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.421061 20148 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:44.489711 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.561985 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 79635.5us
I20260709 13:17:44.568702 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.569638 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.573645 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:44.581857 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.476045 20052 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.474007 20173 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:44.584216 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.587003 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:44.563455 20190 consensus_meta.cc:287] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 13:17:44.586774 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.564404 19819 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.562407 20296 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.596115 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:44.604907 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 312724us
I20260709 13:17:44.605822 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.600879 18309 raft_consensus.cc:2410] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:44.587491 20273 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.659440 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.562956 20148 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.583678 20137 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:44.665393 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.674659 20295 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:17:44.581143 20219 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
W20260709 13:17:44.685120 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.598616 20066 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:17:44.594687 20052 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.697801 18277 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:44.608952 19819 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:44.703883 18202 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.001s
I20260709 13:17:44.600123 20190 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.739701 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:44.745061 18202 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.006s	sys 0.004s
W20260709 13:17:44.748636 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 558859us
I20260709 13:17:44.749253 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:17:44.753917 18202 leader_election.cc:336] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.631s (SENT)
I20260709 13:17:44.690470 20137 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.705214 20188 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:44.754082 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:44.755077 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:44.739771 20258 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:44.746217 19864 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:17:44.769713 18202 leader_election.cc:336] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.694s (SENT)
I20260709 13:17:44.655049 20296 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.760655 18303 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:44.676566 20273 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.779459 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:44.785964 18202 leader_election.cc:336] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.704s (SENT)
I20260709 13:17:44.786640 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:44.776954 20307 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:44.790743 20227 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:44.791859 20301 log.cc:927] Time spent T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:17:44.778002 20188 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:44.794674 18310 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
W20260709 13:17:44.795423 20291 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.138s	user 0.003s	sys 0.000s
I20260709 13:17:44.696832 20173 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.701584 20280 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:17:44.753487 20176 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:44.751825 20299 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:44.802350 18306 raft_consensus.cc:2376] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5. Re-sending same reply.
I20260709 13:17:44.808097 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:44.790095 20258 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:44.826660 19387 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:44.805456 19745 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:17:44.851943 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 265876us
I20260709 13:17:44.831784 20219 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:44.857165 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:44.808988 20176 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.845527 20199 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:44.864974 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.866122 18307 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:44.866387 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:44.867971 20315 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:44.869225 19819 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:44.870139 20176 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:44.872594 20190 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:44.873690 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.874115 20296 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:44.874369 18309 raft_consensus.cc:2376] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4. Re-sending same reply.
I20260709 13:17:44.875381 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.875463 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.876180 18307 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:44.879566 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:44.883440 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:44.885917 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:17:44.923990 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.959357 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.969468 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 220269us
W20260709 13:17:44.979576 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 150977us
I20260709 13:17:44.981801 18202 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:44.974924 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:44.991781 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:44.993005 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 107196us
I20260709 13:17:44.993837 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:44.891777 20277 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:44.852846 19745 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:45.017195 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:44.937947 20148 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:44.862494 20219 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:44.947988 20315 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:45.043885 18202 leader_election.cc:336] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.531s (SENT)
I20260709 13:17:45.045580 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:45.051818 18202 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.878s (SENT)
W20260709 13:17:45.052994 18202 leader_election.cc:336] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.935s (SENT)
I20260709 13:17:45.053469 18202 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:45.047168 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:44.991784 20188 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.054566 18307 raft_consensus.cc:2376] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5. Re-sending same reply.
I20260709 13:17:45.061020 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:45.065249 18309 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:45.056584 20277 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.046885 20298 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:45.046175 20318 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.068543 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:45.070127 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 53031.7us
I20260709 13:17:44.937034 20199 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:45.068536 20320 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:17:45.071216 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:45.071580 18307 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:45.069370 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.066097 20315 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.074703 18309 raft_consensus.cc:2376] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 2. Re-sending same reply.
I20260709 13:17:45.074911 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.075482 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.075668 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.076128 18309 raft_consensus.cc:2376] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4. Re-sending same reply.
I20260709 13:17:45.069451 20210 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:45.078835 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.079862 18309 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:45.080150 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.081195 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:45.074880 20318 raft_consensus.cc:697] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:17:45.081180 20309 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:17:45.085706 20315 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:45.087600 19745 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:45.071151 20298 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:45.104319 20315 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.105186 20315 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.106804 20199 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:45.107005 20298 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:45.082741 20314 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:17:45.089840 20219 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:45.090041 20170 consensus_meta.cc:287] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.939s	user 0.011s	sys 0.002s
I20260709 13:17:45.110311 20318 consensus_queue.cc:237] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:45.113628 19776 consensus_meta.cc:287] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.931s	user 0.012s	sys 0.000s
W20260709 13:17:45.093937 20034 consensus_meta.cc:287] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.930s	user 0.007s	sys 0.004s
I20260709 13:17:45.097488 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.102885 20326 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:45.079607 20327 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:45.115630 20326 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.117357 18309 raft_consensus.cc:2410] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:17:45.116648 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.118765 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:45.118772 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.119418 18307 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.119823 18309 raft_consensus.cc:2410] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:45.121199 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.123260 18304 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:45.124436 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1057) took 1082 ms. Trace:
I20260709 13:17:45.125308 18304 rpcz_store.cc:276] 0709 13:17:44.041732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.045446 (+  3714us) service_pool.cc:224] Handling call
0709 13:17:45.124256 (+1078810us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000bd6d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:45.124368 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2422115072}
I20260709 13:17:45.125952 20326 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:45.126737 18304 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:17:45.129663 18311 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:45.130451 20218 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.131055 20218 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.133811 20218 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:45.131018 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1060) took 1085 ms. Trace:
I20260709 13:17:45.139825 20137 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.140496 20315 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.137482 20057 raft_consensus.cc:3055] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:45.147078 20057 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:45.147872 20210 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.148411 20210 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.137598 18311 rpcz_store.cc:276] 0709 13:17:44.045805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.058198 (+ 12393us) service_pool.cc:224] Handling call
0709 13:17:45.130820 (+1072622us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540013ea54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:45.130945 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2391886208}
I20260709 13:17:45.154414 18311 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:45.156136 20315 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:45.157590 18311 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:17:45.160434 18311 pending_rounds.cc:85] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 2
I20260709 13:17:45.160503 20210 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.163839 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1026) took 1004 ms. Trace:
I20260709 13:17:45.164373 18231 rpcz_store.cc:276] 0709 13:17:44.159437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.159624 (+   187us) service_pool.cc:224] Handling call
0709 13:17:44.160049 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:44.333131 (+173082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.163546 (+830415us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54001879d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:45.163764 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389228416}
W20260709 13:17:45.170166 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 95504.2us
I20260709 13:17:45.151764 20202 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.171741 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.172529 20202 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:45.173112 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.147917 20057 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.174609 18351 leader_election.cc:400] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:17:45.175117 18351 leader_election.cc:403] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:17:45.175252 20057 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.175838 20078 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.176091 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:45.177132 20293 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.613s	user 0.006s	sys 0.009s
W20260709 13:17:45.179493 18202 leader_election.cc:336] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.873s (SENT)
I20260709 13:17:45.180095 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:45.160671 18311 pending_rounds.cc:107] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:17:45.182327 18311 raft_consensus.cc:2889] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:45.182276 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 153) took 1105 ms. Trace:
I20260709 13:17:45.181643 20276 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.184746 18307 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:45.185873 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.186444 18307 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:45.189284 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.183385 18385 rpcz_store.cc:276] 0709 13:17:44.077298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.077462 (+   164us) service_pool.cc:224] Handling call
0709 13:17:44.108362 (+ 30900us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.108844 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:44.146016 (+ 37172us) log.cc:844] Serialized 14 byte log entry
0709 13:17:44.302969 (+156953us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.305456 (+  2487us) log.cc:844] Serialized 26 byte log entry
0709 13:17:44.305575 (+   119us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:44.305605 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.305666 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.141615 (+835949us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b48001e0258. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18719caa1 00007fa187193b37 00007fa1871939ca 00007fa18728b26f 00007fa18728af37 00007fa18729f55c 00007fa18729f508 00007fa18729f488 00007fa18729f443 00007fa18729e6ec 00007fa1861c8a96
0709 13:17:45.171464 (+ 29849us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:17:45.182019 (+ 10555us) raft_consensus.cc:1685] finished
0709 13:17:45.182050 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.182220 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7146,"prepare.queue_time_us":47382,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":8412,"raft.run_cpu_time_us":10828,"raft.run_wall_time_us":850567,"spinlock_wait_cycles":48027776,"thread_start_us":109660,"threads_started":1,"wal-append.queue_time_us":254890}
I20260709 13:17:45.190837 18307 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:45.190934 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.181663 20078 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:45.193807 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:45.193779 18311 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:45.192596 20031 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:45.187837 19635 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:45.197723 20218 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.197831 20031 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:45.198534 20031 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.188190 20318 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:17:45.197266 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.187773 20276 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.195356 20078 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:45.201929 20078 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.203119 20276 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.196357 20055 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.188846 20328 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.206872 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.209061 20218 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:45.209494 20218 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:45.209874 20218 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.215202 20173 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:45.215510 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:45.217334 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.218402 20299 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:17:45.218672 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 243828us
I20260709 13:17:45.219302 20317 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.218950 20299 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:45.219847 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.221356 19819 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.222139 18277 leader_election.cc:400] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6.
I20260709 13:17:45.223304 18277 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.218896 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:45.224491 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:45.227757 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.233317 18384 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:45.233763 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:45.239442 18386 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:45.233964 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.234841 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.241369 18378 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:45.242277 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.233650 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.243614 18377 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:45.236402 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.240060 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:45.248239 18202 leader_election.cc:336] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.773s (SENT)
I20260709 13:17:45.194969 20315 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:45.250557 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:45.262518 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.264496 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:45.265447 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.265220 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.219434 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:45.227339 20285 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.556s	user 0.001s	sys 0.007s
I20260709 13:17:45.250653 19819 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.253325 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.269438 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.270336 18384 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:45.271129 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.259119 20317 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:45.255194 18276 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.251672 18378 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:45.274557 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.280941 18276 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.282409 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.283157 18307 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
W20260709 13:17:45.283542 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 76713us
I20260709 13:17:45.284192 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.284946 18307 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:45.285122 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.275219 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.288682 18276 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.226186 20216 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.290014 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.290419 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:45.290854 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.295432 18276 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.269510 20034 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.306353 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.293558 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.294404 18377 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:45.280488 20227 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.298422 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.299620 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1552) took 1577 ms. Trace:
I20260709 13:17:45.301656 18308 raft_consensus.cc:2410] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:45.303184 20299 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:45.286037 18953 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 1.
I20260709 13:17:45.279593 20315 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:45.308332 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.295554 18305 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
W20260709 13:17:45.331033 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.345547 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:45.346688 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.347577 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:45.348304 18305 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:45.318081 18386 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:45.290635 20328 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:45.355530 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.293936 20318 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.291254 19864 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.291853 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.313941 20202 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.343461 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.354008 20328 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:45.357719 20161 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:45.358258 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:45.361537 20322 consensus_queue.cc:1059] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:45.363222 20281 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.364451 20321 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:45.364753 20031 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.365897 18276 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.288703 19819 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:45.344544 20330 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:17:45.355182 18200 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:45.314690 20055 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:45.314177 18383 rpcz_store.cc:276] 0709 13:17:43.722443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.733397 (+ 10954us) service_pool.cc:224] Handling call
0709 13:17:43.733797 (+   400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:43.743488 (+  9691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.743530 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:43.744159 (+   629us) log.cc:844] Serialized 52 byte log entry
0709 13:17:43.919246 (+175087us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b48001e0258. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18719caa1 00007fa187193b37 00007fa1871939ca 00007fa18728b26f 00007fa18728af37 00007fa18729f55c 00007fa18729f508 00007fa18729f488 00007fa18729f443 00007fa18729e6ec 00007fa1861c8a96
0709 13:17:44.433387 (+514141us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:44.433439 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.433520 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.226777 (+793257us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:17:45.299359 (+ 72582us) raft_consensus.cc:1685] finished
0709 13:17:45.299383 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.299559 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4286,"raft.run_cpu_time_us":2640,"raft.run_wall_time_us":180916,"spinlock_wait_cycles":44552320,"thread_start_us":597429,"threads_started":1,"wal-append.queue_time_us":786332}
I20260709 13:17:45.367749 18385 raft_consensus.cc:2393] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:45.367642 18307 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:45.387313 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.388324 18307 raft_consensus.cc:2410] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:45.389071 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:45.310534 20317 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.309731 20094 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.371381 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:45.390391 18305 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:45.375243 18377 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:45.393697 18377 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:45.365226 20273 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.376890 18386 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:45.354792 20185 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:45.379248 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.405453 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:45.345634 20188 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:17:45.406085 19819 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.381706 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.389328 19864 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:45.382359 20281 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.407565 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.408490 18312 raft_consensus.cc:2410] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:17:45.384450 20210 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:17:45.408896 20281 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.409216 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.409955 18312 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:45.409883 20031 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:45.409780 20078 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.411165 18312 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:45.411656 18309 raft_consensus.cc:2410] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:45.383445 18276 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.411985 20078 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:45.411857 20218 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.413188 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.413322 20057 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:45.413782 20057 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.414125 20057 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:45.375577 20328 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.414295 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:45.416442 18121 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 943649b738074d87a593c237cf998758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 459e82ee6b564cc19be6f73186938e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:45.354254 20315 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.417640 20273 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.382467 20148 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.427302 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.436817 18305 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:45.437620 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.437844 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.438197 18380 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:45.393649 20055 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:45.403606 20185 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:45.406421 20206 raft_consensus.cc:3055] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:45.382824 20318 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.385281 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:45.421483 18378 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:45.422453 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.423446 18384 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:45.420913 18311 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:45.439183 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.453365 18386 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:45.453495 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.448837 20055 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:45.403390 20266 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:45.407021 19864 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:45.476621 20326 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.443936 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:45.476871 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.477545 18385 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:45.440761 19819 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.478056 20078 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:45.478933 20137 raft_consensus.cc:3055] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:45.479333 20137 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:45.480334 20266 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:45.480707 19864 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:45.480919 20266 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.482311 20052 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:45.456813 18276 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:45.449126 20218 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:45.488116 20170 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:45.488569 20170 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.488926 20170 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.463125 18307 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:45.473038 20185 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.471653 20194 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:45.492710 20194 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:45.414352 20202 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.478657 19819 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.494571 18306 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:45.515985 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 141687us
I20260709 13:17:45.447616 20031 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.517654 18201 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:45.447340 20173 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:45.447522 20281 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:45.518113 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47653.8us
I20260709 13:17:45.447118 20199 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:45.457726 20258 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.493140 20194 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:45.488109 20276 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.455912 20328 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.447248 20148 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:45.534842 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 155828us
I20260709 13:17:45.448135 20206 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:45.536674 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:45.522951 19635 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:45.480201 20137 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.520941 20218 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:17:45.531219 20199 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:45.659983 20328 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:45.669337 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 132815us
I20260709 13:17:45.670737 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:45.672192 18306 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:45.677193 18312 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:45.661973 20326 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.534166 20281 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.682564 20137 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:45.669467 20199 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.544997 20258 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.545320 20276 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.680230 20031 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:45.693609 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 1486) took 1125 ms. Trace:
I20260709 13:17:45.710227 18308 rpcz_store.cc:276] 0709 13:17:44.568225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.568385 (+   160us) service_pool.cc:224] Handling call
0709 13:17:45.693383 (+1124998us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54001bb554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:45.693537 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1683380480}
I20260709 13:17:45.719669 20280 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:45.737267 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.739986 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 65227.4us
I20260709 13:17:45.686993 20206 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.741339 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.728376 19635 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:17:45.742337 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 196283us
I20260709 13:17:45.712875 20339 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 13:17:45.743676 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 217132us
I20260709 13:17:45.748891 18235 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:45.750967 18235 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:45.752837 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.753772 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.753902 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.754805 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.754886 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.755729 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:45.755520 18231 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:45.757633 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:45.758239 18233 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.758523 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:45.759716 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:45.762656 18228 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:45.762779 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:17:45.765002 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 239984us
I20260709 13:17:45.765981 18230 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:45.766465 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1561) took 1203 ms. Trace:
I20260709 13:17:45.766793 18382 rpcz_store.cc:276] 0709 13:17:44.563198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.563331 (+   133us) service_pool.cc:224] Handling call
0709 13:17:44.584874 (+ 21543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.847828 (+262954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.847867 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.848451 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.046570 (+198119us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:45.046620 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.766125 (+719505us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400129654. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:45.766162 (+    37us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.766195 (+    33us) raft_consensus.cc:1685] finished
0709 13:17:45.766203 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.766407 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48169,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5709,"spinlock_wait_cycles":380402048,"thread_start_us":294496,"threads_started":2,"wal-append.queue_time_us":228639}
I20260709 13:17:45.767943 18230 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:45.742246 19819 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.773883 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.745611 20031 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:17:45.781388 20276 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.757237 20206 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.789296 20170 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.794998 18228 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:45.740376 20280 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:45.800248 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 46904.6us
W20260709 13:17:45.801828 20341 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:17:45.804011 19387 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:45.804566 19387 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.804921 18233 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:45.806066 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:45.807792 20322 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.808334 20322 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.811936 19387 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.811828 20232 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:45.812851 20148 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.814195 20281 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.814563 20277 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.810930 20322 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.820319 20218 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.802910 20192 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:17:45.822834 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.824106 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.823809 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.825495 20188 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:45.823776 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:45.826848 20318 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:45.827235 20318 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:45.827850 20318 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.827263 19635 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.832161 20280 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.833922 18202 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:45.803658 20343 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:17:45.826853 20057 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.837565 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.845599 18382 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:45.840631 20277 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:45.847707 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:45.848313 18381 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.849485 19387 raft_consensus.cc:2764] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:17:45.840999 20170 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.841696 20258 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.848356 19864 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.862879 19864 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.864145 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:45.868027 20170 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.868708 20170 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.875160 20170 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:45.805648 20342 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.070s	user 0.001s	sys 0.001s
I20260709 13:17:45.819043 20055 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.881703 18383 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:45.883296 20055 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:45.870185 20057 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:45.870210 18276 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:45.843484 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:45.877769 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1517) took 1197 ms. Trace:
I20260709 13:17:45.886204 18306 rpcz_store.cc:276] 0709 13:17:44.680038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.161775 (+481737us) service_pool.cc:224] Handling call
0709 13:17:45.494427 (+332652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.672667 (+178240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.877586 (+204919us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400222ed0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:45.877711 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":764120320}
I20260709 13:17:45.886891 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:45.887209 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:45.887874 18377 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:45.888741 20176 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:45.888931 20258 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:45.889804 20176 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.890599 20176 raft_consensus.cc:3055] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:45.890733 20339 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:45.891292 20339 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:45.892371 18382 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:45.892129 20339 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.893486 20339 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.837484 20266 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:45.898175 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.898401 20266 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:45.891043 20176 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:45.887600 20188 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:17:45.900405 20188 raft_consensus.cc:3055] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:45.900269 20176 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.901022 20188 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:45.901278 20173 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:45.901791 20173 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.902499 20173 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.901929 20188 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.903503 20188 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.905859 20199 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:45.906380 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.906823 18306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:45.924988 18306 raft_consensus.cc:606] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:45.925390 18306 raft_consensus.cc:614] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:45.925588 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:45.920323 18381 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:45.923242 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:45.927663 18961 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.928897 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.929518 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.930580 18307 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:17:45.931759 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.932665 18304 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:45.934299 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.934955 18306 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:45.931761 18303 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:45.936267 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.936443 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.937077 18306 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:45.937690 18276 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:45.937810 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.929589 18308 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:45.939237 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.939787 18308 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:45.939805 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:45.940886 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:45.941154 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.942523 18304 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:45.942610 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.943575 18232 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:45.842375 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:45.945087 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.946548 18305 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:45.947786 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:45.953828 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.956272 18304 raft_consensus.cc:2368] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:17:45.957494 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.954069 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:45.955209 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.959548 18306 raft_consensus.cc:2368] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:17:45.977631 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.979598 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.980381 18232 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:45.981257 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:45.981706 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.982463 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.981916 18231 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:17:45.983557 18229 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:45.984544 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.984644 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:45.985502 18232 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 2.
I20260709 13:17:45.986415 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:45.987917 18235 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:45.982437 18230 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:45.995159 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:45.938062 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:45.901714 20176 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:46.005447 18377 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:46.010558 18382 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:17:46.011804 18276 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:46.013463 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:45.990190 18132 catalog_manager.cc:5697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 reported cstate change: leader changed from <none> to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 3 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:46.015399 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 173086us
W20260709 13:17:46.017589 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 79628.1us
I20260709 13:17:46.019706 18277 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:46.019985 20170 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:46.020694 20348 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:46.021490 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:46.022857 20317 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:46.022933 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.023970 19819 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:46.024494 19819 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.024883 19819 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:46.024920 18277 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.025755 20279 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:46.026336 20279 raft_consensus.cc:697] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:46.027478 20279 consensus_queue.cc:237] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.028249 20317 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:46.031308 20148 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:46.049516 18308 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:46.053220 18132 catalog_manager.cc:5697] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 3 to 4, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 4 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.014252 18303 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:46.037449 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:46.054042 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:46.059067 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:46.031924 18309 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:45.946439 20113 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:46.076834 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:46.047364 19864 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:46.037936 20278 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:46.085350 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:46.085988 18133 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39270 (request call id 185) took 7659 ms. Trace:
I20260709 13:17:46.048257 20317 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.061172 20057 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.089025 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:17:46.092664 20357 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260709 13:17:46.094889 20317 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:46.097368 20355 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.004s
I20260709 13:17:46.109740 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:46.075608 20326 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:46.091531 18133 rpcz_store.cc:276] 0709 13:17:38.416802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.417019 (+   217us) service_pool.cc:224] Handling call
0709 13:17:46.075798 (+7658779us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:44.743929 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:44.791155 (+ 47226us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:44.791198 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:17:44.791220 (+    22us) tablet.cc:662] Decoding operations
0709 13:17:44.793263 (+  2043us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:44.793324 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:44.793355 (+    31us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:17:44.795204 (+  1849us) tablet.cc:701] Row locks acquired
0709 13:17:44.795233 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:17:44.795433 (+   200us) write_op.cc:270] Start()
0709 13:17:44.795577 (+   144us) write_op.cc:276] Timestamp: P: 1783603064795376 usec, L: 0
0709 13:17:44.795601 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:17:44.874166 (+ 78565us) log.cc:844] Serialized 9711 byte log entry
0709 13:17:45.171349 (+297183us) op_driver.cc:464] REPLICATION: finished
0709 13:17:45.341999 (+170650us) write_op.cc:301] APPLY: starting
0709 13:17:45.350412 (+  8413us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:45.456205 (+105793us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:45.473989 (+ 17784us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:45.488313 (+ 14324us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:45.488656 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 13:17:45.488716 (+    60us) write_op.cc:312] APPLY: finished
0709 13:17:45.489197 (+   481us) log.cc:844] Serialized 163 byte log entry
0709 13:17:45.490095 (+   898us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:45.490333 (+   238us) write_op.cc:454] Released schema lock
0709 13:17:45.490409 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:45.523575 (+ 33166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:45.525792 (+  2217us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":363601,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":118198,"apply.run_cpu_time_us":6135,"apply.run_wall_time_us":207274,"num_ops":24,"prepare.queue_time_us":249989,"prepare.run_cpu_time_us":23022,"prepare.run_wall_time_us":358074,"raft.queue_time_us":76445,"raft.run_cpu_time_us":3418,"raft.run_wall_time_us":26580,"replication_time_us":375576,"thread_start_us":347105,"threads_started":4,"wal-append.queue_time_us":206548}]]}
I20260709 13:17:46.047960 20277 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:17:46.046996 20185 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
W20260709 13:17:46.128937 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 311847us
I20260709 13:17:46.131760 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:46.072136 20218 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 13:17:46.147518 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.140947 19387 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:46.148850 19387 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:46.141857 20327 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:46.142903 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:46.143204 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:46.164410 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.151592 18236 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:46.157313 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:46.099963 20348 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:46.080591 20052 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
W20260709 13:17:46.168192 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 205403us
I20260709 13:17:46.088563 20031 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:17:46.121865 19864 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:46.084760 20318 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.186120 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.135005 20315 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:46.190685 18230 consensus_queue.cc:237] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:46.192911 18237 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:46.193909 19387 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:46.168849 20161 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:46.176626 20170 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:46.195556 20170 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.195904 20170 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:46.139562 20326 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:46.147846 20225 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.159708 20210 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:46.088493 20113 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:46.205024 20227 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:46.204963 20345 consensus_queue.cc:1059] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:46.230849 20345 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:46.231230 20345 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:46.121111 20057 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.211840 18202 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.212014 20190 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:46.212260 20199 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:46.139170 20328 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:17:46.215523 18379 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:46.218156 20113 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:46.205828 20258 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.227593 19864 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.229846 20318 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:46.239136 20258 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.237339 20190 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:46.241580 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:46.179153 20296 consensus_queue.cc:1059] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:17:46.249042 18202 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.251567 20346 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:46.251695 20190 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:46.251596 20258 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:46.213611 20225 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.264559 20347 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:46.265966 20225 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:46.267665 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 135967us
I20260709 13:17:46.269693 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:46.270941 18351 leader_election.cc:400] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:17:46.272902 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:46.232163 20345 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.283864 18351 leader_election.cc:400] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:17:46.287020 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:46.287138 18351 leader_election.cc:403] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:46.289933 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:46.291716 18308 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:46.292869 18308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:46.293148 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:46.293426 18308 raft_consensus.cc:606] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.293807 18308 raft_consensus.cc:614] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:46.273698 20052 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:46.299376 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:46.302421 18312 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:46.266932 20326 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.307789 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.308120 18308 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:46.303076 18231 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:46.310577 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.283167 20318 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:46.328858 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.330022 19387 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:46.294675 20277 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:46.294513 20328 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
W20260709 13:17:46.306754 20194 consensus_meta.cc:287] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.672s	user 0.002s	sys 0.009s
I20260709 13:17:46.350859 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.364765 19635 raft_consensus.cc:2764] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:17:46.366418 20161 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.367007 20161 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:46.369140 20368 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:17:46.370092 20094 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:46.371191 20347 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:46.372329 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.373622 20194 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.374629 20094 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:46.369184 20161 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:46.376780 18378 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:46.376137 20232 consensus_queue.cc:1059] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:46.377784 20094 raft_consensus.cc:3055] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:17:46.377861 20137 consensus_meta.cc:287] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.000s
I20260709 13:17:46.378257 20094 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:46.378626 18310 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:46.327031 20206 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:46.379089 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.382860 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.387133 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:46.343492 20296 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.333323 20227 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:17:46.328354 20348 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:17:46.355185 20192 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:46.376183 20194 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:46.420495 20347 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:46.405150 20285 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:17:46.403676 20055 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:46.403952 19635 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:46.355336 20315 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.072s
W20260709 13:17:46.435674 20173 consensus_meta.cc:287] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.003s
I20260709 13:17:46.476370 18305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d03313400e274f83883c84395905b4cd"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:46.493818 18961 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:46.463083 20347 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.495823 18200 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:46.421387 20296 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:46.520146 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 120506us
I20260709 13:17:46.470558 19635 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:46.518792 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:46.522993 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.500233 20347 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:46.526795 20296 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:46.538614 20372 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:17:46.547355 18305 raft_consensus.cc:606] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.548024 18305 raft_consensus.cc:614] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:46.495407 20245 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:46.521070 20339 consensus_meta.cc:287] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.000s
I20260709 13:17:46.480366 20173 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.594748 20339 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:46.595367 20339 raft_consensus.cc:697] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:17:46.571888 19819 consensus_meta.cc:287] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.000s
I20260709 13:17:46.550144 19635 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.467610 20094 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:46.611662 20382 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:17:46.611904 20094 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:46.590710 20317 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.627907 20339 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:46.628592 20317 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:46.632643 18304 raft_consensus.cc:2368] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
W20260709 13:17:46.574421 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 268852us
W20260709 13:17:46.572227 20188 consensus_meta.cc:287] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.668s	user 0.014s	sys 0.000s
I20260709 13:17:46.636500 18229 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:17:46.638594 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 119215us
I20260709 13:17:46.644891 18961 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:46.646811 18960 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:46.672742 20391 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:46.673457 20391 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.674281 20055 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:46.674911 20055 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:46.675750 20391 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:46.677983 20370 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:17:46.678614 20190 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.608369 19819 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.681929 20388 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:46.682507 19819 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:46.686149 20348 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.686735 20348 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.663594 20315 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:17:46.686728 20173 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:46.692404 20113 raft_consensus.cc:3055] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:46.692939 20113 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:46.693385 20348 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:46.693341 20347 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.693837 20113 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:46.695191 20113 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.695942 20347 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:46.696761 18232 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:46.701766 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:46.727185 18230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:17:46.728775 18230 raft_consensus.cc:606] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.729377 18230 raft_consensus.cc:614] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:46.744122 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:46.750890 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:46.754277 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:46.754911 18309 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:46.756574 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:46.757902 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:46.759357 18311 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:46.760622 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:46.763000 18385 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:46.771216 18377 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:46.773293 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:46.775480 18377 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:46.778663 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:46.786393 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:46.787052 18303 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:46.789041 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:46.795934 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:46.735882 20190 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:46.794596 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:46.791253 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:46.741102 20194 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:46.809273 18309 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:46.753204 20376 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:46.793617 20378 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:17:46.829183 20055 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.831442 20055 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:46.833065 20206 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:46.834724 20176 consensus_meta.cc:287] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.003s
I20260709 13:17:46.836277 19635 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.838392 19635 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:46.809091 20057 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:46.841493 20170 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.004s
I20260709 13:17:46.815524 20194 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:46.824635 20376 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:46.857193 20367 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:17:46.858691 20376 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:46.860760 20395 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.080s	user 0.003s	sys 0.002s
I20260709 13:17:46.865288 20194 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:46.913602 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 169531us
W20260709 13:17:46.919535 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.920634 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.928557 18202 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:46.931783 18229 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:46.932505 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:46.935663 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:46.937175 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:46.938717 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:46.939781 18230 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:17:46.944428 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:46.943161 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:46.943861 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:46.950418 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:46.951700 18237 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:46.956565 18277 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:46.964967 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1083) took 1033 ms. Trace:
I20260709 13:17:46.965582 18307 rpcz_store.cc:276] 0709 13:17:45.931393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.933022 (+  1629us) service_pool.cc:224] Handling call
0709 13:17:45.933360 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.933590 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.933616 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:45.995201 (+ 61585us) log.cc:844] Serialized 26 byte log entry
0709 13:17:46.281950 (+286749us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:46.393171 (+111221us) log.cc:844] Serialized 14 byte log entry
0709 13:17:46.394348 (+  1177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.394768 (+   420us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:46.734054 (+339286us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b1800393760. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:17:46.964095 (+230041us) raft_consensus.cc:1685] finished
0709 13:17:46.964296 (+   201us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.964674 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37341,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":14979,"raft.queue_time_us":241,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"spinlock_wait_cycles":62303488,"thread_start_us":288043,"threads_started":2,"wal-append.queue_time_us":296854}
I20260709 13:17:46.969812 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:46.971020 18307 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:46.972411 18307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:46.973701 18307 raft_consensus.cc:606] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.979187 18309 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:46.980219 18309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef83aa6f9534403ebe38156348430345"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:46.981206 18311 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:46.981608 18309 raft_consensus.cc:606] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:46.983060 18309 raft_consensus.cc:614] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:46.985731 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:46.989001 18307 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:47.000938 19387 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:47.001935 19387 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.004930 20057 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:47.005810 20057 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.020474 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:47.022109 18236 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:47.023113 18380 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:47.023396 19819 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:47.024363 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:47.011749 18303 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:17:47.024178 19819 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:46.847281 20170 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.053186 19387 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:47.053431 18305 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:17:47.059692 20188 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:47.099005 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:47.051100 20057 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:47.058487 20385 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:47.101253 20385 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.102448 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:47.105084 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:47.108979 18236 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
W20260709 13:17:47.063004 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54499.1us
I20260709 13:17:47.111205 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:47.113816 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:47.064973 20338 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:47.049286 20206 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:47.116529 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:47.068060 20170 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:47.087091 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1086) took 1154 ms. Trace:
I20260709 13:17:47.089929 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1081) took 1159 ms. Trace:
W20260709 13:17:47.092425 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.106711 20385 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:47.054025 19819 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.062727 19635 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:17:47.118978 18230 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:47.128804 18310 rpcz_store.cc:276] 0709 13:17:45.930727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.931508 (+   781us) service_pool.cc:224] Handling call
0709 13:17:47.089558 (+1158050us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b54003c19d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:47.089717 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1026038144}
I20260709 13:17:47.128472 18306 rpcz_store.cc:276] 0709 13:17:45.932327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.960341 (+ 28014us) service_pool.cc:224] Handling call
0709 13:17:45.960698 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:46.218649 (+257951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:46.218685 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:46.218724 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:46.218755 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.086564 (+867809us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b5400234e54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:47.086631 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.086864 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592800512}
W20260709 13:17:47.129736 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 64840.3us
I20260709 13:17:47.137122 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1590) took 1241 ms. Trace:
I20260709 13:17:47.137583 18378 rpcz_store.cc:276] 0709 13:17:45.895776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.896653 (+   877us) service_pool.cc:224] Handling call
0709 13:17:45.896923 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:46.377367 (+480444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.136472 (+759105us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b5400242f54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:47.136878 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102982528}
I20260709 13:17:47.138144 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1304) took 1316 ms. Trace:
I20260709 13:17:47.138513 18379 rpcz_store.cc:276] 0709 13:17:45.821403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.829627 (+  8224us) service_pool.cc:224] Handling call
0709 13:17:45.829946 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:46.243211 (+413265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.137652 (+894441us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b540004c4d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:47.137956 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886249728}
I20260709 13:17:47.139958 18276 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:47.140898 18201 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:47.141997 20327 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:47.143137 20327 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.144045 20031 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:47.144959 20031 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.146394 19635 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:47.146607 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:47.147795 20281 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:47.148674 20281 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.151109 20281 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:47.129941 19387 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:17:47.151700 20281 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:47.153254 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:47.153820 20225 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:47.155395 20273 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:47.146934 19635 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:47.168306 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:47.169169 18382 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:47.170166 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:47.173422 18276 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:47.160908 20225 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.147928 20031 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:47.186084 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:47.140964 20404 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:47.189492 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:47.186988 20188 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:47.193559 18310 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:47.194856 20057 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:47.195312 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:47.188537 20225 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:47.198065 19819 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:47.199940 20404 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:47.209381 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 44521.1us
I20260709 13:17:47.212973 20188 consensus_queue.cc:1059] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:47.213492 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:47.214901 20192 raft_consensus.cc:3055] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:47.215477 20192 raft_consensus.cc:740] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:47.216909 20190 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:47.217568 20190 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:47.217988 20327 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:47.218890 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:47.216917 20192 consensus_queue.cc:260] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.220453 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:47.221655 20192 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:47.222471 20113 consensus_meta.cc:287] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.527s	user 0.019s	sys 0.007s
I20260709 13:17:47.224010 19635 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.226049 19635 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:47.266959 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54604.4us
I20260709 13:17:47.268253 18276 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:47.274068 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:47.277089 18382 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:17:47.287271 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 146519us
I20260709 13:17:47.294229 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:47.294562 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:47.295275 18303 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:47.296591 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:47.297722 18383 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:47.301352 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:47.302050 18378 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:47.271855 20404 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:47.218909 20190 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:47.286835 20094 consensus_meta.cc:287] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.008s
I20260709 13:17:47.292245 20351 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:47.317198 18230 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:47.270139 20327 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
W20260709 13:17:47.355186 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 87059.2us
I20260709 13:17:47.313362 20273 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.360917 20113 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:47.331027 20210 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:47.365782 20210 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:47.362676 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:47.322468 20351 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:47.369195 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:47.378111 19387 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:47.378786 19387 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:47.379310 19387 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:47.392089 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.385892 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:47.329967 20404 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:17:47.395829 20266 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:47.424579 20266 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:47.426682 18201 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:47.427832 20276 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:47.435555 20148 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:47.436297 20148 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.437714 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:47.439170 18276 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:47.441315 20317 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:47.441741 20340 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.442516 20340 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.445147 20376 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:47.446022 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:47.448845 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:47.448863 20351 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.454730 20351 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:47.456149 20321 consensus_queue.cc:1175] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" responder_term: 4 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:47.417649 20273 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.463588 20232 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.421124 20281 consensus_queue.cc:1059] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:17:47.468984 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:47.369644 20225 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.473831 20225 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:47.465833 20340 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:47.477278 20078 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:47.477773 20078 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:47.478893 20078 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.487139 20194 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:47.464329 20232 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.493544 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1091) took 1559 ms. Trace:
I20260709 13:17:47.494163 20232 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:47.495261 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:47.497113 20176 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.497881 20176 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:47.487198 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 155213us
I20260709 13:17:47.504920 20194 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:47.505343 20328 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:47.509119 20148 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:47.493958 18304 rpcz_store.cc:276] 0709 13:17:45.933766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.957165 (+ 23399us) service_pool.cc:224] Handling call
0709 13:17:47.493121 (+1535956us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54001decd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:47.493343 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1544069504}
I20260709 13:17:47.512182 18304 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:47.515995 20113 raft_consensus.cc:3055] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:47.517251 20113 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:47.518321 20113 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.521770 20273 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:47.522049 20057 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:47.536897 18961 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:47.591583 20078 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:47.592037 20057 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.592892 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:47.593775 18381 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:47.597177 20113 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:47.597823 20348 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:47.597906 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:47.598601 20348 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:47.541479 20266 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:47.542390 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:47.544128 20347 raft_consensus.cc:2955] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:47.547344 20176 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:47.551187 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:47.564944 20345 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:47.440407 18276 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:47.568495 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:47.501621 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:47.574779 19387 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.608736 18378 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:47.614286 18383 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:47.603752 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:47.597420 20057 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:47.649514 19387 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:47.591894 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:47.661664 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 254711us
I20260709 13:17:47.648684 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:47.730991 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 290647us
I20260709 13:17:47.786782 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:47.730975 19387 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:47.736299 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:47.795234 19387 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.795614 20281 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:47.796190 20281 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:47.796298 20406 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.796725 20281 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:47.796988 20406 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.797794 19387 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:47.799477 20406 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:47.642460 20210 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.801262 18381 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:47.801878 18384 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
W20260709 13:17:47.802353 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.802870 20052 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:47.656366 20273 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:47.723588 20194 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.726871 20170 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:47.813766 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:47.677316 20348 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:47.730008 20225 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:17:47.907763 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 92462.5us
I20260709 13:17:47.911685 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:47.808575 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 80928.4us
I20260709 13:17:47.723297 20176 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.182s
I20260709 13:17:47.917178 19387 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:17:47.934355 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 330708us
I20260709 13:17:47.932255 20273 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.933202 20232 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:47.960044 19387 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:47.971805 20419 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:17:47.973480 20391 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.974042 20391 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.974396 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1557) took 1201 ms. Trace:
I20260709 13:17:47.974900 18307 rpcz_store.cc:276] 0709 13:17:46.773395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.013600 (+240205us) service_pool.cc:224] Handling call
0709 13:17:47.014428 (+   828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.015329 (+   901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.015372 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.016200 (+   828us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.378008 (+361808us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:47.378074 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.378163 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.974141 (+595978us) raft_consensus.cc:1685] finished
0709 13:17:47.974170 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.974329 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10514,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":178,"thread_start_us":332192,"threads_started":1,"wal-append.queue_time_us":619667}
I20260709 13:17:47.930629 20376 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:47.961807 20192 consensus_meta.cc:287] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.740s	user 0.010s	sys 0.006s
I20260709 13:17:47.991581 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:47.985148 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 179135us
I20260709 13:17:47.962011 20232 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.926970 20194 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:47.953722 20170 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:47.955358 20225 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:48.020721 19387 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.013018 20232 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:48.029255 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:48.023229 20194 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:48.037848 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.038134 20280 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:48.040110 18382 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:48.037946 18200 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:17:48.044935 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 187899us
I20260709 13:17:48.001086 20391 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.054841 19387 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:48.069248 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:48.078891 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 132932us
W20260709 13:17:48.085671 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 88550.2us
I20260709 13:17:48.087258 18276 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:48.100695 18276 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:48.038980 20376 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.064829 20391 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.078738 20190 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.134325 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:48.053783 20280 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:17:48.111358 20148 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:48.131539 20406 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:48.037703 18957 raft_consensus.cc:2955] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:48.170507 20057 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:17:48.179075 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 44886.1us
W20260709 13:17:48.198359 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 97765.8us
I20260709 13:17:48.213630 20376 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:48.215145 20078 consensus_meta.cc:287] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.623s	user 0.005s	sys 0.006s
I20260709 13:17:48.193307 20192 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:48.217679 20280 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:48.217793 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:48.218642 18310 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:48.218394 20280 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:48.219125 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:48.220851 20344 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:48.222266 20344 raft_consensus.cc:3055] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:48.222684 20344 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:48.223654 20344 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.225055 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:48.225745 18311 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:48.226754 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:48.149154 20190 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.227407 18304 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:48.229101 20190 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.230176 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:48.142117 20188 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:48.119643 20225 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:48.232481 20188 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.231714 20344 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:48.232937 20190 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:48.234421 20190 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:48.235106 20190 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:48.133490 20391 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:48.206668 20170 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.234679 20280 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:48.237738 20391 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:48.239895 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 158849us
I20260709 13:17:48.241245 18201 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:48.258463 20055 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.263034 20055 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.263763 18311 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:48.265261 20055 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:48.254259 20338 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:17:48.259208 20176 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:48.267933 20176 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.268105 20338 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:48.268569 20338 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:48.268396 20176 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:48.269161 20113 consensus_meta.cc:287] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.651s	user 0.008s	sys 0.004s
I20260709 13:17:48.269550 20338 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.235196 20225 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:48.270639 20345 consensus_meta.cc:287] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.622s	user 0.005s	sys 0.005s
W20260709 13:17:48.265336 20351 consensus_meta.cc:287] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.810s	user 0.008s	sys 0.003s
I20260709 13:17:48.273705 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:48.274405 18309 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 2.
I20260709 13:17:48.274802 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:48.276254 18236 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:48.277230 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:48.277648 18307 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:48.277904 18312 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:48.279036 20258 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.279608 20258 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.235013 20188 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:48.301533 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 97874.4us
I20260709 13:17:48.303650 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.305889 18381 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:48.315176 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.316998 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.317749 18202 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:48.323220 18379 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:48.324208 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.325079 18379 raft_consensus.cc:2410] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:48.325906 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.326179 20345 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:48.326603 20345 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.326942 20345 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:48.231848 20281 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.327440 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:48.331673 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.327991 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1567) took 1007 ms. Trace:
I20260709 13:17:48.327008 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.334841 19387 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:48.338358 18383 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:48.332504 18308 rpcz_store.cc:276] 0709 13:17:47.320712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.470366 (+149654us) service_pool.cc:224] Handling call
0709 13:17:47.470765 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:47.471243 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.471275 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:47.471980 (+   705us) log.cc:844] Serialized 52 byte log entry
0709 13:17:47.852365 (+380385us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:47.852410 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.852483 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.327692 (+475209us) raft_consensus.cc:1685] finished
0709 13:17:48.327723 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.327910 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3399,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":379807,"threads_started":1,"wal-append.queue_time_us":842722}
I20260709 13:17:48.345392 18229 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:48.346150 19635 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.346642 19635 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.355144 20281 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.359602 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.361848 19387 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.365231 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.366377 18383 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:48.375372 18311 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:48.387034 19387 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:48.361377 20317 consensus_meta.cc:287] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.920s	user 0.009s	sys 0.004s
I20260709 13:17:48.392237 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:48.395658 18383 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:48.400367 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.401160 18385 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
W20260709 13:17:48.402895 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 443329us
W20260709 13:17:48.403287 20413 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.602s	user 0.003s	sys 0.003s
I20260709 13:17:48.397897 20317 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:48.413009 20170 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.430578 20170 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.397353 20225 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:17:48.437130 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:48.455827 20176 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.486101 20190 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.489008 20190 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.490428 20232 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.490988 20345 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.497599 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:48.498677 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 181055us
I20260709 13:17:48.493108 20170 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.503639 19387 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:48.503751 18202 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:48.493592 20225 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:48.508010 18202 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:48.507826 19387 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:48.514539 20190 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:48.514640 20436 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:48.511864 20438 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:17:48.515547 20436 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.518064 20436 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.518754 20190 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:48.519429 20190 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:48.519548 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.520422 18379 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 6: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:48.507069 20344 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:48.534723 19387 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.526997 20344 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:48.513458 20225 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.530915 20232 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.546125 19387 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:48.547827 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 117628us
I20260709 13:17:48.538676 20410 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:48.540622 20344 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.552378 20410 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.557262 20410 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:48.558187 20410 consensus_queue.cc:1059] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:17:48.561636 20326 raft_consensus.cc:3055] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:17:48.562153 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.562433 20326 raft_consensus.cc:740] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:48.564340 20441 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:48.563768 20326 consensus_queue.cc:260] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.568744 20227 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:48.569285 20227 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.570048 20210 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.571796 20227 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.589978 20344 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.571831 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:17:48.572749 20435 log.cc:927] Time spent T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:17:48.573758 20225 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.578367 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1181) took 1389 ms. Trace:
I20260709 13:17:48.585084 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.601097 18236 rpcz_store.cc:276] 0709 13:17:47.188760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.188935 (+   175us) service_pool.cc:224] Handling call
0709 13:17:48.578085 (+1389150us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540036a1d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:48.578256 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2425513856}
W20260709 13:17:48.605774 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 96537.6us
I20260709 13:17:48.608026 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:48.609838 20348 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:48.610553 20348 raft_consensus.cc:697] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:48.613358 20344 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.614156 20344 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:48.614627 20344 raft_consensus.cc:697] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:48.615594 20344 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.600720 20345 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.603653 20225 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:48.618142 20225 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:48.618659 20436 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:48.619465 20326 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.619343 20436 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.626407 20015 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:48.627035 20015 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:48.628625 20258 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.630086 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:48.630440 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 58723us
I20260709 13:17:48.631521 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.632308 18384 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:48.632812 20440 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:48.611791 20348 consensus_queue.cc:237] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.634765 18276 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:48.640013 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:48.640918 18236 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:48.635310 20188 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:48.643890 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.643229 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.620460 20225 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:48.647832 18233 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:48.621892 20436 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.645593 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.650089 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.639614 20410 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:48.648746 18231 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:48.641742 20170 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:48.624019 20190 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.655056 18228 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 6: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:48.656735 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:48.653556 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.647367 20188 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.658716 18237 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:48.662031 20278 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:48.662694 20278 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:48.663415 20278 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:48.663712 20278 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:48.661490 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:48.667349 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.667856 20015 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.657748 20170 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:48.668880 20170 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:48.661792 20338 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:48.651961 20258 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:48.654589 20410 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:48.689430 18229 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:48.692271 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.695091 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.697687 20185 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:48.697629 20225 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:48.698416 20225 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:48.700529 20225 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:48.687012 20278 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.706336 20278 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:48.707137 20170 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:48.708643 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.701833 20190 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.709972 18351 leader_election.cc:400] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:17:48.715875 20170 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.727339 18236 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:48.728112 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.731115 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:17:48.738184 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.740790 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:48.741304 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:48.741649 18311 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 5: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:48.740480 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:48.742563 18308 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:48.702653 20258 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.727205 20436 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:48.744601 18236 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:17:48.746016 18312 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:48.746418 18303 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:48.746430 18307 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:48.749320 18236 pending_rounds.cc:85] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 2
W20260709 13:17:48.759526 20451 log.cc:927] Time spent T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:48.763800 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:48.740461 20281 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:48.765239 20281 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.757539 20436 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:48.754107 18236 pending_rounds.cc:107] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:17:48.771364 18236 raft_consensus.cc:2889] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:48.775122 18386 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:48.779376 20273 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.717576 20410 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.753018 20278 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.783094 18311 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: [5.3-6.4]
I20260709 13:17:48.786005 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.791865 18276 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:48.787516 18236 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:48.805084 20278 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.807382 20278 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:48.817287 20170 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:48.818178 20170 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:48.821180 20410 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:48.821465 20436 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:48.823366 20436 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:48.826267 20258 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.823917 20436 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:48.797502 20450 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:17:48.864862 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.819568 20170 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.868503 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.871867 20459 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:48.875149 18386 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:48.797142 20273 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:48.875872 18237 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:48.880765 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.808432 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:48.885830 18312 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:48.885881 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:48.872673 20347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:42512 (request call id 69) took 2671 ms. Trace:
I20260709 13:17:48.887737 20347 rpcz_store.cc:276] 0709 13:17:46.175228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.175375 (+   147us) service_pool.cc:224] Handling call
0709 13:17:46.205125 (+ 29750us) log.cc:844] Serialized 508 byte log entry
0709 13:17:48.827897 (+2622772us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17896,"raft.queue_time_us":306721,"raft.run_cpu_time_us":3379,"raft.run_wall_time_us":104802,"thread_start_us":491803,"threads_started":3,"wal-append.queue_time_us":319128,"wal-append.run_cpu_time_us":6928,"wal-append.run_wall_time_us":1376734}
I20260709 13:17:48.899636 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:48.900400 18232 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:48.900244 20227 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.901154 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.901067 20227 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.894906 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:48.903316 18308 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:48.903842 20176 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.895646 19635 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.895742 20318 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:17:48.906025 20318 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:48.906422 20318 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:48.906857 20436 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.907195 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:48.907374 20318 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.908825 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.909606 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.910558 18235 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:48.904865 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:48.911682 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:48.912295 18309 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:48.880940 20218 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:48.914667 20218 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:48.915944 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:48.881398 20258 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.916728 20326 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:48.916910 20258 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.881431 20273 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.917402 20326 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:48.919143 20258 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.919548 20273 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.907394 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:48.921064 18310 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:48.922474 18277 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:48.925639 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:48.936247 18236 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:48.879305 20459 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:48.942229 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:48.943912 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.946770 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:48.947698 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:48.941352 20433 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:48.950367 20433 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:48.950387 18121 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2b14d7467c934fdca91c8a466ef2d764 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:48.941514 20225 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:48.950917 20318 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:48.951318 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:48.920248 20326 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:48.962106 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.941562 20273 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.903630 20227 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:48.988951 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:48.987429 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:48.950954 20433 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:49.004127 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.033607 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:48.992268 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:49.048357 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:48.992689 20185 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:49.026729 18121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 44396.3us
I20260709 13:17:49.059370 20185 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.054219 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:49.064145 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.032904 20218 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:49.043665 20347 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.961777 20225 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:49.048231 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:49.045573 20457 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:48.961824 20326 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:49.085152 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 137480us
I20260709 13:17:49.050771 20113 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:48.990849 20455 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:17:49.115063 18228 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:49.123994 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:49.060134 20459 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:49.135787 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:49.136595 18228 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:49.105072 20345 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:49.138693 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.141134 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.141870 18379 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:49.146939 20459 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:49.155172 20185 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:49.162441 20441 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:49.162998 20441 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.110868 20225 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:49.165165 20441 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:49.169803 20345 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.171995 20345 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:49.182302 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.185477 18228 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:49.181670 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:49.188786 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:49.186738 18235 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:49.194602 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:49.211635 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:49.208667 20345 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:49.213442 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:49.177400 20188 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:49.124713 20457 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:49.112044 20347 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.226568 18382 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:17:49.227046 18382 pending_rounds.cc:85] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 3
I20260709 13:17:49.227312 18382 pending_rounds.cc:107] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:17:49.227556 18382 raft_consensus.cc:2889] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:49.228665 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:49.229367 18233 raft_consensus.cc:2368] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6.
I20260709 13:17:49.234776 18231 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:49.236027 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:49.238600 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:49.244058 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.129364 20326 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.225613 20348 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:49.265173 20348 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.265622 20348 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.265690 18232 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:49.221189 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:49.193346 20454 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.148s	user 0.002s	sys 0.002s
I20260709 13:17:49.213366 20345 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:49.220722 20441 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:17:49.228185 20457 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:49.268710 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:49.248540 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:49.286327 18231 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:49.293220 18233 raft_consensus.cc:2410] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:49.301363 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:49.302331 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:49.304984 18237 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:49.298610 20347 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:49.219899 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:49.321957 18228 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:49.297273 19819 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
W20260709 13:17:49.323195 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 220461us
I20260709 13:17:49.329836 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:49.336762 20460 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:49.324795 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:49.347841 18380 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.339000 20345 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:49.327349 20326 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:49.354645 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 129693us
W20260709 13:17:49.361433 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 237535us
I20260709 13:17:49.376377 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.376567 18277 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:49.378690 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:49.352869 20185 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:49.389547 18275 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:49.387933 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:49.388731 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:49.406363 18385 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:49.388994 20441 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:49.360839 20278 consensus_queue.cc:1059] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:17:49.417994 18275 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:49.424052 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:49.406700 20273 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:49.445673 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.446179 18275 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:49.448889 20273 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:49.427233 20326 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:49.452952 20467 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:49.429682 20459 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:49.454416 20459 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:49.454993 20459 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:49.456312 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:49.459513 18351 leader_election.cc:400] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6.
I20260709 13:17:49.459879 18351 leader_election.cc:403] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:49.414477 20281 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:49.447621 18275 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:49.413503 20441 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:49.414942 20475 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:49.405069 20433 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.428057 20472 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:49.464990 20345 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:49.468120 18380 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:49.474953 18351 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:49.494853 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:17:49.486733 20476 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:17:49.459131 20258 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:49.504428 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:49.481637 20441 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.480827 20473 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:49.494319 20278 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6.
I20260709 13:17:49.500375 20410 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:49.517234 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:17:49.517792 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 138832us
W20260709 13:17:49.515583 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 105441us
I20260709 13:17:49.505818 20472 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:49.512470 20258 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.513118 20225 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.505016 20345 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:49.481362 20326 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 13:17:49.515278 20470 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:17:49.503737 20113 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:49.510833 20185 consensus_queue.cc:1059] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
W20260709 13:17:49.538401 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 128266us
I20260709 13:17:49.539373 18277 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:49.516969 20457 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.550673 20433 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:49.555855 20479 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:17:49.557536 18380 consensus_queue.cc:237] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:49.541999 20410 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:17:49.547250 20465 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:17:49.566859 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.568636 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:49.555888 20218 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:17:49.564236 20471 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:17:49.572063 20218 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:49.574023 20326 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:49.565182 20410 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.567662 20475 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:49.579582 20318 consensus_queue.cc:1059] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:49.579793 20218 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.581137 20218 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:49.582377 20345 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:49.585232 20225 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:49.586243 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:49.587004 20457 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:49.563108 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:49.576592 20326 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:49.594751 20258 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:49.596359 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.596993 18386 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:49.597919 20488 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:49.598335 20488 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:49.599238 20488 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:49.600994 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47525.5us
I20260709 13:17:49.601341 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.601656 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:49.581156 20472 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.605669 20441 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.607766 20441 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:49.594841 20326 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.613991 20326 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.588193 20410 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.620797 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.621806 18382 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:49.622684 20318 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:49.623200 20318 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.623615 20318 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.618633 20457 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:49.630580 20457 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.631060 20457 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:49.629913 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 66886.3us
I20260709 13:17:49.632390 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:49.620894 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:49.634590 18377 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.638307 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.639289 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:49.640898 18233 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
W20260709 13:17:49.642498 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.637346 20317 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:49.646950 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:49.646428 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:49.653811 18277 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:49.656153 20459 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:49.658145 20317 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:49.659217 20317 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.674105 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.674887 18384 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:49.675314 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.676120 18381 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:49.654502 20348 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.674818 18379 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:49.677012 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.678468 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.678544 18386 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:49.679880 18926 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:49.680930 20015 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:49.687506 18377 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:49.695814 20478 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:49.696295 20348 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:49.696370 20478 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:49.654911 20490 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 13:17:49.697708 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.697475 20478 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.698403 20490 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:49.698680 20478 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:49.698863 20490 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:17:49.703369 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 49639.5us
W20260709 13:17:49.708501 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.699930 20490 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.715395 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:49.706679 20225 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:49.711275 20472 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.720194 20472 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.723935 20472 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:49.729382 18953 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:49.731096 20457 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.734074 20460 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:49.734206 20457 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:49.734704 20460 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.735427 20318 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.736650 20488 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.737696 20318 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:49.745240 20490 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:49.753211 18231 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:49.758016 20410 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:49.764760 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 49460.8us
I20260709 13:17:49.771013 20225 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:49.774536 20225 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:49.778193 20225 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.779850 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:49.788676 20478 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:49.790743 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 57243.1us
I20260709 13:17:49.793417 20218 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.793915 20218 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.794867 20468 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:49.795478 20468 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.795948 20218 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:49.797611 20468 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:49.814194 18385 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 6: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:17:49.817000 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 161378us
I20260709 13:17:49.819316 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:49.820124 18235 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.827716 18235 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:49.837869 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:49.838603 18311 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:49.775760 20475 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:49.841133 20489 raft_consensus.cc:3055] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:49.840240 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:49.841506 20489 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:49.841778 18235 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.842312 20489 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.843297 20489 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:49.844648 18132 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 80) took 9485 ms. Trace:
I20260709 13:17:49.845621 18231 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:49.848764 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:49.849517 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:49.850346 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:49.850697 20490 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:49.852752 18235 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:49.859429 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:49.859719 18237 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:49.860877 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:49.861035 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:49.861467 18310 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.862023 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:49.862776 18312 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 5: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:49.864961 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:49.866205 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:49.851198 20497 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:49.866755 18303 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:49.867383 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:49.867856 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:49.868003 18231 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:49.869019 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:49.869835 18303 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:49.863515 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:49.868902 20488 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:49.877969 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:49.883302 18384 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:49.877501 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:49.884397 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:49.886835 18381 raft_consensus.cc:2368] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6.
I20260709 13:17:49.891906 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:49.892594 18309 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.895022 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:49.895807 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:49.857019 20490 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:49.903672 18379 raft_consensus.cc:2368] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6.
I20260709 13:17:49.897909 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.891762 20497 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:49.904835 18385 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:49.883076 20467 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.914672 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:49.917127 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.921401 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:49.921687 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:49.922580 18382 raft_consensus.cc:2410] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:17:49.872553 18135 catalog_manager.cc:5697] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 3 to 6, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 6 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.932090 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:49.932802 18306 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:49.933624 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:49.934410 18306 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:49.900216 20468 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:49.937390 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:49.941685 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:49.943742 18306 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:49.944290 18311 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:49.952188 18276 leader_election.cc:400] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6.
I20260709 13:17:49.952780 18276 leader_election.cc:403] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:17:49.965369 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:49.923077 20478 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:49.937757 20218 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:49.983062 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:49.978549 18276 leader_election.cc:400] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6.
I20260709 13:17:49.937911 20318 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.980867 18311 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:17:49.986841 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.845017 18132 rpcz_store.cc:276] 0709 13:17:40.321677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.321887 (+   210us) service_pool.cc:224] Handling call
0709 13:17:40.511819 (+189932us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54002ae254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dd090 00007fa18227bf3a 00007fa1880321cc 00007fa18813037e 00007fa1865f12a4 00007fa1865f1232 00007fa1865f1161 00007fa1865f10dc 00007fa1865f0392 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:49.806456 (+9294637us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:46.616723 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:46.617344 (+   621us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:46.617385 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:17:46.617401 (+    16us) tablet.cc:662] Decoding operations
0709 13:17:46.624089 (+  6688us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:46.624160 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:46.624186 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:17:46.624587 (+   401us) tablet.cc:701] Row locks acquired
0709 13:17:46.624603 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:17:46.624756 (+   153us) write_op.cc:270] Start()
0709 13:17:46.624881 (+   125us) write_op.cc:276] Timestamp: P: 1783603066624705 usec, L: 0
0709 13:17:46.624917 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:17:46.625588 (+   671us) log.cc:844] Serialized 988 byte log entry
0709 13:17:46.874280 (+248692us) op_driver.cc:464] REPLICATION: finished
0709 13:17:46.876038 (+  1758us) write_op.cc:301] APPLY: starting
0709 13:17:46.876135 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:46.876254 (+   119us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:46.876446 (+   192us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:46.876848 (+   402us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:46.876988 (+   140us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:17:46.877023 (+    35us) write_op.cc:312] APPLY: finished
0709 13:17:46.877176 (+   153us) log.cc:844] Serialized 28 byte log entry
0709 13:17:46.877290 (+   114us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:46.877359 (+    69us) write_op.cc:454] Released schema lock
0709 13:17:46.877422 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:47.060948 (+183526us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:47.061034 (+    86us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":232,"mutex_wait_us":14466,"reported_tablets":15,"spinlock_wait_cycles":319764224,"child_traces":[["op",{"apply.queue_time_us":1282,"apply.run_cpu_time_us":2040,"apply.run_wall_time_us":184642,"num_ops":2,"prepare.queue_time_us":520063,"prepare.run_cpu_time_us":28813,"prepare.run_wall_time_us":109237,"raft.queue_time_us":4853,"raft.run_cpu_time_us":1603,"raft.run_wall_time_us":1628,"replication_time_us":249128,"thread_start_us":418741,"threads_started":4,"wal-append.queue_time_us":154554,"wal-append.run_cpu_time_us":10682,"wal-append.run_wall_time_us":1287441}]]}
I20260709 13:17:49.990131 18276 leader_election.cc:403] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:17:49.990109 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:49.961303 20459 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.927234 20460 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:49.999445 18310 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:50.002452 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:50.003305 18234 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.979900 20113 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:49.926443 20467 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.010473 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:49.985810 20218 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.962813 20468 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.028482 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:50.029325 18228 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:49.988354 20478 raft_consensus.cc:697] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:50.009891 18135 catalog_manager.cc:5697] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 3 to 4, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 4 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:17:49.968739 20225 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.039557 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:50.032523 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:50.012003 20113 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:50.036259 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:50.029947 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:50.039619 18135 catalog_manager.cc:5697] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 4 to 5, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 5 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:50.050007 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:50.001883 20487 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:50.043839 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:50.035565 18229 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:50.046367 18310 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:50.044207 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:50.026417 20218 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.048002 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:50.051309 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:50.050189 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:50.000281 20318 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.041726 20410 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:50.089706 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:50.047137 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:50.054898 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:50.087893 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:50.081683 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:50.054214 20113 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:50.103020 20468 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:50.054538 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:50.073596 20227 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:50.094091 18229 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:50.094787 18232 raft_consensus.cc:2368] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6.
I20260709 13:17:50.097527 18230 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:50.098850 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:50.025467 20490 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.072453 20491 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:17:50.115921 20410 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:50.031345 20497 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.088497 20185 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:50.109560 20495 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:50.165174 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:17:50.166085 20503 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:50.167829 18201 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:50.171288 18234 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:50.127810 18135 catalog_manager.cc:5697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 1 to 4, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 4 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:17:50.136258 18228 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
W20260709 13:17:50.143595 20502 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:17:50.138634 20478 consensus_queue.cc:237] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.130141 18229 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
W20260709 13:17:50.142663 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.176026 18309 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:50.130131 20460 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:50.115861 20468 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.173342 18201 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:50.110888 20227 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:50.183063 20227 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:50.193039 20318 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:50.196782 20347 raft_consensus.cc:2764] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:17:50.172560 18135 catalog_manager.cc:5697] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 1 to 5, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 5 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:50.205170 18135 catalog_manager.cc:5697] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 1 to 4, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 4 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:50.207139 18135 catalog_manager.cc:5697] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 3 to 4, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 4 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:50.210402 18135 catalog_manager.cc:5697] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 2 to 5, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 5 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:17:50.211377 20218 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.226724 20467 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:50.225793 20468 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.224547 20475 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.238507 20468 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:50.238734 20475 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.245747 20218 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:50.252537 18135 catalog_manager.cc:5697] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 1 to 2, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 2 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:50.303802 20514 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:50.304539 20514 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:50.305048 20514 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:50.305363 20467 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:50.306166 20467 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.309247 20467 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:50.310374 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 137163us
W20260709 13:17:50.313916 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 87695.6us
I20260709 13:17:50.316445 18135 catalog_manager.cc:5697] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:50.325675 18135 catalog_manager.cc:5697] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 1 to 4, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 4 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:17:50.331110 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:50.331557 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:50.314393 20326 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.344847 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:50.345983 18308 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.319200 20225 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:50.343344 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:50.351438 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:50.356662 18306 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:50.356938 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:50.358804 18311 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
W20260709 13:17:50.358835 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 47478.6us
I20260709 13:17:50.361045 18201 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:50.341555 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:50.362804 18277 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:50.363511 20433 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:50.363646 20317 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:50.367568 18307 raft_consensus.cc:2368] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
I20260709 13:17:50.367715 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:50.370401 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:50.370810 18135 catalog_manager.cc:5697] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:50.384770 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:50.388768 18303 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:50.390903 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:50.391965 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 310524us
I20260709 13:17:50.372362 18135 catalog_manager.cc:5697] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 1 to 5, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 5 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:17:50.344980 20468 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.394714 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:50.350123 20345 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:50.413475 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:50.352352 20487 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6.
I20260709 13:17:50.415105 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:50.405388 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:50.422618 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:50.423753 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:50.415396 18135 catalog_manager.cc:5697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 3 to 4, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 4 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:50.425614 20518 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:50.428912 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:50.429698 20410 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:50.431087 20410 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:50.431425 20410 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.431746 20410 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:50.433947 18351 leader_election.cc:400] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
I20260709 13:17:50.394011 20475 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:50.357434 20326 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.410386 20225 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:50.437062 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:50.384960 20433 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:17:50.416751 20460 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:50.447127 20514 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.449412 20514 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:50.445195 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54149.9us
I20260709 13:17:50.436537 20478 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:50.433130 20218 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:50.427945 20491 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:50.450677 18201 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:50.427752 20497 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.416834 20468 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.469318 18960 consensus_queue.cc:237] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:50.470602 18201 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:50.470916 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:50.445016 20185 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:50.475198 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:50.476079 20525 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:50.477545 20227 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.478018 20468 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:50.478889 20510 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:17:50.479861 20227 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:50.466660 20318 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.480753 20318 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.416337 20519 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:17:50.473522 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:50.483801 18234 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:50.487891 18233 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:50.446767 20488 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:17:50.474305 20218 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:50.490870 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:50.487075 20460 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:17:50.491901 20517 log.cc:927] Time spent T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:50.491822 20460 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.494388 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:50.495329 20460 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:50.495496 18201 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:50.495909 20511 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:50.489442 20468 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:50.497262 20468 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.499099 20326 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:50.499373 20468 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:50.485111 20497 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.501353 20497 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:50.501646 20410 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.504132 20410 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:50.501590 20218 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.538535 18308 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:50.517490 18233 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:50.521031 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:50.522804 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:50.541234 18228 raft_consensus.cc:2410] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:50.542303 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:50.543020 18228 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:50.524642 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:50.526515 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:50.528733 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:50.542409 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 147665us
I20260709 13:17:50.545471 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:50.546851 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:17:50.533622 20459 consensus_meta.cc:287] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.005s
I20260709 13:17:50.535264 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:50.536273 18201 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:50.555994 20318 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:50.598520 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 62325.2us
I20260709 13:17:50.599159 20511 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:50.539868 20516 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:50.544293 18237 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:50.600106 20516 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:50.599757 20459 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6.
W20260709 13:17:50.598752 20489 consensus_meta.cc:287] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.755s	user 0.009s	sys 0.005s
I20260709 13:17:50.601142 20516 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.535394 20525 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:50.548240 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:50.604031 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 56272.4us
I20260709 13:17:50.604717 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:50.605506 18202 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:50.606269 20258 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:50.606282 20532 raft_consensus.cc:2764] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:17:50.606753 20258 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.593155 18276 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:50.607227 20258 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:50.579141 18234 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:50.615890 18230 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.608314 20459 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:50.626812 20519 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.627398 20519 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.631699 20519 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:50.632861 18235 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 7: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:50.640115 18304 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:50.641381 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:50.642050 18307 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:50.642535 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:50.619122 20113 consensus_meta.cc:287] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.517s	user 0.006s	sys 0.005s
I20260709 13:17:50.644148 18277 leader_election.cc:400] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6.
I20260709 13:17:50.654910 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:50.657712 20317 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:50.658150 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:50.659087 18303 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
W20260709 13:17:50.651554 20507 log.cc:927] Time spent T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.515s	user 0.001s	sys 0.004s
W20260709 13:17:50.753949 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 99143us
I20260709 13:17:50.799819 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:50.760576 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 93856.6us
I20260709 13:17:50.779747 20489 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.704005 18306 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:50.653728 20113 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:50.769203 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 162005us
I20260709 13:17:50.802827 18311 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:50.764204 20347 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:50.813335 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:50.817003 18234 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:50.820145 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:50.869014 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 53166.8us
I20260709 13:17:50.879475 20258 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.891855 20258 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:50.812593 18953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53364 (request call id 186) took 1015 ms. Trace:
I20260709 13:17:50.870301 20513 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:50.870422 20528 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:17:50.872555 20347 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:50.965704 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:50.870965 20326 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:50.902572 20113 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:50.814509 20489 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:50.823570 20511 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:50.934334 20410 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:50.920877 18307 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
W20260709 13:17:50.922303 20507 log.cc:927] Time spent T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:17:50.935842 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:50.930871 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 56081.4us
I20260709 13:17:50.942217 18230 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:50.960290 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:50.981264 18386 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:50.961773 18380 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:17:50.982694 18380 pending_rounds.cc:85] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 2
I20260709 13:17:50.983079 18380 pending_rounds.cc:107] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:17:50.983402 18380 raft_consensus.cc:2889] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:50.931836 20227 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:50.871685 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:50.968317 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:50.973587 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:50.994354 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:50.984525 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:50.958608 20495 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.995079 18383 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
W20260709 13:17:50.998759 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 127132us
I20260709 13:17:50.994151 18384 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:50.968955 20326 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.003146 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:51.004248 18234 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:51.005716 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:51.009192 18202 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:50.994052 20478 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:51.042068 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:50.997502 20511 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:51.024842 18384 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:51.010032 20326 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:51.047465 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 447872us
I20260709 13:17:51.052070 18202 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:51.060585 18201 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:50.993861 20410 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.007285 20527 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:51.065092 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:51.066008 18384 raft_consensus.cc:2410] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:17:51.049358 20516 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:51.067129 20516 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:51.067589 20516 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:50.941270 18953 rpcz_store.cc:276] 0709 13:17:49.796984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.797162 (+   178us) service_pool.cc:224] Handling call
0709 13:17:49.797698 (+   536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:49.798097 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.798124 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:50.213808 (+415684us) spinlock_profiling.cc:243] Waited 8.9 ms on lock 0x7b2c00047988. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:17:50.420156 (+206348us) log.cc:844] Serialized 508 byte log entry
0709 13:17:50.622376 (+202220us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:50.624483 (+  2107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.655855 (+ 31372us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.690285 (+ 34430us) raft_consensus.cc:1685] finished
0709 13:17:50.716628 (+ 26343us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.810348 (+ 93720us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20471680,"thread_start_us":147789,"threads_started":1,"wal-append.queue_time_us":172796}
I20260709 13:17:51.072625 20227 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:51.073282 20227 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:51.073766 20536 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:17:51.006908 20495 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.057376 20526 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:51.043440 20534 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:51.082643 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:51.083133 18201 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:51.062624 20490 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:51.056668 20478 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.088241 20490 raft_consensus.cc:697] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:51.089565 20478 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:51.089244 20490 consensus_queue.cc:237] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.092928 20511 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.095167 20514 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:51.095558 20514 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.095973 20514 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:51.096386 18201 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:51.083640 20528 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:51.097398 20519 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:51.098400 20528 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:51.100266 18201 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:51.102141 20525 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:51.104255 18386 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 6: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:51.104476 20525 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:17:51.104797 20537 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:17:51.105002 20525 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:51.112018 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:51.113822 20347 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:51.048125 20348 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:17:51.079674 20258 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:51.131286 20348 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:17:51.124963 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 325231us
I20260709 13:17:51.124214 20273 raft_consensus.cc:2764] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:17:51.127139 20317 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:51.128130 20495 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:51.128295 20478 raft_consensus.cc:2955] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:51.147748 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:51.147982 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:51.149015 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:51.138075 18383 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:51.131758 20348 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:51.152853 20348 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.142313 20488 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.124761 20532 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:51.154448 20488 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.155771 20489 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:51.158267 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:51.162240 20113 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:51.162642 20113 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.163004 20113 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:51.165340 20519 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:51.165421 20472 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:51.166174 20519 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:51.168167 20513 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:51.168234 20433 raft_consensus.cc:3055] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:51.169351 20433 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:51.169060 20513 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.170148 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:51.170312 20433 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.171561 20513 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:51.172645 20527 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:51.173282 20527 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.172719 20488 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:51.175380 20528 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.175563 20527 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:51.176292 20410 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:51.177726 20513 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:51.178284 20513 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:51.181160 18310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:51.182125 18310 raft_consensus.cc:606] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:51.182559 18310 raft_consensus.cc:614] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:51.168771 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:51.194917 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:51.197125 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:51.197839 18385 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:51.197350 20516 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:51.204571 20538 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:51.155311 18953 raft_consensus.cc:2955] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:51.206408 20516 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:51.209398 19819 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:51.211162 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:51.212559 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:51.219274 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:51.220441 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:51.222808 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:51.154457 20348 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:51.171573 20433 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:51.223237 19819 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:51.189940 20519 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:51.229758 20410 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:51.238202 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:51.102782 20534 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.190544 20317 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:51.241961 18377 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:51.245177 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:51.302448 18237 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:51.227504 20273 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:17:51.232187 18384 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:51.306284 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:51.249805 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:51.250267 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:51.250748 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:51.255232 18201 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:51.310714 20489 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.311870 20513 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:51.252983 20531 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:51.312937 20531 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:51.264834 20441 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:51.316031 20441 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:51.299017 20497 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:51.317497 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:51.317399 20497 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.299288 20218 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.320844 20218 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.323822 20218 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:51.293228 20467 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:51.326207 20467 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.297801 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:51.311425 20489 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.294150 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:51.337036 18303 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:51.328796 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 74765.8us
I20260709 13:17:51.339490 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:51.310148 20495 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:51.335301 18309 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:51.343760 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:51.347265 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:51.348354 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:51.349118 18228 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:51.346939 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:51.357684 18309 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:51.353096 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:51.300776 20488 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.327941 20519 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:51.317054 19819 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.363215 18386 raft_consensus.cc:2955] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:51.373312 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:51.382881 18237 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:51.374536 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:51.335058 20518 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:51.362859 20532 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:51.392362 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:51.336086 20218 consensus_queue.cc:1059] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:17:51.384299 18235 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:51.391005 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:51.327013 20326 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.395085 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:51.385283 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 281435us
W20260709 13:17:51.388984 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 295823us
I20260709 13:17:51.372197 20497 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:51.405124 18237 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:17:51.405290 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:51.327701 20410 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:51.360673 20495 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:51.409282 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 248058us
I20260709 13:17:51.420140 20531 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:51.420576 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:51.422120 18381 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 6: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:51.397696 20467 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:51.369421 20488 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.456446 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:51.457046 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 146856us
I20260709 13:17:51.457247 18377 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:51.457381 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:51.457661 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:51.458508 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:51.459339 18307 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:51.410859 20516 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.461208 18306 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:51.412465 20497 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.472672 18303 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:51.389612 20519 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:51.460384 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:51.482641 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:51.483536 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:51.431464 20527 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:51.434248 18200 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:51.498124 18307 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:51.498916 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:51.407555 20514 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:51.499244 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 84023.7us
I20260709 13:17:51.414129 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:51.467648 20478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46836 (request call id 66) took 1876 ms. Trace:
W20260709 13:17:51.505076 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 70937us
I20260709 13:17:51.470656 20467 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:51.551661 18236 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:17:51.512177 20528 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:51.486068 20516 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.526895 20273 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.498076 20497 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.539614 20511 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:51.539543 20526 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:51.453671 20317 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:51.542605 20467 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:51.732148 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 218064us
W20260709 13:17:51.649960 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 191793us
W20260709 13:17:51.854208 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 440139us
I20260709 13:17:51.854321 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:51.855605 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:51.696781 18385 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
W20260709 13:17:51.642668 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 175737us
W20260709 13:17:51.900696 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 46858.7us
W20260709 13:17:51.697933 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 176345us
W20260709 13:17:51.925269 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 71004.1us
I20260709 13:17:51.926826 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:17:51.748805 20554 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
W20260709 13:17:51.724749 20557 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:17:51.636130 20548 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 13:17:51.819519 20556 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:17:51.822299 20433 consensus_meta.cc:287] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.003s
W20260709 13:17:51.646059 20525 consensus_meta.cc:287] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.003s
W20260709 13:17:51.830106 20566 log.cc:927] Time spent T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:17:51.652033 20531 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:17:51.995652 20535 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.933s	user 0.000s	sys 0.014s
I20260709 13:17:51.652745 20489 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:51.924819 20113 consensus_meta.cc:287] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.761s	user 0.011s	sys 0.003s
W20260709 13:17:52.053149 18202 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.001s	sys 0.031s
I20260709 13:17:51.989466 20326 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:51.849532 20516 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:51.953334 20570 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 13:17:52.056936 18380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.011s	sys 0.022s
I20260709 13:17:52.001873 20467 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:51.977383 20555 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:17:51.925866 20441 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:51.982244 20565 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:51.983884 20519 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:51.984730 20514 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:51.647913 20534 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:51.943005 20218 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:51.943432 20488 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:51.947218 20567 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:52.017561 18382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.011s	sys 0.017s
I20260709 13:17:52.026399 18306 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:17:52.026679 18305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
W20260709 13:17:52.083976 18382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.012s	sys 0.017s
W20260709 13:17:51.945860 20227 consensus_meta.cc:287] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.872s	user 0.011s	sys 0.003s
W20260709 13:17:52.003052 20348 consensus_meta.cc:287] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.749s	user 0.010s	sys 0.000s
I20260709 13:17:51.637866 20273 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:52.053802 18202 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.001s	sys 0.031s
W20260709 13:17:52.055150 18312 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.006s	sys 0.027s
I20260709 13:17:51.988489 20573 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:51.996975 20472 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:52.016708 20495 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:51.959017 20497 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:52.057438 18380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.011s	sys 0.022s
I20260709 13:17:51.947458 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:52.045964 20532 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:52.049006 20433 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:52.047432 20531 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:52.084137 18306 pending_rounds.cc:85] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 2
I20260709 13:17:52.054899 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:52.086544 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 231067us
W20260709 13:17:52.098737 18312 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.006s	sys 0.028s
I20260709 13:17:52.041859 20525 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.068483 20516 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:52.104772 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 586168us
W20260709 13:17:52.058990 20527 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.009s	sys 0.025s
I20260709 13:17:52.118172 18306 pending_rounds.cc:107] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:17:52.141367 18306 raft_consensus.cc:2889] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:52.126432 18380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1403) took 1016 ms. Trace:
I20260709 13:17:52.126474 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1118) took 1586 ms. Trace:
I20260709 13:17:52.054802 20113 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.127544 18276 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:52.130837 20574 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:52.156114 18305 raft_consensus.cc:606] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:52.167733 18305 raft_consensus.cc:614] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:52.142052 18380 rpcz_store.cc:276] 0709 13:17:51.109841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.112624 (+  2783us) service_pool.cc:224] Handling call
0709 13:17:51.112934 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.113154 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:51.195686 (+ 82532us) log.cc:844] Serialized 14 byte log entry
0709 13:17:52.125987 (+930301us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:52.126054 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:52.126122 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.126215 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.126359 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19118,"prepare.queue_time_us":202078,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":26699,"thread_start_us":992792,"threads_started":2}
I20260709 13:17:52.171742 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:52.078657 20565 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:52.111435 20472 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.178169 20472 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.121531 20573 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:52.143656 18232 rpcz_store.cc:276] 0709 13:17:50.525275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.525715 (+   440us) service_pool.cc:224] Handling call
0709 13:17:50.573849 (+ 48134us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:50.584794 (+ 10945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:50.584823 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:50.600957 (+ 16134us) log.cc:844] Serialized 26 byte log entry
0709 13:17:50.925839 (+324882us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:50.925874 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.926595 (+   721us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:51.994865 (+1068270us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:17:52.102709 (+107844us) raft_consensus.cc:1685] finished
0709 13:17:52.102739 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.112070 (+  9331us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21350,"raft.queue_time_us":11365,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":3371392,"thread_start_us":324425,"threads_started":1,"wal-append.queue_time_us":396535}
I20260709 13:17:52.101884 20227 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.179864 18234 raft_consensus.cc:2410] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:17:52.180564 20227 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.167280 20514 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:17:52.182672 18953 raft_consensus.cc:1813] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Handling vote request from an unknown peer 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:52.182897 20590 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:52.183351 18953 raft_consensus.cc:2410] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:17:52.126169 20531 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:52.118710 20433 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:52.184821 20433 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:51.521186 20478 rpcz_store.cc:276] 0709 13:17:49.555342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.555569 (+   227us) service_pool.cc:224] Handling call
0709 13:17:49.576190 (+ 20621us) log.cc:844] Serialized 508 byte log entry
0709 13:17:49.732764 (+156574us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b1800420ee0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:17:50.144982 (+412218us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b5400017820. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821e8dbe 00007fa1821f3930 00007fa1821f38d8 00007fa1821f3858 00007fa1821f3813 00007fa1821f2a9c 00007fa1880de626 00007fa1880d8dd8 00007fa18222f7cb 00007fa1822322c0
0709 13:17:51.428427 (+1283445us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53621,"raft.queue_time_us":86155,"raft.run_cpu_time_us":1310,"raft.run_wall_time_us":11106,"spinlock_wait_cycles":14221952,"thread_start_us":94148,"threads_started":2,"wal-append.queue_time_us":89140,"wal-append.run_cpu_time_us":6265,"wal-append.run_wall_time_us":1451998}
W20260709 13:17:52.189123 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 240994us
W20260709 13:17:52.195067 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 67629.5us
I20260709 13:17:52.199441 18276 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:52.117836 20218 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:52.202965 19819 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:52.208678 19819 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:52.209071 19819 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:52.210095 20580 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:52.210992 20594 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.211612 20273 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.212466 20525 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.167277 20516 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.213871 20562 raft_consensus.cc:3055] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:52.214282 20562 raft_consensus.cc:740] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:52.214723 20516 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.215122 20562 consensus_queue.cc:260] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.133420 20532 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:52.217891 19819 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.159276 20527 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:52.220675 19819 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.221575 20527 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.222265 20218 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.211496 20594 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.227217 20594 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.167770 20534 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:17:52.229739 20581 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:17:52.231138 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1679) took 1003 ms. Trace:
I20260709 13:17:52.216420 20562 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:52.232645 20433 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.233529 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1235) took 1015 ms. Trace:
I20260709 13:17:52.233968 18234 rpcz_store.cc:276] 0709 13:17:51.217676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.218934 (+  1258us) service_pool.cc:224] Handling call
0709 13:17:52.233334 (+1014400us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b54001897d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:52.233472 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2206438144}
I20260709 13:17:52.231545 18384 rpcz_store.cc:276] 0709 13:17:51.227919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.373204 (+145285us) service_pool.cc:224] Handling call
0709 13:17:51.373615 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:51.492013 (+118398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:51.492057 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:51.501495 (+  9438us) log.cc:844] Serialized 26 byte log entry
0709 13:17:51.702639 (+201144us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:51.702697 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.702794 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:52.230904 (+528110us) raft_consensus.cc:1685] finished
0709 13:17:52.230927 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.231070 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58350,"raft.queue_time_us":135001,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":16695,"spinlock_wait_cycles":166144,"thread_start_us":254007,"threads_started":2,"wal-append.queue_time_us":500286}
I20260709 13:17:52.206233 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:52.204995 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:52.241109 20513 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.241446 20594 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:52.241734 20513 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.244095 20513 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.245808 20565 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:52.247640 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.249383 20433 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.249626 20574 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:52.250444 20574 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:52.254524 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1392) took 1289 ms. Trace:
I20260709 13:17:52.254878 20577 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.255005 18381 rpcz_store.cc:276] 0709 13:17:50.965198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.965340 (+   142us) service_pool.cc:224] Handling call
0709 13:17:52.254269 (+1288929us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b540004c4d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:52.254429 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1025823616}
I20260709 13:17:52.255640 20577 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.263964 20577 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.266104 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1672) took 1122 ms. Trace:
I20260709 13:17:52.266739 18378 rpcz_store.cc:276] 0709 13:17:51.143982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.358782 (+214800us) service_pool.cc:224] Handling call
0709 13:17:51.359176 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.461641 (+102465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:51.461677 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:51.461741 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:51.461773 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.265745 (+803972us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54000023d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:52.265820 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.266019 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235165440}
I20260709 13:17:52.248868 20113 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.269546 18305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:52.270114 18305 raft_consensus.cc:606] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:52.204583 18309 raft_consensus.cc:2368] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6.
I20260709 13:17:52.283782 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:52.288658 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:52.290053 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:52.294011 20573 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:52.294979 20410 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:52.302207 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1240) took 1057 ms. Trace:
I20260709 13:17:52.302714 18236 rpcz_store.cc:276] 0709 13:17:51.244411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.245207 (+   796us) service_pool.cc:224] Handling call
0709 13:17:51.245716 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:51.552332 (+306616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.301897 (+749565us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54000d1954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:52.302131 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702707968}
I20260709 13:17:52.281914 20532 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:52.310629 18305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "715a2657f09449038e569acddbab1aea"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "b52e2477fc524694967c4a16afa983e3"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:52.311228 18305 raft_consensus.cc:606] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Received request to transfer leadership to TS b52e2477fc524694967c4a16afa983e3
I20260709 13:17:52.311535 18305 raft_consensus.cc:614] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:52.317029 20585 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 13:17:52.329080 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 122448us
I20260709 13:17:52.330247 18276 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:52.332083 18276 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:52.336015 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.337649 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.368564 18305 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:52.336987 18381 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
W20260709 13:17:52.373194 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 130065us
W20260709 13:17:52.374682 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 135656us
W20260709 13:17:52.375871 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 43918.1us
I20260709 13:17:52.376124 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:52.376600 18276 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:52.381438 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.382041 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:52.385803 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:52.387115 18309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:17:52.387631 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:52.387650 18309 raft_consensus.cc:606] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:52.389230 18309 raft_consensus.cc:614] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:52.266911 20574 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:52.391031 18276 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:52.391219 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:52.393019 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:52.393957 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:52.397044 18237 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:52.398074 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:52.398635 18237 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:52.375406 20113 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:52.399433 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:52.392089 20487 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:52.415642 18303 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:52.416847 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:52.417742 20578 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:52.379881 20326 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:52.419188 18236 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 7: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:52.413106 20575 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:52.419677 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 61791.2us
I20260709 13:17:52.420431 18202 leader_election.cc:400] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6.
I20260709 13:17:52.445577 18202 leader_election.cc:403] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:17:52.420894 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:52.421221 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:52.392762 20526 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:52.435937 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:52.384327 20516 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:52.422188 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:17:52.380595 20534 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:17:52.397607 20441 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:52.396623 20478 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:52.451272 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:52.455061 18120 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 943649b738074d87a593c237cf998758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 13:17:52.458206 18201 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:52.464468 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1166) took 1008 ms. Trace:
I20260709 13:17:52.465672 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:52.466672 20573 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.453511 20317 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:52.452889 20578 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.489100 20573 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.443645 20326 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:52.518730 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52231.3us
W20260709 13:17:52.519009 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 98720.6us
I20260709 13:17:52.520115 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:52.521004 18236 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:52.494717 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:52.419703 20574 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:52.466524 18230 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:52.465404 18303 rpcz_store.cc:276] 0709 13:17:51.455854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.496062 (+ 40208us) service_pool.cc:224] Handling call
0709 13:17:51.496408 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.435504 (+939096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.464204 (+ 28700us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54000bc2d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:52.464400 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113542016}
I20260709 13:17:52.536113 18232 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 7: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:52.526996 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:52.528429 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:52.529390 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:52.530946 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:52.540118 18311 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:52.460634 20441 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:52.545035 18120 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 110843us
I20260709 13:17:52.438148 20347 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:17:52.559667 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:52.560945 18310 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 5: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:17:52.562950 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 111763us
I20260709 13:17:52.563773 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:52.463376 20410 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:52.554028 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.576151 18237 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:52.555187 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.577338 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.577796 18384 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:17:52.539297 18312 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:52.578480 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:52.565987 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.567404 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:52.579504 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:52.579783 18385 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 6: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:52.491926 20526 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:52.524240 20326 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:52.580940 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:52.597384 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.598835 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:52.582201 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.583446 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.524227 20497 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:52.451987 20439 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 13:17:52.587085 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:52.613760 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:52.587868 18230 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:52.494769 20488 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:17:52.571494 18236 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:52.569545 20578 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.558848 20441 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.494663 20478 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:52.606791 18276 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:52.614714 18311 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:52.524644 20514 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:52.618811 18927 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:52.568642 20318 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:17:52.657773 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 51054.3us
I20260709 13:17:52.658677 18276 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:52.604821 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:52.464110 20516 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:52.569378 20317 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:52.561937 20567 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:52.572907 20410 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.495028 20531 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.580407 20490 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:52.582756 20345 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.612877 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.620965 20579 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6.
I20260709 13:17:52.585963 20572 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:52.600903 20553 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.661275 18310 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:17:52.665277 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:52.666536 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.629168 20489 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:52.677930 18235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:17:52.743201 18308 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:52.689795 18304 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:52.691869 20410 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:52.642158 20347 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.654481 20218 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:52.667940 20542 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:52.664785 20015 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:17:52.642107 20348 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:17:52.624528 20497 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.689670 20589 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:52.695076 18384 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:17:52.743533 18235 raft_consensus.cc:606] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:52.754343 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.638401 18380 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:52.675580 20467 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:52.672960 20318 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.664542 20514 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.795060 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.797326 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.786907 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:52.766410 20580 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:52.788654 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:52.824782 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:52.769991 20218 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.757633 20433 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:52.731057 20345 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.841789 20589 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:52.793722 20489 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.844980 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:52.765727 20347 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.784030 20518 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:52.854513 20598 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:17:52.854835 20484 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:52.864802 20527 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:52.866080 20595 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.776750 20577 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:52.917538 20577 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:52.919559 20577 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:52.785570 20575 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:52.920279 20575 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.922310 20575 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.927291 20531 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.929248 20478 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:52.931980 20514 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.931748 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:52.875624 20348 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:52.876673 20564 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:17:52.900877 20557 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:17:52.886782 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 86055.7us
I20260709 13:17:52.885495 20589 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.893918 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.894322 20516 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:52.800953 20604 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:52.965138 20604 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:52.855607 20578 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:52.727842 20526 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.750208 20553 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.973985 20553 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.749162 20567 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.839519 20317 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.901021 20518 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.977248 20518 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.911199 20484 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:52.977574 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:52.979847 20484 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.911898 20527 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.980430 18305 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:17:52.912690 20599 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:17:52.913435 20596 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:17:52.913666 20497 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:52.914674 20595 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.983294 20497 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:52.983855 20497 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.984908 20595 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.916216 20532 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.985605 20532 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.986061 20497 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:52.987797 20532 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.917021 20511 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:52.988461 20511 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.976382 20567 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:52.991276 20511 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.791783 20467 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:52.992879 20467 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:52.993011 20604 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:52.992908 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.994505 18385 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:52.752910 20572 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.982669 20527 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.909659 20573 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:53.021864 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 365134us
I20260709 13:17:52.995587 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:52.870745 20433 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.959663 18381 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:17:53.024649 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:52.894989 20489 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:52.994858 20589 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:53.012698 20518 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.042788 18201 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:52.957545 20348 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.048177 18201 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:53.050753 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:53.053409 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:53.056622 20608 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.059417 20608 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.063369 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.064435 20572 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:53.064579 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.065613 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.065747 20218 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:53.066601 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.067557 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.067898 20348 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:53.069751 20489 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:53.071062 20347 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:53.073505 20318 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:53.048259 20518 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.077906 20518 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:53.078481 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:53.078931 20345 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:52.993697 20564 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.080529 18385 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:53.081025 20564 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:53.081256 20562 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.848s	user 0.010s	sys 0.002s
I20260709 13:17:53.082299 20612 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:53.040057 20553 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:53.085021 20553 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.086908 20553 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:53.057080 20511 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:53.089165 20433 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:53.087718 20410 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.094537 20410 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:53.097795 18385 raft_consensus.cc:2410] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:53.101876 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:53.102679 20608 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:53.107491 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.035696 20497 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:53.115610 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:53.117290 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:53.118019 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:53.118731 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:53.119024 18311 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:53.120744 18277 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:53.121272 20433 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:53.122769 20441 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:53.123344 20326 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
I20260709 13:17:53.123842 18380 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
W20260709 13:17:53.124259 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 78751.1us
W20260709 13:17:53.127070 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 79062.7us
I20260709 13:17:53.127627 18383 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
W20260709 13:17:53.128448 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 303740us
I20260709 13:17:53.129573 18306 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
I20260709 13:17:53.284461 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:53.285881 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 165205us
I20260709 13:17:53.283874 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.252351 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.169348 18386 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:17:53.276262 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.169929 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:53.242260 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.130726 20472 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.133700 18307 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:53.290105 18201 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:53.249693 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.293596 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.255347 18232 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:53.287950 18386 pending_rounds.cc:85] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 2
I20260709 13:17:53.211205 18385 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:53.291812 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:53.290654 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:53.290548 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:53.124393 20495 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.171s
I20260709 13:17:53.276667 20487 raft_consensus.cc:993] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:17:53.578895 18235 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:53.622699 18200 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:17:53.617372 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 326857us
I20260709 13:17:53.623726 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:53.301381 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:53.618139 18312 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:53.626894 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.627532 18312 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:53.411343 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:53.612198 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 231) took 1034 ms. Trace:
I20260709 13:17:53.185220 20345 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:53.628831 18233 rpcz_store.cc:276] 0709 13:17:52.576255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.577987 (+  1732us) service_pool.cc:224] Handling call
0709 13:17:52.578291 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.717426 (+139135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.717478 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:52.717544 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:52.717592 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.610731 (+893139us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400059454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:53.610781 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.610908 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319294848}
I20260709 13:17:53.608362 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.295111 18386 pending_rounds.cc:107] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:17:53.302681 18231 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:53.414270 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.352710 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:53.606972 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.619742 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:53.344982 18927 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:53.360044 18379 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:53.131328 20578 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:53.606513 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.643071 18386 raft_consensus.cc:2889] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:53.131043 20258 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:53.610173 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.625197 20579 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:53.646716 18228 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:53.647461 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.647693 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.647866 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.194979 20580 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:53.381078 20518 raft_consensus.cc:993] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:17:53.296838 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.650501 18385 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:17:53.650545 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1418) took 1083 ms. Trace:
I20260709 13:17:53.631035 18229 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:53.651643 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.631145 20113 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:53.652731 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.655186 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:53.506858 20623 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:17:53.659346 18386 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:53.642942 18307 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:53.579804 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.293040 20616 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:53.630467 20433 raft_consensus.cc:1081] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:17:53.183285 20467 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.211191 20589 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.664551 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:53.666088 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:53.648931 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.610693 18304 raft_consensus.cc:2955] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:53.643862 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.644655 18201 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:53.342916 20617 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:53.644484 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.651226 18377 rpcz_store.cc:276] 0709 13:17:52.567608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.669543 (+101935us) service_pool.cc:224] Handling call
0709 13:17:52.705960 (+ 36417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.033188 (+327228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.033223 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:53.033273 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:53.033315 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.650310 (+616995us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54003bcc54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:53.650358 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.650484 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752031616}
I20260709 13:17:53.651893 20580 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:53.383582 20624 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:17:53.655620 18229 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:53.659795 20579 raft_consensus.cc:1081] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
W20260709 13:17:53.642840 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 297955us
I20260709 13:17:53.610395 20621 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:53.385174 20441 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:53.644680 20573 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:53.388935 20227 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:53.658628 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:53.685209 18231 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:53.685549 18229 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:53.659938 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:53.302470 20526 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:53.642226 18232 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:53.686600 18385 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:53.382400 20610 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:53.172097 20497 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.643563 18277 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:53.696548 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 53053us
I20260709 13:17:53.649797 20490 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:53.663329 20218 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:53.649967 20587 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:53.295038 20326 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.313874 20472 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.657724 20578 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:53.670650 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1408) took 1120 ms. Trace:
I20260709 13:17:53.670821 20594 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:17:53.716305 20622 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.490s	user 0.000s	sys 0.011s
I20260709 13:17:53.671281 18201 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:17:53.717360 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 46172.1us
I20260709 13:17:53.718389 20594 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:53.713308 18382 rpcz_store.cc:276] 0709 13:17:52.549907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.550052 (+   145us) service_pool.cc:224] Handling call
0709 13:17:52.582809 (+ 32757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.859830 (+277021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.859872 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:52.859926 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:52.859976 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.670360 (+810384us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b540019a854. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:53.670422 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.670580 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636510080}
I20260709 13:17:53.718945 20594 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:53.719419 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.719858 20594 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.720762 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.671521 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1649) took 1138 ms. Trace:
I20260709 13:17:53.652948 20317 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:53.672413 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:53.721745 18305 rpcz_store.cc:276] 0709 13:17:52.532861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.664369 (+131508us) service_pool.cc:224] Handling call
0709 13:17:52.664684 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.981029 (+316345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.671235 (+690206us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54001de554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:53.671429 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725095808}
I20260709 13:17:53.722612 18228 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:53.676317 20583 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:53.655279 20113 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.655910 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.728967 18233 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:53.689079 18303 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:53.662086 20495 consensus_queue.cc:1243] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer 459e82ee6b564cc19be6f73186938e79 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:53.642175 20345 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.701074 18385 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:53.676790 20534 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:53.668224 20604 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:53.680729 20487 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:53.677718 20478 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:53.711246 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.708756 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:53.721371 18382 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:53.694705 20526 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.730079 20113 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:53.751573 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:53.707980 20610 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:53.695641 20488 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:53.668931 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.725847 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1421) took 1152 ms. Trace:
I20260709 13:17:53.708912 20490 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.711704 20587 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:53.796970 20587 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:53.797331 20433 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:53.798048 20433 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:53.798519 20433 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:53.799392 20433 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.681192 20617 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.737042 18228 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:17:53.696185 20621 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:53.750010 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1704) took 1040 ms. Trace:
I20260709 13:17:53.813462 20589 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:53.813822 18382 rpcz_store.cc:276] 0709 13:17:52.709921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.749029 (+1039108us) service_pool.cc:224] Handling call
0709 13:17:53.749347 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.749591 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.749630 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:53.749689 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:53.749733 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.749805 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.749941 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:53.815109 20621 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:53.674521 18230 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:53.724380 18231 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:17:53.703796 20227 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:53.731853 20317 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:53.711436 20218 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:53.726989 20258 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:17:53.738637 20495 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:53.771366 18235 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:53.805704 18384 rpcz_store.cc:276] 0709 13:17:52.574970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.596963 (+ 21993us) service_pool.cc:224] Handling call
0709 13:17:53.725719 (+1128756us) spinlock_profiling.cc:243] Waited 96.7 ms on lock 0x7b540012b454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:53.725798 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222423296}
I20260709 13:17:53.811470 20617 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:53.811951 18380 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:53.746866 20534 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.749588 20273 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:53.747429 20487 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:53.824203 20317 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.826639 20218 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:53.751951 20526 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:53.834628 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1702) took 1125 ms. Trace:
I20260709 13:17:53.749711 20604 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:53.843024 18384 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:53.811472 20472 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:53.850332 20534 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:53.856676 18384 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:53.860200 20583 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:53.854184 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:53.857494 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 212159us
I20260709 13:17:53.884232 20487 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.885121 20604 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:53.885553 20487 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:53.885994 20478 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:53.886543 20478 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:53.889151 18384 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:53.890275 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.890905 18384 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:53.911203 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:53.843961 18378 rpcz_store.cc:276] 0709 13:17:52.709499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.217656 (+508157us) service_pool.cc:224] Handling call
0709 13:17:53.218017 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.218260 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:53.484810 (+266550us) log.cc:844] Serialized 14 byte log entry
0709 13:17:53.834178 (+349368us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:53.834249 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:53.834315 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.834419 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.834557 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":678,"prepare.queue_time_us":359199,"raft.queue_time_us":830,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":17854,"spinlock_wait_cycles":13547776,"thread_start_us":429224,"threads_started":2,"wal-append.queue_time_us":359486}
I20260709 13:17:53.932324 18276 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:17:53.935186 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 208285us
I20260709 13:17:53.817948 20488 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:53.939016 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 187532us
W20260709 13:17:53.937304 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 271300us
I20260709 13:17:53.940114 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:53.943210 18378 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:53.956578 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:53.956722 20534 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:53.944994 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:53.952198 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.958703 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:53.953742 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.866978 20490 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:53.954716 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:53.960431 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:53.961475 20490 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:53.961567 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:53.961928 20490 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.962311 20490 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:53.936889 20472 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.009528 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:54.007411 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 66586.9us
I20260709 13:17:53.989516 18378 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:53.943974 20345 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:53.950908 20589 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 13:17:54.119302 18305 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:17:54.048713 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 117795us
W20260709 13:17:54.051116 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.047610 18378 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:54.127974 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1178) took 1012 ms. Trace:
I20260709 13:17:54.134708 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:54.118820 20273 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.140084 20273 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.142340 20273 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:54.144763 18305 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:54.145896 20562 raft_consensus.cc:3055] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:54.146313 20562 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:54.146234 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:53.954002 20497 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:53.952189 20518 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:53.945065 20527 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.199s
I20260709 13:17:54.156531 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:53.954258 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:54.156703 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 145649us
I20260709 13:17:54.159281 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:53.966334 20610 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:54.013998 20579 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:54.136596 18378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46844
I20260709 13:17:54.158988 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:54.165062 18378 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:54.165750 18378 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:53.964692 20495 consensus_queue.cc:1059] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.187s
I20260709 13:17:54.066992 20632 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:54.160130 18309 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:54.005985 20617 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.152s
I20260709 13:17:54.167181 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.060271 20218 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:54.006548 20326 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:54.068922 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 124036us
I20260709 13:17:54.161676 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.185173 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.185451 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:54.186084 18306 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:54.182358 18276 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:54.181701 18378 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:53.951059 20478 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:53.944171 20621 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:54.011204 20633 raft_consensus.cc:2764] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:17:54.085850 20637 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:54.171100 18307 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 6: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:54.151304 20531 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:17:54.172325 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 207984us
W20260709 13:17:54.184286 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 143287us
I20260709 13:17:54.158152 20518 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.038915 20472 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.188302 20488 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:54.164387 20587 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:54.189960 18276 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:17:54.295878 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1692) took 1588 ms. Trace:
I20260709 13:17:54.192617 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.315018 18381 rpcz_store.cc:276] 0709 13:17:52.707125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.028040 (+320915us) service_pool.cc:224] Handling call
0709 13:17:53.028308 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.286131 (+257823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.286162 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:53.286200 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:53.286227 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.295557 (+1009330us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54000ba9d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:54.295625 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.295792 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592151296}
I20260709 13:17:54.315680 18309 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:17:54.316263 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 354727us
I20260709 13:17:54.310951 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.218133 18202 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:54.288465 20580 consensus_meta.cc:287] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.000s
I20260709 13:17:54.336215 18305 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
W20260709 13:17:54.271229 20639 log.cc:927] Time spent T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
W20260709 13:17:54.276952 20635 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 13:17:54.271951 20643 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:17:54.182248 20218 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:54.338285 20654 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:54.330232 20616 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:17:54.305239 20113 consensus_meta.cc:287] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 13:17:54.432356 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1706) took 1697 ms. Trace:
W20260709 13:17:54.454284 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 137164us
I20260709 13:17:54.455390 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:54.455772 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 237751us
I20260709 13:17:54.133260 18304 rpcz_store.cc:276] 0709 13:17:53.115876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.609936 (+494060us) service_pool.cc:224] Handling call
0709 13:17:53.610310 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.610552 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:53.719948 (+109396us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.127611 (+407663us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.127667 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:54.127712 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.127781 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.127911 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3688,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"thread_start_us":407305,"threads_started":1,"wal-append.queue_time_us":342656}
I20260709 13:17:54.330207 20644 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.189005 20495 raft_consensus.cc:3055] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:54.457608 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:54.218779 20631 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:54.458170 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:54.310269 20637 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.464356 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:54.188884 20650 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:54.514818 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:54.468016 18232 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:54.312361 20621 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:54.171648 20526 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:54.462685 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 272813us
I20260709 13:17:54.192160 20583 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.257s
I20260709 13:17:54.412905 20594 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:54.515189 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:54.496037 20616 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:54.515486 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:54.515544 18231 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:54.432266 18378 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:54.511343 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:54.346483 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.526544 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:54.456166 18382 rpcz_store.cc:276] 0709 13:17:52.735366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.815275 (+1079909us) service_pool.cc:224] Handling call
0709 13:17:53.815703 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.837613 (+ 21910us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:53.950255 (+112642us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.191611 (+241356us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.255445 (+ 63834us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.255528 (+    83us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:54.255596 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.432088 (+176492us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b540033d954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:54.432139 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.432285 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65562,"prepare.queue_time_us":201137,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":1193,"raft.queue_time_us":98787,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":17125,"spinlock_wait_cycles":140869504,"thread_start_us":306188,"threads_started":2}
I20260709 13:17:54.616732 18230 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
W20260709 13:17:54.533918 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 78593.7us
I20260709 13:17:54.218124 20490 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.311111 20531 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.526216 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.621949 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:54.623991 18307 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:54.538666 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:54.589819 20326 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.509548 20580 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.593305 18228 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:17:54.631264 18382 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:54.509763 20495 raft_consensus.cc:740] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:54.510069 20631 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:54.596081 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 57347.9us
I20260709 13:17:54.533720 20650 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:54.641604 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:54.510744 20113 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.375902 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 1718) took 1333 ms. Trace:
I20260709 13:17:54.400595 20651 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:54.182796 20632 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.620416 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1705) took 1910 ms. Trace:
I20260709 13:17:54.513264 20654 raft_consensus.cc:697] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:54.532558 20621 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:54.629932 20497 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:54.638195 18231 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:54.642589 18276 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:17:54.515177 20487 consensus_meta.cc:287] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.629s	user 0.013s	sys 0.001s
I20260709 13:17:54.615947 20218 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:54.616765 20441 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:54.618893 20616 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:54.649410 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:54.645751 18383 rpcz_store.cc:276] 0709 13:17:53.042190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.067344 (+ 25154us) service_pool.cc:224] Handling call
0709 13:17:54.375656 (+1308312us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b540019bc54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:54.375814 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136886016}
I20260709 13:17:54.675203 18377 rpcz_store.cc:276] 0709 13:17:52.710134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.811766 (+1101632us) service_pool.cc:224] Handling call
0709 13:17:53.812177 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.812562 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.812591 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.813141 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:17:53.938835 (+125694us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:53.938877 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.938937 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:54.620215 (+681278us) raft_consensus.cc:1685] finished
0709 13:17:54.620234 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.620350 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7560,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5123,"thread_start_us":125298,"threads_started":1,"wal-append.queue_time_us":233711}
I20260709 13:17:54.619997 20478 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.679003 18378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:17:54.693028 18378 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:54.693578 18378 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:54.514546 20644 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.648430 20433 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:54.615954 20573 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:17:54.627334 20641 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:54.703007 20573 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:54.702951 20641 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.703549 20573 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:54.704504 20573 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.705539 20641 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:54.705842 20573 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:54.707757 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:54.683562 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.699846 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.645262 20631 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:54.700431 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.710736 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.711802 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.712852 18311 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:54.713963 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.715150 20630 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:54.715270 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.712003 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.630692 20534 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:17:54.666816 20410 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.667332 20345 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:54.617254 20594 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:54.725914 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:54.702131 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 244577us
I20260709 13:17:54.634202 20326 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.740796 18307 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:54.695824 20649 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:54.761651 20665 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:54.762355 20665 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:54.762998 20653 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:17:54.763206 20594 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:54.765024 20660 consensus_queue.cc:1059] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:54.727149 20650 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.767118 20665 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:54.770044 18232 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:54.731516 20345 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:54.797703 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 274813us
I20260709 13:17:54.793977 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.688439 20651 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.701599 20478 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.727880 20441 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:54.772440 20488 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:54.804083 18378 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:54.795202 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 173324us
I20260709 13:17:54.759591 20649 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:54.731297 20433 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:54.814733 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:54.815271 18383 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 7. Ops: []
I20260709 13:17:54.740136 20410 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.796627 20439 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:54.794785 20641 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:17:54.818557 18378 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:54.799492 20654 consensus_queue.cc:237] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.819041 20490 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:54.820497 20632 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:54.818574 20580 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:54.804173 20645 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:54.801043 20345 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:54.796005 20630 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:54.799856 20665 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:54.827620 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.807832 20583 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:17:54.835749 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:54.946496 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:54.947330 18231 raft_consensus.cc:3055] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:54.947727 18231 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:54.948612 18231 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.836272 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:54.950012 18235 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:54.837604 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:54.951176 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:54.951916 18235 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:54.838325 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:54.739219 20495 consensus_queue.cc:260] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.840544 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:54.824234 20113 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:54.845088 20439 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:54.850276 20534 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:54.853536 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:54.854218 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:54.823380 20649 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:54.855044 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:54.857954 20478 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:54.960901 20626 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:54.961342 20626 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:54.961236 20621 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.860922 20644 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:54.961594 20433 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.822242 20488 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.963366 20621 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:54.964380 20488 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:54.964730 18310 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:54.957381 20665 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.966257 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1728) took 1112 ms. Trace:
I20260709 13:17:54.967365 20665 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:54.966676 18381 rpcz_store.cc:276] 0709 13:17:53.853648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.316198 (+462550us) service_pool.cc:224] Handling call
0709 13:17:54.316465 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:54.454921 (+138456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:54.454952 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:54.509937 (+ 54985us) log.cc:844] Serialized 26 byte log entry
0709 13:17:54.825291 (+315354us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:54.825349 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.825444 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:54.966050 (+140606us) raft_consensus.cc:1685] finished
0709 13:17:54.966072 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.966195 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5430,"raft.queue_time_us":138022,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":17000,"thread_start_us":190583,"threads_started":1,"wal-append.queue_time_us":347543}
I20260709 13:17:54.868988 20441 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.968298 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.861837 20410 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:54.874326 20651 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:54.880841 20526 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:54.881776 20667 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:54.824837 20497 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:54.954988 20495 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:54.957265 18202 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.674s (SENT) [suppressed 47 similar messages]
I20260709 13:17:54.969393 18307 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:54.873389 20326 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:54.968273 20664 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:17:54.973659 18235 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:17:55.010519 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:55.011724 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:54.957237 20534 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:54.999118 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1438) took 1115 ms. Trace:
I20260709 13:17:54.999426 20497 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:55.000130 18379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1414) took 2434 ms (client timeout 3215 ms). Trace:
I20260709 13:17:54.998063 20667 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.011750 18380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1727) took 1186 ms. Trace:
I20260709 13:17:54.945628 20645 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:54.974697 20478 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.956144 20630 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.012355 18307 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:55.017607 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:55.087333 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 236) took 1689 ms. Trace:
W20260709 13:17:55.051148 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 179169us
I20260709 13:17:55.021127 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:55.070013 18303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1177) took 1948 ms (client timeout 1590 ms). Trace:
W20260709 13:17:55.139513 18303 rpcz_store.cc:269] 0709 13:17:53.115611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.287559 (+171948us) service_pool.cc:224] Handling call
0709 13:17:55.063639 (+1776080us) spinlock_profiling.cc:243] Waited 61.8 ms on lock 0x7b54000bd6d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:55.063875 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142074240}
W20260709 13:17:55.133314 18379 rpcz_store.cc:269] 0709 13:17:52.565617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.565739 (+   122us) service_pool.cc:224] Handling call
0709 13:17:54.999898 (+2434159us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b5400277254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:55.000039 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1757730048}
I20260709 13:17:55.018196 20439 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.133219 18236 rpcz_store.cc:276] 0709 13:17:53.398511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.661654 (+263143us) service_pool.cc:224] Handling call
0709 13:17:53.661924 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.812536 (+150612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.816426 (+  3890us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:53.816478 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:53.816532 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.086952 (+1270420us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540029bdd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:55.087017 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.087245 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345884544}
I20260709 13:17:55.089738 20610 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:55.113888 18228 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:55.087955 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 271) took 1863 ms. Trace:
I20260709 13:17:55.127862 18383 rpcz_store.cc:276] 0709 13:17:53.883296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.694945 (+811649us) service_pool.cc:224] Handling call
0709 13:17:54.701934 (+  6989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.826074 (+124140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.998842 (+172768us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54003bd154. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:54.999051 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260204800}
I20260709 13:17:55.095387 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:55.138188 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 180936us
I20260709 13:17:55.131685 18380 rpcz_store.cc:276] 0709 13:17:53.825698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.297411 (+471713us) service_pool.cc:224] Handling call
0709 13:17:54.297871 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:54.298349 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:17:54.516133 (+217784us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.679445 (+163312us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:54.690842 (+ 11397us) log.cc:844] Serialized 26 byte log entry
0709 13:17:54.728375 (+ 37533us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:54.728444 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.728537 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:54.855235 (+126698us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b18003d7560. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:17:54.967696 (+112461us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:17:55.011482 (+ 43786us) raft_consensus.cc:1685] finished
0709 13:17:55.011510 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.011678 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179433,"prepare.queue_time_us":322856,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":58824,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":37678,"spinlock_wait_cycles":34167424,"thread_start_us":268836,"threads_started":2,"wal-append.queue_time_us":233560}
I20260709 13:17:55.140482 18201 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:55.157171 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.157729 18380 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:17:55.126850 20487 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:55.168102 20616 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:55.168834 20487 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:55.170490 20655 raft_consensus.cc:3055] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:55.170893 18311 raft_consensus.cc:1813] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Handling vote request from an unknown peer 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:55.171011 20655 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:55.171229 20487 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:55.130609 20410 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:55.172425 20410 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.174564 20472 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.177004 20616 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:55.172093 20655 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.179590 18310 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:55.180186 20645 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:55.164656 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 143622us
I20260709 13:17:55.166162 18953 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:55.171518 18311 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:55.180757 20674 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:55.138898 20534 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:55.182717 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.209748 20660 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:55.184716 18310 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:55.210604 20660 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:55.212083 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 1662) took 1051 ms. Trace:
I20260709 13:17:55.212477 18305 rpcz_store.cc:276] 0709 13:17:54.161139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.161350 (+   211us) service_pool.cc:224] Handling call
0709 13:17:55.211882 (+1050532us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540013ef54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:55.212017 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347771136}
I20260709 13:17:55.213249 20660 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:55.213830 20660 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:55.085072 20467 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.154556 18312 rpcz_store.cc:276] 0709 13:17:53.224087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.646992 (+422905us) service_pool.cc:224] Handling call
0709 13:17:53.652361 (+  5369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.721215 (+ 68854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.721236 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:53.721270 (+    34us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:53.721291 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.087720 (+1366429us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b54000cb2d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:55.087769 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.087897 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157882624}
I20260709 13:17:55.021337 20587 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.214933 20617 consensus_queue.cc:1059] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:55.215660 20660 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:55.189211 20667 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.190861 20656 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:55.216925 20656 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:55.191805 20649 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.194018 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:55.193992 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:55.194053 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.203173 20579 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:55.195338 20669 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:55.089695 20218 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.086723 20345 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.205839 20674 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:55.020807 20326 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.216033 20617 raft_consensus.cc:3055] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:55.204763 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:54.993490 20631 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.155623 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:55.141992 20478 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.220682 18383 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:17:55.220953 18307 raft_consensus.cc:2410] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:55.154044 20610 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:55.222687 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:55.222992 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:55.234863 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.240610 18303 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:55.224673 20441 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:55.259747 18308 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 7: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:55.256373 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:55.254522 18201 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:55.262614 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:55.263299 18381 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:55.227449 20674 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:55.227192 20617 raft_consensus.cc:740] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:17:55.270311 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.190933 20562 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.277594 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.277686 18228 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:17:55.279922 18234 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:55.281401 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:55.283015 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:55.264317 20645 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:55.287932 20675 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:55.288580 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:55.243748 20326 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.290336 18381 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:55.280654 20668 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:55.293282 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.280826 20662 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:55.277159 20526 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:55.307291 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.307157 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:55.311071 20660 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:55.313401 20526 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.314436 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:55.315682 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:55.269055 20663 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:17:55.290853 20645 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:55.316349 18233 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:55.226949 20579 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:55.304682 20562 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:55.346920 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.336865 18381 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:17:55.318581 18237 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:55.317893 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.345544 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:55.351445 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 50683.7us
I20260709 13:17:55.352138 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.352716 18378 raft_consensus.cc:1813] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Handling vote request from an unknown peer 459e82ee6b564cc19be6f73186938e79
W20260709 13:17:55.326776 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.353210 18378 raft_consensus.cc:2410] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:17:55.319217 18276 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:55.291023 20497 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:55.350724 18377 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
W20260709 13:17:55.317199 20680 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:17:55.303586 20441 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:55.316390 20526 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.302917 20662 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:17:55.345841 20682 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:17:55.344879 20645 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:55.360023 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:55.284729 20610 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.362344 18276 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:55.365612 18377 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:55.366828 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:55.359593 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:55.384181 20410 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:55.385416 20633 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:55.357746 20441 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:55.358078 20487 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.358242 20467 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:55.408823 20467 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:55.409317 20467 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:55.370275 20497 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:55.387094 20534 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.412958 20497 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:55.413653 20497 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:55.388212 20681 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:17:55.389417 20631 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.390363 18377 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:17:55.384071 20677 log.cc:927] Time spent T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:17:55.392387 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1197) took 1050 ms. Trace:
I20260709 13:17:55.361311 20662 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:55.393747 20433 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:55.406050 20616 consensus_queue.cc:1059] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:55.406810 20441 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:55.407873 20487 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.437546 20487 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.438522 20326 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:55.413003 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:55.441299 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1670) took 1185 ms. Trace:
I20260709 13:17:55.441629 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:55.442150 20649 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.443015 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:55.366016 20630 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.443791 18377 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:55.391976 20610 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:55.426729 18310 rpcz_store.cc:276] 0709 13:17:54.341952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.211200 (+869248us) service_pool.cc:224] Handling call
0709 13:17:55.211513 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.211841 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.211869 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.212301 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:17:55.280307 (+ 68006us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:55.280354 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.280486 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:55.392186 (+111700us) raft_consensus.cc:1685] finished
0709 13:17:55.392209 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.392328 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2511,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":67720,"threads_started":1,"wal-append.queue_time_us":152323}
I20260709 13:17:55.318025 20617 consensus_queue.cc:260] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:55.433282 20616 raft_consensus.cc:3055] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:55.433694 20433 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.441898 18303 rpcz_store.cc:276] 0709 13:17:54.255884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.153089 (+897205us) service_pool.cc:224] Handling call
0709 13:17:55.178881 (+ 25792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:55.253320 (+ 74439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.440893 (+187573us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b54000bd1d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:55.441207 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141342976}
I20260709 13:17:55.450606 18377 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:55.451678 20661 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:55.453187 20579 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:55.455690 20684 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:17:55.458074 20518 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.459283 20478 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:55.460943 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1666) took 1276 ms. Trace:
I20260709 13:17:55.462742 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:55.464985 18386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 228) took 2754 ms. Trace:
I20260709 13:17:55.464771 20630 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:55.465910 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 230) took 1850 ms. Trace:
I20260709 13:17:55.484705 18384 rpcz_store.cc:276] 0709 13:17:53.615578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.918189 (+302611us) service_pool.cc:224] Handling call
0709 13:17:53.923566 (+  5377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.006535 (+ 82969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:54.006566 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.006612 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:54.006647 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.465679 (+1459032us) spinlock_profiling.cc:243] Waited 82.7 ms on lock 0x7b540033de54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:55.465726 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.465842 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190281088}
I20260709 13:17:55.466455 20578 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:55.483820 18306 rpcz_store.cc:276] 0709 13:17:54.184146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.186940 (+  2794us) service_pool.cc:224] Handling call
0709 13:17:54.187284 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.724314 (+537030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:54.724349 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.724394 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:54.724436 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.460633 (+736197us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b540013f454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:55.460704 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.460878 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1234502528}
I20260709 13:17:55.484778 18229 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:17:55.472258 20649 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.485988 18386 rpcz_store.cc:276] 0709 13:17:52.711229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.818141 (+1106912us) service_pool.cc:224] Handling call
0709 13:17:53.820253 (+  2112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.831953 (+ 11700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.831991 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:53.832035 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:53.832079 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.464745 (+1632666us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b5400080054. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:55.464794 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.464924 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17982848}
I20260709 13:17:55.489646 18386 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:55.490581 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:55.472402 20616 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:55.475414 20433 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:55.464743 20631 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:17:55.477048 20656 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:55.484436 20650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.006s	sys 0.017s
I20260709 13:17:55.489022 20617 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:55.479861 20661 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.505271 18382 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
W20260709 13:17:55.499490 20650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.007s	sys 0.017s
I20260709 13:17:55.506108 18382 pending_rounds.cc:85] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 3
I20260709 13:17:55.506513 18382 pending_rounds.cc:107] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:17:55.506989 18382 raft_consensus.cc:2889] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:55.510576 20616 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.493922 20649 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.520005 20626 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.556910 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.521911 20661 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:55.527302 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.527627 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1199) took 1140 ms. Trace:
I20260709 13:17:55.558419 18308 rpcz_store.cc:276] 0709 13:17:54.387060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.711750 (+324690us) service_pool.cc:224] Handling call
0709 13:17:55.527438 (+815688us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b54001de554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:55.527565 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1234553600}
I20260709 13:17:55.528287 20637 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.529299 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1186) took 1190 ms. Trace:
I20260709 13:17:55.503132 20656 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.528595 18201 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:55.537107 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1703) took 2827 ms. Trace:
I20260709 13:17:55.567566 18311 rpcz_store.cc:276] 0709 13:17:54.338918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.714973 (+376055us) service_pool.cc:224] Handling call
0709 13:17:55.529113 (+814140us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b540011c454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:55.529245 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031307008}
I20260709 13:17:55.548974 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:55.501065 20674 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.569128 20227 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:55.570433 20674 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.543967 20531 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.572307 20662 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.574420 20662 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.529948 20616 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:55.568341 18385 rpcz_store.cc:276] 0709 13:17:52.709710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.744666 (+1034956us) service_pool.cc:224] Handling call
0709 13:17:54.298892 (+554226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.299101 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:54.299136 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.299187 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:54.299229 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.299298 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.536941 (+1237643us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b540012aa50. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:55.537050 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1273627520}
I20260709 13:17:55.575958 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1435) took 1693 ms. Trace:
I20260709 13:17:55.577373 20656 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.579978 18230 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:55.576359 18382 rpcz_store.cc:276] 0709 13:17:53.882335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.667408 (+785073us) service_pool.cc:224] Handling call
0709 13:17:54.696641 (+ 29233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:55.507592 (+810951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.575736 (+ 68144us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b540004b854. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:55.575901 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856616192}
I20260709 13:17:55.581529 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:55.583314 18382 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:55.583431 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:55.583842 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:55.586817 18953 raft_consensus.cc:1813] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Handling vote request from an unknown peer b52e2477fc524694967c4a16afa983e3
I20260709 13:17:55.587374 18953 raft_consensus.cc:2393] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:17:55.585043 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:55.588109 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.560228 20663 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:55.589195 20663 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:55.590036 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.591183 20663 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:55.535615 20534 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:55.548988 20472 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:55.592430 20472 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:55.593278 20472 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.594412 20472 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:55.597524 18382 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:17:55.598440 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.599393 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:55.602777 20580 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:55.603451 20467 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.605000 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.605237 18382 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:17:55.605988 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:55.608657 18382 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:55.610616 18382 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:55.615067 20433 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.616765 20433 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.619035 20441 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.619436 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:55.620481 20345 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.621683 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:55.584981 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:55.625784 20649 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.623999 20497 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.586104 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:55.627995 18378 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:55.628502 20497 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:55.629896 20626 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:55.634352 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:17:55.637370 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.635852 18386 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:55.639287 20649 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:17:55.640403 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 111883us
I20260709 13:17:55.641583 20662 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:55.643976 20345 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.584434 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.596380 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1275) took 1127 ms. Trace:
I20260709 13:17:55.650527 18276 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:55.582501 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:55.652137 18276 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:55.648617 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:55.576776 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.591711 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.670575 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:55.673323 18235 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:55.684369 18961 raft_consensus.cc:2393] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 3: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:17:55.685899 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:55.616034 20655 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:55.686800 18383 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:55.646668 18232 rpcz_store.cc:276] 0709 13:17:54.473500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.526248 (+ 52748us) service_pool.cc:224] Handling call
0709 13:17:55.596096 (+1069848us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540037dcd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:55.596287 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349370624}
I20260709 13:17:55.690858 18229 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:55.647116 20662 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:55.697162 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:55.694759 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.689247 18926 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:55.690203 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:55.710855 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:55.711282 18200 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:55.712540 18200 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:55.711530 18235 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:55.716055 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.717046 18380 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
W20260709 13:17:55.697595 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 57461.5us
I20260709 13:17:55.705936 18234 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:55.686043 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:55.724364 18276 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:55.726217 20650 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:55.728585 20227 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:55.728753 20604 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:55.730018 20630 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:55.728617 20497 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:55.730536 20650 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:55.730850 20497 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:55.731240 20650 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.731786 20650 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:55.731897 20497 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.688011 20649 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:55.741568 18385 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:55.746685 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:55.747876 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 58749us
I20260709 13:17:55.748605 20568 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:55.749161 20568 raft_consensus.cc:697] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:55.750001 20568 consensus_queue.cc:237] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:55.753170 20693 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:17:55.702450 20433 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:55.757347 18231 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:55.763847 18201 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:55.711297 20218 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:55.703385 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:55.647342 20345 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.780331 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:55.736620 20527 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:55.722240 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:54.060293 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:55.791877 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:55.718073 20531 consensus_queue.cc:1059] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:17:55.799226 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.740978 20656 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.812621 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:55.785280 20660 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:55.817485 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.825680 18379 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:55.826839 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:55.822990 18235 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:55.782567 20649 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:55.788535 20441 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:55.833437 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:55.837188 18383 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:17:55.832394 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:55.860075 18379 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:55.849457 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:55.850896 18231 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:55.790499 20433 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:55.861184 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1177) took 1022 ms. Trace:
I20260709 13:17:55.857712 18385 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:17:55.861749 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 141116us
I20260709 13:17:55.865227 18385 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:55.862387 18131 catalog_manager.cc:5697] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 4 to 5, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New cstate: current_term: 3 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:55.868901 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:55.861761 18231 rpcz_store.cc:276] 0709 13:17:54.838548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.946092 (+107544us) service_pool.cc:224] Handling call
0709 13:17:55.628930 (+682838us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b18002e2720. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822ae646 00007fa1821e858e 00007fa182269f9e 00007fa18226b7de 00007fa18227727c 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c
0709 13:17:55.757053 (+128123us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b58002a35d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821cf0aa 00007fa182251447 00007fa182269fe7 00007fa18226b7de 00007fa18227727c 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c
0709 13:17:55.861100 (+104047us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1446521600}
I20260709 13:17:55.802778 20672 consensus_queue.cc:1059] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:17:55.825109 20660 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.834945 20617 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:55.829391 20487 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:55.870843 20637 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.886157 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:55.959993 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 73967.9us
I20260709 13:17:55.845693 20630 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:55.877041 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:55.896186 20646 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:55.897835 20345 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.871636 20662 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.900970 20433 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:55.867305 20534 raft_consensus.cc:2764] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:17:55.891937 20531 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:55.855839 20665 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:17:55.908505 20645 consensus_meta.cc:287] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.521s	user 0.004s	sys 0.006s
I20260709 13:17:55.980218 20487 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:55.950853 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 113848us
W20260709 13:17:55.934758 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:55.953686 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.885900 20651 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:55.910872 20660 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:55.949069 20617 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:55.965868 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 88927us
W20260709 13:17:55.966364 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 102118us
I20260709 13:17:55.949469 20472 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.952090 20467 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:55.982463 20531 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:55.950254 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 164826us
I20260709 13:17:55.982334 20441 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:55.979975 20630 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:56.011312 20697 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:17:55.989725 20174 raft_consensus.cc:2955] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:55.887843 20604 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:17:56.036270 18234 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:56.040593 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:56.097545 18383 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:56.098565 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:56.041401 18201 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:17:56.138351 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 97014.8us
I20260709 13:17:55.966416 20637 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:56.038182 20696 log.cc:927] Time spent T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:17:56.116956 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:56.033115 20617 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:56.040488 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:56.037365 20695 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
W20260709 13:17:56.150914 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 110517us
I20260709 13:17:56.123620 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.022039 20646 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:56.096602 20531 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:56.132189 18308 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:56.028210 20651 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:56.041833 20472 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.018671 20645 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:56.119019 20616 consensus_meta.cc:287] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.000s
W20260709 13:17:56.156635 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 194481us
I20260709 13:17:56.096334 20667 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:56.026213 20665 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:56.096745 20669 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:56.148443 18305 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:56.018795 20649 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.132377 20441 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:17:56.159842 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 250245us
I20260709 13:17:56.148332 20626 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:56.187373 18384 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:56.157460 20608 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:56.156828 20227 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:17:56.156950 20551 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:56.174278 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:56.190289 20646 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.157316 20218 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:17:56.196220 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 59787.3us
I20260709 13:17:56.170650 20667 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:56.213980 18379 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:17:56.204170 20441 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.216868 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1737) took 1032 ms. Trace:
I20260709 13:17:56.217495 18377 rpcz_store.cc:276] 0709 13:17:55.184079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.480428 (+296349us) service_pool.cc:224] Handling call
0709 13:17:55.482532 (+  2104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.482914 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.482932 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.483317 (+   385us) log.cc:844] Serialized 26 byte log entry
0709 13:17:55.530643 (+ 47326us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:55.530681 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.530761 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.216563 (+685802us) raft_consensus.cc:1685] finished
0709 13:17:56.216593 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.216786 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":878,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":5774,"thread_start_us":26392,"threads_started":1,"wal-append.queue_time_us":244021}
W20260709 13:17:56.225150 20698 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:17:56.228749 20631 raft_consensus.cc:3055] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:56.229132 20631 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:56.230041 20631 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.231215 20631 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:56.236398 20646 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:56.245234 20710 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.245433 20472 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:56.245870 20710 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:56.217597 20608 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:56.210302 18275 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:17:56.251621 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.250681 18275 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:56.186180 20487 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:56.256688 18305 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:56.210932 20551 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:56.220806 20720 consensus_queue.cc:1059] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.137s
I20260709 13:17:56.246850 20526 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:56.365332 18275 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:17:56.228410 20654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.031s	sys 0.065s
W20260709 13:17:56.252174 20650 consensus_meta.cc:287] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.002s
I20260709 13:17:56.211151 20712 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:56.389387 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 169738us
I20260709 13:17:56.359982 20472 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:56.172959 20669 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:56.469498 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.261273 20707 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.209s
I20260709 13:17:56.512504 18927 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:56.257005 20467 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:56.402654 20654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.034s	sys 0.065s
W20260709 13:17:56.469424 20716 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.268s	user 0.000s	sys 0.000s
I20260709 13:17:56.388270 20526 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:17:56.543807 20701 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:17:56.541143 20608 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.515530 20218 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:17:56.553190 20551 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:56.557499 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 192256us
I20260709 13:17:56.564599 18377 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:56.409204 20712 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:56.387468 20487 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.573010 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:56.569567 20637 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:56.575704 20655 consensus_meta.cc:287] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.862s	user 0.010s	sys 0.000s
I20260709 13:17:56.452595 20518 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:17:56.576397 18233 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:56.410751 20531 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.559103 20467 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.411419 20650 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.510118 20704 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.171s
I20260709 13:17:56.580674 20665 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:56.471657 20617 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.543422 20649 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:56.562148 20630 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:56.580533 20580 consensus_queue.cc:1059] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:56.580334 20702 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:56.595161 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:56.568831 20712 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:56.622072 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.622608 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.622812 18305 raft_consensus.cc:1813] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Handling vote request from an unknown peer b52e2477fc524694967c4a16afa983e3
I20260709 13:17:56.623262 18305 raft_consensus.cc:2393] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 3: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
W20260709 13:17:56.622129 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.623683 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:56.624441 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.625216 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:56.603986 20227 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.595911 20710 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:56.629784 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.660497 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.626005 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.658071 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.658993 18310 raft_consensus.cc:2410] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:56.590516 20467 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.661386 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.619482 20630 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:56.666368 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.675298 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.675397 18310 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:56.676594 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.677435 18310 raft_consensus.cc:2368] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7.
I20260709 13:17:56.660504 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.668094 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.669083 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:56.679522 18311 raft_consensus.cc:2368] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7.
I20260709 13:17:56.661638 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:56.672991 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.680827 18305 raft_consensus.cc:2410] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:56.603663 20526 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.710668 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.845757 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:56.877189 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.879549 18308 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:56.879897 18312 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:56.880375 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.829975 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:56.792338 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.882513 20526 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:56.877796 20174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:38094 (request call id 0) took 6390 ms. Trace:
I20260709 13:17:56.880883 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.884189 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:56.673684 20527 consensus_meta.cc:287] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.864s	user 0.013s	sys 0.000s
I20260709 13:17:56.885121 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.885761 18305 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:56.660995 20723 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:56.889792 18230 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:56.893273 18304 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:17:56.894670 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.661715 20227 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.896566 20531 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:56.916330 20723 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.917531 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:56.921504 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.921581 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.922387 18303 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:56.673952 20667 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:56.912765 18312 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:56.926227 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.910081 18308 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:56.888362 20649 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.661885 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:56.927904 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.887176 20727 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:56.929234 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:56.929697 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.931653 18303 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:56.931754 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.932283 18308 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:56.914515 20527 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:56.935225 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:56.936900 20487 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:56.942391 20617 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:56.957576 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.959151 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.788738 20630 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:56.950978 20660 consensus_meta.cc:287] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.912s	user 0.006s	sys 0.002s
I20260709 13:17:56.926120 20669 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:56.949746 18308 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:56.961642 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:56.953298 20727 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.970350 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.970909 18309 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:17:56.971597 20727 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:56.972658 20467 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:56.962630 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:56.973770 18304 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:56.974715 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.890856 20174 rpcz_store.cc:276] 0709 13:17:50.438503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.438731 (+   228us) service_pool.cc:224] Handling call
0709 13:17:50.482280 (+ 43549us) log.cc:844] Serialized 508 byte log entry
0709 13:17:50.889381 (+407101us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b54007ae520. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821ec142 00007fa1821cceaa 00007fa1821d3d53 00007fa1821d3cd9 00007fa1821d3c69 00007fa1821d3c31 00007fa1821d2dfd 000000000038f354 000000000038f199 00007fa17f186475
0709 13:17:51.497021 (+607640us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b2c00047988. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7ba0a 00007fa180b7b693 00007fa180b7b631 00007fa1822afb52 00007fa1822afcf5 00007fa1821ec691 00007fa1821cceaa 00007fa1821d3d53 00007fa1821d3cd9 00007fa1821d3c69
0709 13:17:52.258164 (+761143us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b18003c5700. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822afd01 00007fa1821ec691 00007fa1821cceaa 00007fa1821d3d53 00007fa1821d3cd9 00007fa1821d3c69 00007fa1821d3c31 00007fa1821d2dfd 000000000038f354 000000000038f199
0709 13:17:56.828527 (+4570363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21928,"raft.queue_time_us":2384,"raft.run_cpu_time_us":17943,"raft.run_wall_time_us":2209336,"spinlock_wait_cycles":1641221632,"thread_start_us":329130,"threads_started":1,"wal-append.queue_time_us":493093,"wal-append.run_cpu_time_us":2254,"wal-append.run_wall_time_us":1121234}
I20260709 13:17:56.930615 20649 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:56.977746 20649 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:56.980139 20227 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:56.982161 18303 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:56.990115 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.990715 18308 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:56.991652 18304 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:17:56.992343 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.963789 18312 raft_consensus.cc:2368] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6.
I20260709 13:17:56.966619 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.997848 18306 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:56.971668 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.963485 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:56.997046 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:56.998276 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:57.502197 20649 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:57.240049 20722 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.575s	user 0.001s	sys 0.001s
I20260709 13:17:57.502869 20649 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:57.305629 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:57.502562 18308 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 7: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:17:57.513334 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.065832 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:57.537096 18309 raft_consensus.cc:2410] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:57.530753 18310 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:17:56.998682 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:57.538435 18306 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:17:57.539923 18306 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:57.541208 18306 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:17:57.531904 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 493878us
I20260709 13:17:57.550108 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:57.296813 20728 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.636s	user 0.003s	sys 0.004s
I20260709 13:17:57.130146 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 1738) took 1945 ms. Trace:
I20260709 13:17:57.302078 20646 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:17:57.555779 18351 leader_election.cc:336] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.590s (SENT)
I20260709 13:17:57.292784 20650 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:57.418125 20712 consensus_meta.cc:287] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.000s
I20260709 13:17:57.225564 20669 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:57.300257 20631 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:57.019434 20174 raft_consensus.cc:3055] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:57.571264 20630 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:57.571574 20174 raft_consensus.cc:740] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:56.990634 20660 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:57.574126 20645 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:57.309986 20617 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:57.570657 20703 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:57.549595 20616 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.560766 20646 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:57.569679 20631 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:57.570056 20712 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:57.573470 20669 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:57.602221 20712 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:57.005048 18119 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 80d0760748294d8d8cb291466766b8a5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:17:57.133533 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 147158us
W20260709 13:17:57.001734 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:57.634671 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:57.635466 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:57.637421 18119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 632202us
W20260709 13:17:57.243670 18233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1191) took 1918 ms (client timeout 1541 ms). Trace:
W20260709 13:17:57.641420 18233 rpcz_store.cc:269] 0709 13:17:55.325715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.345188 (+ 19473us) service_pool.cc:224] Handling call
0709 13:17:57.243387 (+1898199us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540001b8d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:17:57.243573 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2815967616}
I20260709 13:17:57.318293 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1276) took 1629 ms. Trace:
I20260709 13:17:57.052956 18303 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:17:57.651736 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:57.553188 18310 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:57.654086 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1686) took 1027 ms. Trace:
I20260709 13:17:57.654644 18310 rpcz_store.cc:276] 0709 13:17:56.626167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.538075 (+911908us) service_pool.cc:224] Handling call
0709 13:17:57.552872 (+ 14797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.653197 (+100325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.653872 (+   675us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:57.586145 20616 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:57.561929 18351 leader_election.cc:336] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.501s (SENT)
I20260709 13:17:57.565840 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:57.658962 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 96933.7us
I20260709 13:17:57.557665 18384 rpcz_store.cc:276] 0709 13:17:55.184364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.486171 (+301807us) service_pool.cc:224] Handling call
0709 13:17:55.486436 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.188001 (+701565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.129809 (+941808us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b5400075654. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:57.130056 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611396864}
I20260709 13:17:57.321866 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:57.648243 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:57.666410 18305 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 7: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:57.665726 20174 consensus_queue.cc:260] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:57.667238 20616 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:57.668849 18311 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
W20260709 13:17:57.646425 18202 leader_election.cc:336] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.674s (SENT)
I20260709 13:17:57.668123 20174 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:57.668413 20616 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:17:57.645417 18230 rpcz_store.cc:276] 0709 13:17:55.689148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.690535 (+  1387us) service_pool.cc:224] Handling call
0709 13:17:55.690776 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.913528 (+1222752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.318000 (+404472us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54001879d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:17:57.318218 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2756929920}
I20260709 13:17:57.701112 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:57.699285 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:57.591724 20649 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:57.691481 18131 catalog_manager.cc:5697] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 1 to 2, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:57.584995 20617 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:57.757128 20617 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:57.762261 20583 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.764595 20583 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:57.765218 20497 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.764905 20631 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:57.766067 20497 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:57.766896 20631 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:57.772387 20660 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:57.772672 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:57.773972 20608 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.193s	user 0.025s	sys 0.050s
W20260709 13:17:57.774447 20608 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.226s	user 0.025s	sys 0.050s
I20260709 13:17:57.780652 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:57.781128 20646 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:57.783537 20646 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:57.793686 20649 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:57.795042 20649 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:57.767704 20583 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:57.817327 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 283813us
I20260709 13:17:57.818866 18276 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:57.823038 20258 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:57.823499 20742 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:57.824810 20258 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:57.831933 20704 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:57.832499 20704 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:57.833890 20258 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:57.834265 20669 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:57.824967 20742 raft_consensus.cc:697] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:57.836724 20742 consensus_queue.cc:237] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:57.837823 20723 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:57.846345 20711 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 1.435s	user 0.003s	sys 0.010s
I20260709 13:17:57.855106 20738 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.855923 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:57.857116 20649 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:57.857272 20645 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:57.856200 20738 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:57.858312 20645 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:57.858883 20644 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:57.860787 18349 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:57.861692 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:57.861521 20608 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.864802 20669 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.864976 20608 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:57.864148 18927 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:57.866676 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1714) took 1192 ms. Trace:
I20260709 13:17:57.867043 20703 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.867264 18307 rpcz_store.cc:276] 0709 13:17:56.674478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.664342 (+989864us) service_pool.cc:224] Handling call
0709 13:17:57.865106 (+200764us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b58000e1398. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:17:57.865527 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.866048 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.866076 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:57.866147 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:57.866233 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.866298 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.866419 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36732800}
I20260709 13:17:57.889082 18303 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:57.891129 20645 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:57.896668 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 243365us
I20260709 13:17:57.864251 18312 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:57.905118 20651 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:57.906383 18384 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:57.908502 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:57.908775 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:57.869369 20608 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:57.869894 20258 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.871255 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:57.871731 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.872481 20738 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:57.873162 20497 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:57.873646 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:57.875097 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:57.877115 18311 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:57.921691 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:57.922777 18304 raft_consensus.cc:1813] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Handling vote request from an unknown peer 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:57.923543 18304 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:57.924902 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:57.926862 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:57.936124 18310 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
W20260709 13:17:57.936985 18351 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.676s (SENT)
W20260709 13:17:57.939465 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54567.1us
I20260709 13:17:57.944979 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:57.959335 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:57.948865 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:57.986588 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:58.004726 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:58.007722 20741 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:17:58.019177 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:58.021658 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 56609.2us
I20260709 13:17:58.006352 20258 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:58.033035 18307 raft_consensus.cc:2368] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
W20260709 13:17:58.035189 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.022658 20608 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:58.049816 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:58.059654 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:58.061275 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 420755us
I20260709 13:17:58.063555 18311 raft_consensus.cc:2376] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6. Re-sending same reply.
I20260709 13:17:58.064002 20725 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:17:58.064702 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:58.066416 18311 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:58.008670 20741 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:58.082702 18308 raft_consensus.cc:2410] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:17:58.082893 18202 leader_election.cc:336] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.746s (SENT)
I20260709 13:17:58.091176 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:58.099860 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:17:58.099900 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 185356us
I20260709 13:17:58.101225 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:58.106079 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:58.108943 18311 raft_consensus.cc:2376] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6. Re-sending same reply.
I20260709 13:17:58.108812 18309 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
W20260709 13:17:58.128870 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.129240 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.129616 20746 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:17:58.132040 20174 consensus_queue.cc:1059] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:58.133919 20174 raft_consensus.cc:3055] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:58.134469 20174 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:58.134703 20661 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.135197 20594 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.135489 20661 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:58.139318 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 62088us
I20260709 13:17:58.141978 18304 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:58.150262 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.152030 20704 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:58.153050 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1223) took 1094 ms. Trace:
I20260709 13:17:58.153288 20704 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:58.153564 18305 rpcz_store.cc:276] 0709 13:17:57.059030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.667544 (+608514us) service_pool.cc:224] Handling call
0709 13:17:57.878161 (+210617us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b58000e1398. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:17:57.878484 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.879162 (+   678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.879197 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:57.879932 (+   735us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.047460 (+167528us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:58.047515 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.047600 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.152639 (+105039us) raft_consensus.cc:1685] finished
0709 13:17:58.152667 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.152954 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2183,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"spinlock_wait_cycles":29935488,"thread_start_us":167001,"threads_started":1,"wal-append.queue_time_us":214957}
W20260709 13:17:58.157126 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 74300.8us
I20260709 13:17:58.157629 18310 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:17:58.157904 18202 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.767s (SENT)
I20260709 13:17:58.158442 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:58.159953 18230 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:58.161331 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.162995 18201 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:58.164541 20644 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:58.168931 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:58.169397 20745 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:17:58.169257 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.156165 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:58.148463 20747 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:58.174533 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:58.175518 18311 raft_consensus.cc:2368] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6.
I20260709 13:17:58.175982 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.176187 20562 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:58.140151 20258 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:58.176440 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:58.147501 18131 catalog_manager.cc:5697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.177134 18235 raft_consensus.cc:2410] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:58.178462 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:58.178993 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:58.177040 20497 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:58.186887 20497 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:58.187328 18233 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:58.189896 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:58.190896 18312 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:17:58.191715 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:58.193778 18307 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:17:58.194147 18307 pending_rounds.cc:85] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 3
I20260709 13:17:58.177557 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:58.179589 18351 leader_election.cc:336] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.678s (SENT)
I20260709 13:17:58.136103 20594 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:58.179127 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.201006 18380 raft_consensus.cc:2410] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:17:58.201826 18379 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
W20260709 13:17:58.202121 18202 leader_election.cc:336] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.845s (SENT)
I20260709 13:17:58.202313 20594 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:58.194347 18307 pending_rounds.cc:107] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:17:58.202778 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:58.203056 18307 raft_consensus.cc:2889] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:58.204865 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:58.206385 20747 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:58.208841 20497 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:58.210832 20712 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:58.211272 20712 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:58.212396 20712 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:58.213475 20712 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:58.215190 20753 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:17:58.217374 18379 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:58.218374 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.219424 18303 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:58.219678 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.224045 18378 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:58.224797 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:58.225805 18379 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 8: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:58.225700 20656 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:58.229566 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:58.229998 18308 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:58.232127 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.176884 20562 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:58.233214 18386 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:58.217885 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:58.236791 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:58.246515 18235 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:58.246918 18383 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:58.192745 20174 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:58.249053 20661 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:58.250450 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:58.244611 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:58.254633 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 131975us
I20260709 13:17:58.256733 18307 raft_consensus.cc:2376] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7. Re-sending same reply.
I20260709 13:17:58.258792 20741 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:58.220029 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:58.260771 18202 leader_election.cc:336] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.862s (SENT)
I20260709 13:17:58.261662 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:58.261930 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1708) took 1598 ms. Trace:
I20260709 13:17:58.263047 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.264765 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.265336 18379 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:58.267560 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:58.268762 18377 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:17:58.269557 20174 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:58.273451 18379 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:58.275139 20562 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:17:58.277485 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:58.277631 18351 leader_election.cc:336] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.706s (SENT)
I20260709 13:17:58.278262 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:58.267583 20656 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:58.281425 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.282335 18382 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:58.283587 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.284706 18378 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:58.284781 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.285557 20562 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:58.286739 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.262408 18306 rpcz_store.cc:276] 0709 13:17:56.663864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.541953 (+878089us) service_pool.cc:224] Handling call
0709 13:17:57.542304 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:57.800093 (+257789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.803404 (+  3311us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:57.908903 (+105499us) log.cc:844] Serialized 52 byte log entry
0709 13:17:58.105667 (+196764us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:58.148805 (+ 43138us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.254460 (+105655us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b180034d080. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:17:58.255699 (+  1239us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.261345 (+  5646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.261446 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.261567 (+   121us) raft_consensus.cc:1685] finished
0709 13:17:58.261586 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.261756 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111141,"prepare.queue_time_us":42575,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":94,"raft.queue_time_us":246109,"raft.run_cpu_time_us":627,"raft.run_wall_time_us":627,"spinlock_wait_cycles":54413184,"thread_start_us":287321,"threads_started":2,"wal-append.queue_time_us":238433}
I20260709 13:17:58.287427 18233 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:17:58.288022 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:58.289821 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.290536 18386 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:58.292100 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.287422 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.293001 18386 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
W20260709 13:17:58.297080 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 131787us
I20260709 13:17:58.309875 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:17:58.314208 18351 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.713s (SENT)
I20260709 13:17:58.298616 20644 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:58.325033 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:58.326650 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.326660 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:17:58.327670 18307 raft_consensus.cc:2376] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7. Re-sending same reply.
W20260709 13:17:58.321525 18202 leader_election.cc:336] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.933s (SENT)
I20260709 13:17:58.329644 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:58.333087 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:58.343547 18234 raft_consensus.cc:2368] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8.
I20260709 13:17:58.344822 18230 raft_consensus.cc:2955] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:58.332453 20562 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:58.354018 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:58.354995 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:58.355093 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.355343 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:17:58.364856 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.367549 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.368949 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.369587 18386 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:58.356922 18379 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:17:58.371521 18377 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:58.372462 18380 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:58.373108 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.375617 18235 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:17:58.380268 18308 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:58.383842 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:58.391664 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:58.387373 18377 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:58.398140 18384 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:58.400269 20760 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:58.400622 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 101662us
W20260709 13:17:58.401506 18351 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.716s (SENT)
I20260709 13:17:58.401906 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:58.395104 18306 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:17:58.404556 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:58.409340 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:58.417307 20645 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:58.418718 18229 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:58.401847 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.426636 18231 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
W20260709 13:17:58.427054 18351 leader_election.cc:336] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.802s (SENT)
I20260709 13:17:58.426668 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:58.427654 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:58.428233 18233 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:58.428678 20562 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:58.430236 18351 leader_election.cc:336] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.812s (SENT)
W20260709 13:17:58.440903 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 127756us
I20260709 13:17:58.441660 18351 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:17:58.452644 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.419287 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:58.459249 18229 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:58.470106 18377 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:17:58.476384 20706 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:58.512396 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:58.478571 20645 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:58.521757 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.508023 20761 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:17:58.601681 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 106947us
I20260709 13:17:58.521757 20433 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:17:58.513273 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.618543 18380 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:58.618947 18228 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:58.484203 20644 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:58.639927 20762 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:17:58.636377 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 206180us
W20260709 13:17:58.641606 18351 leader_election.cc:336] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.862s (SENT)
I20260709 13:17:58.656118 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:58.658982 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52220.9us
W20260709 13:17:58.643157 18351 leader_election.cc:336] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.877s (SENT)
I20260709 13:17:58.664134 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:58.665069 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 58163us
I20260709 13:17:58.616284 20703 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:58.665280 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:58.671679 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.673862 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.675895 18229 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:17:58.681511 18385 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:17:58.590011 20706 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:58.685308 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:17:58.694680 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.692250 18276 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:58.703054 18235 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:58.703079 18234 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:58.711480 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 50366.3us
I20260709 13:17:58.700971 20645 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:58.709764 20651 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:58.715519 20651 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:17:58.693944 20761 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:58.716025 20651 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:58.718094 20761 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:58.719223 20706 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:58.722412 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.723242 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:58.723690 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.724187 18232 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:58.692122 20703 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:58.724327 18236 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
W20260709 13:17:58.715653 20764 log.cc:927] Time spent T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
W20260709 13:17:58.727154 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 84257.5us
I20260709 13:17:58.680578 20760 consensus_queue.cc:1059] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 13:17:58.727916 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:58.733021 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.729497 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.741285 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:58.743752 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.744459 18236 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
W20260709 13:17:58.749688 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 75287.9us
I20260709 13:17:58.754142 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.738247 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:17:58.756915 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 76562.4us
W20260709 13:17:58.766991 18351 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.993s (SENT)
I20260709 13:17:58.767148 20703 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:58.767537 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:58.768574 20608 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:58.754046 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:58.773360 20644 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.774113 20644 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:58.778275 20704 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:58.778921 18201 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:58.779953 20656 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:58.780400 20656 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.780781 20656 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:58.784384 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 71281.9us
I20260709 13:17:58.807031 18232 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:58.816713 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:17:58.827843 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 60909.5us
I20260709 13:17:58.830555 18276 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:58.823576 20644 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:58.849606 18233 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
W20260709 13:17:58.856650 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.842010 20630 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:58.866293 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 60023.8us
I20260709 13:17:58.869626 18201 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:58.873000 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:58.878051 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.894083 18383 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:58.894276 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.874903 20583 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:58.898222 18202 leader_election.cc:336] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.951s (SENT)
I20260709 13:17:58.873610 20433 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:58.878096 20644 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:58.900405 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.905395 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:58.907546 18377 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:17:58.909795 18200 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:58.910472 18379 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:17:58.920816 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:58.924939 20660 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:58.931417 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:58.932099 20630 consensus_queue.cc:1059] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:58.933090 20710 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:58.898746 20583 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:58.902976 20433 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.964221 20433 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:58.967940 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 58252.1us
I20260709 13:17:58.968875 18200 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:58.969933 20760 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:17:58.912323 18202 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.990s (SENT)
I20260709 13:17:58.905076 20644 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.947503 20712 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:58.948010 20660 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:17:58.951709 20785 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:17:58.954262 20174 consensus_meta.cc:287] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.000s
I20260709 13:17:58.985297 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:58.953971 20651 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:58.955404 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:58.960629 20583 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:58.978407 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:58.979104 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:58.976994 18926 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:58.982189 20644 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:58.999595 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 44311.2us
I20260709 13:17:59.000685 18276 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:17:59.003508 20780 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 13:17:58.982685 20712 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:59.005455 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:59.009503 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:59.014118 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:59.014994 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:17:59.016726 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 104450us
I20260709 13:17:59.017027 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:59.017661 18230 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:17:59.012075 20630 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:59.008793 20712 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:59.020917 18233 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:59.020006 20630 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.025138 20630 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:59.020221 20710 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:59.027021 20710 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.028035 18232 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:17:59.027387 20710 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:59.016312 20783 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:59.034606 20783 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:59.035018 20783 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:59.037581 18202 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.030s (SENT)
I20260709 13:17:59.038136 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:59.043079 18233 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:59.045276 20660 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:59.048697 20783 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:59.049719 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:59.051062 20783 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:59.052230 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:59.016187 20656 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.052878 18381 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.054736 20656 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:59.055315 18228 raft_consensus.cc:2368] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8.
I20260709 13:17:59.061736 18201 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:59.062562 18381 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:17:59.063472 18378 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:59.064349 18926 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:17:59.064927 20761 raft_consensus.cc:3055] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:59.065515 20761 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:59.065932 20741 raft_consensus.cc:3055] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:59.066417 20741 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:59.066660 20761 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.067469 20741 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.068193 20761 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:59.068912 20741 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:59.069303 20651 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:59.065500 20783 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:59.077312 20783 raft_consensus.cc:697] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:59.078336 20783 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:59.080850 18351 leader_election.cc:336] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.161s (SENT)
I20260709 13:17:59.081447 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:17:59.081482 18120 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 943649b738074d87a593c237cf998758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8b4fbc44aa2649f0bcac5cd70f71951d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:17:59.082492 20562 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:59.082969 18351 leader_election.cc:336] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.171s (SENT)
W20260709 13:17:59.083887 18351 connection.cc:256] RPC call timeout handler was delayed by -1.0267035660001511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260709 13:17:59.084005 20741 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:59.084112 20660 consensus_queue.cc:1059] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:59.084416 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:59.085325 20741 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:59.085489 20660 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:59.085876 20741 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:17:59.086081 20174 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:59.045235 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:59.087244 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.088070 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.086476 20760 raft_consensus.cc:3055] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:59.092623 20760 raft_consensus.cc:740] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:59.095093 20760 consensus_queue.cc:260] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:59.097162 18135 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39288 (request call id 177) took 13934 ms (client timeout 15000 ms). Trace:
I20260709 13:17:59.085924 20660 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.098052 20660 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:59.098737 20760 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:59.099162 18202 leader_election.cc:336] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.080s (SENT)
I20260709 13:17:59.099642 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:59.100538 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:59.102571 20644 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.107965 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:17:59.108381 20644 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:59.110361 20704 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:59.111891 18202 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.288s (SENT)
I20260709 13:17:59.112339 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:59.087183 20630 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.113435 20704 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:59.117522 20760 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.117784 20630 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:59.119364 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:59.125088 20562 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:59.086479 20741 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:59.129269 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 114348us
I20260709 13:17:59.142225 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:59.142590 18276 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:59.143193 18380 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:59.144379 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:59.113590 20583 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.148974 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:59.151412 18378 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:59.103564 18135 rpcz_store.cc:269] 0709 13:17:45.162784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.165624 (+  2840us) service_pool.cc:224] Handling call
0709 13:17:59.096875 (+13931251us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:51.073630 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:51.074455 (+   825us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:51.074524 (+    69us) write_op.cc:435] Acquired schema lock
0709 13:17:51.074545 (+    21us) tablet.cc:662] Decoding operations
0709 13:17:51.333623 (+259078us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:51.333726 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:51.333756 (+    30us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:17:51.522676 (+188920us) tablet.cc:701] Row locks acquired
0709 13:17:51.555711 (+ 33035us) write_op.cc:260] PREPARE: finished
0709 13:17:51.635056 (+ 79345us) write_op.cc:270] Start()
0709 13:17:51.667303 (+ 32247us) write_op.cc:276] Timestamp: P: 1783603071579728 usec, L: 0
0709 13:17:51.684178 (+ 16875us) op_driver.cc:348] REPLICATION: starting
0709 13:17:51.724662 (+ 40484us) log.cc:844] Serialized 5686 byte log entry
0709 13:17:52.316669 (+592007us) spinlock_profiling.cc:243] Waited 89.5 ms on lock 0x7b180035ab80. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:17:52.839423 (+522754us) op_driver.cc:464] REPLICATION: finished
0709 13:17:53.083895 (+244472us) write_op.cc:301] APPLY: starting
0709 13:17:53.083992 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:53.084305 (+   313us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:53.084342 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:53.116336 (+ 31994us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:53.116730 (+   394us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:17:53.116777 (+    47us) write_op.cc:312] APPLY: finished
0709 13:17:53.117155 (+   378us) log.cc:844] Serialized 100 byte log entry
0709 13:17:53.117323 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:53.117486 (+   163us) write_op.cc:454] Released schema lock
0709 13:17:53.117560 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:53.117923 (+   363us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:53.117947 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":59424,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":215329,"apply.run_cpu_time_us":3932,"apply.run_wall_time_us":34009,"num_ops":14,"prepare.queue_time_us":567997,"prepare.run_cpu_time_us":30045,"prepare.run_wall_time_us":1115560,"raft.queue_time_us":404553,"raft.run_cpu_time_us":10751,"raft.run_wall_time_us":308309,"replication_time_us":1080860,"spinlock_wait_cycles":205738880,"thread_start_us":1308551,"threads_started":4,"wal-append.queue_time_us":494771,"wal-append.run_cpu_time_us":59043,"wal-append.run_wall_time_us":1814149}]]}
I20260709 13:17:59.156531 18232 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:59.154500 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:59.156008 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:59.165297 18380 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:17:59.126492 20651 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:17:59.168426 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.118337 20760 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:59.171154 18276 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:59.172133 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:59.152593 20796 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:59.197679 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 85831.6us
I20260709 13:17:59.173728 20562 raft_consensus.cc:2764] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:17:59.183014 20608 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:59.204087 20608 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:59.204578 20608 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:59.169229 20630 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:17:59.212353 20583 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:59.214321 20433 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:17:59.222658 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54329.4us
I20260709 13:17:59.226320 18378 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
W20260709 13:17:59.243399 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.248926 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 82457.5us
I20260709 13:17:59.172425 20725 consensus_queue.cc:1059] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
W20260709 13:17:59.253856 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 43779.8us
I20260709 13:17:59.228889 20796 raft_consensus.cc:697] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:59.256505 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:59.254797 20793 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:59.274998 18201 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:59.293533 20651 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:59.294234 20651 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:59.295200 20651 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.297871 20712 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.285372 20793 raft_consensus.cc:697] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:59.302196 20793 consensus_queue.cc:237] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.283109 20790 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:59.304068 20790 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:59.305447 20790 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.300277 20712 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:59.310114 20760 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:17:59.321996 20741 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.326789 20710 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.329787 20710 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:59.280474 20779 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:59.342547 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 67628.4us
W20260709 13:17:59.331955 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 75415.2us
I20260709 13:17:59.349354 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:59.353825 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:59.354533 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:59.355016 18385 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:59.363096 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 192929us
I20260709 13:17:59.364989 18200 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:59.366703 18202 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:17:59.369024 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:59.371462 18230 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:17:59.374356 18230 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:59.341181 20433 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:59.369252 20660 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.380119 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:59.399675 18233 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:59.361825 20645 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:59.403487 18230 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:59.381860 20796 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.350762 20741 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:59.381852 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:59.385540 20608 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.377951 18131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 81) took 7995 ms. Trace:
I20260709 13:17:59.410681 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:59.381201 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:59.411839 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:59.393136 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:17:59.400856 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47438.7us
I20260709 13:17:59.412949 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:17:59.407676 20792 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.411965 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:59.412422 18231 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:59.373016 20760 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:59.423754 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:59.361244 20779 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:59.402459 20645 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:59.411136 18131 rpcz_store.cc:276] 0709 13:17:51.382427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.411427 (+ 29000us) service_pool.cc:224] Handling call
0709 13:17:59.377836 (+7966409us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:58.451294 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:58.452140 (+   846us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:58.452205 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:17:58.452237 (+    32us) tablet.cc:662] Decoding operations
0709 13:17:58.594968 (+142731us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:58.626561 (+ 31593us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:58.628732 (+  2171us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:17:58.720618 (+ 91886us) tablet.cc:701] Row locks acquired
0709 13:17:58.720673 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:17:58.720902 (+   229us) write_op.cc:270] Start()
0709 13:17:58.721091 (+   189us) write_op.cc:276] Timestamp: P: 1783603078720818 usec, L: 0
0709 13:17:58.721111 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:17:58.721975 (+   864us) log.cc:844] Serialized 1310 byte log entry
0709 13:17:59.092401 (+370426us) op_driver.cc:464] REPLICATION: finished
0709 13:17:59.175631 (+ 83230us) write_op.cc:301] APPLY: starting
0709 13:17:59.175747 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:59.175949 (+   202us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:59.176117 (+   168us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:59.176774 (+   657us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:59.177089 (+   315us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:17:59.177144 (+    55us) write_op.cc:312] APPLY: finished
0709 13:17:59.177449 (+   305us) log.cc:844] Serialized 34 byte log entry
0709 13:17:59.177647 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:59.177756 (+   109us) write_op.cc:454] Released schema lock
0709 13:17:59.177823 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:59.178264 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:59.178293 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2357262,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":59072,"apply.run_cpu_time_us":2620,"apply.run_wall_time_us":2627,"num_ops":3,"prepare.queue_time_us":198792,"prepare.run_cpu_time_us":29078,"prepare.run_wall_time_us":360358,"raft.queue_time_us":60245,"raft.run_cpu_time_us":2765,"raft.run_wall_time_us":128098,"replication_time_us":301110,"thread_start_us":239448,"threads_started":4,"wal-append.queue_time_us":131856}]]}
I20260709 13:17:59.443310 18235 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:59.442579 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 213212us
W20260709 13:17:59.447825 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 72961.9us
I20260709 13:17:59.456830 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:59.459558 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:59.469385 20608 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:59.472112 18233 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:17:59.467643 18277 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:59.466003 20741 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:59.479390 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:59.440615 20645 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:59.466981 20801 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:59.469914 20779 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:59.483173 20433 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:59.483814 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.484102 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.484532 20809 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:59.439903 20760 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:17:59.493328 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:59.494484 18385 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:17:59.495119 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:59.497642 18386 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:59.499135 20583 raft_consensus.cc:3055] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:59.499605 20583 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:59.433866 20792 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:59.486155 20608 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:59.506708 18384 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:59.507889 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:59.497048 20809 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:59.525827 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:59.527825 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:59.504712 20608 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:17:59.529560 20803 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:59.529505 20608 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:59.547072 20814 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:17:59.523736 20802 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.528152 20809 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:59.544772 20712 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:59.569878 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 80803us
I20260709 13:17:59.541378 20803 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:17:59.571930 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 102086us
I20260709 13:17:59.570634 20802 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.575413 20802 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:59.577261 20645 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.581285 20792 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:59.583953 20660 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:59.584479 18301 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b14d7467c934fdca91c8a466ef2d764 with delete_type TABLET_DATA_TOMBSTONED (TS 459e82ee6b564cc19be6f73186938e79 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43780
I20260709 13:17:59.584980 18351 leader_election.cc:400] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8.
I20260709 13:17:59.585531 18351 leader_election.cc:403] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:17:59.571666 20712 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.571280 20814 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:17:59.597396 20608 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.598757 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:59.599568 20608 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:59.601084 18277 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:59.603165 20800 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.466s	user 0.000s	sys 0.005s
I20260709 13:17:59.605247 20433 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:59.606211 20433 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:59.606529 20433 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:59.606901 20433 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:59.610164 18277 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:59.611105 20796 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:59.612957 18277 leader_election.cc:400] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8.
W20260709 13:17:59.619490 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.619493 20796 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:59.620612 20796 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.622967 20796 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:59.622860 20583 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:59.624478 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:59.628182 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:59.634750 20822 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8.
I20260709 13:17:59.636184 20774 raft_consensus.cc:3055] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:59.638216 20651 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:59.634896 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:17:59.643824 18386 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:17:59.645265 18235 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:59.652411 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:59.653144 18308 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:17:59.625988 20803 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:59.660988 20712 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:59.649554 20651 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:17:59.666388 20651 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.668164 20651 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:59.668431 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:17:59.669961 20803 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:17:59.670506 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 46156.5us
I20260709 13:17:59.652637 20796 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:59.673106 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:59.674229 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:59.676910 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:17:59.677075 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:59.677599 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:17:59.646785 20774 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:17:59.680430 18386 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:17:59.686578 20774 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:17:59.688659 18384 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:59.688362 18276 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:59.688781 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:59.692121 18307 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:17:59.693925 18955 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:59.668654 20583 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.690349 20645 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:17:59.701761 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:59.703063 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:59.703992 20741 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:59.704329 20710 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:59.704898 20710 raft_consensus.cc:697] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:59.705916 20710 consensus_queue.cc:237] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.703184 20774 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.706351 20811 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:59.708968 20802 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:59.709498 20802 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:59.710606 20802 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.718456 18237 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:59.721415 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:17:59.724115 20803 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:59.724450 20741 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:59.712321 20802 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:59.732295 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.734807 20645 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:59.736711 18381 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:59.738312 20805 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:59.738917 20805 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:17:59.740051 20805 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.741508 20809 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.742242 18380 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:59.743541 18379 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:59.744331 20809 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:17:59.746016 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 53861.9us
W20260709 13:17:59.746981 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 58309.3us
I20260709 13:17:59.748814 18201 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:59.750180 18201 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:17:59.753176 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:59.754446 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:59.755059 18381 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:59.755867 20741 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:17:59.756959 20741 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.761749 20803 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:59.756978 20804 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:59.759630 20790 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:59.689081 20433 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.784677 20804 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:17:59.790498 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.764272 20774 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:59.793895 18276 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:17:59.805325 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:17:59.806453 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:17:59.808171 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.814826 18377 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:59.819854 18381 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:17:59.770558 20803 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 13:17:59.867334 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.802528 20824 tablet_replica.cc:333] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:17:59.874641 18201 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:17:59.876919 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 70574.7us
I20260709 13:17:59.877928 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:59.803159 20774 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.820784 20712 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:59.866539 20741 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:17:59.798506 20789 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:17:59.872619 20796 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:59.907938 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.908564 20775 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:59.909097 20775 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.909451 20775 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:59.822815 20630 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:17:59.821058 20583 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:17:59.880476 20774 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:59.882226 20712 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.914456 20796 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:17:59.924994 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 51891.9us
W20260709 13:17:59.924204 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.925382 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 56531.1us
I20260709 13:17:59.925446 20712 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:59.925130 20630 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:59.950570 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:17:59.950934 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 73067us
I20260709 13:17:59.957348 20739 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 13:17:59.958190 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.948823 20630 raft_consensus.cc:3055] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:59.975422 20630 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:17:59.976431 20630 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.957222 18953 consensus_queue.cc:237] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:17:59.978516 20825 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:17:59.927023 20804 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.985517 20805 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:59.989145 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 48556.9us
I20260709 13:17:59.990209 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:17:59.991150 20822 raft_consensus.cc:2764] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:17:59.991634 20645 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:59.993291 20796 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:17:59.995204 18132 catalog_manager.cc:5697] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 3 to 4, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 4 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:17:59.949692 20819 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:59.999260 20811 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.005069 20433 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:00.005424 20827 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.100s	user 0.003s	sys 0.000s
I20260709 13:18:00.006248 18384 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:00.008001 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:00.011543 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:00.026036 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:00.040867 18202 leader_election.cc:336] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.550s (SENT)
I20260709 13:18:00.041903 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:17:59.977785 20630 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:59.957261 20824 raft_consensus.cc:2243] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:00.060072 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:00.060694 20774 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:00.018899 20811 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.062978 20774 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:00.064011 20811 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.069952 18132 catalog_manager.cc:5697] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:00.070982 20811 consensus_queue.cc:1059] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:00.066882 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.072273 18308 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.073625 20433 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:00.074060 20433 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.074234 18351 leader_election.cc:400] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6.
I20260709 13:18:00.073988 20712 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.074540 20433 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:00.076016 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:00.064006 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 52534.6us
I20260709 13:18:00.080286 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:00.071672 18132 catalog_manager.cc:5697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 2 to 5, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 5 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.017369 20645 raft_consensus.cc:697] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:00.076263 20712 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.054725 20819 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:00.080600 20651 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:00.094954 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 54167.2us
W20260709 13:18:00.100327 18202 leader_election.cc:336] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.557s (SENT)
I20260709 13:18:00.100768 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:00.102066 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:00.098016 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 177751us
I20260709 13:18:00.087898 20822 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:00.055438 20562 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 13:18:00.124426 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 48463.6us
I20260709 13:18:00.125916 18132 catalog_manager.cc:5697] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 2 to 3, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 3 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:00.098819 20712 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:00.138616 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:00.147440 20710 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.148897 20645 consensus_queue.cc:237] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.154435 20824 raft_consensus.cc:2272] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:00.156893 20819 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:00.159056 18202 leader_election.cc:336] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.568s (SENT)
I20260709 13:18:00.159574 18202 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:00.160851 18202 leader_election.cc:336] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.584s (SENT)
I20260709 13:18:00.162042 20651 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:00.162168 20808 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:00.101388 20829 consensus_queue.cc:1059] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 13:18:00.164374 20829 raft_consensus.cc:3055] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:00.164767 20829 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:00.165558 20829 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.166694 20829 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:00.167469 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.168440 20433 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.169560 20775 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:00.171144 20793 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:00.132905 20832 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:00.212756 18237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:00.219076 18307 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:00.133011 20712 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:00.234754 18237 raft_consensus.cc:606] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:00.219620 20809 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:00.221128 20775 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:00.251464 20809 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:00.197362 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 95346.2us
I20260709 13:18:00.253868 20809 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.253930 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.255117 20802 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:00.256170 18307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:18:00.256899 18307 raft_consensus.cc:606] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:00.258083 20809 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:00.223253 18132 catalog_manager.cc:5697] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 5 to 7, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 7 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.212698 20710 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:00.258584 20809 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.231418 20823 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:00.260900 18132 catalog_manager.cc:5697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 3 to 5, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 5 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.261969 20830 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:00.262187 20809 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.262578 20830 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.262970 18132 catalog_manager.cc:5697] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 3 to 4, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 4 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.235949 18308 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
W20260709 13:18:00.256075 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 117530us
W20260709 13:18:00.272895 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.132941 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 80714.7us
I20260709 13:18:00.246217 20832 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:00.246348 20804 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:00.247788 20792 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:00.247502 20712 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:00.299894 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 386234us
I20260709 13:18:00.299232 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:00.234571 20793 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:00.228600 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.307121 18312 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:00.262861 18307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:18:00.222482 20433 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.231607 20822 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:00.213039 20824 ts_tablet_manager.cc:1916] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:00.258565 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.287962 18381 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:00.308694 18132 catalog_manager.cc:5697] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 3 to 6, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 6 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:00.299041 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:00.307701 18307 raft_consensus.cc:606] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:00.312140 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.310093 20838 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:00.321080 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 62591.7us
I20260709 13:18:00.321842 18132 catalog_manager.cc:5697] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 3 to 6, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 6 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.322731 20741 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:00.323426 20741 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:00.297127 20832 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:00.326534 20823 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:00.324383 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.328182 18237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:00.328727 20433 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:00.323784 18132 catalog_manager.cc:5697] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 2 to 5, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 5 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:00.335377 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64452.7us
I20260709 13:18:00.335601 18312 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
I20260709 13:18:00.337793 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:00.344664 18277 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:00.348912 18202 leader_election.cc:336] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.842s (SENT)
I20260709 13:18:00.349529 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:00.350354 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.344801 18132 catalog_manager.cc:5697] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.360272 18383 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:00.360424 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:00.321107 20830 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.356364 20796 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:00.367080 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:00.305276 20804 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:00.368007 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 346169us
I20260709 13:18:00.370817 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:00.375016 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:00.375608 18386 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:00.375939 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:00.361718 20809 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:00.364605 20822 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:00.378994 18379 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:18:00.384142 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 76268us
I20260709 13:18:00.389745 20651 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.390221 18383 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:00.392619 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:00.393297 18233 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.394279 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.395089 20807 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:00.395469 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.396653 20807 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:00.397336 20807 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:00.397632 18237 raft_consensus.cc:606] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:00.397771 20807 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:00.398164 18237 raft_consensus.cc:614] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:00.390870 20793 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.396687 20838 raft_consensus.cc:697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:00.398999 20804 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.399592 20838 consensus_queue.cc:237] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:00.400722 20823 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:00.401212 20793 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.402235 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:00.402776 18228 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:00.403864 18312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:18:00.404484 18312 raft_consensus.cc:606] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:00.404902 18312 raft_consensus.cc:614] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:00.410022 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.390331 20651 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:00.418409 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 80718.4us
W20260709 13:18:00.419119 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 70262.9us
W20260709 13:18:00.420226 18202 leader_election.cc:336] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.892s (SENT)
I20260709 13:18:00.421976 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.407584 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:00.410641 18385 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:00.411712 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.425773 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:00.400370 20804 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.379447 20802 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:00.381860 20645 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:00.452200 18233 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:18:00.453351 20630 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.457239 20630 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.454142 20741 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 13:18:00.459127 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 62624.7us
I20260709 13:18:00.459695 20630 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.448307 20803 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:00.462397 20792 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:00.436969 20775 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:00.463335 20775 raft_consensus.cc:697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:00.464162 20775 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:00.449244 20804 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.456033 20822 raft_consensus.cc:2764] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:18:00.468994 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:00.470738 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.471299 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:00.452023 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:00.471349 18308 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:00.474000 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.474221 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.459349 20741 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:00.476727 20741 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:00.476852 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.476958 20712 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:00.477649 18306 raft_consensus.cc:2368] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8.
I20260709 13:18:00.477720 20741 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.478955 18309 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:00.481889 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.483004 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.483024 20804 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.484071 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.484774 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.484916 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.485185 20651 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.485664 18310 raft_consensus.cc:2410] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:00.486433 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.487453 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.488336 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.489135 18304 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 5: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:00.490438 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.491132 18304 raft_consensus.cc:2368] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7.
I20260709 13:18:00.491628 20833 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:00.491940 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.492259 20651 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:00.492482 18304 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:00.489516 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.494133 18308 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:18:00.494925 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.495496 18308 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:00.489142 18306 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:00.488490 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.497728 18305 raft_consensus.cc:2410] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:00.492888 20651 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.503665 20651 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.479028 20741 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:00.507472 20829 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:00.510504 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:00.510987 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.505631 18309 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:00.506265 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.512359 18305 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:00.504884 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.506929 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.505403 18303 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:00.513650 18308 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:00.506399 20807 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:00.514786 18351 connection.cc:256] RPC call timeout handler was delayed by -1.1664891779998925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 13:18:00.515237 18351 connection.cc:256] RPC call timeout handler was delayed by -1.0923210339999514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
I20260709 13:18:00.515120 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.515982 18308 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:00.511122 18236 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:00.497679 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.516492 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.517069 18304 raft_consensus.cc:2368] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7.
I20260709 13:18:00.523132 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.530646 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:00.532567 18306 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:00.532896 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.533573 18307 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.534216 18228 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
I20260709 13:18:00.530500 18386 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:00.536026 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.538318 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:00.538470 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.538928 18232 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:00.539331 18303 raft_consensus.cc:2410] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:00.543277 18308 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:00.544267 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:00.544279 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.545279 18308 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:00.546182 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.546337 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.546922 18309 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:00.561270 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.562412 18304 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:00.564859 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:00.568398 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.568610 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 148405us
W20260709 13:18:00.569697 18202 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.912s (SENT)
I20260709 13:18:00.569901 18276 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:00.565743 18306 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:18:00.573431 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:00.574002 20833 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:00.574565 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:00.575153 18231 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:00.575088 20832 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.580852 18310 raft_consensus.cc:2393] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:00.582862 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.584012 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.576203 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:00.580950 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.595005 18236 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:00.596503 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:00.597303 18236 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.600672 18303 raft_consensus.cc:2368] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 4. Current term is 5.
I20260709 13:18:00.601289 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.601483 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:00.535930 20645 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:00.617897 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 94825.4us
I20260709 13:18:00.618042 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.545575 20651 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:00.584767 20805 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:00.624876 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.625627 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:00.637192 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:00.637856 18233 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:00.641278 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.642211 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:00.643236 18304 raft_consensus.cc:2410] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:00.632611 18309 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:00.633823 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:00.644352 18231 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:00.609553 20433 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:00.593667 20819 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:00.648811 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.634199 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64511.5us
W20260709 13:18:00.653312 18351 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.547s (SENT) [suppressed 72 similar messages]
I20260709 13:18:00.651013 18310 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:00.659277 18233 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:00.616704 20804 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.663447 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.669247 18232 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:00.670397 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:00.670471 18236 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
W20260709 13:18:00.672838 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.670397 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.675477 18306 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:00.669679 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.676770 18310 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:00.677860 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.678843 18310 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:00.684136 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:00.685469 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:00.687170 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:00.688022 18228 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:18:00.574585 20833 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.692736 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.696303 18304 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:00.636207 20805 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:00.692108 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:00.693101 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.706599 18303 raft_consensus.cc:2368] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
I20260709 13:18:00.700439 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.700954 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:00.709327 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:00.710171 18232 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:00.709944 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.712951 20807 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:00.716383 20833 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.716797 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.721289 18381 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:00.722414 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:00.723730 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:00.724822 18307 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:18:00.725083 18228 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:00.685742 20433 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:00.725925 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.660989 20830 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.727128 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.726871 20433 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.727355 20830 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.727921 18307 raft_consensus.cc:2410] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:00.727517 18308 raft_consensus.cc:2410] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:18:00.641629 20775 raft_consensus.cc:2955] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 4 to 7, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:18:00.729490 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.729944 20830 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.730548 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.731598 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.731904 18233 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:00.633445 20651 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.736946 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:00.738051 18228 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:00.733986 18233 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:00.751050 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.751510 18305 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:00.763815 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.767196 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:00.769781 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:00.770785 18228 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:00.771031 18233 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:18:00.787550 18236 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:00.769790 20836 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:18:00.773136 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.773223 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:00.793876 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.776670 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:00.795207 18230 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:00.692747 20804 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.796981 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.797870 18310 raft_consensus.cc:2410] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:00.642413 20645 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:00.802264 20645 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:00.741429 20805 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:00.802824 20804 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.737151 20832 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:00.805286 18120 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 943649b738074d87a593c237cf998758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8b4fbc44aa2649f0bcac5cd70f71951d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:18:00.805716 20829 raft_consensus.cc:993] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:18:00.806267 20837 raft_consensus.cc:1081] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:18:00.806599 18228 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:00.765342 20828 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:00.737149 20741 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:18:00.812541 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.690632 20819 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:00.780877 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.829489 18309 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:00.791594 20830 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:18:00.835011 20819 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.832571 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:00.836301 18379 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:18:00.786235 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:00.768992 18277 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.775602 20833 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:00.841579 18309 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:00.795563 18306 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:00.793870 18308 raft_consensus.cc:2410] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:00.822777 18310 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:00.836747 18383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:18:00.847774 18383 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.848150 18383 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:00.778379 20824 ts_tablet_manager.cc:1929] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:18:00.838194 18380 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:00.839502 18231 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:00.839715 18311 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:18:00.832576 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:00.873306 18310 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:00.845826 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 77126us
I20260709 13:18:00.877362 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.779767 18232 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:00.889328 18233 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:00.891409 20829 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:00.893824 18277 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.895036 20829 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:00.897207 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.868758 18230 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:00.869874 18308 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:00.870863 18303 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:18:00.898782 18303 pending_rounds.cc:85] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 4
I20260709 13:18:00.899099 18303 pending_rounds.cc:107] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:18:00.899323 18303 raft_consensus.cc:2889] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:00.876659 18231 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:00.902446 18308 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:00.878142 18306 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:00.904260 18306 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:00.904711 18308 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:00.857316 18309 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:00.732462 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:00.906924 18308 raft_consensus.cc:2955] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:18:00.839775 20651 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:00.915918 18277 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:00.918218 18310 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:00.917698 18305 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:00.919378 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:00.916666 18236 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:00.921248 18277 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:00.918252 20829 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:00.923425 20837 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:00.880851 20807 raft_consensus.cc:476] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 13:18:00.920882 20824 log.cc:1199] T 2b14d7467c934fdca91c8a466ef2d764 P 459e82ee6b564cc19be6f73186938e79: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-1-root/wals/2b14d7467c934fdca91c8a466ef2d764
I20260709 13:18:00.954874 18304 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:00.924605 18305 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:00.931178 18311 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:00.869004 20832 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:00.926081 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:00.924775 20828 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:01.000449 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 332005us
W20260709 13:18:00.992688 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 45862.1us
W20260709 13:18:01.001149 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:01.000738 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 74731.4us
I20260709 13:18:00.960903 20833 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:01.002468 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:01.009884 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 245026us
W20260709 13:18:01.027354 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:01.046125 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 43773.1us
I20260709 13:18:01.047114 18277 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:01.003002 20630 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:01.009313 20833 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.010205 20824 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43780 (request call id 75) took 1450 ms. Trace:
W20260709 13:18:01.054765 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 401486us
W20260709 13:18:01.058707 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 138851us
I20260709 13:18:01.061161 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:01.061233 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.041750 20828 raft_consensus.cc:697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:18:01.061760 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 132603us
I20260709 13:18:01.066350 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:01.055426 18351 leader_election.cc:336] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.614s (SENT)
I20260709 13:18:01.050668 20837 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:01.054394 20811 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:01.056363 20833 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.079515 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:01.088259 18201 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:01.115808 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 49515.5us
I20260709 13:18:01.085089 20793 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:01.085083 20645 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:01.073539 20433 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
W20260709 13:18:01.130959 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 69830.2us
W20260709 13:18:01.132702 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 49269.3us
I20260709 13:18:01.133899 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:01.135656 18380 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:01.135740 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:01.137035 18379 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:01.118403 20704 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:01.154373 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:01.141081 20656 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:18:01.089901 20779 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:18:01.157829 18377 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:01.094498 20805 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.122958 20793 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:01.126802 20651 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:01.163515 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:01.159859 20562 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:01.168793 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:01.176646 18380 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:01.171868 18378 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:01.172683 20805 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:01.121528 20630 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:18:01.173657 20775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:38094 (request call id 1) took 1785 ms. Trace:
I20260709 13:18:01.178707 18383 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.174600 20793 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:01.056557 20824 rpcz_store.cc:276] 0709 13:17:59.567485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.584051 (+ 16566us) service_pool.cc:224] Handling call
0709 13:17:59.690936 (+106885us) ts_tablet_manager.cc:1151] Deleting tablet 2b14d7467c934fdca91c8a466ef2d764
0709 13:17:59.760228 (+ 69292us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:18:00.498279 (+738051us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:00.778214 (+279935us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:00.992142 (+213928us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":99351,"thread_start_us":54779,"threads_started":1}
I20260709 13:18:01.192023 18383 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:01.175099 20651 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:01.201565 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 65332.4us
I20260709 13:18:01.189038 20837 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
W20260709 13:18:01.210680 20855 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:18:01.211227 20877 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:01.211783 20712 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:01.177489 20828 consensus_queue.cc:237] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:01.218557 20860 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.157s	user 0.004s	sys 0.000s
W20260709 13:18:01.223522 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 68680.5us
I20260709 13:18:01.234790 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:01.267361 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.271122 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:01.272552 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:01.273875 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 97355.6us
I20260709 13:18:01.275804 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:01.239037 20651 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:01.286846 18121 catalog_manager.cc:5028] TS 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): tablet 2b14d7467c934fdca91c8a466ef2d764 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:18:01.277256 20562 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:01.278720 20823 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:01.278832 20805 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:01.292891 20805 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:01.293260 20805 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:01.270327 20877 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:01.299510 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:01.310736 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 241651us
I20260709 13:18:01.302793 20562 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:01.315632 18308 raft_consensus.cc:2955] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:18:01.324476 18303 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:01.324821 18385 raft_consensus.cc:2955] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:18:01.353500 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 118837us
I20260709 13:18:01.355094 20866 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:01.356012 20833 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.356841 20830 raft_consensus.cc:2764] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:18:01.358327 20833 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:01.355821 20866 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:01.356464 20859 log.cc:927] Time spent T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:01.369765 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:01.374024 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 74555.1us
I20260709 13:18:01.186621 20775 rpcz_store.cc:276] 0709 13:17:59.388103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.388278 (+   175us) service_pool.cc:224] Handling call
0709 13:17:59.618380 (+230102us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b18003791a0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822ae73d 00007fa182279f3f 00007fa1822796b3 00007fa1822719fa 00007fa1872394c9 00007fa1807b5c54 00007fa1807b5be2 00007fa1807b5b11 00007fa1807b5a8c 00007fa1807b4d42
0709 13:17:59.720277 (+101897us) spinlock_profiling.cc:243] Waited 67.5 ms on lock 0x7b58001217d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821cf0aa 00007fa182251447 00007fa18226e70a 00007fa18226f76a 00007fa18226e91b 00007fa18227a03c 00007fa1822796b3 00007fa1822719fa 00007fa1872394c9 00007fa1807b5c54
0709 13:17:59.955656 (+235379us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b5800169ad0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821cf0aa 00007fa182251447 00007fa18226e70a 00007fa18226f76a 00007fa18226e91b 00007fa18227a03c 00007fa1822796b3 00007fa1822719fa 00007fa1872394c9 00007fa1807b5c54
0709 13:18:00.001865 (+ 46209us) log.cc:844] Serialized 508 byte log entry
0709 13:18:00.390389 (+388524us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b5400423220. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821e8dbe 00007fa1821f3930 00007fa1821f38d8 00007fa1821f3858 00007fa1821f3813 00007fa1821f2a9c 00007fa1880de626 00007fa1880d8dd8 00007fa18222f7cb 00007fa1822322c0
0709 13:18:01.173554 (+783165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14516,"raft.queue_time_us":25173,"raft.run_cpu_time_us":1234,"raft.run_wall_time_us":7899,"spinlock_wait_cycles":700834944,"thread_start_us":94622,"threads_started":1,"wal-append.queue_time_us":309140}
I20260709 13:18:01.377367 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:01.306380 20811 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:18:01.384177 18228 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:01.389683 18229 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:01.381250 20704 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.398698 20704 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.399377 18379 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:01.397220 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:01.401664 18382 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:01.351329 20739 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:18:01.381235 20809 raft_consensus.cc:2764] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:01.417907 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:01.422441 18119 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1dea3366ee674017a0bbfc9bce0d9a73 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:01.375029 20830 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:18:01.420181 20741 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:18:01.427356 18351 leader_election.cc:400] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
W20260709 13:18:01.429147 20881 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:18:01.430800 18351 leader_election.cc:403] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.436506 18202 leader_election.cc:400] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7.
I20260709 13:18:01.436954 18202 leader_election.cc:403] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.406133 20562 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:01.446331 20866 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:01.449944 20793 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.453352 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:01.470144 20789 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.470829 20789 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:01.429005 20630 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:18:01.437484 20808 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:01.403088 20876 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:18:01.455961 20807 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:01.495249 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:01.500722 18381 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:01.482964 20704 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:01.459834 20822 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:01.485479 20830 consensus_queue.cc:1243] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer 459e82ee6b564cc19be6f73186938e79 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:01.504278 18201 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:01.489949 20828 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.489537 20789 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:01.406999 20877 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.526408 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:01.527123 20804 raft_consensus.cc:993] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:18:01.528831 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:01.528983 18382 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:18:01.529747 18231 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:01.530330 20656 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:01.530797 20656 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:01.531008 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 94674.9us
I20260709 13:18:01.531792 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:01.533041 20793 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:01.533998 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:01.536576 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:01.528002 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:01.540776 18234 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.542238 18926 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:01.544015 18231 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:01.541121 18201 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:01.550876 20830 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:01.551283 20830 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:01.551700 20830 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:01.552920 20819 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:01.505127 20562 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:01.504590 20885 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7.
I20260709 13:18:01.553911 20562 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:01.554931 20562 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.513140 20866 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:18:01.539356 20828 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:01.551584 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 56402.3us
I20260709 13:18:01.558139 20779 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:01.566175 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:01.570093 18234 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:18:01.541666 20656 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:01.579898 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:01.569478 20779 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:01.590444 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 58722.1us
I20260709 13:18:01.539044 20704 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:18:01.591212 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:01.579841 20822 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:01.576167 20866 raft_consensus.cc:1081] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:18:01.637198 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:01.638005 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:01.638281 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:01.642233 18234 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:18:01.640555 18379 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:01.586720 20837 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:01.592172 20779 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.649088 18201 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:01.639703 20433 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.581995 20893 consensus_queue.cc:1059] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
W20260709 13:18:01.673920 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 89576.8us
I20260709 13:18:01.649505 20638 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:18:01.643229 20897 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:18:01.634708 20888 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:18:01.674211 20837 raft_consensus.cc:697] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:01.693295 20819 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:01.702632 20828 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:01.675227 20433 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.707525 20804 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:01.728760 20903 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:18:01.729866 20895 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:18:01.730204 20903 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:18:01.739090 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 55772us
W20260709 13:18:01.739244 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 159434us
W20260709 13:18:01.741518 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.742424 18277 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:01.743525 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:01.750629 20880 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:01.734509 20804 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:01.738538 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 90104.1us
I20260709 13:18:01.755686 18385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46844
I20260709 13:18:01.756268 18385 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:01.756680 18385 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:01.742978 20704 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:01.744872 20710 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.747654 20832 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:18:01.777072 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 185920us
I20260709 13:18:01.779729 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:01.759433 20822 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:01.757499 20804 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:01.757265 20880 raft_consensus.cc:697] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:01.792135 20656 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:01.792858 20898 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.104s	user 0.002s	sys 0.000s
I20260709 13:18:01.794690 20656 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:01.796602 20891 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 13:18:01.804838 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 43954us
I20260709 13:18:01.762290 20704 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:01.808101 18385 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.768620 20832 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:01.813797 18228 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:01.822460 20832 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:01.823820 20805 consensus_meta.cc:287] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 13:18:01.773128 20710 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.824182 20832 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:01.844985 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:01.852267 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 72681.2us
I20260709 13:18:01.853744 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:01.854698 20904 raft_consensus.cc:2764] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:01.855429 20904 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:01.855822 20704 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.857400 20704 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:01.824966 20828 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:18:01.863339 20904 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:01.824388 20805 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.865581 18377 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:01.818724 18234 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:01.865505 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:01.866643 20808 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:01.866719 20805 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:01.867092 20808 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:01.867542 20808 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:01.868847 20899 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:18:01.870893 20710 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:01.871558 20710 consensus_queue.cc:1059] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:01.872445 20828 raft_consensus.cc:3055] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:01.872934 20828 raft_consensus.cc:740] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:01.873075 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:01.873934 20828 consensus_queue.cc:260] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.875118 20828 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:01.876250 20808 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.879282 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:01.880888 18202 leader_election.cc:400] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 4. Current term is 5.
I20260709 13:18:01.882474 18202 leader_election.cc:403] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.880787 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:01.771976 20837 consensus_queue.cc:237] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.886234 18202 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:01.881055 20880 consensus_queue.cc:237] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.883452 20656 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:01.879769 20808 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:01.867515 20805 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:01.898772 18229 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:18:01.903136 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.846601 20908 raft_consensus.cc:3055] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:01.917634 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:01.816288 18385 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:01.906155 20805 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:01.908521 20908 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:18:01.915953 20651 consensus_meta.cc:287] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 13:18:01.993780 20909 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 4. Current term is 5.
I20260709 13:18:01.994815 20905 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:01.924811 20793 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.070080 20908 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:01.997362 20710 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:02.032696 20823 consensus_meta.cc:287] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.741s	user 0.012s	sys 0.000s
W20260709 13:18:02.072716 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 155219us
I20260709 13:18:02.076496 18202 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:02.071720 20908 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:01.926512 20893 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.143s
I20260709 13:18:02.071555 20710 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.047016 20651 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.074288 20904 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:02.186986 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 110625us
W20260709 13:18:02.146034 20881 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:18:02.190677 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:02.079547 20823 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:02.199424 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 454197us
I20260709 13:18:02.078783 20433 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:01.927034 20822 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.068964 20793 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.212914 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:02.214977 20907 log.cc:927] Time spent T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:18:02.216035 20656 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:02.172936 20805 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.185895 20904 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:18:02.223945 20779 consensus_meta.cc:287] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.000s
W20260709 13:18:02.225320 20914 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:18:02.226589 20630 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:02.222355 20807 consensus_meta.cc:287] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.724s	user 0.007s	sys 0.004s
W20260709 13:18:02.282544 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 69727.3us
I20260709 13:18:02.209693 20905 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:02.214206 20808 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:02.300217 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:02.231773 20433 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:02.302990 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.288792 20904 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:02.284250 20819 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:02.286321 20884 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:02.299206 20805 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.333969 20793 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:02.307240 20807 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
I20260709 13:18:02.343878 20819 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.345441 20710 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:02.345701 20885 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:02.346057 20885 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:02.346449 20819 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:02.346812 20885 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.347918 20885 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:02.348924 20911 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:18:02.351198 20918 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:18:02.301890 20630 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.295078 20836 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:02.308013 20888 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:02.357125 20710 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.317117 20808 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:02.294086 20779 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:02.315965 20433 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.362794 20651 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:02.386049 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64285.6us
W20260709 13:18:02.382828 20830 consensus_meta.cc:287] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.813s	user 0.007s	sys 0.006s
I20260709 13:18:02.395021 18202 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:02.386914 20832 consensus_meta.cc:287] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.002s
W20260709 13:18:02.396229 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.362751 20710 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.384632 20793 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:02.392735 20888 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:02.352173 20884 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.425611 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:02.358433 20905 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.401058 20704 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:02.444895 20656 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:18:02.447176 20901 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:02.399137 20830 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.450526 20809 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:02.450438 20904 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.450943 20830 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:02.455420 20927 consensus_queue.cc:1059] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:18:02.456583 20927 raft_consensus.cc:3055] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:02.456911 20927 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:02.456971 20904 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:02.457922 20927 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.459048 20927 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:02.461408 20828 consensus_meta.cc:287] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.004s
I20260709 13:18:02.465229 20741 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.465770 20741 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:02.469489 20923 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:02.470142 20819 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:02.472486 20916 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:02.473064 20916 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.475051 20916 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:02.476090 20893 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:02.476423 20893 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:02.477262 20893 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.478399 20893 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:02.489382 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 276580us
I20260709 13:18:02.490839 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:02.488209 20809 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:02.492029 20908 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:02.492806 20809 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.492360 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:02.494036 20809 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:02.492698 20903 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:02.494894 20884 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:02.495000 20822 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:02.495632 20822 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:02.496454 20822 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.499482 20807 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:02.501798 20905 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:02.503072 20433 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:02.444136 20808 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.446044 20630 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:02.504952 20630 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.505369 20630 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.507443 20630 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:02.443162 20651 consensus_queue.cc:1059] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:18:02.512202 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:02.513063 18308 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
W20260709 13:18:02.514137 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.515862 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:02.516644 18230 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:02.517246 18229 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:02.517915 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:02.521224 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:02.521786 18228 raft_consensus.cc:3055] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:02.521598 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:02.522215 18228 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:02.523200 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:02.523991 18234 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:02.525022 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:02.525462 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:02.527405 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:02.527951 18230 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:02.533363 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:02.523012 18228 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.539485 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:02.540930 18234 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 6: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:02.545873 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:02.546883 18311 raft_consensus.cc:2410] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:02.546705 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:02.547315 18305 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:02.547567 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:02.548056 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:02.548358 18307 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:18:02.548466 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:02.549228 18304 raft_consensus.cc:2376] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8. Re-sending same reply.
I20260709 13:18:02.431794 20930 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:02.549939 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:02.555056 18228 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:02.556926 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:02.555500 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:02.557569 18303 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:02.555636 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:02.561060 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:02.556658 18306 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:02.508551 20651 raft_consensus.cc:3055] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:02.562168 18305 raft_consensus.cc:2410] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:02.574993 18312 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:18:02.562536 18307 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:02.575430 18312 pending_rounds.cc:85] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 3
I20260709 13:18:02.575693 18312 pending_rounds.cc:107] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:02.575917 18312 raft_consensus.cc:2889] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:02.576009 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:02.576418 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:02.577114 18307 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:18:02.562806 18229 raft_consensus.cc:2410] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:18:02.564909 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:02.566989 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:02.579632 18311 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:02.580027 18229 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:02.567363 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:02.568624 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:02.581198 18309 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:02.582073 18120 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 943649b738074d87a593c237cf998758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8b4fbc44aa2649f0bcac5cd70f71951d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:18:02.585031 20932 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.155s	user 0.000s	sys 0.002s
I20260709 13:18:02.531872 20828 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.587265 20828 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.568977 18230 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:02.488976 20829 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.575706 18232 raft_consensus.cc:2393] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:02.431716 20793 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.592083 18309 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:02.592589 20793 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:02.533223 20630 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.597506 18308 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:18:02.602231 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.602348 18311 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:02.604310 18235 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:02.606173 20562 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:02.606972 20562 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:02.608770 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 45374.3us
I20260709 13:18:02.589805 20823 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:02.609620 20823 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:02.611783 20912 consensus_queue.cc:1059] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:02.611832 20823 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:02.575276 20651 raft_consensus.cc:740] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:02.623219 20651 consensus_queue.cc:260] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.624246 18228 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:18:02.624585 20651 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:02.422783 20888 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:02.629947 20888 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:02.632294 20779 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:02.635568 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:02.635787 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 66020.6us
I20260709 13:18:02.636585 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:02.636270 18379 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:18:02.644456 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.651608 18385 raft_consensus.cc:3055] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:02.652195 18385 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:02.653203 18385 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:02.634974 20804 consensus_meta.cc:287] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.822s	user 0.010s	sys 0.001s
I20260709 13:18:02.696656 18385 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.708141 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:02.709605 18377 raft_consensus.cc:2410] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:18:02.707665 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 50997.3us
I20260709 13:18:02.730055 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:02.730788 18382 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:02.712004 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:02.737692 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:02.738620 18382 raft_consensus.cc:2393] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:02.739941 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:02.740753 18386 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:18:02.657912 20811 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:02.706808 20645 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:02.603513 20829 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.751915 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:02.645972 20630 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.755353 18303 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:02.734879 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:02.757516 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:02.760215 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:02.784435 18386 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 6: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:02.760578 18237 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:02.761633 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:02.787401 18385 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:02.799631 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:02.802050 18385 raft_consensus.cc:2410] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:18:02.756348 20811 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.595626 20930 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.744719 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:02.806376 18381 raft_consensus.cc:3055] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:02.816857 18381 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:02.711828 20804 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.740888 20832 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:18:02.812790 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:02.817866 18385 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:18:02.825469 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 94649us
I20260709 13:18:02.827749 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:02.828401 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:02.829134 18228 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 6: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:02.810338 20811 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:02.835515 18231 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 8: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:02.760185 20645 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.832625 18306 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:02.837297 18381 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.838253 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:02.839215 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:02.841934 18202 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:02.842410 18235 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:02.843726 18202 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:18:02.845079 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 234134us
I20260709 13:18:02.847700 18351 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:02.818565 20882 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:02.854730 18381 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:02.851722 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:02.825479 20710 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:02.882066 20901 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:02.853246 20822 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:02.889290 20822 consensus_queue.cc:1059] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:02.891098 20822 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:02.854175 20830 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:18:02.895591 20645 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:02.895985 20894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.018s	user 0.021s	sys 0.035s
W20260709 13:18:02.897928 20925 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:18:02.853417 20808 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:02.873188 20805 consensus_meta.cc:287] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.001s
I20260709 13:18:02.897050 20645 raft_consensus.cc:3055] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:02.853615 20937 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:02.902356 20894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.214s	user 0.021s	sys 0.036s
I20260709 13:18:02.860025 20638 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:02.878443 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:02.884323 20562 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:02.960381 18381 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:18:02.962430 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 84065.2us
I20260709 13:18:02.964409 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:02.846571 20889 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.326s
I20260709 13:18:02.967103 18202 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:02.927603 20943 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:02.926537 20808 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:02.971685 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:02.930253 20645 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:02.986737 20819 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:02.987351 20819 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:02.872886 20882 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:02.993960 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.971830 20836 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:02.968523 20830 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:02.976408 20808 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:02.974882 20885 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:02.988265 20819 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:02.971364 20943 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:02.960454 20638 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:02.971313 20866 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
W20260709 13:18:03.019141 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.006901 20893 consensus_meta.cc:287] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.007s
W20260709 13:18:03.021173 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 161800us
I20260709 13:18:03.005666 20830 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:03.021899 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:03.010922 20829 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:03.011484 20836 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:03.043776 20936 log.cc:927] Time spent T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
W20260709 13:18:03.044083 20921 log.cc:927] Time spent T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.434s	user 0.000s	sys 0.001s
W20260709 13:18:03.044912 20941 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:18:03.047660 20942 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 13:18:03.048401 20940 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:18:03.049912 18379 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:18:03.051319 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:03.017697 20885 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:03.068945 20939 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:18:03.061026 20893 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:03.072883 20938 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:18:03.030328 20630 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:03.031509 20830 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.086972 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:03.103435 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 52190.9us
I20260709 13:18:03.103649 18382 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:03.089072 18385 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:03.089941 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:03.091743 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:03.106850 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:03.107741 20950 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:03.108422 20950 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:03.108742 20885 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.109386 20950 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.107854 20893 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:03.114403 20893 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.053728 20804 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:03.099196 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.100589 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1357) took 1554 ms. Trace:
I20260709 13:18:03.100682 18381 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:03.086053 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:03.100926 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:03.102727 18926 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:03.104197 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:03.125458 18379 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:03.124486 18236 rpcz_store.cc:276] 0709 13:18:01.524719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.534697 (+  9978us) service_pool.cc:224] Handling call
0709 13:18:01.534986 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.552606 (+ 17620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.552650 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.553197 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.746831 (+193634us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b18000ba9a0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:18:01.916232 (+169401us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:02.036057 (+119825us) log.cc:844] Serialized 14 byte log entry
0709 13:18:02.148019 (+111962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.148121 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.073396 (+925275us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b18000ba9a0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:18:03.079227 (+  5831us) raft_consensus.cc:1685] finished
0709 13:18:03.079263 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.079475 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147544,"prepare.queue_time_us":151306,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":136132,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":19074,"spinlock_wait_cycles":30569600,"thread_start_us":169189,"threads_started":1,"wal-append.queue_time_us":633317}
I20260709 13:18:03.064213 20930 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:03.151759 18383 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:03.023456 20645 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.155207 18201 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:03.157963 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 294) took 1295 ms. Trace:
I20260709 13:18:03.161871 18233 rpcz_store.cc:276] 0709 13:18:01.862594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.863059 (+   465us) service_pool.cc:224] Handling call
0709 13:18:01.863403 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.863745 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.863774 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.864250 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.062059 (+197809us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:02.062117 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.062218 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.157752 (+1095534us) raft_consensus.cc:1685] finished
0709 13:18:03.157772 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.157901 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1168,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"thread_start_us":197367,"threads_started":1,"wal-append.queue_time_us":533675}
I20260709 13:18:03.164597 18379 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:03.149623 20876 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:03.185406 20876 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:03.186589 20876 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:03.168625 20804 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:03.101521 20943 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.170323 20645 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.171049 20882 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:03.175007 20808 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.150152 20809 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:03.177074 20836 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.179303 20638 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:03.180042 20828 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:03.182389 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1360) took 1439 ms. Trace:
W20260709 13:18:03.189426 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.157035 20947 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:03.228891 18231 rpcz_store.cc:276] 0709 13:18:01.742995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.743209 (+   214us) service_pool.cc:224] Handling call
0709 13:18:03.182107 (+1438898us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540001c7d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:03.182283 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2505949440}
W20260709 13:18:03.192365 20941 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:18:03.229434 20947 raft_consensus.cc:697] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:03.231891 20947 consensus_queue.cc:237] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.220407 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:03.234220 18385 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
W20260709 13:18:03.197515 20927 consensus_meta.cc:287] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.738s	user 0.013s	sys 0.001s
W20260709 13:18:03.221095 20651 consensus_meta.cc:287] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.004s
W20260709 13:18:03.284857 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 89915.2us
I20260709 13:18:03.281546 20805 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:03.288898 20651 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:18:03.246301 20809 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:03.298224 20943 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:03.317309 20955 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.169s	user 0.001s	sys 0.001s
I20260709 13:18:03.309626 20741 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:03.301156 20805 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:03.336195 18382 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:03.343202 20950 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:03.346755 20950 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.348610 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:03.349709 20808 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:03.354046 20958 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:18:03.357759 20805 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:03.358026 20897 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:18:03.359213 20809 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:03.359421 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:03.362591 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:03.350991 20950 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:03.366855 20811 consensus_meta.cc:287] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.000s
I20260709 13:18:03.372352 18926 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:03.374800 20777 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:03.375223 20777 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:03.375564 20777 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.367532 20811 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.382874 20811 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:03.366134 20830 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.387632 18201 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:03.389243 18201 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:03.399976 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:03.400955 18231 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.396564 20809 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:03.393898 20901 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:03.408888 20808 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.419530 20808 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.420377 18231 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:18:03.417121 20809 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:03.421680 20901 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:03.436338 20808 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:03.437820 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:03.437503 20809 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.438861 20901 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.445971 20777 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:03.449124 20777 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:03.449422 20830 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:03.449716 18953 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:03.514245 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.545163 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 49449.4us
W20260709 13:18:03.510214 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.551412 20969 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:18:03.531956 20808 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.552182 20808 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.532944 20830 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.555445 20830 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.458405 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:03.557406 20808 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:03.558135 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:03.560353 18385 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.567063 18385 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:18:03.570216 20830 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:03.572134 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:03.574415 18384 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:18:03.573666 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:03.575599 18385 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 3.
I20260709 13:18:03.575910 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 1784) took 1011 ms. Trace:
I20260709 13:18:03.576830 18306 rpcz_store.cc:276] 0709 13:18:02.564467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.564655 (+   188us) service_pool.cc:224] Handling call
0709 13:18:03.575637 (+1010982us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b540013ef54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:03.575814 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582243200}
I20260709 13:18:03.577579 18926 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:03.580078 18201 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:03.582319 18201 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:03.585650 20872 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:18:03.593042 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 779994us
I20260709 13:18:03.589347 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1789) took 1020 ms. Trace:
I20260709 13:18:03.599754 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:03.615124 18385 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:03.581112 20902 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:03.631397 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 63084.3us
I20260709 13:18:03.586253 20830 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:03.683560 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1786) took 1070 ms. Trace:
I20260709 13:18:03.684298 18310 rpcz_store.cc:276] 0709 13:18:02.565168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.565385 (+   217us) service_pool.cc:224] Handling call
0709 13:18:02.565712 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.566082 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.566123 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.566618 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.822968 (+256350us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:03.012358 (+189390us) log.cc:844] Serialized 14 byte log entry
0709 13:18:03.635284 (+622926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.635402 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.635463 (+    61us) raft_consensus.cc:1685] finished
0709 13:18:03.635483 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.635677 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":658897,"prepare.queue_time_us":11714,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":3344,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":20574,"thread_start_us":392603,"threads_started":2,"wal-append.queue_time_us":367865}
I20260709 13:18:03.627919 20872 raft_consensus.cc:697] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:03.631419 20902 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.632324 20793 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.634541 20830 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.640103 20433 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:03.699831 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 65948.1us
I20260709 13:18:03.697533 20902 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:03.696031 20901 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.734761 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:03.735493 18379 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:03.736402 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:03.737147 18310 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 7: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:03.701570 20830 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.741605 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:03.742108 18310 raft_consensus.cc:1813] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Handling vote request from an unknown peer 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:03.742622 18310 raft_consensus.cc:2368] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:18:03.749504 18310 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:03.700421 20793 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.753340 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:03.753886 18310 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:03.756768 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:03.727931 20433 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.758168 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:03.758996 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:03.759372 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:03.759742 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:03.779302 18236 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:03.779984 18231 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:03.780580 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:03.783541 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:03.784189 18305 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:03.780005 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:03.785663 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:03.784476 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:03.785053 18230 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:03.795264 18233 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:03.796157 18304 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:03.802067 18311 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:03.797305 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:03.803287 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:03.807509 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:03.807384 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:03.812363 18308 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.815732 18310 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:03.812026 18312 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:18:03.817806 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:03.756126 20809 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:03.741828 20901 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.803128 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:03.819149 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:03.819787 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:03.820914 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:03.827832 18311 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:03.822325 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:03.823340 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 88412.1us
I20260709 13:18:03.822744 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:03.823891 18305 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:03.781507 20836 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.825774 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:03.781384 20894 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:03.770735 20811 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:03.828663 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:03.841794 18312 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:03.864286 18236 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:03.843446 18305 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:03.833501 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:03.827186 20809 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:03.838480 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 58547.6us
I20260709 13:18:03.838680 18234 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:03.873656 18276 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:03.875171 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:03.839466 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:03.803808 20829 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.823412 18304 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:03.878808 18276 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:03.865097 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.865581 18233 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:03.866237 18305 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:03.843493 18277 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:03.854138 18309 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:03.841228 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1568) took 1088 ms. Trace:
I20260709 13:18:03.862991 18200 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:18:03.849224 20978 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:03.884845 18312 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:03.907318 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:03.907696 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:03.907887 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:03.908398 18382 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:03.908761 18233 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:03.909955 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:03.910789 18385 raft_consensus.cc:2410] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:18:03.880836 18235 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:03.902904 18305 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:03.905740 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:03.912497 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:03.902104 18377 rpcz_store.cc:276] 0709 13:18:02.751546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.752728 (+  1182us) service_pool.cc:224] Handling call
0709 13:18:02.797204 (+ 44476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.875543 (+ 78339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.875570 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.875608 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:02.875643 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.839726 (+964083us) spinlock_profiling.cc:243] Waited 78.1 ms on lock 0x7b540004ced4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:03.839773 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.839888 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179721984}
I20260709 13:18:03.903759 18228 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:18:03.914502 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 71073.3us
I20260709 13:18:03.904050 18276 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:03.845079 20945 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.916564 18308 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
W20260709 13:18:03.917124 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.817962 20872 consensus_queue.cc:237] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:03.879129 20889 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.898974 20832 raft_consensus.cc:2764] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:03.850652 20793 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:03.861970 20433 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:03.844682 20630 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:03.923241 18351 leader_election.cc:400] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:18:03.958319 20630 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:03.959544 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:03.924299 18382 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:03.840646 20983 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:03.961102 20983 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:03.961675 20809 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:03.961771 20983 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:03.879451 20884 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.963495 20884 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.870039 20811 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:03.927057 18228 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:03.943650 18304 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:03.934089 18236 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:03.918018 18305 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:03.945258 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:03.905855 20931 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.905395 20885 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:03.953696 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 79708.8us
W20260709 13:18:03.918109 20973 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.348s	user 0.004s	sys 0.000s
I20260709 13:18:03.913316 20951 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.917313 20916 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.977242 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:03.926469 20741 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:03.884399 20829 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.885510 20894 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.990377 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:03.919860 20893 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:03.950752 20930 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:03.987834 18383 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:03.877892 20836 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.988858 18385 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:03.975394 20931 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.984604 20880 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:04.006218 18276 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:03.990089 20562 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.986215 20809 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.992897 20807 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:03.954588 20945 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:04.002359 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 87260.2us
I20260709 13:18:03.996843 20930 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.998847 20893 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:04.001029 20882 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:04.003854 20984 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:03.990689 20630 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:03.966902 20889 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:03.986747 20916 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.034075 18386 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:03.980435 20951 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.004568 20919 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:04.011245 20433 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:04.070784 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:04.024923 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:04.009296 20888 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:18:04.026140 20930 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:04.016479 20976 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 13:18:04.093578 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 73164.9us
I20260709 13:18:04.100322 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:04.025895 20807 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.026434 20808 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:18:04.019286 20562 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.025499 20809 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.080746 20885 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:04.139653 18237 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1244) took 1624 ms (client timeout 1573 ms). Trace:
W20260709 13:18:04.142292 18237 rpcz_store.cc:269] 0709 13:18:02.515178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.517590 (+  2412us) service_pool.cc:224] Handling call
0709 13:18:04.139486 (+1621896us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540001bdd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:04.139588 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243645696}
W20260709 13:18:04.142346 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 119879us
I20260709 13:18:04.146023 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:04.146656 18386 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:04.116025 20884 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:04.134258 20980 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.270s	user 0.001s	sys 0.001s
I20260709 13:18:04.079041 20993 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:18:04.148142 18201 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:04.190172 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 98804.5us
I20260709 13:18:04.200762 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:18:04.215691 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 79153.9us
I20260709 13:18:04.218950 18277 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:04.139839 20990 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:04.242180 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 282687us
I20260709 13:18:04.186965 20924 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:04.258149 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:18:04.265021 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 116959us
I20260709 13:18:04.141405 20433 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:04.189801 20998 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:04.144176 20901 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:04.223800 20983 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:04.224093 20811 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:04.259335 20630 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:04.136657 20885 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.120828 20902 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.218147 20793 consensus_queue.cc:1059] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:18:04.264830 20823 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:04.221025 20837 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:18:03.595727 18307 rpcz_store.cc:276] 0709 13:18:02.568559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.577631 (+  9072us) service_pool.cc:224] Handling call
0709 13:18:02.577899 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.578196 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.578220 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.578622 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.806014 (+227392us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:02.806339 (+   325us) log.cc:844] Serialized 14 byte log entry
0709 13:18:03.357539 (+551200us) spinlock_profiling.cc:243] Waited 8.18 ms on lock 0x7b48002619d8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18719caa1 00007fa187193b37 00007fa1871939ca 00007fa18728b26f 00007fa18728af37 00007fa18729f55c 00007fa18729f508 00007fa18729f488 00007fa18729f443 00007fa18729e6ec 00007fa1861c8a96
0709 13:18:03.588760 (+231221us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b18003bc6e0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa18226b060 00007fa18227d716 00007fa18228e287 00007fa18228e208
0709 13:18:03.588969 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.589060 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.589116 (+    56us) raft_consensus.cc:1685] finished
0709 13:18:03.589135 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.589280 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10031,"prepare.queue_time_us":2379,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":796724,"raft.run_cpu_time_us":3709,"raft.run_wall_time_us":769826,"spinlock_wait_cycles":33776640,"thread_start_us":227101,"threads_started":1,"wal-append.queue_time_us":256493}
I20260709 13:18:04.294623 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:04.269793 20880 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:04.281415 20888 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:04.344107 18131 catalog_manager.cc:5697] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 3 to 5, term changed from 2 to 3, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132), VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New cstate: current_term: 3 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:04.323807 20830 consensus_meta.cc:287] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.579s	user 0.005s	sys 0.005s
W20260709 13:18:04.333032 20996 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:04.295552 20983 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.341015 21002 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.328871 20963 raft_consensus.cc:3055] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:04.442135 20963 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:04.443205 20963 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.295857 20908 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.280910 20829 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:04.325268 20562 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:04.328739 20916 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:04.318492 20901 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:04.440311 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 145793us
I20260709 13:18:04.337209 20809 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:04.333263 20951 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:04.441428 18229 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:04.290827 20836 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:04.321475 20807 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:04.439775 20983 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:04.327768 20945 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:04.328270 20889 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:04.318210 20894 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:04.393998 21000 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.325510 20811 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 13:18:04.261190 20990 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.435181 20880 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.435541 20888 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:04.466269 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 208758us
I20260709 13:18:04.269871 20924 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.320417 21003 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.137s
W20260709 13:18:04.475754 20991 log.cc:927] Time spent T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:18:04.475816 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:04.476496 20995 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:04.477990 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 254364us
I20260709 13:18:04.458109 20999 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:04.459236 20963 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:04.486084 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:04.494285 18276 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:04.332341 20630 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:04.435326 20823 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.473356 20893 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:04.439860 20830 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.517930 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:04.499400 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:04.495349 20880 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:04.503355 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.473062 20916 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.507189 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.527252 18236 raft_consensus.cc:2410] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:04.474110 20829 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:04.478387 20919 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.505779 20945 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:04.508852 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.509728 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.535032 18228 raft_consensus.cc:2410] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:04.510560 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.495491 20888 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:04.502738 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.454360 21002 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.296368 20998 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.524338 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.548550 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:04.486567 20908 consensus_queue.cc:1059] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:18:04.500676 20833 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:04.486802 21007 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.501886 20999 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:04.466851 20901 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:04.537199 18276 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:04.538659 20902 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:04.539631 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:04.521840 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:04.595947 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:04.596954 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 59889.9us
I20260709 13:18:04.539726 20993 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:04.548980 18237 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
W20260709 13:18:04.552992 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.555316 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:04.505453 20562 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:18:04.530012 20894 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:04.570214 20830 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:04.612469 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 72929.3us
I20260709 13:18:04.615815 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:04.616176 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:04.573609 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:04.521731 20893 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:18:04.617812 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:04.478003 21000 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:04.583719 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 72967.3us
I20260709 13:18:04.618867 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:04.539778 18235 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:04.597694 18276 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:04.596835 18305 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:04.601421 18233 raft_consensus.cc:2410] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:04.505990 20995 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:04.548484 21008 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:04.616392 18304 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:04.521322 20951 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:18:04.620863 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:04.609678 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54471.8us
I20260709 13:18:04.629557 18305 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:18:04.630034 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:04.596112 20945 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:04.622465 18306 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:04.536576 20916 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.533700 20829 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:04.630863 18202 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:04.630936 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:04.583927 20807 raft_consensus.cc:3055] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:04.637769 20807 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:04.598398 20908 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:04.539441 20919 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.603073 20999 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:04.618319 20808 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:04.611743 21013 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:04.619949 20902 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:04.646325 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:04.624571 20993 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:04.617103 21012 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:04.638664 20807 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.635061 20984 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:04.661502 21020 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:04.629707 20885 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:04.641798 20811 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:04.621567 20894 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.648537 20808 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:04.646086 20809 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:04.675135 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.635229 20830 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:18:04.600371 21007 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.702476 21007 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:04.703120 20894 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:04.678504 20808 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:04.704141 20919 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:04.673350 20811 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.705677 20823 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:04.705920 20811 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:04.708151 21002 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:04.701363 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.717998 20807 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:04.720588 20924 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:04.669051 20804 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:04.662588 20937 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:04.672312 20984 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.646482 20908 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:04.740999 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 113089us
I20260709 13:18:04.633894 21008 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.755352 18234 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:04.756254 18305 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:04.756755 18306 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:04.736196 21012 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:04.738509 20930 consensus_meta.cc:287] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.001s
W20260709 13:18:04.750478 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 104221us
I20260709 13:18:04.771567 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:04.757467 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:04.761682 18237 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:04.762554 18235 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:04.773245 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:04.763639 18236 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:04.760382 20808 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.765709 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:04.779343 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:04.779963 18305 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:04.780364 20916 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:04.780839 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:04.781880 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:04.782317 21000 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:04.782414 18305 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:04.771847 21012 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.740489 20630 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:04.784494 20908 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:04.769121 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:04.769423 21015 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:18:04.785024 21012 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:04.737663 21018 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.001s
I20260709 13:18:04.753641 20984 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:04.773211 18304 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:04.787658 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:04.788101 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1306) took 1002 ms. Trace:
I20260709 13:18:04.771260 20804 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.788488 18310 rpcz_store.cc:276] 0709 13:18:03.785459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.325187 (+539728us) service_pool.cc:224] Handling call
0709 13:18:04.325552 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:04.325890 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:04.325915 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:04.326468 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:18:04.462502 (+136034us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:04.463382 (+   880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.463505 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:04.787908 (+324403us) raft_consensus.cc:1685] finished
0709 13:18:04.787928 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:04.788047 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2548,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":96,"thread_start_us":135551,"threads_started":1,"wal-append.queue_time_us":300359}
I20260709 13:18:04.789695 20804 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.741554 20951 consensus_queue.cc:1243] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:04.780295 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.792229 18234 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:04.793450 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.794553 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.794955 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.795094 18234 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:04.795616 18231 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:18:04.796051 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.796505 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.796698 18234 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:04.797613 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.798300 18231 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:04.804984 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:04.805354 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:04.775116 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:04.829556 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 54472.5us
I20260709 13:18:04.837581 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:04.839519 20894 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:04.839982 20894 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.844039 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:04.840342 20894 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:04.855253 20999 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.735983 20945 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:04.755614 20990 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:04.861132 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:04.755541 20937 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:04.861443 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:04.933787 18228 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:04.996595 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 164386us
I20260709 13:18:04.777107 21002 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:05.007103 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:05.007578 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:05.014508 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:05.007647 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:05.016178 18380 raft_consensus.cc:2410] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:05.015244 18310 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:04.930678 20983 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.017428 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:05.018131 18310 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:05.016340 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:04.801815 20809 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:05.027019 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:05.027691 18377 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:05.027765 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:05.028707 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:05.029021 18386 raft_consensus.cc:2410] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:05.019788 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:05.019788 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:04.987843 20880 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:04.985442 18120 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 943649b738074d87a593c237cf998758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8b4fbc44aa2649f0bcac5cd70f71951d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:18:04.929754 21020 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:05.013156 20830 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:18:04.865121 20901 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:05.022855 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:04.982230 20998 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:04.986780 18276 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:05.024317 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:05.073779 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:04.989593 21012 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:04.803869 20888 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.018803 20983 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.081139 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:05.081425 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:05.081702 18311 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.082000 18308 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:18:05.030331 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:05.031198 18310 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:05.031831 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:05.033496 20963 consensus_meta.cc:287] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.528s	user 0.005s	sys 0.005s
I20260709 13:18:05.033998 18953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54020 (request call id 233) took 1647 ms. Trace:
I20260709 13:18:05.034574 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:04.963069 20916 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:05.026873 18275 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:04.982933 20999 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:04.961230 20645 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:04.777737 20930 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.015223 21017 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.025311 18304 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:05.090827 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 104106us
I20260709 13:18:04.962761 20811 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.104282 20937 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:05.092921 18953 rpcz_store.cc:276] 0709 13:18:03.386842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.396352 (+  9510us) service_pool.cc:224] Handling call
0709 13:18:03.416157 (+ 19805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.450194 (+ 34037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.033741 (+1583547us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b540047cf54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:05.033918 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69195008}
I20260709 13:18:05.109700 20880 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.037853 21002 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:05.111729 18305 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:05.112414 18230 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:18:05.093195 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 58686us
I20260709 13:18:05.115463 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:05.097132 18380 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:05.071213 18120 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 85822.3us
I20260709 13:18:05.122015 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:05.126477 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:05.129361 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:05.133152 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.137986 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:05.098763 20885 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:05.156813 18311 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:18:05.147394 18202 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:05.089314 21012 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:05.136708 20937 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:05.165899 20902 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:05.171026 20963 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
W20260709 13:18:05.182480 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.157581 20830 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:05.111336 20916 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.113857 20645 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:05.159315 20885 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.126579 21002 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:05.209942 18337 heartbeater.cc:646] Failed to heartbeat to 127.16.188.190:46739 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.16.188.190:46739 timed out after 15.000s (SENT)
I20260709 13:18:05.159984 20880 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:05.231767 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:05.184541 20937 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.166680 20809 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:05.172435 20979 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:05.120230 21017 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:05.217970 20902 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.221513 20830 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:05.259873 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 233083us
I20260709 13:18:05.218988 20823 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.219272 20901 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:05.261041 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1795) took 1461 ms. Trace:
W20260709 13:18:05.261353 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 112609us
I20260709 13:18:05.265466 18381 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:05.265954 18381 pending_rounds.cc:85] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 2
I20260709 13:18:05.266180 18381 pending_rounds.cc:107] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:05.266398 18381 raft_consensus.cc:2889] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:05.233819 20885 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:05.229106 21007 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.271386 18228 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:18:05.161023 20984 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.265007 18312 rpcz_store.cc:276] 0709 13:18:03.799942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.907237 (+107295us) service_pool.cc:224] Handling call
0709 13:18:03.925422 (+ 18185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.960756 (+ 35334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.960791 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:03.960833 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:03.960867 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.260797 (+1299930us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b540011c954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:05.260852 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:05.260985 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80697088}
I20260709 13:18:05.257645 20872 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:05.261269 20902 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:05.178289 21020 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.262589 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:05.257064 20809 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:05.257789 20945 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:05.256604 20937 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:05.405670 18380 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:05.417150 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1305) took 1633 ms. Trace:
I20260709 13:18:05.348551 18306 raft_consensus.cc:2368] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:18:05.293306 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:05.418654 18303 rpcz_store.cc:276] 0709 13:18:03.783966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.790096 (+  6130us) service_pool.cc:224] Handling call
0709 13:18:03.790409 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:03.838451 (+ 48042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.838484 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.104565 (+1266081us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b2c0010c0c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:18:05.104989 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:18:05.169693 (+ 64704us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:05.169729 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.297313 (+127584us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b54001decd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:05.297388 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:05.399216 (+101828us) raft_consensus.cc:1685] finished
0709 13:18:05.399241 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:05.417056 (+ 17815us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26211,"raft.queue_time_us":27903,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":72307840,"thread_start_us":64298,"threads_started":1,"wal-append.queue_time_us":292309}
W20260709 13:18:05.421710 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 159193us
I20260709 13:18:05.422482 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:05.263670 20830 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.422722 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:05.341403 18311 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:05.436123 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:05.285666 20645 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:05.293798 20828 raft_consensus.cc:3055] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:05.273600 20823 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.290324 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:05.283293 20880 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:05.440299 18312 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:05.295495 20811 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.416566 20930 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.285637 20916 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:05.462522 20828 raft_consensus.cc:740] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:05.424654 20807 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.381698 20888 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.429772 20979 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:05.437706 20793 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.475178 21052 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:05.429944 20433 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:05.278172 21007 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.294910 21012 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:05.294580 20872 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:05.353998 20994 consensus_queue.cc:1059] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:18:05.439146 20968 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:05.273510 20901 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:05.301548 20894 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.459034 21017 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:05.471119 21002 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.454376 21039 consensus_queue.cc:1059] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:18:05.500860 21038 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:05.478183 20880 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:05.499308 20807 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:05.518810 20968 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:05.476963 21044 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:18:05.499753 20433 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.544855 20433 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.546679 20804 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.550120 20807 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:05.516252 20888 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
W20260709 13:18:05.537597 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 74953.4us
W20260709 13:18:05.541810 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 61816.3us
I20260709 13:18:05.522457 20916 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:05.557868 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:05.560689 18377 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:05.565974 21007 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.568006 18381 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:05.555204 20902 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.570183 20872 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.570780 20902 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.568822 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:05.571991 20880 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:05.588822 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:05.589550 18303 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:05.590817 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:05.591403 18303 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:05.529624 21038 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.606338 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:05.559849 20651 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:05.608070 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:05.610917 18303 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:05.611483 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:05.614832 18377 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:05.621755 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:05.622573 18381 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:05.617522 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:05.573937 21017 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:18:05.628366 18276 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:05.632167 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:05.633337 18303 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:05.632611 20985 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:18:05.629324 20710 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:05.629532 20994 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:05.647070 20931 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.647598 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:05.635557 20807 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.615953 20880 consensus_queue.cc:1059] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:18:05.664088 18303 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:05.634495 20630 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:05.623371 20651 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:05.672223 20807 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.698482 20994 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:05.701016 20901 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:05.700809 20994 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.701339 20894 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.634048 20968 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:05.697276 21048 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:18:05.705293 20885 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.707330 20885 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.709885 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1263) took 1922 ms. Trace:
I20260709 13:18:05.710254 18232 rpcz_store.cc:276] 0709 13:18:03.787228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.787342 (+   114us) service_pool.cc:224] Handling call
0709 13:18:03.816250 (+ 28908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.913931 (+ 97681us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:03.952331 (+ 38400us) log.cc:844] Serialized 14 byte log entry
0709 13:18:04.129810 (+177479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:04.129914 (+   104us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:04.130006 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.786890 (+656884us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b180043be20. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:18:05.709677 (+922787us) spinlock_profiling.cc:243] Waited 97.5 ms on lock 0x7b540029c7d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:05.709724 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:05.709830 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5426,"prepare.queue_time_us":38207,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":8455,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2831,"spinlock_wait_cycles":257259520,"thread_start_us":157059,"threads_started":1,"wal-append.queue_time_us":268635,"wal-append.run_cpu_time_us":6596,"wal-append.run_wall_time_us":1231939}
I20260709 13:18:05.640791 20823 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:05.713637 18351 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.546s (SENT) [suppressed 2 similar messages]
I20260709 13:18:05.736723 20562 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:05.737553 20562 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.740991 20828 consensus_queue.cc:260] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:05.742024 20562 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:05.743628 20937 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.744696 20829 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:05.746060 20937 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.746956 18383 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:05.573863 20916 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.769520 20651 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:05.772061 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 58452.7us
I20260709 13:18:05.773121 21020 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:05.773257 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.700404 20807 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:05.774482 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:05.775072 18305 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:05.775260 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1386) took 1954 ms. Trace:
W20260709 13:18:05.775952 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.775422 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:05.696930 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:05.778218 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:05.780733 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:05.780884 18308 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:05.775660 18229 rpcz_store.cc:276] 0709 13:18:03.820748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.820875 (+   127us) service_pool.cc:224] Handling call
0709 13:18:03.821231 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:04.467258 (+646027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.775006 (+1307748us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b540005a354. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:05.775197 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425726848}
I20260709 13:18:05.781864 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:05.696915 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:05.673120 20630 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:05.670085 20710 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.782876 20807 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:05.783066 20562 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:05.776166 20823 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:05.714011 20809 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.788023 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:05.785984 20645 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:05.838654 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 50677.8us
I20260709 13:18:05.776998 20828 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.763970 20830 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.840612 20645 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:05.843015 20645 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:05.844784 18308 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:05.845100 21038 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.777951 21020 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.849733 21020 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:05.850515 21020 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:05.850364 20645 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.851227 21020 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:05.852916 20645 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:05.852330 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1382) took 2035 ms. Trace:
I20260709 13:18:05.856760 18230 rpcz_store.cc:276] 0709 13:18:03.816726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.817801 (+  1075us) service_pool.cc:224] Handling call
0709 13:18:04.340859 (+523058us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.113035 (+772176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.851257 (+738222us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54001883d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:05.852144 (+   887us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54001883d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:05.852271 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2975756928}
I20260709 13:18:05.847168 18305 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:05.795850 20630 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:05.798945 20562 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:05.873643 20916 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:05.876592 20562 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.889858 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:05.893144 18275 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:05.837594 20823 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.901551 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:05.902307 18386 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:18:05.838039 20807 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:05.907580 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:05.859252 21020 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.914160 20710 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.913525 20833 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:05.916368 20823 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:05.903653 20990 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:05.917670 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:05.903733 20994 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:05.918455 20994 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.909901 20993 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:18:05.911707 20807 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.924084 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:05.924686 18383 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:05.925832 20807 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:05.928293 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:05.937716 20993 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:05.940284 20993 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:05.940809 20993 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:05.941256 20830 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.946398 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1794) took 2146 ms. Trace:
I20260709 13:18:05.946067 20562 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.946825 18309 rpcz_store.cc:276] 0709 13:18:03.799658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.904022 (+104364us) service_pool.cc:224] Handling call
0709 13:18:03.904327 (+   305us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:03.914150 (+  9823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.914183 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:03.919350 (+  5167us) log.cc:844] Serialized 78 byte log entry
0709 13:18:04.241991 (+322641us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:04.508330 (+266339us) log.cc:844] Serialized 14 byte log entry
0709 13:18:04.508631 (+   301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.508711 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:05.926227 (+1417516us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b18003b7460. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:18:05.946056 (+ 19829us) raft_consensus.cc:1685] finished
0709 13:18:05.946175 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:05.946338 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9684,"prepare.queue_time_us":329792,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":10807,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":41228,"spinlock_wait_cycles":11937536,"thread_start_us":487198,"threads_started":2,"wal-append.queue_time_us":555939}
I20260709 13:18:05.948328 20562 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:05.927510 20994 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.963596 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:05.964982 20830 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.966873 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1584) took 1164 ms. Trace:
I20260709 13:18:05.966981 20830 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:05.969455 20830 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:05.974020 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:05.974659 18379 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:18:05.976472 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:05.984825 18304 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.987649 18303 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:05.984356 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:05.990288 18202 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:05.967675 18385 rpcz_store.cc:276] 0709 13:18:04.802113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.802692 (+   579us) service_pool.cc:224] Handling call
0709 13:18:05.965888 (+1163196us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5800050198. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:18:05.966121 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.966398 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.966435 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:05.966495 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:05.966538 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.966623 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:05.966782 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54154496}
I20260709 13:18:06.005146 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:06.008773 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:06.009539 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 169865us
I20260709 13:18:06.014575 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:06.022461 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:06.030717 18379 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:06.033639 18276 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:05.963673 21045 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:05.988624 20984 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:06.007107 20888 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:06.007790 20937 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:06.016044 20894 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:06.018671 20990 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.007457 21010 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:06.042060 20710 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:06.019603 20901 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:06.035670 20823 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:06.036131 21017 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:06.032051 20884 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:06.043143 20888 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.040058 21045 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:06.051023 21055 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.084904 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 63465.4us
I20260709 13:18:06.035404 20916 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:18:06.046447 20807 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:18:06.065227 20710 raft_consensus.cc:697] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:06.067536 20937 raft_consensus.cc:697] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:06.052479 20630 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.049820 21066 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:18:06.069622 20888 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:06.080174 21020 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:06.061986 20562 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:18:06.125473 20630 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:06.052767 20990 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.126490 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:06.127295 18379 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:06.127827 20990 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:06.118005 21045 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.130322 21045 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:06.131564 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:06.133205 20710 consensus_queue.cc:237] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.114097 18304 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:18:06.057801 21010 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:06.092568 20894 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:06.091614 20901 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:06.144995 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:06.121114 21020 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:06.100700 21017 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:06.151172 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 103289us
I20260709 13:18:06.071743 20884 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.153064 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:06.156352 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:06.088583 21067 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:18:06.161350 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:06.093734 20993 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.146210 20651 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.155459 20830 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:06.102929 21055 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.161940 20807 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:06.163196 21008 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:06.162055 20562 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:06.179877 20893 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:06.160171 20916 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:18:06.205183 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.187649 20830 raft_consensus.cc:697] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:06.190693 20807 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:06.201288 20893 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.222571 20830 consensus_queue.cc:237] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.197547 20562 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.215284 20919 raft_consensus.cc:3055] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:06.216355 20807 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:06.229760 20884 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:06.182590 20651 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:06.247118 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 87846.8us
I20260709 13:18:06.224938 20893 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:06.234578 21028 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.283042 21028 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.285321 21028 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:06.184686 20937 consensus_queue.cc:237] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.252900 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:06.250281 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:06.287972 18385 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:06.251452 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:06.291579 18380 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:06.292930 18276 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:06.199236 20894 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.234947 20562 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:06.287253 21007 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:06.237656 20885 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.304138 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 141110us
I20260709 13:18:06.189081 20901 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.317904 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:06.336887 18234 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:06.237282 20919 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:06.242764 21052 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:06.324545 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:06.344141 18232 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:06.289570 20963 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:06.333854 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:06.336014 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:06.337428 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:06.350560 18230 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:06.203565 21017 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.270370 20836 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:06.330406 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:06.360946 18231 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:06.317819 20837 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:06.353279 21010 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:06.355716 18310 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:06.318879 20889 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:18:06.347070 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:06.388335 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:06.357795 20919 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.365784 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:06.367640 21064 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:18:06.334928 21007 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.359972 20808 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:06.367301 20837 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:06.389168 18231 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:06.359252 20836 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:06.422596 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:06.423301 18380 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:06.405900 18230 raft_consensus.cc:2410] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:06.424882 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:06.406576 18232 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:06.338878 20885 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:06.441509 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.396126 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 145711us
W20260709 13:18:06.390813 21068 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
W20260709 13:18:06.428980 21076 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 13:18:06.429083 21079 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:06.429860 21020 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:06.430415 21055 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:06.431330 21080 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.434082 21007 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:06.362092 20963 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:06.353885 21052 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.453688 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:06.461237 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:06.454263 18234 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:06.399798 20993 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:06.421867 20837 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:06.423250 20832 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:06.421867 20995 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:06.438756 21006 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.453975 20919 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:06.462360 21073 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.252s	user 0.001s	sys 0.001s
W20260709 13:18:06.461961 21077 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:18:06.462868 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:06.905527 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.018330 18231 consensus_meta.cc:287] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.606s	user 0.031s	sys 0.021s
I20260709 13:18:07.018724 18231 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
W20260709 13:18:07.019562 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 516576us
I20260709 13:18:07.020251 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:06.722005 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:07.021327 18351 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:18:06.607791 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.023571 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:06.463034 18237 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:07.024236 18378 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
W20260709 13:18:06.818477 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 340074us
I20260709 13:18:07.024981 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:06.854740 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:06.505275 18230 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:18:06.513366 18380 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:07.009141 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:07.016999 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:06.459215 21020 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:07.047832 18378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1592) took 2218 ms (client timeout 1856 ms). Trace:
W20260709 13:18:07.049728 18235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.000s	sys 0.013s
I20260709 13:18:07.069803 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:07.009413 21045 consensus_meta.cc:287] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.879s	user 0.005s	sys 0.009s
W20260709 13:18:06.681082 21074 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.456s	user 0.001s	sys 0.000s
I20260709 13:18:07.001679 20889 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:07.161885 20889 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:07.162374 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1594) took 2349 ms. Trace:
I20260709 13:18:07.162781 18382 rpcz_store.cc:276] 0709 13:18:04.812786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.815586 (+  2800us) service_pool.cc:224] Handling call
0709 13:18:05.968984 (+1153398us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5800050198. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:18:05.969219 (+   235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.969635 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.969663 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.970173 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:18:06.120942 (+150769us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:06.138663 (+ 17721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.138743 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.161999 (+1023256us) raft_consensus.cc:1685] finished
0709 13:18:07.162022 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.162281 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3771,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":22467,"spinlock_wait_cycles":29374208,"thread_start_us":150347,"threads_started":1,"wal-append.queue_time_us":217008}
W20260709 13:18:06.963091 21083 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:18:07.001138 20828 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:18:07.002919 20837 consensus_meta.cc:287] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.001s
W20260709 13:18:06.819907 20893 consensus_meta.cc:287] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.009s
W20260709 13:18:06.795681 20807 consensus_meta.cc:287] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.000s
W20260709 13:18:07.048628 18378 rpcz_store.cc:269] 0709 13:18:04.806311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.807067 (+   756us) service_pool.cc:224] Handling call
0709 13:18:07.023420 (+2216353us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5800050198. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa1872390a0 00007fa187238984 00007fa1807b36d4 00007fa1807b3662
0709 13:18:07.024660 (+  1240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36846976}
W20260709 13:18:06.768244 21068 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:18:07.036150 20888 consensus_meta.cc:287] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.892s	user 0.008s	sys 0.012s
I20260709 13:18:07.066027 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:07.192296 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:07.193372 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:07.136679 18235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.001s	sys 0.022s
I20260709 13:18:06.511071 21006 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:06.964036 21089 log.cc:927] Time spent T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:18:06.484167 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:06.871393 21039 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:07.064859 20562 consensus_meta.cc:287] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.699s	user 0.010s	sys 0.002s
W20260709 13:18:07.146036 18233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1399) took 2629 ms (client timeout 2844 ms). Trace:
W20260709 13:18:07.205407 18233 rpcz_store.cc:269] 0709 13:18:04.510197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.510330 (+   133us) service_pool.cc:224] Handling call
0709 13:18:07.139066 (+2628736us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x7b540001ccd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:07.139186 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149843200}
I20260709 13:18:07.206881 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:06.484380 20832 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.979866 20710 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:07.146744 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:07.146857 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:07.209542 18228 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 9: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:06.543540 20884 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:07.153074 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:06.466174 21080 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:06.465291 20823 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:06.734812 20651 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:06.540298 20645 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.620s
W20260709 13:18:07.017438 20901 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.007s	sys 0.010s
I20260709 13:18:06.770031 21087 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.913702 20916 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:07.175688 18305 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:06.689680 20995 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:06.542515 20630 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:07.164440 20889 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:07.139560 20894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.004s	sys 0.022s
I20260709 13:18:07.188977 18237 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:07.140208 20902 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.194963 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:07.235224 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:07.236016 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:07.137524 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:07.197194 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:07.236635 18232 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:07.101402 21020 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:07.208230 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:07.197713 20888 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:07.198053 20937 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.019s	sys 0.026s
I20260709 13:18:07.273335 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:07.218654 21075 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:07.176445 21013 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:07.224045 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1619) took 1296 ms. Trace:
I20260709 13:18:07.187646 20893 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:07.230419 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:07.222609 20901 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.007s	sys 0.010s
W20260709 13:18:07.273720 20937 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.020s	sys 0.027s
I20260709 13:18:07.216672 20710 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:07.196063 21010 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:18:07.185056 20837 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:07.192101 20807 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:07.236785 18231 raft_consensus.cc:2368] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
I20260709 13:18:07.316416 20837 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:07.317816 20807 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:07.185307 20828 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:07.319984 20828 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:07.242120 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 220847us
W20260709 13:18:07.215930 18201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.014s	sys 0.028s
W20260709 13:18:07.321091 18201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.014s	sys 0.029s
W20260709 13:18:07.321441 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 627458us
I20260709 13:18:07.321342 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:07.221015 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1841) took 1470 ms. Trace:
I20260709 13:18:07.275890 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:07.277182 18235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
W20260709 13:18:07.322805 18306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1321) took 2536 ms (client timeout 3037 ms). Trace:
I20260709 13:18:07.323232 18235 raft_consensus.cc:606] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
W20260709 13:18:07.233211 20894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.004s	sys 0.022s
I20260709 13:18:07.202037 21039 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:07.212877 20562 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:07.330833 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:07.279683 18383 rpcz_store.cc:276] 0709 13:18:05.927683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.927883 (+   200us) service_pool.cc:224] Handling call
0709 13:18:05.944423 (+ 16540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.944810 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.944842 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.945341 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:18:06.092888 (+147547us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:06.110310 (+ 17422us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.116155 (+  5845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.116262 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.223831 (+1107569us) raft_consensus.cc:1685] finished
0709 13:18:07.223857 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.223983 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17698,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3567,"raft.queue_time_us":18982,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":835,"thread_start_us":147140,"threads_started":1,"wal-append.queue_time_us":232996}
I20260709 13:18:07.283917 21020 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:07.234033 20630 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:07.220378 20823 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:07.230268 20916 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:07.344916 18379 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:07.273583 20902 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:07.288064 20888 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:07.232937 21052 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:07.288141 20893 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:07.352674 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:07.219084 20884 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:07.354995 20884 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:07.312590 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 125437us
I20260709 13:18:07.233578 21095 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:07.356873 21095 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:07.323292 18306 rpcz_store.cc:269] 0709 13:18:04.758324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.765604 (+  7280us) service_pool.cc:224] Handling call
0709 13:18:07.294442 (+2528838us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b540013f454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:07.294606 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1294692096}
I20260709 13:18:07.276252 21075 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:07.330178 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:07.364578 21099 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:07.365144 21099 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:07.366439 21080 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:07.367163 18232 raft_consensus.cc:2393] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 6: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:18:07.367717 21090 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:18:07.372605 18384 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:07.374406 20562 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:07.375201 21103 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:07.339730 20807 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:07.378954 20630 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:07.381029 21091 log.cc:927] Time spent T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:18:07.381371 20832 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:07.382859 21039 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:07.384267 20916 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:07.385500 20833 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:07.385970 20833 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.389282 21075 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:07.290303 21013 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:07.357311 21095 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.394034 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1332) took 1043 ms. Trace:
I20260709 13:18:07.394383 18305 rpcz_store.cc:276] 0709 13:18:06.350260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.354802 (+  4542us) service_pool.cc:224] Handling call
0709 13:18:07.393867 (+1039065us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54000bd1d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:07.393977 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1771887872}
I20260709 13:18:07.396166 20885 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:07.397511 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1411) took 1147 ms. Trace:
I20260709 13:18:07.397890 18237 rpcz_store.cc:276] 0709 13:18:06.249600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.252679 (+  3079us) service_pool.cc:224] Handling call
0709 13:18:07.397351 (+1144672us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b540001bdd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:07.397451 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405531904}
I20260709 13:18:07.351117 20828 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:07.403788 20828 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:07.405239 21006 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:07.406181 20828 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:07.360635 20837 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:07.408025 20837 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:07.414307 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1414) took 1093 ms. Trace:
I20260709 13:18:07.414685 18236 rpcz_store.cc:276] 0709 13:18:06.320683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.321151 (+   468us) service_pool.cc:224] Handling call
0709 13:18:06.343748 (+ 22597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.438743 (+ 94995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:06.438773 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:06.438839 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:06.438870 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.414091 (+975221us) spinlock_profiling.cc:243] Waited 94.8 ms on lock 0x7b540005a854. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:07.414140 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.414254 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218021120}
I20260709 13:18:07.415370 21075 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:07.418558 20809 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:07.425312 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 375) took 1755 ms. Trace:
I20260709 13:18:07.425675 18303 rpcz_store.cc:276] 0709 13:18:05.669850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.670039 (+   189us) service_pool.cc:224] Handling call
0709 13:18:05.670460 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.988223 (+317763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.425046 (+1436823us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b5400341054. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:07.425252 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701406464}
I20260709 13:18:07.322386 18308 rpcz_store.cc:276] 0709 13:18:05.750906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.845570 (+ 94664us) service_pool.cc:224] Handling call
0709 13:18:05.845953 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:05.846366 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.846398 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:05.847042 (+   644us) log.cc:844] Serialized 52 byte log entry
0709 13:18:06.031394 (+184352us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:06.048637 (+ 17243us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.049681 (+  1044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.049760 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.220782 (+1171022us) raft_consensus.cc:1685] finished
0709 13:18:07.220806 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.220954 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18491,"prepare.queue_time_us":9302,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":3203,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":9885,"thread_start_us":183084,"threads_started":1,"wal-append.queue_time_us":269257}
I20260709 13:18:07.339066 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:07.341324 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:07.227049 21087 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:07.313325 20645 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:07.241997 20995 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:07.350221 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.350679 18386 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:18:07.362342 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:07.461988 18383 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
W20260709 13:18:07.499100 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.367170 21099 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:07.539443 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1408) took 1290 ms. Trace:
I20260709 13:18:07.539985 18229 rpcz_store.cc:276] 0709 13:18:06.248792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.248975 (+   183us) service_pool.cc:224] Handling call
0709 13:18:06.295941 (+ 46966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.544578 (+248637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:06.544611 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:06.544654 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:06.544688 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.539121 (+994433us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b5400187ed4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:07.539185 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.539369 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571204352}
I20260709 13:18:07.537806 20562 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:07.536489 20645 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:07.376332 20807 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:08.111304 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 769999us
I20260709 13:18:08.183218 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:08.174255 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:08.188956 18955 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 3.
I20260709 13:18:08.124668 20963 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:08.188318 20995 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:08.140491 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:07.457871 20888 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:07.706858 20829 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:07.735018 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.125918 20837 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:08.131775 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 315) took 1438 ms. Trace:
I20260709 13:18:07.457654 20994 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:08.192855 18382 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:08.130900 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:07.644870 21087 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:08.193697 20994 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:07.530247 20828 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:08.194604 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.124431 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1836) took 2528 ms. Trace:
W20260709 13:18:07.963936 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.196491 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.191172 20888 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:07.707430 18378 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:08.198379 18382 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:08.025703 21099 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.199407 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:07.745700 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.143766 18229 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:08.201066 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.201182 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.199461 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:08.201565 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1287) took 1057 ms. Trace:
I20260709 13:18:08.201761 18377 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:18:08.229388 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.230018 18377 raft_consensus.cc:1813] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Handling vote request from an unknown peer b52e2477fc524694967c4a16afa983e3
I20260709 13:18:08.230558 18377 raft_consensus.cc:2410] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:18:08.126798 20823 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:07.567929 18234 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:08.158710 18200 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:08.231633 18229 rpcz_store.cc:276] 0709 13:18:07.144229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.143292 (+999063us) service_pool.cc:224] Handling call
0709 13:18:08.143574 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.201301 (+ 57727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.201504 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:08.218757 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:08.120056 20902 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:08.204129 20807 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:08.195859 20828 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:08.195850 18232 rpcz_store.cc:276] 0709 13:18:06.693316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.130843 (+1437527us) service_pool.cc:224] Handling call
0709 13:18:08.131159 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.131366 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.131403 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:08.131469 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:08.131512 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.131580 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.131705 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:08.244731 18377 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:08.119628 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:08.199302 21099 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.189095 20645 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:08.118402 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.785949 21013 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:07.707023 20885 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:18:08.038591 21093 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.698s	user 0.003s	sys 0.000s
I20260709 13:18:07.705731 21007 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:07.567124 18131 catalog_manager.cc:5697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 3 to 5, term changed from 3 to 5, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to <none>, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New cstate: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:18:08.149008 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.263355 18308 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 2.
W20260709 13:18:07.791657 18384 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1593) took 2985 ms (client timeout 3078 ms). Trace:
I20260709 13:18:08.191874 18236 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:07.737564 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:07.893606 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:08.264483 18384 rpcz_store.cc:269] 0709 13:18:04.806542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.815426 (+  8884us) service_pool.cc:224] Handling call
0709 13:18:07.024836 (+2209410us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b5800050198. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa1872390a0 00007fa187238984 00007fa1807b36d4 00007fa1807b3662
0709 13:18:07.791333 (+766497us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b5400129654. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:07.791549 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826657408}
I20260709 13:18:08.132954 18230 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:08.265748 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:07.868577 20919 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:07.642851 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:08.213667 21109 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:08.269174 18383 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:08.216670 20562 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:08.144145 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:08.272130 18380 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:08.190395 21075 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:08.217971 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:08.279305 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 65870.6us
I20260709 13:18:07.688616 18386 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:08.228446 18378 raft_consensus.cc:2410] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:08.202356 18312 rpcz_store.cc:276] 0709 13:18:05.596537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.596669 (+   132us) service_pool.cc:224] Handling call
0709 13:18:05.596901 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.626722 (+ 29821us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:05.627023 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 13:18:05.911555 (+284532us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b1800093940. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa185c6b3c7 00007fa18227d9a7 00007fa18228d0bf 00007fa18228d038
0709 13:18:05.911826 (+   271us) log.cc:844] Serialized 14 byte log entry
0709 13:18:05.912066 (+   240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:05.912133 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:05.912198 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.400041 (+1487843us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b1800093940. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:18:07.734743 (+334702us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b540011d354. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:08.124097 (+389354us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.124301 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":276282,"prepare.queue_time_us":295970,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":1545,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":5785,"spinlock_wait_cycles":97868288}
I20260709 13:18:08.239360 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1285) took 1095 ms. Trace:
I20260709 13:18:08.281255 18384 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:08.281378 18237 rpcz_store.cc:276] 0709 13:18:07.143643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.135412 (+991769us) service_pool.cc:224] Handling call
0709 13:18:08.135729 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.229591 (+ 93862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.229619 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:08.229659 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:08.229687 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.239012 (+  9325us) spinlock_profiling.cc:243] Waited 93.7 ms on lock 0x7b54000d1954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:08.239085 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.239281 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215436672}
W20260709 13:18:08.239974 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 81360.1us
I20260709 13:18:08.246655 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.251070 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:08.252482 18234 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1425) took 1796 ms (client timeout 2061 ms). Trace:
I20260709 13:18:08.249266 18349 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:18:08.283531 18234 rpcz_store.cc:269] 0709 13:18:06.456167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.462621 (+  6454us) service_pool.cc:224] Handling call
0709 13:18:08.252264 (+1789643us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b540001a9d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:08.252414 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1264190336}
I20260709 13:18:08.235532 20937 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:08.260042 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:08.294796 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.256311 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 312) took 1584 ms. Trace:
I20260709 13:18:07.736539 20741 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:08.265889 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1284) took 1122 ms. Trace:
I20260709 13:18:08.295760 18230 rpcz_store.cc:276] 0709 13:18:07.143340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.132375 (+989035us) service_pool.cc:224] Handling call
0709 13:18:08.132731 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.265592 (+132861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.265822 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:08.217698 20710 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:08.229460 20993 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:08.267529 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 48836.7us
I20260709 13:18:08.281312 20562 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:08.274547 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:08.230949 20804 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:08.233325 20990 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:08.192867 20829 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.288604 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.289567 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.290166 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:08.313802 18926 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.010s	sys 0.018s
I20260709 13:18:08.290431 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.291468 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:08.292048 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:08.314716 18384 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:08.292279 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.316143 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.295794 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:08.298988 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.317435 18303 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:18:08.298930 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.295535 18228 rpcz_store.cc:276] 0709 13:18:06.672136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.229281 (+1557145us) service_pool.cc:224] Handling call
0709 13:18:08.255738 (+ 26457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.255936 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.255966 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:08.256011 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:08.256050 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.256103 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.256250 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:08.248919 20823 consensus_queue.cc:1059] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:18:08.320417 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.320493 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:08.320947 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:08.313401 18378 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:18:08.321744 18380 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:08.282863 21013 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:08.310906 18381 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:18:08.314095 18926 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.010s	sys 0.018s
I20260709 13:18:08.328428 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:08.328765 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 792365us
I20260709 13:18:08.321378 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.322643 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.309712 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:08.323346 18311 raft_consensus.cc:2368] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:18:08.325505 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.284212 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:08.326262 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:08.331310 18309 raft_consensus.cc:2410] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:18:08.313441 20994 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:08.331128 18378 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:08.336223 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.292917 20807 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:08.332389 18382 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:18:08.339584 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.340220 18303 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:08.268347 20885 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.347672 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:08.336921 18377 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:18:08.344223 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:08.340917 18383 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:18:08.281095 20919 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.367723 20829 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:08.310547 20741 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.370079 20741 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:08.302278 18953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54004 (request call id 301) took 1252 ms. Trace:
I20260709 13:18:08.372375 18953 rpcz_store.cc:276] 0709 13:18:07.035663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.046357 (+ 10694us) service_pool.cc:224] Handling call
0709 13:18:07.758599 (+712242us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b580005a998. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14ee9c 00007fa17f14ea5b 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa1872390a0 00007fa187238984 00007fa1807b36d4 00007fa1807b3662
0709 13:18:08.288061 (+529462us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46394752}
I20260709 13:18:08.353107 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.353852 21013 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:08.375331 21013 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.382094 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.382895 18380 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:08.383611 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.385032 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.386159 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:08.387786 20885 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:08.394052 18304 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:08.320029 20990 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:08.284667 20645 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:18:08.360898 21111 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:08.397424 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.398010 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:08.398706 18308 raft_consensus.cc:2368] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:18:08.361268 20888 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:08.363595 21100 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:08.364322 18277 connection.cc:256] RPC call timeout handler was delayed by -1.6042024569999285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260709 13:18:08.396809 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:08.401664 18277 connection.cc:256] RPC call timeout handler was delayed by -1.2589753830000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2844s for a response
I20260709 13:18:08.402204 18381 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:18:08.402478 18277 connection.cc:256] RPC call timeout handler was delayed by -1.1900154019999718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 13:18:08.403061 18277 connection.cc:256] RPC call timeout handler was delayed by -1.0991154020000522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
I20260709 13:18:08.403016 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.404768 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.405366 18303 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:08.405629 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.406623 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.407078 18380 raft_consensus.cc:1813] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Handling vote request from an unknown peer b52e2477fc524694967c4a16afa983e3
I20260709 13:18:08.365037 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.408679 18382 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:18:08.276363 21007 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:08.312268 20804 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.366303 18307 raft_consensus.cc:2410] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:18:08.414824 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:08.394253 18311 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:08.359210 20828 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:08.314363 20993 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.423915 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.425269 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:08.298272 21075 consensus_queue.cc:1059] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:18:08.409432 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.411269 18380 raft_consensus.cc:2410] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:18:08.412241 18386 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:08.409911 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.399518 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.417111 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.434521 18378 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:08.417770 18308 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:08.435214 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.421507 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.431002 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.436450 18382 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:18:08.343037 20807 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:08.437883 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.438480 18303 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:08.438856 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.439464 18386 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:08.435775 18311 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:08.446600 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.447753 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.448555 18303 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:08.414983 20741 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.407828 21100 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.464200 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.465314 18311 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:08.464650 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:08.450727 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.452989 18310 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:18:08.413702 20919 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:08.457901 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.467096 18378 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:08.467198 18308 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:08.471161 18303 raft_consensus.cc:1813] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Handling vote request from an unknown peer b52e2477fc524694967c4a16afa983e3
I20260709 13:18:08.471993 18303 raft_consensus.cc:2410] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:18:08.473214 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.478150 18383 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:18:08.476883 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 189633us
I20260709 13:18:08.483863 18382 raft_consensus.cc:3055] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:08.484270 18382 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:08.445804 20807 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:08.489550 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:08.525650 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 221187us
I20260709 13:18:08.466614 20829 consensus_queue.cc:1059] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:18:08.478102 21101 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:18:08.469223 20741 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:08.526788 20833 consensus_meta.cc:287] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 1.140s	user 0.007s	sys 0.003s
I20260709 13:18:08.538630 21099 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:08.542830 21095 consensus_meta.cc:287] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 1.149s	user 0.010s	sys 0.001s
W20260709 13:18:08.580672 21105 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.387s	user 0.003s	sys 0.005s
W20260709 13:18:08.638406 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 397312us
W20260709 13:18:08.638971 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 335269us
W20260709 13:18:08.643872 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 179202us
I20260709 13:18:08.644656 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:08.656576 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:08.657253 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 179679us
I20260709 13:18:08.647827 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.690420 18308 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:08.695636 20741 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:08.573118 20833 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.697975 20804 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:08.700009 20828 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:08.576300 20836 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:08.692308 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:08.712857 18308 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:08.701807 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.726219 20833 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:08.728575 21106 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.609s	user 0.002s	sys 0.006s
I20260709 13:18:08.731051 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 307) took 2138 ms. Trace:
I20260709 13:18:08.731586 21100 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:08.584682 21095 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:08.734367 18379 raft_consensus.cc:2393] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:08.731498 18231 rpcz_store.cc:276] 0709 13:18:06.592427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.317761 (+725334us) service_pool.cc:224] Handling call
0709 13:18:07.318040 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:07.326427 (+  8387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.326467 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:07.327002 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.555280 (+228278us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:07.555337 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.555429 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:08.589658 (+1034229us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:08.730224 (+140566us) raft_consensus.cc:1685] finished
0709 13:18:08.730270 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.730762 (+   492us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7965,"raft.queue_time_us":8837,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6231,"spinlock_wait_cycles":263013248,"thread_start_us":194647,"threads_started":1,"wal-append.queue_time_us":776024}
I20260709 13:18:08.735029 20990 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:08.735671 21095 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:08.737004 20993 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:08.738416 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:08.741495 18303 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:08.588368 21099 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:08.757994 20828 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:08.758033 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.761547 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1633) took 2310 ms. Trace:
I20260709 13:18:08.764736 21095 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:08.765837 21095 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.768625 21007 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:08.770268 18378 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:08.771549 21095 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:08.762231 18385 rpcz_store.cc:276] 0709 13:18:06.450729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.451045 (+   316us) service_pool.cc:224] Handling call
0709 13:18:06.451519 (+   474us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:07.227765 (+776246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.227797 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:07.228389 (+   592us) log.cc:844] Serialized 52 byte log entry
0709 13:18:07.281352 (+ 52963us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:07.281398 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.782595 (+501197us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54003bc754. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:07.782652 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:08.579841 (+797189us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:08.760750 (+180909us) raft_consensus.cc:1685] finished
0709 13:18:08.760809 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.761225 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1922,"raft.queue_time_us":59082,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":93,"spinlock_wait_cycles":1888858624,"thread_start_us":46998,"threads_started":1,"wal-append.queue_time_us":302963}
I20260709 13:18:08.781006 21101 raft_consensus.cc:3055] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:08.781656 21101 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:08.783375 21099 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:08.784104 21099 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:08.785856 20562 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.787634 21124 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:08.788748 21124 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.791785 21124 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:08.803274 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:08.810137 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:08.810544 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.811497 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.812134 18377 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:08.798095 21007 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.820788 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.821455 18383 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:08.821835 18303 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:18:08.828006 20837 raft_consensus.cc:3055] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:08.828603 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:08.849246 21113 raft_consensus.cc:3055] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:08.849820 21113 raft_consensus.cc:740] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:08.851131 21113 consensus_queue.cc:260] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.836534 21007 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:08.836412 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 281856us
I20260709 13:18:08.829711 20837 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:08.863034 18303 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:08.863206 21113 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:08.867890 18308 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:08.872767 21101 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.873394 21007 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:08.908069 18303 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:08.877924 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:08.883281 18306 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:08.887306 18382 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.888722 21139 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:08.898375 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 314) took 2225 ms. Trace:
W20260709 13:18:08.899850 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 255725us
I20260709 13:18:08.892064 18201 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:08.907137 21101 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:08.860898 20562 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:08.905825 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 84304.8us
I20260709 13:18:08.911619 20837 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.924800 21139 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.927640 21139 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:08.930074 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:08.931211 18305 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:08.907202 21116 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:08.937474 21116 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:08.937232 21099 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.939226 21116 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:08.916791 18235 rpcz_store.cc:276] 0709 13:18:06.672737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.230089 (+1557352us) service_pool.cc:224] Handling call
0709 13:18:08.230387 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.424278 (+193891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.424312 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:08.424354 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:08.424384 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.897769 (+473385us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b540029bdd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:08.897827 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.898105 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445455744}
I20260709 13:18:08.945585 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:08.947981 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 257090us
W20260709 13:18:08.956456 18384 consensus_meta.cc:287] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.010s
I20260709 13:18:08.957041 18384 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:08.957130 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:08.959594 20828 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:08.960093 20828 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:08.962050 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 1907) took 1177 ms. Trace:
I20260709 13:18:08.962517 18379 rpcz_store.cc:276] 0709 13:18:07.784548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.893179 (+108631us) service_pool.cc:224] Handling call
0709 13:18:08.961746 (+1068567us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54000cd0d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:08.961971 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1078103296}
I20260709 13:18:08.968446 18306 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:08.969020 18308 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:08.969506 18312 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:08.969710 18378 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:08.970683 18308 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:08.971952 18381 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:08.973420 18311 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:18:08.973589 18230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:08.974414 18230 raft_consensus.cc:606] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:08.974807 18230 raft_consensus.cc:614] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:08.960194 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 346602us
I20260709 13:18:08.981137 20833 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:08.981340 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:08.982788 21139 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:08.981297 18309 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:08.985086 21099 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:08.985692 18230 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:08.986392 20989 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:08.986498 18303 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:08.986971 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:08.988626 18235 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:08.989025 18304 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:08.986974 20989 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:08.990275 20989 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:08.985548 18131 catalog_manager.cc:5697] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 3 to 4, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 4 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.991506 18307 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:08.993167 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:18:08.983626 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 105902us
I20260709 13:18:08.994467 18276 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:08.993729 20837 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:08.966436 20828 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:09.003795 21139 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:09.013136 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:09.014835 18351 leader_election.cc:400] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
I20260709 13:18:09.015177 18351 leader_election.cc:403] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:09.016666 21002 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:09.019343 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 127498us
I20260709 13:18:09.023407 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.024605 18236 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:09.024448 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.025277 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.026095 18230 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 7: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:09.026902 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.030593 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.032478 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.032784 21099 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:09.033900 20562 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:09.034778 20562 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:09.034901 18382 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:09.036108 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:09.033965 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.036975 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:09.036147 20562 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.038516 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:09.038645 20562 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:09.039907 21002 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:18:09.045125 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 50871.8us
I20260709 13:18:09.046947 18235 raft_consensus.cc:2393] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 6: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:09.049670 21116 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:09.051052 20833 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:09.051513 20833 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:09.051888 20833 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:09.034073 21113 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
I20260709 13:18:09.056815 18233 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:09.058669 18382 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:18:09.059660 20937 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:09.060896 18201 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:09.061091 20937 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:09.061266 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:09.056845 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:09.061766 20937 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:09.063472 21114 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:09.064040 21114 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:09.064574 21114 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:09.063814 20937 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.065800 20937 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:09.067903 18382 pending_rounds.cc:85] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 2
I20260709 13:18:09.068186 18382 pending_rounds.cc:107] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:09.068477 18382 raft_consensus.cc:2889] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:09.069094 20807 consensus_meta.cc:287] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.545s	user 0.003s	sys 0.015s
I20260709 13:18:09.072927 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:09.008567 21139 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:09.073231 18927 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:09.072965 20807 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:09.087975 21139 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:09.090487 20807 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:09.069675 18276 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:09.074177 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:09.092341 18276 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:09.092706 21002 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:09.093295 20994 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:09.078770 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.093647 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:09.094195 21130 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:09.079650 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 98497.4us
I20260709 13:18:09.094612 21130 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.095041 21130 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:09.095391 18277 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:09.094631 20741 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:09.097124 20741 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:09.097553 20741 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:09.092453 21101 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.100864 20710 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:09.101552 20710 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:09.101969 18382 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:09.102669 20710 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.100836 21101 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.106551 21101 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:09.107445 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:18:09.134712 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 61560.1us
I20260709 13:18:09.077543 20989 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:09.152695 18132 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39270 (request call id 186) took 18913 ms (client timeout 15000 ms). Trace:
I20260709 13:18:09.232142 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.234401 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:09.235023 18377 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:09.231690 18132 rpcz_store.cc:269] 0709 13:17:50.131983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.132661 (+   678us) service_pool.cc:224] Handling call
0709 13:18:09.044834 (+18912173us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:01.042607 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:01.131335 (+ 88728us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:01.142730 (+ 11395us) write_op.cc:435] Acquired schema lock
0709 13:18:01.148932 (+  6202us) tablet.cc:662] Decoding operations
0709 13:18:01.173884 (+ 24952us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:01.173967 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:01.173992 (+    25us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:18:01.347788 (+173796us) tablet.cc:701] Row locks acquired
0709 13:18:01.351222 (+  3434us) write_op.cc:260] PREPARE: finished
0709 13:18:01.360256 (+  9034us) write_op.cc:270] Start()
0709 13:18:01.372214 (+ 11958us) write_op.cc:276] Timestamp: P: 1783603081360215 usec, L: 0
0709 13:18:01.375627 (+  3413us) op_driver.cc:348] REPLICATION: starting
0709 13:18:01.503975 (+128348us) log.cc:844] Serialized 4454 byte log entry
0709 13:18:01.996602 (+492627us) op_driver.cc:464] REPLICATION: finished
0709 13:18:02.532863 (+536261us) write_op.cc:301] APPLY: starting
0709 13:18:02.539345 (+  6482us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:02.696156 (+156811us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:02.751533 (+ 55377us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:03.161714 (+410181us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:03.169295 (+  7581us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:18:03.169357 (+    62us) write_op.cc:312] APPLY: finished
0709 13:18:03.169737 (+   380us) log.cc:844] Serialized 82 byte log entry
0709 13:18:03.286329 (+116592us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:03.293241 (+  6912us) write_op.cc:454] Released schema lock
0709 13:18:03.297449 (+  4208us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:03.307133 (+  9684us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:03.307179 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14516,"reported_tablets":42,"spinlock_wait_cycles":4480,"child_traces":[["op",{"apply.queue_time_us":435665,"apply.run_cpu_time_us":24045,"apply.run_wall_time_us":825339,"num_ops":11,"prepare.queue_time_us":367018,"prepare.run_cpu_time_us":9566,"prepare.run_wall_time_us":541961,"raft.queue_time_us":202039,"raft.run_cpu_time_us":65327,"raft.run_wall_time_us":272990,"replication_time_us":620780,"spinlock_wait_cycles":1737088,"thread_start_us":710846,"threads_started":5,"wal-append.queue_time_us":233550,"wal-append.run_cpu_time_us":21635,"wal-append.run_wall_time_us":2429271}]]}
I20260709 13:18:09.122764 20994 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:18:09.181294 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.200744 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.133873 21123 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:09.205996 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 114001us
I20260709 13:18:09.205906 20741 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.206985 20833 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:09.207819 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.209318 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.210541 18381 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:09.210414 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.211375 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:09.212193 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 100927us
I20260709 13:18:09.218822 21130 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.225242 20828 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:09.230451 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:09.230881 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.252719 18382 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:09.263283 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.263891 18232 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:09.264071 18231 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:18:09.261998 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.271428 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.273010 18379 raft_consensus.cc:2410] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:09.259137 20837 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:09.276341 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.276618 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.275060 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.272491 18378 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:09.278702 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:09.279505 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:09.282383 18233 raft_consensus.cc:1813] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Handling vote request from an unknown peer 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:09.264683 20804 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:09.281385 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:09.283818 21013 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:18:09.283665 20804 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.281977 18230 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:09.290737 18233 raft_consensus.cc:2368] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:18:09.298653 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.275422 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:09.298723 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:09.300415 18229 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:09.271201 20994 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.305168 18236 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: [6.5-7.6]
I20260709 13:18:09.306177 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.333248 18201 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:09.330639 18200 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:09.289300 21002 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:18:09.340270 18386 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:09.337261 18229 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:09.341631 21148 consensus_queue.cc:1059] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:18:09.343056 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.343513 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.344444 18380 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:09.347199 18382 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:09.349722 20804 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:09.355036 20828 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:09.356014 18378 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:09.357187 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.359462 21139 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:09.367599 18351 connection.cc:256] RPC call timeout handler was delayed by -1.6218540259999372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3037s for a response
W20260709 13:18:09.369671 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 63236.2us
I20260709 13:18:09.371848 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:09.372862 20937 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:09.373446 21002 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:09.373772 20937 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:09.377327 21148 raft_consensus.cc:3055] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:09.377774 21148 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:09.378723 21148 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:09.382140 21130 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:09.380442 21148 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:09.389168 20741 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:09.389467 20833 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:09.343900 18379 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:09.392942 20804 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:09.394101 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 89386.8us
W20260709 13:18:09.395558 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 63553us
I20260709 13:18:09.383944 18377 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:09.399077 18276 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:09.405894 18232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:09.406773 18232 raft_consensus.cc:606] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:09.408552 20833 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:09.400810 21114 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:09.410043 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.405349 20989 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:09.413980 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.368276 18351 connection.cc:256] RPC call timeout handler was delayed by -1.3999320870000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
W20260709 13:18:09.415275 18351 connection.cc:256] RPC call timeout handler was delayed by -1.3981320870000218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 13:18:09.415817 18351 connection.cc:256] RPC call timeout handler was delayed by -1.3900320870000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:18:09.416352 18351 connection.cc:256] RPC call timeout handler was delayed by -1.3540320869999505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 13:18:09.421058 18236 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:09.418900 18351 connection.cc:256] RPC call timeout handler was delayed by -1.3225320869998995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 13:18:09.421195 18229 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:18:09.423643 18351 connection.cc:256] RPC call timeout handler was delayed by -1.3117320869998821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 13:18:09.424813 18351 connection.cc:256] RPC call timeout handler was delayed by -1.2829320870000629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 13:18:09.425244 18351 connection.cc:256] RPC call timeout handler was delayed by -1.2703320870000425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
I20260709 13:18:09.421480 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:09.426008 18351 connection.cc:256] RPC call timeout handler was delayed by -1.2694320870000411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 13:18:09.426482 18351 connection.cc:256] RPC call timeout handler was delayed by -1.2118320869999479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 13:18:09.422562 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:09.421897 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 50229.1us
I20260709 13:18:09.428032 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:09.428253 18233 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:09.428706 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 155634us
I20260709 13:18:09.429780 18228 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:18:09.427657 18351 connection.cc:256] RPC call timeout handler was delayed by -1.2046320869999363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 13:18:09.432111 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 167216us
W20260709 13:18:09.433609 18351 connection.cc:256] RPC call timeout handler was delayed by -1.0822320869999658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260709 13:18:09.434671 18231 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:09.434652 18351 connection.cc:256] RPC call timeout handler was delayed by -1.0687320869999439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
I20260709 13:18:09.433919 18234 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
W20260709 13:18:09.421281 18120 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 943649b738074d87a593c237cf998758 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8b4fbc44aa2649f0bcac5cd70f71951d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:18:09.421892 21114 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:09.441802 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:09.437673 18232 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:09.441927 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:09.443933 20829 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:09.444386 20829 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:09.444793 20829 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:09.431527 20937 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:09.448881 18233 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:09.435302 20804 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:18:09.452497 18201 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:09.454288 21139 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:09.454833 20804 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:09.459692 18276 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:09.469244 20837 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:09.473088 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:09.476831 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:09.481642 18201 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:09.465669 21139 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:09.485201 21157 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:18:09.486083 18234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87ce294aa3d9426291ec809884e80749"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:09.486724 18234 raft_consensus.cc:606] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:09.487485 18955 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:09.463557 21114 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:18:09.480338 18232 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:09.484237 21139 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.497442 18276 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:09.503466 20994 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:09.508881 18312 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:09.509789 20994 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:09.510673 20994 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:09.511672 20994 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.512317 18310 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:09.513226 20994 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:09.501119 21139 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:09.519613 18304 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:09.520934 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:09.521014 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 83475us
I20260709 13:18:09.522331 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:09.503899 21157 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:09.523432 20710 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:09.504899 21114 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:09.504784 20804 consensus_queue.cc:1059] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:09.496901 20937 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:09.530371 21002 raft_consensus.cc:3055] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:09.524142 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:09.528486 18231 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:18:09.530788 21002 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:09.534603 21002 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:09.536105 21002 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.529421 21114 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:09.537367 21114 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.538576 21114 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:09.523247 21157 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:09.541289 21157 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.543094 21157 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:09.538600 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 59436.5us
I20260709 13:18:09.556284 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:09.557205 20937 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:09.558022 20937 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.558194 21155 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:09.558525 20937 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:09.558738 21155 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:09.559281 21155 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:09.560562 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.560989 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.533303 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:18:09.564277 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 302533us
I20260709 13:18:09.571003 18234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:09.557298 18201 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:18:09.576457 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 52494.5us
I20260709 13:18:09.577740 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:09.578553 20994 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:09.578949 20994 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.579260 20994 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:09.582726 20837 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:09.583178 20837 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:09.583559 20837 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:09.584632 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 119880us
I20260709 13:18:09.586495 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:09.588634 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:09.588863 20562 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:09.589907 20562 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:09.590158 18351 leader_election.cc:400] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:18:09.590551 18351 leader_election.cc:403] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:09.592607 18233 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:09.593286 18234 raft_consensus.cc:606] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:09.593778 18232 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:18:09.594880 18234 raft_consensus.cc:614] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:09.599782 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 66565.6us
I20260709 13:18:09.599959 21154 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:09.600948 21154 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:09.602248 21154 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.605502 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:09.614928 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:09.615741 18379 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:09.622879 18379 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:09.631081 18131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 82) took 9406 ms. Trace:
I20260709 13:18:09.632688 20807 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:18:09.634236 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:09.636279 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 79051us
W20260709 13:18:09.640435 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 43929.5us
I20260709 13:18:09.566247 20710 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:09.641331 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 51342.8us
I20260709 13:18:09.649410 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:09.649658 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:09.650056 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:09.590989 20829 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.666374 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:18:09.668612 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 87842us
I20260709 13:18:09.631465 18131 rpcz_store.cc:276] 0709 13:18:00.225111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.225339 (+   228us) service_pool.cc:224] Handling call
0709 13:18:09.630984 (+9405645us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:09.219969 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:09.220796 (+   827us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:09.220848 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:18:09.220877 (+    29us) tablet.cc:662] Decoding operations
0709 13:18:09.221514 (+   637us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:09.221604 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:09.221630 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:09.222114 (+   484us) tablet.cc:701] Row locks acquired
0709 13:18:09.222160 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:18:09.222333 (+   173us) write_op.cc:270] Start()
0709 13:18:09.222504 (+   171us) write_op.cc:276] Timestamp: P: 1783603089222263 usec, L: 0
0709 13:18:09.222522 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:18:09.223446 (+   924us) log.cc:844] Serialized 1276 byte log entry
0709 13:18:09.444820 (+221374us) op_driver.cc:464] REPLICATION: finished
0709 13:18:09.581776 (+136956us) write_op.cc:301] APPLY: starting
0709 13:18:09.581911 (+   135us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:09.582083 (+   172us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:09.582253 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:09.582911 (+   658us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:09.583257 (+   346us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:18:09.583302 (+    45us) write_op.cc:312] APPLY: finished
0709 13:18:09.583654 (+   352us) log.cc:844] Serialized 34 byte log entry
0709 13:18:09.583872 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:09.583990 (+   118us) write_op.cc:454] Released schema lock
0709 13:18:09.584055 (+    65us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":4749609,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":136599,"apply.run_cpu_time_us":2719,"apply.run_wall_time_us":2726,"num_ops":3,"prepare.queue_time_us":211920,"prepare.run_cpu_time_us":10558,"prepare.run_wall_time_us":38438,"raft.queue_time_us":142573,"raft.run_cpu_time_us":30695,"raft.run_wall_time_us":52150,"replication_time_us":222092,"thread_start_us":332614,"threads_started":4,"wal-append.queue_time_us":57953}]]}
I20260709 13:18:09.671970 18371 tablet_service.cc:1558] Processing DeleteTablet for tablet 80d0760748294d8d8cb291466766b8a5 with delete_type TABLET_DATA_TOMBSTONED (TS 8b4fbc44aa2649f0bcac5cd70f71951d not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:46836
I20260709 13:18:09.673383 20804 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:09.673799 20937 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.674975 20829 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:09.675100 20804 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:09.676000 21116 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:09.677224 20937 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:09.678097 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 100488us
I20260709 13:18:09.679594 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:09.677074 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:09.680796 20829 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:09.681782 20829 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:09.683408 21139 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.683167 20829 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.685575 21155 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.686575 18276 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:09.648553 21002 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:09.681887 18275 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:09.696135 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:09.696734 18378 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:09.698704 21139 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:09.700687 20807 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:09.707408 20837 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:09.710307 20837 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:09.713130 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:09.716223 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:09.718339 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:09.724974 18379 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:09.733659 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 61329.8us
I20260709 13:18:09.729882 20710 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:09.741701 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 233265us
W20260709 13:18:09.744395 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 62566.8us
I20260709 13:18:09.747972 18201 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:09.745428 20710 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:09.749598 20710 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:09.753279 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.762410 18133 catalog_manager.cc:5697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.782083 18275 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:09.793813 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:09.797257 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:09.799165 21155 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:09.799927 18133 catalog_manager.cc:5697] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 3 to 6, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 6 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:09.800428 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:09.801357 18381 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:09.747648 21154 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:09.745848 21002 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:18:09.792894 18277 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:09.816728 18381 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:09.817869 20994 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.820132 20994 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:09.790021 20804 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:09.822605 20804 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:09.823010 20804 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:09.826159 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:09.827700 21115 consensus_queue.cc:1059] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:09.828845 21115 raft_consensus.cc:3055] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:09.829239 21115 raft_consensus.cc:740] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:09.829123 21148 consensus_queue.cc:1059] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:09.830307 21153 raft_consensus.cc:3055] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:09.830179 21115 consensus_queue.cc:260] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:09.830916 21153 raft_consensus.cc:740] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:09.832154 21153 consensus_queue.cc:260] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:09.834499 21148 consensus_queue.cc:1059] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:09.835026 21153 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:09.835693 21148 raft_consensus.cc:3055] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:09.836120 21148 raft_consensus.cc:740] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:09.837147 21148 consensus_queue.cc:260] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:09.839035 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 94235.8us
I20260709 13:18:09.840164 21002 consensus_queue.cc:1059] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:09.841358 21002 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:09.841706 21002 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:09.842348 20937 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:09.843379 21002 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.846239 20937 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:09.850405 18379 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
W20260709 13:18:09.851262 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 69598.5us
I20260709 13:18:09.852185 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.852911 21155 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:09.853156 18381 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:09.854223 18276 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:18:09.859112 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.861227 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:09.871106 18378 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:09.874650 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:09.876412 18276 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:09.876559 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:09.876933 18275 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:09.807963 18133 catalog_manager.cc:5697] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: config changed from index 5 to 3, term changed from 5 to 3, leader changed from <none> to e016302b7e734d74833a2bf7bab44838 (127.16.188.132), VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) added. New cstate: current_term: 3 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:18:09.877991 18378 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:18:09.864812 21167 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.107s	user 0.004s	sys 0.005s
I20260709 13:18:09.838480 21148 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:09.886535 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.886932 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.870703 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.856078 21002 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:09.886142 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:09.863425 20994 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:09.888056 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.902515 18275 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:09.903316 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.904932 18383 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:09.906920 18386 raft_consensus.cc:2393] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:09.912614 18275 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:09.880810 20833 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:09.889812 21154 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:09.914896 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:09.915763 18379 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:09.916774 20710 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:09.917557 20741 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:09.919802 21169 tablet_replica.cc:333] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
W20260709 13:18:09.920533 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 174325us
I20260709 13:18:09.920713 20833 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:09.921816 20833 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.923732 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.925021 20994 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:09.926064 18382 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:09.926105 20994 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.904142 21013 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:09.927606 21013 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:09.925031 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.928660 21013 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.874415 21116 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:09.934768 21116 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:09.938172 18133 catalog_manager.cc:5697] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 1 to 6, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 6 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.944941 20804 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:09.948760 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.950634 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 274139us
I20260709 13:18:09.956199 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:09.957371 18383 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:09.960927 18381 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:09.961000 20804 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:09.972847 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 72025.8us
I20260709 13:18:09.976023 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:09.977476 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.978832 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.903949 21139 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:09.998781 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:10.002314 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:10.003026 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:10.004617 18378 raft_consensus.cc:2376] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8. Re-sending same reply.
I20260709 13:18:10.003219 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:10.004972 18953 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:18:10.011507 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:10.014262 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:10.015434 18379 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:10.016211 18378 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:10.027109 18378 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:10.026326 18384 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:10.029026 18384 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:10.049392 18377 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:18:10.025524 21101 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:18:10.071341 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:10.071774 18381 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:10.038787 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:18:10.074929 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.084749 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 163381us
I20260709 13:18:10.086369 18381 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:10.076982 18378 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.091681 18377 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:10.097541 18307 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:10.085834 21115 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.099262 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:10.102885 18377 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:10.115945 18383 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:18:10.122998 18378 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:10.128286 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.091317 20829 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:18:10.138183 21171 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.138366 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:10.139487 18382 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:10.140834 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:10.126384 21175 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:10.152658 20837 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.150063 20994 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.161618 18384 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:10.150404 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 198278us
I20260709 13:18:10.172375 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:10.161913 21175 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:10.153929 21148 consensus_queue.cc:1059] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:18:10.182212 18378 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:18:10.184036 18277 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:10.181921 21175 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.185156 21154 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:10.187098 18386 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:10.189072 18378 pending_rounds.cc:85] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 3
I20260709 13:18:10.194756 18225 tablet_service.cc:1558] Processing DeleteTablet for tablet 943649b738074d87a593c237cf998758 with delete_type TABLET_DATA_TOMBSTONED (TS b52e2477fc524694967c4a16afa983e3 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42512
W20260709 13:18:10.195806 21172 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:18:10.153918 21171 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.202913 18378 pending_rounds.cc:107] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:10.205827 18378 raft_consensus.cc:2889] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:10.204905 18384 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:10.206219 18351 leader_election.cc:336] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.546s (SENT)
I20260709 13:18:10.212263 21169 raft_consensus.cc:2243] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:10.213845 21169 raft_consensus.cc:2272] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.188333 21101 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:18:10.170719 20994 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.220990 20994 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:10.221791 20989 raft_consensus.cc:3055] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:10.222241 20989 raft_consensus.cc:740] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:10.223167 20989 consensus_queue.cc:260] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:10.224783 20989 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:10.232649 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 48694.6us
I20260709 13:18:10.232750 21139 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.236881 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:10.237710 21171 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:10.239125 18377 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:10.241218 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.241665 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.243095 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:10.243731 18380 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:18:10.245741 18234 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:18:10.169874 20837 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:10.253304 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.258292 18377 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
W20260709 13:18:10.270637 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.273165 18276 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:10.274895 18386 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:10.282287 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:10.286123 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 84479.8us
I20260709 13:18:10.289320 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:10.252240 20833 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:10.305275 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:18:10.306595 21183 log.cc:927] Time spent T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:18:10.307265 21152 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:10.310015 21152 raft_consensus.cc:697] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:10.311034 21152 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:10.290796 21114 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:10.322170 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:10.324772 20804 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:10.324841 21002 consensus_queue.cc:1059] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:10.325598 20804 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.326054 20804 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.329403 20804 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:10.330369 21169 ts_tablet_manager.cc:1916] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:18:10.332922 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51169.2us
I20260709 13:18:10.333798 18277 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:10.335764 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:10.336638 20833 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:10.338505 20837 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:10.336720 21101 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:10.340755 21101 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:10.341310 21101 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:10.361459 18384 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:18:10.361976 18384 pending_rounds.cc:85] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 5
I20260709 13:18:10.362218 18384 pending_rounds.cc:107] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:18:10.362470 18384 raft_consensus.cc:2889] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:10.320451 21114 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.332353 21168 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:10.305162 20994 consensus_queue.cc:1059] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:18:10.375216 21192 raft_consensus.cc:3055] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:10.375783 21187 tablet_replica.cc:333] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
W20260709 13:18:10.370787 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 46421.4us
I20260709 13:18:10.388298 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:10.366813 20741 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.393471 20741 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.395578 20741 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:10.397135 21154 raft_consensus.cc:3055] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:10.397627 21154 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:10.398413 21154 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.373065 21114 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.399741 21154 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.404731 21139 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:10.406157 21170 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:10.407265 21171 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:10.407622 21171 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:10.408401 21171 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.410450 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:10.411089 21101 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:10.416218 21171 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.430080 21187 raft_consensus.cc:2243] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:10.433302 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 45090.1us
I20260709 13:18:10.439244 18384 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:10.387009 21192 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:10.442596 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.443286 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 119508us
I20260709 13:18:10.442765 18383 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:10.445751 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:10.450083 18380 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:10.446178 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:10.452389 20837 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:10.452979 20837 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.431354 20994 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:10.456945 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 46574.6us
I20260709 13:18:10.459671 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:10.459756 21175 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.460846 21002 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:10.461544 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:10.462167 21175 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:10.462435 21002 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:10.443531 21170 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:10.463366 21170 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:10.463891 21170 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.465381 18201 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:10.469161 21192 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.469983 21002 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:10.470808 21192 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:10.472265 21002 consensus_queue.cc:1059] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:10.473404 21002 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:10.474152 21002 raft_consensus.cc:3055] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:10.474228 21101 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:10.474537 21002 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:10.475428 21002 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.476864 20804 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:10.477267 20804 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:10.455086 21114 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:10.482339 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.483554 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.484651 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:10.486644 21114 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:10.487736 20741 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:10.488104 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:10.481892 20937 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:18:10.488448 21013 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:10.489372 20937 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:10.487874 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:10.455017 20833 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:10.483100 21168 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:18:10.492112 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:10.455053 20837 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:10.493387 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.478060 21157 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:10.493659 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:10.493732 21002 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.487769 20804 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.501816 20804 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:10.502562 21193 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:10.503019 21193 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:10.493266 20829 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
W20260709 13:18:10.508917 18202 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.531s (SENT)
I20260709 13:18:10.508760 21157 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.509467 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:10.511044 21157 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:10.512198 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:10.513034 21169 ts_tablet_manager.cc:1929] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:18:10.513563 21169 log.cc:1199] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-2-root/wals/80d0760748294d8d8cb291466766b8a5
I20260709 13:18:10.503942 21193 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.489791 20937 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:10.516984 18120 catalog_manager.cc:5028] TS 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): tablet 80d0760748294d8d8cb291466766b8a5 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:18:10.517377 21193 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.517925 20937 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.519301 20937 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:10.519553 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:10.521955 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.523655 18351 leader_election.cc:400] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 5.
I20260709 13:18:10.524466 20562 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:10.525943 20562 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:10.526383 20562 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:10.524935 21116 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.526988 21187 raft_consensus.cc:2272] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.527295 21116 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.528898 18307 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:10.529511 21116 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:10.530160 18351 leader_election.cc:403] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:10.531210 18351 raft_consensus.cc:2686] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:18:10.531364 20833 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.531906 20833 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:10.534226 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.535315 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:10.536055 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.540583 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:10.543262 18385 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:10.543429 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:10.544278 18233 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 7: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:10.544224 21168 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:10.545217 18381 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:18:10.545593 18381 pending_rounds.cc:85] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 4
I20260709 13:18:10.545807 18381 pending_rounds.cc:107] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:18:10.546061 18381 raft_consensus.cc:2889] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:10.546886 21152 consensus_queue.cc:1059] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:10.547688 18377 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:10.548885 21187 ts_tablet_manager.cc:1916] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:10.549546 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:10.551703 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:10.553218 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:10.554311 18232 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:10.557199 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:10.561251 18231 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:10.562454 18201 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:10.566434 20833 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:10.561115 21171 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:10.573103 21157 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:10.573356 21170 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:10.575830 21168 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:10.576345 21168 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:10.577327 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:10.577201 21168 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.579386 21170 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:10.560691 21175 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:10.590751 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.600589 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.604451 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:10.607419 18202 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.578s (SENT)
I20260709 13:18:10.607961 18202 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:10.599005 21175 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.595372 20741 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:18:10.569482 21002 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:18:10.580257 20562 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.598331 21157 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:18:10.605906 21171 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:10.605751 21115 raft_consensus.cc:3055] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:10.621240 21198 consensus_queue.cc:1059] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:10.623503 18384 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:10.600433 21170 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:18:10.613242 21175 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:10.615962 20937 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:10.628994 21115 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:10.636005 20562 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:10.648350 21152 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.658895 21152 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:10.661909 21192 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:10.662357 21192 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:10.663302 21192 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.665086 20833 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:10.665447 21171 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.666013 20833 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:10.666352 20833 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:10.667157 20833 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.673843 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:10.674687 18234 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:10.649606 21191 consensus_queue.cc:1059] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 13:18:10.668439 20833 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:10.681974 21116 raft_consensus.cc:3055] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:10.692015 18202 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:10.682595 21192 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:10.694144 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 92705.1us
W20260709 13:18:10.713810 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 151264us
I20260709 13:18:10.714687 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:10.715406 18379 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:18:10.694005 21116 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:10.716442 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:10.700034 21152 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:10.722193 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:10.723073 20562 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:10.726176 20562 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:10.726652 18231 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:10.726791 20562 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.720619 20804 raft_consensus.cc:3055] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:10.716781 21002 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:10.721961 21170 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:18:10.718400 21200 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:10.741168 21198 raft_consensus.cc:3055] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:10.741573 21198 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:10.741516 21200 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.742488 21198 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.743722 21200 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:10.743742 21198 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:10.733605 18926 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:10.725267 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:10.737037 21187 ts_tablet_manager.cc:1929] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:18:10.757674 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:10.759053 18351 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:10.759485 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:10.759848 18233 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:10.762710 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:10.762776 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:10.763520 18231 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:10.764483 21187 log.cc:1199] T 943649b738074d87a593c237cf998758 P b52e2477fc524694967c4a16afa983e3: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-0-root/wals/943649b738074d87a593c237cf998758
I20260709 13:18:10.732718 20804 raft_consensus.cc:740] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:10.768872 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:10.769263 20804 consensus_queue.cc:260] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:10.770669 20804 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.774092 18228 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:10.777598 18229 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:10.730567 21168 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:18:10.745188 20937 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:10.787400 21152 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:10.787937 21152 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.788375 21152 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.781201 21200 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:10.782857 21198 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:10.783869 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:10.791564 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 59751.2us
I20260709 13:18:10.825145 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:10.825559 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.706955 21115 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:10.828846 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:10.829633 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:10.830466 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 74021.4us
I20260709 13:18:10.832166 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:10.831055 18307 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:10.833122 18303 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:10.833799 18236 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:10.830108 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:10.835011 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:10.835526 18304 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 7: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:18:10.835582 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51806us
I20260709 13:18:10.836561 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:10.838546 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:10.840754 21200 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:10.844738 18310 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:10.837968 21198 raft_consensus.cc:697] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:10.846767 21198 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:10.842198 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:10.849697 18307 raft_consensus.cc:2410] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:18:10.851565 18233 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:10.824543 20937 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:10.853189 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:10.830806 21114 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.857017 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:10.857540 18228 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:10.858999 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:10.864303 18303 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:10.823705 21175 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.865662 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:10.869114 18304 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:10.871189 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:10.873344 18304 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:10.882210 18228 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:10.885771 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:10.888684 18229 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:10.889879 21206 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:10.890658 21206 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:10.891820 18303 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.891705 21206 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.893523 20937 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.897512 18236 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:10.900995 18237 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:18:10.902105 21204 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:18:10.862706 21114 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.849299 21116 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.909688 18304 raft_consensus.cc:2393] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 5: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:10.920917 18303 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:10.922911 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:10.925459 21200 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:10.937520 21200 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:10.931843 21148 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:18:10.946985 18231 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:10.949142 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:10.949721 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:10.958760 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 90329.7us
I20260709 13:18:10.960758 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:10.961751 18377 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:10.964531 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:10.967350 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:10.971283 18232 raft_consensus.cc:2410] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:18:11.028766 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.042847 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.043989 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 67803.7us
I20260709 13:18:10.934439 21168 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:18:11.044461 18377 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:11.053179 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.054399 18307 raft_consensus.cc:2410] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:18:11.051208 18351 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.500s (SENT) [suppressed 48 similar messages]
I20260709 13:18:11.056334 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:11.058728 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.051635 18303 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:10.992218 21116 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:11.059159 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 220769us
W20260709 13:18:11.067526 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.070144 18307 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:11.071128 18229 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:18:11.072649 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:11.073554 18235 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.991503 21208 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:18:11.081350 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:11.059602 20829 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.057502 21168 consensus_queue.cc:1243] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer 459e82ee6b564cc19be6f73186938e79 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:11.104130 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:11.043586 21193 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:18:11.106600 18236 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:18:11.108660 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.111214 18379 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:11.112797 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.110702 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:18:11.130347 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.126979 18310 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:11.131170 18384 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
W20260709 13:18:11.131734 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51107.8us
I20260709 13:18:11.137946 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:11.152585 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:11.157176 18228 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:18:11.168452 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 117267us
I20260709 13:18:11.163637 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:11.151608 20741 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:11.115571 20829 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:11.171554 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:11.158433 21210 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:18:11.144878 21148 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:18:11.176077 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 50863.6us
I20260709 13:18:11.178675 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.180239 18310 raft_consensus.cc:2410] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:11.177021 21226 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.182036 21226 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:11.184099 21226 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:11.174690 21114 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:11.185546 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.186956 20829 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:11.187335 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:11.188670 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:11.189344 18234 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:18:11.190187 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:11.190914 18234 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:11.191984 18234 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:11.178799 20741 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:11.197633 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:11.231176 18307 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:11.250365 18228 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:11.199719 20562 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:11.252720 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:11.253355 21201 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.540s	user 0.005s	sys 0.002s
I20260709 13:18:11.201587 21152 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:11.254242 20562 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:11.255852 21152 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:11.269109 18312 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:18:11.168180 21219 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:18:11.206887 21208 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.200140 21225 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.196452 21115 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:11.277849 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 167242us
I20260709 13:18:11.282729 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.283073 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.301940 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:11.303642 18234 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 7: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:18:11.304394 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.310348 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.307094 18309 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:11.198894 20741 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:11.305516 21145 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.327040 21220 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:18:11.331552 21216 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:11.332800 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.343231 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.344831 18305 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:11.282191 21208 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:11.347949 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:11.348949 18237 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:11.340657 21230 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:11.352356 21230 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:11.347909 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:11.354478 18309 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:11.375609 18234 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:11.375877 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.376240 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.376468 18312 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:18:11.377468 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:11.377686 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:11.377002 18310 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:18:11.368140 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:11.288877 21225 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:11.379191 18311 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:11.393829 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.402680 18236 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:11.385210 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.379699 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:11.379145 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:11.421255 18312 raft_consensus.cc:2376] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8. Re-sending same reply.
I20260709 13:18:11.420949 18310 raft_consensus.cc:2376] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5. Re-sending same reply.
I20260709 13:18:11.379827 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.406912 18308 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:11.427479 18306 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:11.432119 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:11.433040 18312 raft_consensus.cc:2376] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9. Re-sending same reply.
I20260709 13:18:11.419724 18305 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:11.436614 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:11.434882 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.443001 18383 raft_consensus.cc:1240] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:11.438686 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.441162 18309 raft_consensus.cc:1813] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Handling vote request from an unknown peer 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:11.445101 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.345883 21002 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:18:11.449435 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:11.446835 18305 raft_consensus.cc:2410] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:18:11.450177 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:11.451112 18308 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:11.451395 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.452642 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.417179 21229 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.394222 21208 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:11.453568 18309 raft_consensus.cc:2368] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 6.
I20260709 13:18:11.454728 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:11.456442 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.457273 18306 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:11.457130 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.458038 18303 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:11.459699 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.344805 21216 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:11.462752 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.463618 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.460309 18305 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:11.465929 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.466506 18305 raft_consensus.cc:1813] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Handling vote request from an unknown peer b52e2477fc524694967c4a16afa983e3
I20260709 13:18:11.466915 18305 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:11.471225 18235 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:11.471982 18232 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:11.338292 21145 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:11.476389 18303 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:11.461407 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.483651 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.462040 21193 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:11.491550 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.491698 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.492724 18309 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:11.506878 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.507105 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.507725 18308 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:11.507962 18310 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:11.495121 21193 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:11.509164 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.509586 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:11.509991 18306 raft_consensus.cc:2368] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8.
I20260709 13:18:11.510242 18305 raft_consensus.cc:2376] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7. Re-sending same reply.
I20260709 13:18:11.510658 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:11.510847 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.511132 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.509311 21193 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:11.511945 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:11.513037 18955 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:11.513746 18312 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:11.514117 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.514995 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.515298 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.515865 18312 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:11.516826 21216 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:11.517182 20562 consensus_queue.cc:1059] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:11.518303 20562 raft_consensus.cc:3055] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:11.518709 20562 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:11.519541 18230 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:11.516422 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.520758 21230 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:11.521128 18311 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:18:11.517258 18235 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:11.523368 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:11.511410 18303 raft_consensus.cc:2410] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:11.529454 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:11.519621 20562 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:11.460307 21229 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:11.532289 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:11.531360 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 196060us
I20260709 13:18:11.546535 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:11.553016 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:11.556265 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:11.556562 18232 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:11.550341 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:11.565474 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:11.566202 18232 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:11.566829 18305 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:11.550869 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:11.572153 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:11.585211 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:11.572203 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 229632us
W20260709 13:18:11.571609 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 135091us
I20260709 13:18:11.590960 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:11.563055 21206 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:11.615856 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 43765.5us
I20260709 13:18:11.547204 21216 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:18:11.562885 21168 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:11.565701 20562 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:11.648789 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.615310 21116 consensus_meta.cc:287] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.549s	user 0.013s	sys 0.000s
W20260709 13:18:11.655308 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.614457 21170 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:11.669541 18382 raft_consensus.cc:2410] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:18:11.672506 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 84203us
I20260709 13:18:11.621295 21168 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:11.686856 18202 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.516s (SENT)
I20260709 13:18:11.684067 18308 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:11.615753 18955 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
W20260709 13:18:11.690179 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 73004.8us
I20260709 13:18:11.691453 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:11.689479 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:11.696866 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 78027.6us
I20260709 13:18:11.697566 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:11.698316 18236 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
W20260709 13:18:11.709262 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.698334 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:11.710563 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 112733us
I20260709 13:18:11.685604 21225 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:11.688683 21168 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:11.713490 18385 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:11.710932 18234 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:11.715597 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:11.724599 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:11.725134 18230 raft_consensus.cc:2410] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:11.725407 18306 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
W20260709 13:18:11.729610 18202 leader_election.cc:336] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.806s (SENT)
I20260709 13:18:11.730154 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:11.685958 21116 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:18:11.713197 21208 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:11.734494 21145 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:11.734922 21247 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:18:11.760713 18927 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:18:11.764546 21244 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:18:11.764773 21152 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:11.765245 21152 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.765733 21152 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:11.773198 21175 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:11.800966 18349 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:18:11.819288 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 127903us
I20260709 13:18:11.742941 21220 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:11.820364 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:11.803797 21200 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:11.806257 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:11.804939 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 75356.3us
W20260709 13:18:11.825491 18202 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.833s (SENT)
I20260709 13:18:11.826946 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:11.827140 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:11.828263 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:11.828701 21220 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:11.829488 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:11.831688 18202 leader_election.cc:336] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.053s (SENT)
I20260709 13:18:11.835471 18384 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:11.832008 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:11.838792 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:11.836005 18202 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.061s (SENT)
I20260709 13:18:11.775707 21116 raft_consensus.cc:3055] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:11.840292 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:11.839848 18381 raft_consensus.cc:2410] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:11.768806 21148 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:11.825572 21210 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:18:11.804279 21170 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:11.856268 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 52093.8us
I20260709 13:18:11.860451 18277 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:11.865051 18237 consensus_meta.cc:287] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.001s
W20260709 13:18:11.870658 18202 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.076s (SENT)
I20260709 13:18:11.871402 18202 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:11.868372 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:11.843662 21116 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:11.869221 20837 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.874831 21272 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:11.875911 21272 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:11.875241 20837 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:11.876546 21272 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:11.879542 21272 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:11.826092 21200 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:11.885505 18277 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:11.882547 21272 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:11.891664 18383 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:11.891237 18237 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:18:11.875631 21116 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:11.857815 21229 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:11.898059 21246 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:18:11.888379 21226 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:11.883287 20837 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:11.899952 21261 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:11.869565 21220 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:11.897050 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:11.903151 18202 leader_election.cc:400] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8.
I20260709 13:18:11.909096 18202 leader_election.cc:403] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:11.889832 21200 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:11.910562 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:11.894863 21013 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:11.915984 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:11.916108 21251 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:11.891116 21148 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:11.938586 21148 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:11.939143 21148 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:11.939651 21148 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:11.941723 21148 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:11.917092 21248 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:18:11.894927 21216 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:11.919742 21261 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:11.919821 21175 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:11.919062 18277 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:11.916011 21253 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:18:11.895263 20937 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:11.926980 21272 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:11.946097 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:11.179811 18121 catalog_manager.cc:5028] TS b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): tablet 943649b738074d87a593c237cf998758 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:18:11.948068 21013 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:11.948179 18121 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 819232us
I20260709 13:18:11.948745 21226 consensus_queue.cc:1059] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:11.949532 21013 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:11.950008 21226 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:11.950557 21013 raft_consensus.cc:3055] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:11.950984 21013 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:11.952113 21013 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:11.953855 21013 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:11.953953 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:11.955603 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:11.956646 21268 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:11.956842 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:11.908437 21192 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:11.957195 21268 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:11.957448 18379 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:11.957631 21192 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:11.958310 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:11.958142 21268 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:11.958920 18379 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:18:11.955808 18384 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:11.960403 21114 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:11.960950 21114 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:11.961001 21192 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:11.961608 21233 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.962332 21114 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:11.964169 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.970999 21193 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:11.943856 21152 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:11.978194 21206 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:11.978627 21206 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:11.979563 21206 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:11.980450 21152 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:11.980764 20833 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:11.982216 18276 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:11.983254 18276 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:11.983947 18377 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:11.984200 20829 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:11.984673 20829 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.984998 20829 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:11.986629 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:11.997918 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 174913us
I20260709 13:18:11.930632 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:11.979700 21200 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:11.988991 18131 catalog_manager.cc:5697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 3 to 5, term changed from 3 to 5, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New cstate: current_term: 5 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.001578 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:12.002246 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 71957.4us
W20260709 13:18:12.009943 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 94053.5us
I20260709 13:18:12.002970 21225 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8.
I20260709 13:18:12.009766 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:12.007797 18378 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:18:12.038062 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:12.001164 20741 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:12.041350 18382 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:12.005070 21155 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:12.049533 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:12.005677 21229 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:12.052191 18202 leader_election.cc:336] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.703s (SENT)
I20260709 13:18:12.050734 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:12.057888 18385 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
W20260709 13:18:12.058681 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 48992us
I20260709 13:18:12.059485 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:11.976330 21168 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.021960 20937 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:12.044203 21206 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:11.962251 21233 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:12.048327 20741 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.051281 21152 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.046868 20562 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:12.072540 18202 leader_election.cc:336] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.080s (SENT)
I20260709 13:18:12.073102 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:12.069351 18926 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:12.078253 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:12.079632 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.087929 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:12.077345 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:12.091952 21200 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:12.093956 21168 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:12.100533 21274 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:12.075001 21272 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:12.101352 21272 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:12.101779 21272 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:12.062996 20994 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:18:12.107542 21211 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:12.101028 21274 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.108409 21274 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.109716 21216 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:12.110361 21216 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:12.110569 21235 log.cc:927] Time spent T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.739s	user 0.000s	sys 0.004s
I20260709 13:18:12.110755 21216 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.109910 21264 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:12.083398 20937 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:12.114636 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 416) took 1166 ms. Trace:
I20260709 13:18:12.114338 20937 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.114974 18304 rpcz_store.cc:276] 0709 13:18:10.947824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.948080 (+   256us) service_pool.cc:224] Handling call
0709 13:18:10.948457 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.949560 (+  1103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.949601 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.978617 (+ 29016us) log.cc:844] Serialized 26 byte log entry
0709 13:18:11.269790 (+291173us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:11.269828 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.271326 (+  1498us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:12.109899 (+838573us) spinlock_profiling.cc:243] Waited 8.98 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:12.114309 (+  4410us) raft_consensus.cc:1685] finished
0709 13:18:12.114332 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.114578 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11080,"raft.queue_time_us":737,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":13123,"spinlock_wait_cycles":20643712,"thread_start_us":211000,"threads_started":1,"wal-append.queue_time_us":297142}
I20260709 13:18:12.078294 21152 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:12.117583 21267 log.cc:927] Time spent T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.198s	user 0.002s	sys 0.000s
I20260709 13:18:12.117867 18955 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:18:12.119041 21152 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:12.121820 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:12.122859 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:12.124756 21264 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:12.124688 21227 consensus_queue.cc:1059] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:18:12.125280 21264 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.125620 21264 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.125911 21227 raft_consensus.cc:3055] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:12.126331 21227 raft_consensus.cc:740] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:12.127144 21227 consensus_queue.cc:260] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:12.129169 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:12.121901 21232 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.749s	user 0.003s	sys 0.000s
I20260709 13:18:12.129895 18380 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:18:12.130366 21259 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:12.132730 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1468) took 1277 ms. Trace:
I20260709 13:18:12.133383 18233 rpcz_store.cc:276] 0709 13:18:10.855420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.855571 (+   151us) service_pool.cc:224] Handling call
0709 13:18:10.862233 (+  6662us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:11.083674 (+221441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.083776 (+   102us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:11.110461 (+ 26685us) log.cc:844] Serialized 52 byte log entry
0709 13:18:11.247153 (+136692us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:11.337150 (+ 89997us) log.cc:844] Serialized 14 byte log entry
0709 13:18:11.477744 (+140594us) log.cc:844] Serialized 14 byte log entry
0709 13:18:11.478042 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.478130 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:12.120844 (+642714us) spinlock_profiling.cc:243] Waited 7.7 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:12.132407 (+ 11563us) raft_consensus.cc:1685] finished
0709 13:18:12.132434 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.132641 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74824,"prepare.queue_time_us":135003,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":221091,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":15590,"spinlock_wait_cycles":19145216,"thread_start_us":438549,"threads_started":4,"wal-append.queue_time_us":200339}
I20260709 13:18:12.076737 20741 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.138934 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.139930 18305 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:18:12.140609 21270 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:12.140410 21241 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.143198 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:12.143155 21241 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.143983 18307 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.145566 21241 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:12.146550 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.146504 20804 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.147269 20804 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.148895 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:12.149523 18229 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:18:12.150357 21270 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:12.150481 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:12.151108 18385 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:12.150998 21270 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.153331 20804 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:12.153972 18927 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:12.155159 21270 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:12.155246 21276 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:12.155857 20804 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:12.132663 21237 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.760s	user 0.000s	sys 0.003s
I20260709 13:18:12.070364 21226 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:18:12.163120 21216 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.169137 21191 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 13:18:12.171018 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.168470 20741 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:12.195802 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.196410 20741 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:12.196633 18304 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:18:12.173689 20804 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.197610 21264 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:12.088778 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 88578.5us
I20260709 13:18:12.143260 21116 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:12.200063 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:12.119603 21152 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.191306 18382 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:12.199461 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:12.166742 18926 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:12.169766 18201 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:12.239930 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 70231.4us
I20260709 13:18:12.219910 18385 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
W20260709 13:18:12.220045 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 217498us
I20260709 13:18:12.199708 20562 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:12.220448 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:12.205420 18307 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:12.182282 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.245213 18309 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 5: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:12.186280 18131 catalog_manager.cc:5697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.258194 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:12.259582 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:12.261142 18131 catalog_manager.cc:5697] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 4 to 7, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New cstate: current_term: 5 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.262018 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:12.263055 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:12.263693 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:18:12.264624 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 44256.7us
I20260709 13:18:12.265329 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:12.266856 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:12.267030 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:12.267524 18386 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.268110 18382 raft_consensus.cc:2410] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:12.270440 18378 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:12.270829 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:12.262893 18131 catalog_manager.cc:5697] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.272471 18201 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:12.181954 21227 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.272262 18131 catalog_manager.cc:5697] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 3 to 4, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 4 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:12.278592 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 111940us
I20260709 13:18:12.192546 21216 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:12.279168 18385 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:12.180541 21276 raft_consensus.cc:697] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:18:12.270653 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 71281.5us
I20260709 13:18:12.176782 21233 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:12.318063 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:12.318161 18386 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:18:12.318706 18229 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
W20260709 13:18:12.279690 18202 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.996s (SENT)
I20260709 13:18:12.310575 18378 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:12.257727 21206 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:12.314057 18927 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:12.265858 21241 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:12.324625 18927 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:12.282109 18379 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:12.269647 20833 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:12.314778 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:12.319379 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:12.273259 21259 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:12.266110 21229 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:12.273490 21191 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:12.280289 21211 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:12.310037 21148 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:12.257299 20829 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.269467 21013 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:18:12.178658 21274 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:12.278676 21155 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:12.316386 21200 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:12.238974 21270 consensus_queue.cc:1059] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:18:12.328593 21241 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.332454 21233 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:12.317523 20710 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:12.328250 21206 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:12.264927 21261 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:18:12.351764 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:12.265206 21152 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:12.365247 21206 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:12.367264 21152 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:12.370165 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.371343 21272 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.372620 18384 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:12.371986 21276 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:12.374025 18301 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b14d7467c934fdca91c8a466ef2d764 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 5)) from {username='slave'} at 127.0.0.1:43780
I20260709 13:18:12.334370 21259 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:12.376443 21259 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:12.354146 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 74495.2us
I20260709 13:18:12.280058 21230 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:18:12.357257 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:12.350638 21222 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.359863 21270 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:12.360387 21200 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:12.364652 21277 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:12.383881 18309 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
W20260709 13:18:12.381695 18202 leader_election.cc:336] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.948s (SENT)
I20260709 13:18:12.345351 21225 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:12.385236 18133 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39284 (request call id 173) took 22771 ms (client timeout 15000 ms). Trace:
I20260709 13:18:12.327733 21157 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:18:12.330134 21002 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:18:12.345207 21226 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:12.348845 21148 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.392397 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:12.347657 20833 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:18:12.398207 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.402905 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 45750.4us
I20260709 13:18:12.356832 21233 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:12.356612 21241 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:12.425688 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:12.442045 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 176753us
I20260709 13:18:12.449223 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:12.390188 21223 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:12.390395 21277 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.389357 21271 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:12.484591 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 59013.8us
W20260709 13:18:12.393882 18133 rpcz_store.cc:269] 0709 13:17:49.614480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.616403 (+  1923us) service_pool.cc:224] Handling call
0709 13:18:12.385138 (+22768735us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:10.170008 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:10.190315 (+ 20307us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:10.190372 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:18:10.190424 (+    52us) tablet.cc:662] Decoding operations
0709 13:18:10.191247 (+   823us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:10.191351 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:10.191400 (+    49us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:18:10.191937 (+   537us) tablet.cc:701] Row locks acquired
0709 13:18:10.191963 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:18:10.192162 (+   199us) write_op.cc:270] Start()
0709 13:18:10.192311 (+   149us) write_op.cc:276] Timestamp: P: 1783603090192098 usec, L: 0
0709 13:18:10.192339 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:18:10.272939 (+ 80600us) log.cc:844] Serialized 1776 byte log entry
0709 13:18:10.445218 (+172279us) op_driver.cc:464] REPLICATION: finished
0709 13:18:10.617441 (+172223us) write_op.cc:301] APPLY: starting
0709 13:18:10.629168 (+ 11727us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:10.643096 (+ 13928us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:10.689995 (+ 46899us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:10.744686 (+ 54691us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:10.744904 (+   218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:18:10.744953 (+    49us) write_op.cc:312] APPLY: finished
0709 13:18:10.835118 (+ 90165us) log.cc:844] Serialized 40 byte log entry
0709 13:18:10.852267 (+ 17149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:10.855876 (+  3609us) write_op.cc:454] Released schema lock
0709 13:18:10.857406 (+  1530us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:10.889977 (+ 32571us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:10.890008 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":128761,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":166746,"apply.run_cpu_time_us":4309,"apply.run_wall_time_us":260601,"num_ops":4,"prepare.queue_time_us":194381,"prepare.run_cpu_time_us":4722,"prepare.run_wall_time_us":127153,"replication_time_us":252667,"thread_start_us":264061,"threads_started":2}]]}
I20260709 13:18:12.388231 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:12.386207 21270 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:12.386940 21264 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:12.493022 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 43879.8us
I20260709 13:18:12.342240 21191 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.422127 21175 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:12.496229 21170 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:12.427692 21148 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.498387 21283 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:12.390129 21200 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.390369 21222 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.554229 21206 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:12.508761 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.494617 21223 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.561046 21223 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:12.423434 21226 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.564749 21226 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:12.514370 20562 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:12.566447 20562 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.445192 21233 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:12.481521 21193 consensus_meta.cc:287] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 13:18:12.483003 21216 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:12.533274 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:12.534251 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:12.513191 21277 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.577386 18957 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:12.576965 21216 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.580070 21216 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:12.538630 21274 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:12.542759 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:12.540791 21175 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.545387 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:12.550324 21283 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.555433 21222 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:12.508253 21272 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:12.546355 21170 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:12.597515 21170 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.525609 21271 raft_consensus.cc:697] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:12.598887 21271 consensus_queue.cc:237] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:12.581107 18235 raft_consensus.cc:2410] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:12.537182 20833 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.583745 18121 catalog_manager.cc:5028] TS 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): tablet 2b14d7467c934fdca91c8a466ef2d764 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:18:12.523592 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:12.606520 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 272538us
W20260709 13:18:12.607025 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 83551.1us
W20260709 13:18:12.591336 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 48630.4us
I20260709 13:18:12.593384 18305 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.594501 21283 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:12.592486 21264 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:12.594393 21175 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:12.614835 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:12.614982 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 233320us
I20260709 13:18:12.617291 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:12.617738 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.619722 21002 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:12.620062 21208 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.620676 18230 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:18:12.620558 21208 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.621433 18229 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:18:12.622334 21285 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:18:12.622633 21208 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:12.607682 21211 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:12.623579 20829 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:12.623857 18307 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:12.624086 21211 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.626036 21193 raft_consensus.cc:3055] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:12.626410 21193 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:12.613613 21155 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:12.628091 21155 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.630182 21155 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:12.612577 21157 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.621100 18230 pending_rounds.cc:85] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 3
I20260709 13:18:12.631120 21157 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.631647 18230 pending_rounds.cc:107] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:18:12.631939 18230 raft_consensus.cc:2889] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:12.632100 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:12.632745 18380 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.633397 21157 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:12.612610 21219 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:18:12.627254 21193 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.635383 21219 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:12.635753 21219 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:12.607975 20741 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:12.636575 21264 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:12.638247 21191 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:12.635864 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:12.643970 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:12.646625 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.647789 18234 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:12.643281 18276 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:12.656697 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:12.658638 18305 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:18:12.658393 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:12.655315 18200 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:12.661504 18384 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:18:12.661898 18384 pending_rounds.cc:85] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 4
I20260709 13:18:12.661759 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.662113 18384 pending_rounds.cc:107] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:18:12.662400 18384 raft_consensus.cc:2889] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:12.663862 18380 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:18:12.659335 18234 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
I20260709 13:18:12.636013 21193 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.665441 18926 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:12.660200 18311 pending_rounds.cc:85] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 3
W20260709 13:18:12.666776 18202 leader_election.cc:336] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.180s (SENT)
I20260709 13:18:12.714447 18311 pending_rounds.cc:107] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:18:12.714937 18311 raft_consensus.cc:2889] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:12.712706 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.670639 21200 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:12.656354 21264 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:12.714666 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:12.674305 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.661098 21157 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:12.727270 21292 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:18:12.719770 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54384us
I20260709 13:18:12.587287 21277 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:12.703867 18234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:12.733676 18234 raft_consensus.cc:606] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:12.734140 18234 raft_consensus.cc:614] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:12.734167 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:12.735257 18384 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:12.736975 21168 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:12.656656 20741 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:18:12.723507 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.735172 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.724344 21115 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:12.671954 21191 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:12.731192 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 90598.6us
I20260709 13:18:12.755367 18351 leader_election.cc:400] T 80d0760748294d8d8cb291466766b8a5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 4. Current term is 6.
I20260709 13:18:12.721218 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:12.716902 18304 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:12.748991 20562 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:12.749769 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.776757 18385 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:12.613257 21270 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.727658 21264 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:12.780979 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:12.789441 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:12.790894 20562 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:12.790840 21241 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.791767 21200 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:12.792989 18232 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:12.799639 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:12.803284 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:12.801692 21115 raft_consensus.cc:697] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:18:12.804726 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 70485.7us
I20260709 13:18:12.809036 18310 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:18:12.809760 18310 pending_rounds.cc:85] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 3
I20260709 13:18:12.810104 18310 pending_rounds.cc:107] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:12.810402 18310 raft_consensus.cc:2889] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:12.722458 21225 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:18:12.811826 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.806316 18305 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:18:12.817008 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.827798 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.828051 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.829159 18305 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:12.780905 21191 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:12.831377 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.803280 21264 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.837116 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.838106 18305 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:12.835044 18310 raft_consensus.cc:2368] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
I20260709 13:18:12.809449 21157 raft_consensus.cc:697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:12.800128 21148 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:12.841529 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:12.843179 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 51732.7us
I20260709 13:18:12.834378 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:12.852581 18234 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:12.830636 21270 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:12.854499 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:12.854888 18305 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:12.849261 18310 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:18:12.836678 20994 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:12.857818 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 191074us
I20260709 13:18:12.864570 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:12.874367 18306 raft_consensus.cc:2410] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:12.833175 21191 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:12.880677 18383 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:18:12.881134 18383 pending_rounds.cc:85] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 6
I20260709 13:18:12.881390 18383 pending_rounds.cc:107] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:18:12.881646 18383 raft_consensus.cc:2889] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:12.881745 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:12.882746 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:12.883455 18384 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:12.880808 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:12.885341 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:12.886162 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:12.887229 18234 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.895594 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:12.898437 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:12.877580 21206 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:12.905445 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:12.877735 20804 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:12.916905 18237 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:18:12.917299 18237 pending_rounds.cc:85] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 3
I20260709 13:18:12.917527 18237 pending_rounds.cc:107] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:18:12.917459 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:12.917901 18237 raft_consensus.cc:2889] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:12.920461 21301 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:18:12.858690 21268 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:18:12.921662 21225 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:12.922624 21225 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:12.921991 21297 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:18:12.929734 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1484) took 1326 ms. Trace:
I20260709 13:18:12.930320 18235 rpcz_store.cc:276] 0709 13:18:11.590507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.590655 (+   148us) service_pool.cc:224] Handling call
0709 13:18:12.916238 (+1325583us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b5400059e54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:12.916444 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2274291456}
I20260709 13:18:12.869645 20829 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:18:12.803370 21219 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.899892 21145 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:12.934193 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 93679.1us
W20260709 13:18:12.969230 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 90245.6us
I20260709 13:18:12.937840 18383 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:18:12.970088 18383 pending_rounds.cc:85] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 3
I20260709 13:18:12.970394 18383 pending_rounds.cc:107] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:12.970621 18383 raft_consensus.cc:2889] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:12.942309 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.967664 18234 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:12.972527 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:12.932477 18955 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 5: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:18:12.884017 21170 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:12.976992 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:12.912415 21229 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:12.882969 20994 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:12.985018 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 86633.3us
I20260709 13:18:12.900281 21261 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:18:12.909448 21155 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:18:12.993144 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:12.984839 18276 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:18:13.184427 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 183033us
I20260709 13:18:13.146746 18384 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:13.328439 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:13.244648 21302 log.cc:927] Time spent T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
W20260709 13:18:13.032248 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.331866 20562 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.332396 20562 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:13.334048 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.963299 21206 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.162675 18304 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:13.131174 18235 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:12.905989 21115 consensus_queue.cc:237] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:12.969519 21145 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.989379 21229 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:18:13.074414 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.073031 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.311619 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 317535us
I20260709 13:18:13.188275 21241 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:13.372871 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 388062us
I20260709 13:18:13.374001 18276 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:13.243769 21303 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
W20260709 13:18:13.324744 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 327046us
I20260709 13:18:13.375865 20562 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:13.375873 18201 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:13.227120 21277 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:13.335698 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:12.992893 21157 consensus_queue.cc:237] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:13.353188 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:13.324688 21259 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.147715 21223 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:13.354521 21206 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:13.320031 21101 consensus_queue.cc:1059] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:18:13.373597 21229 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:13.405274 20994 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:13.367322 21145 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:13.339001 21258 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:18:13.386407 18235 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:13.356148 21200 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.419049 18234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:13.405757 21319 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:13.423807 21270 consensus_meta.cc:287] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.543s	user 0.017s	sys 0.001s
I20260709 13:18:13.430770 18234 raft_consensus.cc:606] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:13.442691 18234 raft_consensus.cc:614] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:13.443675 20837 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:18:13.444416 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 70549.7us
W20260709 13:18:13.384966 21233 consensus_meta.cc:287] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.815s	user 0.010s	sys 0.005s
I20260709 13:18:13.416885 21241 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:13.405810 21148 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:13.382645 21310 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:13.456156 21306 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.105s	user 0.001s	sys 0.001s
I20260709 13:18:13.456482 21310 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.456907 21310 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:13.446111 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 117774us
I20260709 13:18:13.374521 21313 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:18:13.451138 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:13.492247 18386 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 5: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:13.454109 20829 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:13.460049 18234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:13.467947 21002 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:13.475399 21305 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.299s	user 0.000s	sys 0.002s
W20260709 13:18:13.479154 21309 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.175s	user 0.000s	sys 0.002s
I20260709 13:18:13.503859 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:13.495574 18234 raft_consensus.cc:606] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:13.504906 18234 raft_consensus.cc:614] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:13.507249 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:13.450496 20837 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:13.508826 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:13.509948 18231 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:13.501917 18306 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:13.516338 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:13.511524 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:13.517518 18305 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:13.512029 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:13.519515 18234 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:18:13.417802 21259 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:13.521250 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:13.524976 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:13.525313 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:13.526818 18309 raft_consensus.cc:2393] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:13.440060 21200 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:13.529394 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:13.531826 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:13.504402 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:13.502554 21241 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:13.534127 18310 raft_consensus.cc:2368] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6.
I20260709 13:18:13.501027 21002 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:13.493614 21320 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:13.543570 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:13.539871 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:13.539268 21208 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:13.514081 21230 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.459247 21233 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:13.555877 18310 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:13.556489 18309 raft_consensus.cc:2368] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
I20260709 13:18:13.538329 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:13.564730 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 188961us
I20260709 13:18:13.566895 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:13.567915 18306 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:13.569476 18306 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:13.577764 18305 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:13.507725 21225 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:13.536278 21241 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.453038 21319 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:13.591585 18380 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:18:13.600842 18380 pending_rounds.cc:85] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 4
W20260709 13:18:13.583060 21226 consensus_meta.cc:287] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 1.018s	user 0.007s	sys 0.006s
I20260709 13:18:13.574414 21313 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:13.601286 18380 pending_rounds.cc:107] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:18:13.607367 18380 raft_consensus.cc:2889] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:13.574242 21170 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:13.610424 18229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:13.611269 18229 raft_consensus.cc:606] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:13.575063 21230 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:13.600907 21241 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:13.636653 20562 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:18:13.609150 21175 consensus_meta.cc:287] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.953s	user 0.013s	sys 0.000s
I20260709 13:18:13.640930 20562 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:13.589462 21323 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:13.573242 21211 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 13:18:13.652415 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 123093us
I20260709 13:18:13.574558 21320 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:13.622834 21002 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:13.659157 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 90199.5us
I20260709 13:18:13.667651 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:13.610565 21226 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:13.616181 20937 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:18:13.647989 21223 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:13.657557 21206 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:13.655076 21170 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:13.673352 21283 consensus_meta.cc:287] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 1.039s	user 0.013s	sys 0.011s
W20260709 13:18:13.690963 21308 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:18:13.696424 18312 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:13.647872 21175 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:13.707307 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 198374us
I20260709 13:18:13.708670 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:13.713296 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:13.715881 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:13.718385 18378 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:13.719262 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:13.720175 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.730783 21313 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:13.734690 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:13.736690 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:13.737669 18309 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:18:13.738899 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:13.739825 18309 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:13.743637 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:13.762022 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:13.674784 21225 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:18:13.706326 21330 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.762766 18380 raft_consensus.cc:1813] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Handling vote request from an unknown peer b52e2477fc524694967c4a16afa983e3
I20260709 13:18:13.769773 18380 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 6: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:13.765641 20833 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.763367 18306 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:18:13.772357 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 112606us
I20260709 13:18:13.693058 21170 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:13.766940 21211 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:13.708997 21283 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:13.789683 18308 raft_consensus.cc:2368] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10.
I20260709 13:18:13.791098 21283 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:13.798031 20562 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:13.805368 21319 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:13.807868 21325 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:18:13.810963 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.722179 21223 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:18:13.819801 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:13.772859 21259 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:13.825254 18309 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:13.767544 20829 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:18:13.834499 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:13.835125 18309 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:13.784622 21200 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:13.811733 20937 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:13.842743 21280 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:13.842468 21327 consensus_queue.cc:1059] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.121s
W20260709 13:18:13.843911 21328 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:18:13.851646 21170 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:13.852187 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1497) took 1233 ms. Trace:
I20260709 13:18:13.841144 21338 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.814401 21233 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:13.781783 20833 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:13.869761 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:13.871111 18229 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:13.864434 18228 rpcz_store.cc:276] 0709 13:18:12.618491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.656082 (+ 37591us) service_pool.cc:224] Handling call
0709 13:18:12.713869 (+ 57787us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.730999 (+ 17130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.731034 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.468739 (+737705us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b2c000014c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:18:13.469234 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.644309 (+175075us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:13.664094 (+ 19785us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.679414 (+ 15320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.679524 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.791559 (+112035us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b18000ae100. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f186522 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:18:13.851941 (+ 60382us) raft_consensus.cc:1685] finished
0709 13:18:13.851967 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.852122 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101921,"prepare.queue_time_us":21874,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":48,"raft.queue_time_us":34663,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":10498,"spinlock_wait_cycles":32157952,"thread_start_us":174757,"threads_started":1,"wal-append.queue_time_us":302999}
I20260709 13:18:13.773100 21330 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:13.877872 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1493) took 1260 ms. Trace:
I20260709 13:18:13.878454 18237 rpcz_store.cc:276] 0709 13:18:12.617367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.617963 (+   596us) service_pool.cc:224] Handling call
0709 13:18:12.916556 (+298593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.918326 (+  1770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.877571 (+959245us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b5400059e50. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:13.877786 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685885824}
I20260709 13:18:13.867728 21280 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:13.901517 18310 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:13.871119 21230 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:13.869168 20937 raft_consensus.cc:697] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:13.916167 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:13.938572 18310 raft_consensus.cc:1813] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Handling vote request from an unknown peer b52e2477fc524694967c4a16afa983e3
I20260709 13:18:13.939106 18310 raft_consensus.cc:2368] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7.
I20260709 13:18:13.940147 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:13.941562 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:13.943154 18310 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:13.920413 18306 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:13.870846 21338 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:13.945616 18309 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:13.889446 21157 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.922466 21145 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:13.924791 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:13.928655 21193 consensus_meta.cc:287] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.217s	user 0.005s	sys 0.009s
I20260709 13:18:13.948935 18237 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:13.926594 21330 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:13.927017 21310 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:13.914904 21304 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:18:13.937736 21335 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:18:13.977530 18201 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:13.930897 21223 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:13.961925 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:13.986025 18382 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 4: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:13.946360 21226 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:13.963536 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1490) took 1347 ms. Trace:
I20260709 13:18:13.991186 18233 rpcz_store.cc:276] 0709 13:18:12.616403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.616987 (+   584us) service_pool.cc:224] Handling call
0709 13:18:13.963288 (+1346301us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54001888d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:13.963466 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271434112}
I20260709 13:18:13.963641 21280 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:13.967860 21191 consensus_meta.cc:287] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.092s	user 0.011s	sys 0.000s
I20260709 13:18:13.969192 18386 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:13.994057 18229 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:13.970233 21338 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:13.971379 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1915) took 1325 ms. Trace:
I20260709 13:18:13.971875 21304 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:13.972640 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 1919) took 1304 ms. Trace:
I20260709 13:18:14.004997 18232 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:13.973941 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:13.966750 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1914) took 1322 ms. Trace:
I20260709 13:18:13.974872 21219 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:13.975324 21170 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.016976 21170 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:14.019158 21170 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:13.975857 18304 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:13.994171 21193 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:13.959685 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.021174 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.023875 18381 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:14.020398 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1496) took 1402 ms. Trace:
I20260709 13:18:14.000206 18303 rpcz_store.cc:276] 0709 13:18:12.646027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.646134 (+   107us) service_pool.cc:224] Handling call
0709 13:18:12.672339 (+ 26205us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:12.719752 (+ 47413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.719782 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:12.724368 (+  4586us) log.cc:844] Serialized 52 byte log entry
0709 13:18:12.899108 (+174740us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:12.899560 (+   452us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.906153 (+  6593us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.321245 (+415092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.321331 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.487690 (+166359us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b18003f87a0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:18:13.971135 (+483445us) raft_consensus.cc:1685] finished
0709 13:18:13.971164 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.971317 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":998512,"prepare.queue_time_us":56638,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":5891,"raft.queue_time_us":52526,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":10430,"spinlock_wait_cycles":8224384,"thread_start_us":515719,"threads_started":2,"wal-append.queue_time_us":646227}
I20260709 13:18:13.981191 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:14.025990 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:13.962728 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:14.026688 18231 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:13.993804 18305 raft_consensus.cc:2368] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8.
I20260709 13:18:14.027093 18382 raft_consensus.cc:2393] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:18:13.979401 21331 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.209s	user 0.001s	sys 0.001s
I20260709 13:18:14.030508 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:13.991634 21175 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:13.961954 20833 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:14.005991 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:14.037632 18233 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:14.010934 18237 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:14.005117 18308 rpcz_store.cc:276] 0709 13:18:12.667782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.667914 (+   132us) service_pool.cc:224] Handling call
0709 13:18:13.972413 (+1304499us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400233a54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:13.972579 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2469696768}
I20260709 13:18:14.039167 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:13.955205 21320 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:14.013089 18386 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:14.006428 18311 rpcz_store.cc:276] 0709 13:18:12.645275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.645525 (+   250us) service_pool.cc:224] Handling call
0709 13:18:12.653099 (+  7574us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:12.723419 (+ 70320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.723447 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:12.732345 (+  8898us) log.cc:844] Serialized 52 byte log entry
0709 13:18:12.986713 (+254368us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:13.965924 (+979211us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.966273 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.966427 (+   154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.966503 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.966547 (+    44us) raft_consensus.cc:1685] finished
0709 13:18:13.966560 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.966688 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1012855,"prepare.queue_time_us":968960,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":9472,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":4908,"thread_start_us":184045,"threads_started":1,"wal-append.queue_time_us":581443}
I20260709 13:18:13.935676 18202 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:14.025080 18236 rpcz_store.cc:276] 0709 13:18:12.618210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.622377 (+  4167us) service_pool.cc:224] Handling call
0709 13:18:12.622684 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.623042 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.623069 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.623530 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:18:12.669580 (+ 46050us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:12.670975 (+  1395us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.712947 (+ 41972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.713035 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.004745 (+1291710us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b18000baa60. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:18:14.020080 (+ 15335us) raft_consensus.cc:1685] finished
0709 13:18:14.020192 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.020338 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48308,"prepare.queue_time_us":432,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":50142,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":4931,"spinlock_wait_cycles":3670272,"thread_start_us":45489,"threads_started":1,"wal-append.queue_time_us":103716}
I20260709 13:18:14.045706 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:14.045737 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 110219us
I20260709 13:18:14.046335 18236 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:14.031754 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:14.046837 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:14.047408 18379 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:14.030541 18382 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:13.997921 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:13.955905 21157 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:14.048585 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:14.055454 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:14.056499 18236 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:18:14.057471 18386 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:14.058544 18927 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:14.057350 18202 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:14.025454 21226 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:14.058830 18201 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:14.062682 18231 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:14.052297 18378 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:14.068063 18202 leader_election.cc:400] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7.
I20260709 13:18:14.001008 21223 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:14.075485 18233 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:14.071604 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:14.008708 21191 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:14.081931 18231 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:14.040534 21351 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:14.092495 21353 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:14.059487 21338 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:14.095148 18237 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:18:14.095727 18201 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:14.063401 21222 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:14.012326 20937 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:14.116386 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 95639.9us
I20260709 13:18:14.055956 21269 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:18:14.077649 21226 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:14.097517 21338 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.126740 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:14.127053 21318 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:14.127976 21262 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:14.128221 18927 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:14.128710 21262 raft_consensus.cc:697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:14.129654 21262 consensus_queue.cc:237] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:14.130693 21269 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:14.131208 21269 raft_consensus.cc:697] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:14.133152 21214 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:14.133693 21214 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:14.135752 21214 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:14.131441 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1339) took 1268 ms. Trace:
I20260709 13:18:14.127878 21320 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:14.138036 18232 rpcz_store.cc:276] 0709 13:18:12.863176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.917178 (+ 54002us) service_pool.cc:224] Handling call
0709 13:18:14.131242 (+1214064us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540021dc54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:14.131367 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2387362560}
I20260709 13:18:14.066519 21175 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:14.127483 21318 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:14.078444 21230 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:18:14.126421 21338 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.124106 21211 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:14.117383 20989 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:18:14.161480 21191 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:14.098053 21351 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:14.165232 18229 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:18:14.166249 21351 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:14.153654 21318 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:14.166910 21157 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:14.117045 21319 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 13:18:14.170545 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 99061.7us
I20260709 13:18:14.143854 21320 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.167217 20829 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:14.153846 21175 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:14.157441 21264 consensus_meta.cc:287] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 1.304s	user 0.013s	sys 0.002s
I20260709 13:18:14.159570 21310 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:14.182933 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:14.187539 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:14.208153 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.172430 21320 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:14.146231 21241 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:14.223405 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 93521.5us
I20260709 13:18:14.227177 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:14.132339 21269 consensus_queue.cc:237] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:14.232893 21288 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:14.234776 21315 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.930s	user 0.003s	sys 0.002s
I20260709 13:18:14.235379 21214 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:14.235761 21223 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:14.236147 21259 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:14.189169 21211 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:18:14.237071 21321 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:14.237607 21145 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:14.237885 21321 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.181860 21170 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:14.235764 21363 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:14.238436 21321 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.238588 21170 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:14.240032 21312 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:14.240785 21346 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 13:18:14.240890 21312 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:14.242470 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:14.243116 18304 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:14.245357 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:14.240084 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:14.246803 18232 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:14.250005 18304 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:14.242657 21157 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:14.242517 18953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53364 (request call id 218) took 1891 ms (client timeout 1921 ms). Trace:
W20260709 13:18:14.256450 18953 rpcz_store.cc:269] 0709 13:18:12.351502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.352228 (+   726us) service_pool.cc:224] Handling call
0709 13:18:12.533106 (+180878us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b580005a998. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa1872390a0 00007fa187238984 00007fa1807b36d4 00007fa1807b3662
0709 13:18:14.242297 (+1709191us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b5400840154. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:14.242430 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1629952128}
I20260709 13:18:14.256964 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:14.172920 20829 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:14.259384 20562 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:14.263013 20562 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:14.263818 18304 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:14.268437 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:14.268862 21370 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:14.291401 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1498) took 1650 ms. Trace:
I20260709 13:18:14.238752 21363 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:14.294203 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:14.295073 18311 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:14.236078 21214 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:14.277832 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:14.284682 18957 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:14.240753 21170 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:14.287441 21193 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:14.185153 21264 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:14.217100 21353 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
W20260709 13:18:14.308766 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 82934.9us
I20260709 13:18:14.291865 18230 rpcz_store.cc:276] 0709 13:18:12.640998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.641523 (+   525us) service_pool.cc:224] Handling call
0709 13:18:12.672227 (+ 30704us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.713266 (+ 41039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.713298 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.789603 (+1076305us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b48001bc3d8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18719caa1 00007fa187193b37 00007fa1871939ca 00007fa18728b26f 00007fa18728af37 00007fa18729f55c 00007fa18729f508 00007fa18729f488 00007fa18729f443 00007fa18729e6ec 00007fa1861c8a96
0709 13:18:13.930516 (+140913us) spinlock_profiling.cc:243] Waited 8.13 ms on lock 0x7b2c000014c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:18:13.937795 (+  7279us) log.cc:844] Serialized 26 byte log entry
0709 13:18:14.035381 (+ 97586us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:14.072749 (+ 37368us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.083245 (+ 10496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.083325 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.291185 (+207860us) raft_consensus.cc:1685] finished
0709 13:18:14.291204 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.291339 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88236,"prepare.queue_time_us":37192,"prepare.run_cpu_time_us":6004,"prepare.run_wall_time_us":7596,"raft.queue_time_us":60203,"raft.run_cpu_time_us":5514,"raft.run_wall_time_us":1077168,"spinlock_wait_cycles":25576576,"thread_start_us":73057,"threads_started":1,"wal-append.queue_time_us":192480}
I20260709 13:18:14.316768 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:14.260932 21268 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:14.322995 18202 leader_election.cc:336] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.018s (SENT)
I20260709 13:18:14.323612 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:14.325240 18232 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:18:14.413929 18953 raft_consensus.cc:2368] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10.
I20260709 13:18:14.415256 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:14.423024 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:14.425330 21370 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:14.435343 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 112393us
I20260709 13:18:14.261473 21206 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:18:14.445559 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:14.448767 21357 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 13:18:14.450182 21359 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
W20260709 13:18:14.452244 21358 log.cc:927] Time spent T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:18:14.453953 21175 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:14.304037 18955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54020 (request call id 254) took 1956 ms (client timeout 2362 ms). Trace:
I20260709 13:18:14.314998 21170 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:14.261313 21157 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:14.473855 21363 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:14.463507 18955 rpcz_store.cc:269] 0709 13:18:12.345800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.346975 (+  1175us) service_pool.cc:224] Handling call
0709 13:18:14.260954 (+1913979us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54004a9a54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:14.292751 (+ 31797us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835109120}
W20260709 13:18:14.482264 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 213856us
I20260709 13:18:14.490686 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:14.426070 21370 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:14.441859 21226 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:14.439927 21346 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:14.507182 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:14.518394 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 265453us
I20260709 13:18:14.551808 18927 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:14.551947 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 44828.2us
I20260709 13:18:14.511826 21280 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.569020 21280 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:14.571149 21280 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:14.504868 21170 raft_consensus.cc:697] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:14.429476 21268 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:14.516852 21303 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:18:14.600976 21192 raft_consensus.cc:3055] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:14.602602 21241 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:14.480109 21214 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:15.184872 18351 connection.cc:256] RPC call timeout handler was delayed by -1.6416373950000889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
I20260709 13:18:14.861686 21206 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.185985 20562 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:14.617507 18311 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:18:15.186744 20562 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:14.559366 21341 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:18:14.652635 21352 log.cc:927] Time spent T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.733s	user 0.004s	sys 0.000s
I20260709 13:18:15.187630 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:14.610133 21157 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:14.748847 21222 consensus_meta.cc:287] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.628s	user 0.007s	sys 0.005s
I20260709 13:18:14.693861 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:15.189718 21222 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:14.779291 21229 consensus_meta.cc:287] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 1.348s	user 0.005s	sys 0.008s
I20260709 13:18:15.191061 21192 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:15.191272 21229 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:14.949779 21268 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:14.654873 21338 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.192265 21192 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:14.677161 21264 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:15.193197 21370 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:15.133198 18378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.005s	sys 0.017s
W20260709 13:18:15.194036 18378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.006s	sys 0.017s
I20260709 13:18:14.561724 21259 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:15.195119 21259 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:15.195868 21259 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:14.710222 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:15.197989 18310 raft_consensus.cc:2376] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10. Re-sending same reply.
I20260709 13:18:14.696823 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1509) took 1187 ms. Trace:
I20260709 13:18:14.605003 20837 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:14.587604 21343 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.623s
I20260709 13:18:14.677294 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:14.709619 21280 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.483s
I20260709 13:18:14.724711 21320 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.193835 21192 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.193684 21229 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:14.997956 21312 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:14.654477 21170 consensus_queue.cc:237] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:15.204906 18229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1522) took 1210 ms (client timeout 1561 ms). Trace:
I20260709 13:18:15.205205 20562 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:15.201058 18304 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:18:14.810608 21219 consensus_meta.cc:287] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.786s	user 0.013s	sys 0.000s
I20260709 13:18:15.199934 18235 rpcz_store.cc:276] 0709 13:18:13.509081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.510100 (+  1019us) service_pool.cc:224] Handling call
0709 13:18:13.510443 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.510871 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.510911 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.511474 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.686365 (+174891us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:13.730336 (+ 43971us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.730580 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.732078 (+  1498us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.677435 (+945357us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b18003bffe0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:18:14.696305 (+ 18870us) raft_consensus.cc:1685] finished
0709 13:18:14.696487 (+   182us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.696743 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23465,"prepare.queue_time_us":77429,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":87798,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":27523,"spinlock_wait_cycles":4231424,"thread_start_us":119271,"threads_started":2,"wal-append.queue_time_us":248838}
I20260709 13:18:14.610288 20829 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:14.923424 20804 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:18:15.212347 18229 rpcz_store.cc:269] 0709 13:18:13.994896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.997620 (+  2724us) service_pool.cc:224] Handling call
0709 13:18:15.202928 (+1205308us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540037e6d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:15.204822 (+  1894us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268373376}
I20260709 13:18:15.215188 20837 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:15.186026 21206 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:15.220256 21168 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:15.226171 21168 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:15.227465 21206 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:14.730696 21371 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:15.223163 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 429) took 1041 ms. Trace:
I20260709 13:18:15.222347 21208 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.228897 18378 rpcz_store.cc:276] 0709 13:18:14.182065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.182727 (+   662us) service_pool.cc:224] Handling call
0709 13:18:14.183033 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:14.191468 (+  8435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.191519 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:14.192200 (+   681us) log.cc:844] Serialized 26 byte log entry
0709 13:18:14.480608 (+288408us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b180046ab00. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:18:15.194544 (+713936us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:15.194594 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.194667 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:15.222863 (+ 28196us) raft_consensus.cc:1685] finished
0709 13:18:15.222885 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.223098 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10800,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":11156,"spinlock_wait_cycles":9037440,"thread_start_us":713733,"threads_started":1,"wal-append.queue_time_us":970279}
I20260709 13:18:15.227425 21168 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.230741 21208 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.214124 21157 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.677434 21321 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:15.232604 21318 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.065s	user 0.014s	sys 0.000s
I20260709 13:18:15.232892 21346 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:15.236173 21002 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:15.242982 18960 raft_consensus.cc:2368] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6.
I20260709 13:18:15.234549 21371 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:15.238713 21168 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.241315 21318 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.239152 21206 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:15.231683 20804 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.256868 21338 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.257851 21206 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.261557 21321 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:15.261855 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.263196 20562 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.264788 18351 leader_election.cc:400] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
I20260709 13:18:15.248469 21219 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:15.266619 20562 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.261917 20829 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.267223 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:15.254249 21280 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:15.236475 21157 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.244867 21346 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.264184 21264 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:15.274363 20562 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:15.274780 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:15.275317 18310 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:15.279215 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:15.279851 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:15.280033 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:15.280198 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:15.280294 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:15.280865 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:15.281505 18378 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:15.281931 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:15.281689 21371 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.276360 18303 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:15.275717 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:15.277755 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:15.275676 18308 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:18:15.282073 21229 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:15.265103 21370 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:15.283806 18304 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:15.299180 18309 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.271430 21377 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.302641 20562 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:15.308324 18378 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:15.272058 21312 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:15.309249 18309 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:15.303128 20562 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:15.270315 21219 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.313230 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.335078 18378 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:15.273775 21280 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:15.301016 21378 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:15.272344 20829 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:15.338485 21219 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.338860 20829 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:15.340137 20829 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.340596 20829 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:15.342633 20562 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:15.343314 20562 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:15.347919 21206 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:15.278519 21264 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.303838 21229 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.335886 21320 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.311506 21318 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.361231 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:15.362326 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:15.363058 18235 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
W20260709 13:18:15.363387 18312 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 1917) took 2716 ms (client timeout 2199 ms). Trace:
I20260709 13:18:15.364126 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:15.363785 18312 rpcz_store.cc:269] 0709 13:18:12.646558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.647492 (+   934us) service_pool.cc:224] Handling call
0709 13:18:15.363161 (+2715669us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000bccd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:15.363309 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2377770368}
I20260709 13:18:15.365790 18235 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:15.367702 18234 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:15.368064 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:15.368817 18230 raft_consensus.cc:2410] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:15.369653 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:15.358398 21307 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 2.071s	user 0.017s	sys 0.001s
I20260709 13:18:15.371130 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:15.373621 21320 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:18:15.374418 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.374940 18229 raft_consensus.cc:2393] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 6: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:15.378082 21323 raft_consensus.cc:993] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:18:15.375541 21320 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.380328 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 1933) took 1646 ms. Trace:
I20260709 13:18:15.376130 21157 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.381374 21157 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:15.381868 21157 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.383179 21268 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.383706 21268 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.357276 21229 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.372557 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:15.358399 21346 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.380736 18305 rpcz_store.cc:276] 0709 13:18:13.734335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.734463 (+   128us) service_pool.cc:224] Handling call
0709 13:18:15.380161 (+1645698us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b5400234954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:15.380276 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593941248}
I20260709 13:18:15.378907 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1911) took 2735 ms. Trace:
I20260709 13:18:15.386119 18307 rpcz_store.cc:276] 0709 13:18:12.643788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.645704 (+  1916us) service_pool.cc:224] Handling call
0709 13:18:12.715804 (+ 70100us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:12.717860 (+  2056us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:12.733442 (+ 15582us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.918299 (+184857us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:12.957511 (+ 39212us) log.cc:844] Serialized 52 byte log entry
0709 13:18:12.957682 (+   171us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:13.960578 (+1002896us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b180038fc80. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa185c6b3c7 00007fa18227d9a7 00007fa18228d0bf 00007fa18228d038
0709 13:18:13.960824 (+   246us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.961178 (+   354us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.961342 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.961510 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:15.357827 (+1396317us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:15.378644 (+ 20817us) raft_consensus.cc:1685] finished
0709 13:18:15.378670 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.378836 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26961,"prepare.queue_time_us":1030388,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":98,"raft.queue_time_us":40939,"raft.run_cpu_time_us":470,"raft.run_wall_time_us":32116,"spinlock_wait_cycles":94361728,"thread_start_us":121612,"threads_started":1,"wal-append.queue_time_us":201436}
I20260709 13:18:15.357319 21259 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.390383 18383 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:15.385972 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.374241 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:15.391794 18235 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:15.372270 18234 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
W20260709 13:18:15.393796 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.312474 21377 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.307240 21370 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.389825 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:15.392058 21323 raft_consensus.cc:1081] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:18:15.315203 21312 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:15.395853 18378 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:15.397487 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:15.398363 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.399492 18385 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:15.377058 20804 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.408087 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.410143 18378 raft_consensus.cc:2410] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:15.411602 18235 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:15.411803 18228 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:15.406402 21318 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:15.414609 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.415082 21259 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:15.414870 21318 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.415596 21214 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:15.416476 21214 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.417718 21318 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.401912 21304 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.405364 20837 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.413214 20804 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:15.438485 21157 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.439152 21157 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:15.410991 21346 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.439713 21346 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.439617 21157 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.433431 21280 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:15.434921 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.436209 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.437273 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.449941 18381 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
W20260709 13:18:15.450152 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 169956us
I20260709 13:18:15.437889 21312 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:15.438889 20804 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.429454 21264 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:15.423768 21320 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.441320 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:15.441685 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.448755 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 351) took 1476 ms. Trace:
I20260709 13:18:15.411875 20829 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:15.459201 18233 rpcz_store.cc:276] 0709 13:18:13.971859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.120289 (+148430us) service_pool.cc:224] Handling call
0709 13:18:15.203065 (+1082776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.203291 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.203318 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.203363 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:15.203394 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.203454 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.448530 (+245076us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540037e6d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:15.448679 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2483242880}
I20260709 13:18:15.462056 21346 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:15.453840 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 175982us
I20260709 13:18:15.470253 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:15.470923 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:15.471724 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:15.471777 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:15.472944 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.472960 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:15.473892 18961 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:18:15.474788 21264 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:15.475281 21264 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.477434 21264 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:15.477927 21264 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:15.478391 21264 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.483232 21157 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.485670 18349 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:15.487802 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.488458 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.489096 18383 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:15.467193 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:15.490373 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.490936 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.493624 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.494393 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.497227 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:15.498143 18382 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:15.498811 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:15.499505 21377 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:15.500456 18384 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:15.501185 18379 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:15.502943 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:15.504609 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:15.505333 18384 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:15.506604 18381 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:15.491097 18385 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:15.515036 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.515606 21259 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.516736 18960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54004 (request call id 315) took 1260 ms. Trace:
I20260709 13:18:15.517170 18960 rpcz_store.cc:276] 0709 13:18:14.255969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.321256 (+ 65287us) service_pool.cc:224] Handling call
0709 13:18:15.512493 (+1191237us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54001f63d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:15.516661 (+  4168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875679104}
I20260709 13:18:15.517674 20804 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.480429 21264 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:15.520378 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.516033 18377 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 8: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:15.518657 18230 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:15.438457 21214 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.523264 18383 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
W20260709 13:18:15.523797 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 56725.8us
I20260709 13:18:15.529871 20562 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:15.530082 18351 leader_election.cc:400] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6.
I20260709 13:18:15.531149 18351 leader_election.cc:403] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:15.531222 20562 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:15.532770 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:15.532693 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 68283.2us
I20260709 13:18:15.533939 18383 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:15.536846 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:15.537549 18232 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.539147 18383 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:15.504304 21157 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.543987 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:15.520152 21371 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:15.544735 18305 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:15.549371 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:15.533943 18382 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:15.544318 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:15.549768 20562 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:15.448920 20837 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.560042 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:15.561391 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:15.562201 21170 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:15.562953 21170 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:15.563346 21170 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:15.563752 21170 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:15.565412 18232 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:18:15.538690 21264 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6.
I20260709 13:18:15.508718 21229 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.570340 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:15.575502 18351 leader_election.cc:400] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
I20260709 13:18:15.575868 18351 leader_election.cc:403] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:15.577610 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:15.571548 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.581812 18382 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:15.576491 20562 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
W20260709 13:18:15.588994 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.589224 18927 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:15.574512 18384 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:15.575163 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:15.589470 20562 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:15.537385 21280 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:18:15.568821 21342 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:15.588178 21383 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:18:15.597764 21377 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:15.598219 21377 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:15.599077 21377 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.594933 20804 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:15.572268 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:15.606859 20804 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.607970 21383 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:15.608669 21383 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:15.588584 21214 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:15.609712 21383 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.610535 21214 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.611050 21383 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:15.588464 21370 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:15.570732 21274 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:18:15.613811 21229 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.614405 20804 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.607982 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.608887 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.615981 18383 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:15.618505 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.620012 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.620748 18377 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:15.600301 21377 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:15.614696 21342 raft_consensus.cc:697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:18:15.627916 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 89108.9us
I20260709 13:18:15.619197 18385 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:15.634861 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:15.553906 21157 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.591744 21288 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:18:15.636053 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:15.636823 18377 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.637380 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.638262 18382 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:15.637676 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:15.591931 21380 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:15.678115 18277 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:15.615046 21321 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:15.588667 21312 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:18:15.714898 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:15.617810 21168 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:15.639210 18384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46844
W20260709 13:18:15.779930 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:15.781920 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.859241 18384 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:15.859925 18384 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:15.792974 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 70897.6us
W20260709 13:18:15.864557 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 249733us
W20260709 13:18:15.867825 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.637102 21370 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:15.883291 18385 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:18:15.892575 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 350593us
I20260709 13:18:15.680071 21268 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.795709 21321 raft_consensus.cc:697] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:15.671030 21386 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:15.679466 21280 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:15.899132 21321 consensus_queue.cc:237] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:15.900132 18378 raft_consensus.cc:3055] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:15.900609 18378 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:15.901510 18378 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.902539 18378 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:15.899174 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:15.818969 21380 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:15.915140 18377 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:18:15.916963 18384 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.926776 18378 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:18:15.927392 18378 pending_rounds.cc:85] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 5
I20260709 13:18:15.927696 18378 pending_rounds.cc:107] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:18:15.928025 18378 raft_consensus.cc:2889] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:15.903581 18385 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:15.750792 21249 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.162s
I20260709 13:18:15.892208 21214 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:15.965237 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:15.964847 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 71201us
I20260709 13:18:15.793229 21168 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:15.975699 18384 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:15.943559 21268 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:15.942739 21382 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:15.891752 21370 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.979969 20837 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:15.916100 21342 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:15.996901 21380 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:15.951967 21271 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:18:15.984403 21268 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.972378 21343 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:18:16.041141 18229 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:18:16.041869 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.043555 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:16.047767 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.053057 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:16.057070 18232 raft_consensus.cc:2410] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:16.058365 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:16.059412 18233 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
W20260709 13:18:16.064920 18351 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.129:43781 timed out after 1.510s (SENT) [suppressed 23 similar messages]
I20260709 13:18:16.036597 21268 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:16.074664 18229 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
W20260709 13:18:16.078226 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:16.088610 21393 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:18:16.088920 21395 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:18:16.091521 21157 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:16.103044 21392 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:18:16.104502 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:16.108908 21371 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:16.112178 21396 log.cc:927] Time spent T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:16.088670 21002 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.144388 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:16.153116 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:16.156805 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 52008.1us
I20260709 13:18:16.160775 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:16.181736 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:16.155593 21191 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:16.191509 21268 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:16.217175 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:16.220016 18230 raft_consensus.cc:2410] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:18:16.200435 21170 consensus_meta.cc:287] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.004s
I20260709 13:18:16.234679 21191 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:16.235507 21170 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:16.168861 21259 consensus_meta.cc:287] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.007s
I20260709 13:18:16.237478 18229 raft_consensus.cc:2410] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:16.204250 21371 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:16.202198 21377 consensus_meta.cc:287] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.004s
I20260709 13:18:16.258610 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:16.263082 18228 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:16.267081 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:16.143368 21353 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:16.267781 18235 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:16.266518 18230 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:16.245748 21259 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:16.299463 18230 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:16.301002 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:16.211793 21002 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:16.311828 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.323238 18230 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:16.323738 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 345594us
I20260709 13:18:16.326121 18235 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:18:16.333643 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.344756 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:16.345598 18234 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:18:16.349272 18233 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:16.287985 21353 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:16.350426 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:16.376186 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:16.376164 18234 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
W20260709 13:18:16.350606 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.363021 18131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 83) took 6646 ms. Trace:
I20260709 13:18:16.388202 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:16.391816 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:16.372010 21408 log.cc:927] Time spent T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:18:16.392145 18235 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:16.392769 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:16.331624 21191 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:16.325654 21382 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:16.396978 18234 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:16.373420 18371 tablet_service.cc:1558] Processing DeleteTablet for tablet 80d0760748294d8d8cb291466766b8a5 with delete_type TABLET_DATA_TOMBSTONED (TS 8b4fbc44aa2649f0bcac5cd70f71951d not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:46836
I20260709 13:18:16.399329 18232 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
W20260709 13:18:16.381376 21399 log.cc:927] Time spent T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:18:16.400063 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:16.401927 18276 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:16.416239 18236 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
W20260709 13:18:16.410203 18277 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.004s	sys 0.022s
I20260709 13:18:16.379580 21168 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:16.417322 18277 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.005s	sys 0.022s
I20260709 13:18:16.371820 21370 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:16.417204 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:16.419513 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 555183us
I20260709 13:18:16.425988 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:16.427207 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:16.429590 21381 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:16.430562 21381 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:16.430990 21381 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.431394 21381 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:16.379359 18131 rpcz_store.cc:276] 0709 13:18:09.703828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.704013 (+   185us) service_pool.cc:224] Handling call
0709 13:18:16.349781 (+6645768us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:12.557227 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:12.558082 (+   855us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:12.558136 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:18:12.558164 (+    28us) tablet.cc:662] Decoding operations
0709 13:18:12.559083 (+   919us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:12.559171 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:12.559211 (+    40us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:18:12.559972 (+   761us) tablet.cc:701] Row locks acquired
0709 13:18:12.559998 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:18:12.560205 (+   207us) write_op.cc:270] Start()
0709 13:18:12.560361 (+   156us) write_op.cc:276] Timestamp: P: 1783603092560135 usec, L: 0
0709 13:18:12.560392 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:18:12.712106 (+151714us) log.cc:844] Serialized 2083 byte log entry
0709 13:18:13.809986 (+1097880us) op_driver.cc:464] REPLICATION: finished
0709 13:18:14.063710 (+253724us) write_op.cc:301] APPLY: starting
0709 13:18:14.077628 (+ 13918us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:14.117815 (+ 40187us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:14.145368 (+ 27553us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:14.422821 (+277453us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:14.423108 (+   287us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:18:14.423163 (+    55us) write_op.cc:312] APPLY: finished
0709 13:18:14.423469 (+   306us) log.cc:844] Serialized 46 byte log entry
0709 13:18:14.423711 (+   242us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:14.423848 (+   137us) write_op.cc:454] Released schema lock
0709 13:18:14.423903 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:14.424354 (+   451us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:14.424387 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":223766,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":231363,"apply.run_cpu_time_us":4696,"apply.run_wall_time_us":379094,"num_ops":5,"prepare.queue_time_us":267322,"prepare.run_cpu_time_us":29235,"prepare.run_wall_time_us":275907,"raft.queue_time_us":275332,"raft.run_cpu_time_us":8636,"raft.run_wall_time_us":232668,"replication_time_us":1218395,"spinlock_wait_cycles":33152,"thread_start_us":640555,"threads_started":4,"wal-append.queue_time_us":186032,"wal-append.run_cpu_time_us":66504,"wal-append.run_wall_time_us":3270266}]]}
I20260709 13:18:16.439132 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:18:16.439968 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.449862 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:16.451627 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:16.451987 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:16.454555 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.455166 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:16.455237 18305 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:16.455884 18309 raft_consensus.cc:2368] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10.
I20260709 13:18:16.455822 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.459054 18236 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:16.459633 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.460132 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.404500 21170 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:16.461047 18310 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:16.461156 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:16.471462 18304 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:16.478140 18236 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:16.461699 18305 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:16.461614 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:16.497247 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:16.499245 18305 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:16.500133 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:16.500970 18306 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:16.502033 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.503053 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.526383 18308 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 6: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:16.527472 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.528914 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.529783 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.533396 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:16.534415 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:16.536226 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 74675.3us
I20260709 13:18:16.539379 18236 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:16.547003 18304 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:16.533558 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.408092 21401 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.118s
W20260709 13:18:16.466523 21383 consensus_meta.cc:287] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.851s	user 0.012s	sys 0.007s
I20260709 13:18:16.460702 21168 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.468034 21407 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:16.560491 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.560761 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.460685 21413 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:16.553880 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:16.556080 21402 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:18:16.568408 18200 leader_election.cc:400] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10.
I20260709 13:18:16.599372 18200 leader_election.cc:403] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:18:16.548926 21370 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.584558 21382 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:16.626364 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 58114.2us
I20260709 13:18:16.626957 21415 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:16.640897 21415 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:16.641273 21415 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:16.567266 21407 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:16.644831 21407 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:16.645270 21401 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:16.645989 21401 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:16.652799 18306 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
W20260709 13:18:16.630441 18351 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.003s	sys 0.030s
W20260709 13:18:16.656627 18351 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.004s	sys 0.030s
I20260709 13:18:16.638589 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 451) took 1111 ms. Trace:
W20260709 13:18:16.657132 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 592238us
W20260709 13:18:16.657963 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.639227 18200 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:16.657310 18312 rpcz_store.cc:276] 0709 13:18:15.527555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.528063 (+   508us) service_pool.cc:224] Handling call
0709 13:18:15.540327 (+ 12264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.717614 (+177287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.717663 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.846318 (+128655us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.380282 (+533964us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:16.380340 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.380432 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.638366 (+257934us) raft_consensus.cc:1685] finished
0709 13:18:16.638385 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.638522 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29826,"raft.queue_time_us":51654,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":38780,"thread_start_us":647927,"threads_started":2,"wal-append.queue_time_us":748339}
I20260709 13:18:16.661579 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.660642 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:16.672664 18236 raft_consensus.cc:3055] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:16.572852 21268 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:16.673368 18236 raft_consensus.cc:740] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:16.627331 21410 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:18:16.640172 21353 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:16.636863 21312 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:16.573189 21168 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:16.638671 21002 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:16.711607 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:16.706763 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 368775us
I20260709 13:18:16.705673 18236 consensus_queue.cc:260] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:16.731017 18236 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:16.739570 18201 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:16.749145 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.750182 21422 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.750622 18234 raft_consensus.cc:2393] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:16.750735 21422 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:16.751197 21168 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:16.751891 21168 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10.
I20260709 13:18:16.717053 21268 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.753127 21268 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:16.755189 21268 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:16.756595 21353 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:16.757850 21208 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:16.758224 21353 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:16.758630 21353 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:16.759019 21353 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:16.648488 21370 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:16.762749 21370 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:16.739217 21002 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.764200 21002 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:16.766433 21002 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:16.769636 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 2064) took 1162 ms. Trace:
I20260709 13:18:16.770030 18381 rpcz_store.cc:276] 0709 13:18:15.607251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.607662 (+   411us) service_pool.cc:224] Handling call
0709 13:18:16.769443 (+1161781us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400276d54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:16.769575 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2496363776}
I20260709 13:18:16.770411 21381 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:16.772710 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:16.800694 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 410634us
I20260709 13:18:16.771795 21415 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:16.803473 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:16.797221 21280 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.012s	sys 0.025s
I20260709 13:18:16.773355 21168 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:16.796721 21381 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:16.810489 21422 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:16.821992 21371 consensus_meta.cc:287] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.001s
I20260709 13:18:16.822531 21371 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:16.827358 18202 leader_election.cc:336] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.724s (SENT)
W20260709 13:18:16.809480 21280 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.013s	sys 0.025s
I20260709 13:18:16.796370 21170 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 13:18:16.831656 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.796056 21380 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:18:16.839736 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.840396 18310 raft_consensus.cc:2393] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:16.869928 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.872002 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.874092 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.874998 18312 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:16.875996 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.831861 18236 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:16.795662 21370 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:16.837841 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:16.933578 18305 raft_consensus.cc:2368] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
W20260709 13:18:16.881198 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:16.894481 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:16.930401 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 85009.1us
I20260709 13:18:16.931099 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:16.936116 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.937326 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:16.937889 18310 raft_consensus.cc:2376] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7. Re-sending same reply.
I20260709 13:18:16.937948 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.938715 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.938941 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.939553 18308 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:16.940656 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:16.941679 18308 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:16.932349 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.962563 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.962898 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.963953 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:16.964108 18202 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:16.963901 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.966565 18202 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:16.965411 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.969518 18310 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:16.971385 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.972872 21168 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:16.973163 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:16.838740 21280 raft_consensus.cc:697] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:17.023231 21280 consensus_queue.cc:237] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:16.977746 21214 consensus_queue.cc:1059] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:18:17.029670 21214 raft_consensus.cc:3055] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:17.030161 21214 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:17.031203 21214 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:16.993172 21193 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:17.033360 21193 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:16.975013 21383 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:17.034818 21383 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:17.035913 21383 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.037513 21383 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:17.042546 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.980160 18305 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:16.991366 18310 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:16.993652 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.978003 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:16.978790 21427 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:17.053501 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.998003 21370 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:17.047385 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:17.045601 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:17.060909 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:16.986850 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:17.050380 21422 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:16.965389 21170 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:16.963450 21259 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.051680 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:17.052711 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 74820us
W20260709 13:18:17.055647 18276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.024s	sys 0.042s
W20260709 13:18:17.068264 18276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.024s	sys 0.042s
W20260709 13:18:17.068604 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 531474us
I20260709 13:18:17.068780 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:17.069797 18312 raft_consensus.cc:2410] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:18:17.072942 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:17.074108 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:17.075759 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:17.076489 18386 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:17.077559 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:17.078333 18379 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
W20260709 13:18:17.062940 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 76403.1us
I20260709 13:18:17.080837 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:17.081882 18385 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:17.082649 18308 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:17.084867 18308 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:17.065040 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 425866us
I20260709 13:18:16.973785 21415 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:17.097369 18310 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:18:17.101238 18202 leader_election.cc:336] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.199s (SENT)
I20260709 13:18:17.101923 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:17.089797 18200 leader_election.cc:400] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6.
I20260709 13:18:17.104014 18200 leader_election.cc:403] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:17.054033 21344 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:17.066109 21214 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:17.064113 21002 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:17.068066 21380 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:17.111624 18312 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:17.125897 18236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:17.126670 18236 raft_consensus.cc:606] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:17.127101 18236 raft_consensus.cc:614] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:17.080885 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:17.096372 21208 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:18:17.136066 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 396274us
I20260709 13:18:17.111577 21371 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:17.067894 21370 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.138414 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:17.138892 18277 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:17.068917 21422 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:17.090344 21170 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.090569 21259 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.112689 21344 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:17.158139 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:17.140846 21404 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.194602 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:17.195413 18378 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:17.198200 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:17.199867 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:17.201537 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:17.202217 18380 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:17.206679 18385 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:17.109066 21193 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:17.215863 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 77562us
I20260709 13:18:17.216627 18201 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:18:17.216609 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 66868.3us
I20260709 13:18:17.156128 21371 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:17.220197 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 61678.2us
I20260709 13:18:17.152240 21436 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.152168 21429 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.153447 21002 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:17.225128 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 46047.8us
I20260709 13:18:17.225136 18308 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:17.230821 18385 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:17.154780 21427 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 5. Current term is 6.
I20260709 13:18:17.153539 21208 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:17.221640 21386 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.320s	user 0.014s	sys 0.037s
I20260709 13:18:17.209004 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:17.238286 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:17.250109 18306 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:17.226015 21168 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:17.236773 20837 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:17.243705 21429 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.248368 18201 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:17.215936 20829 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:17.245546 21386 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.344s	user 0.014s	sys 0.037s
I20260709 13:18:17.225196 21428 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:18:17.300693 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52450.9us
I20260709 13:18:17.244906 21371 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:17.307143 18201 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:18:17.306756 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 50492.8us
I20260709 13:18:17.253659 21438 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:17.213810 21404 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:17.321542 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:17.309473 21386 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:18:17.301436 21229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.419s	user 0.007s	sys 0.024s
I20260709 13:18:17.333751 18201 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:17.335197 18201 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:17.338449 21191 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:17.338627 21418 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:17.338979 21191 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:17.341773 18201 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:17.309316 21380 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.254269 21414 consensus_queue.cc:1059] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:18:17.309110 21427 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:17.316867 18378 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
W20260709 13:18:17.338052 21229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.473s	user 0.007s	sys 0.024s
W20260709 13:18:17.354734 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.339241 21418 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:17.349097 18380 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:17.321456 21002 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:17.323239 21438 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:17.360144 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1349) took 1285 ms. Trace:
I20260709 13:18:17.368033 18232 rpcz_store.cc:276] 0709 13:18:16.074706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.074889 (+   183us) service_pool.cc:224] Handling call
0709 13:18:17.359907 (+1285018us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b540029c7d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:17.360066 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448983936}
I20260709 13:18:17.339459 21191 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:17.318398 21330 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:18:17.240309 21436 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:17.350466 21417 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:17.353101 21427 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:17.313064 20829 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.386528 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:17.365329 21418 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:17.393330 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.357698 21380 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.366304 21439 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:17.395349 18276 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:17.367307 21002 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:17.371765 21438 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:17.385159 21433 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:18:17.406762 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:18:17.417028 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 336214us
I20260709 13:18:17.383059 21417 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:17.338821 21386 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:17.399334 21432 log.cc:927] Time spent T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:18:17.388433 21428 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.421546 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:17.412432 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:17.386124 21427 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:17.403074 18120 catalog_manager.cc:5028] TS 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): tablet 80d0760748294d8d8cb291466766b8a5 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:18:17.427999 18351 leader_election.cc:400] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
I20260709 13:18:17.406533 21002 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:17.429999 18351 leader_election.cc:403] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:17.403448 21439 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:17.363281 21208 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.410108 21370 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:17.409090 21259 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:17.435180 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:17.425292 21417 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:17.422421 21170 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:17.434947 18276 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:17.426080 21440 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:17.468583 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:17.432878 21439 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:17.433251 21445 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:17.493451 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 58569.9us
I20260709 13:18:17.497834 21344 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:17.499028 21380 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:17.505041 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:17.506083 21415 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:17.506644 21415 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:17.507637 21415 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.401087 21371 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.445919 21259 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
I20260709 13:18:17.512873 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:17.504187 21445 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:17.513983 21370 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:17.436483 21430 consensus_queue.cc:1059] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
W20260709 13:18:17.500713 21437 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.253s	user 0.001s	sys 0.001s
I20260709 13:18:17.431192 21428 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:17.522140 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 295365us
I20260709 13:18:17.483119 21170 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:17.483351 21280 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:17.518894 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:17.534931 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:17.514844 21441 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.205s	user 0.001s	sys 0.001s
W20260709 13:18:17.539847 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.502312 21440 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.510172 20837 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:17.524888 21383 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:17.543239 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:17.525475 21380 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:18:17.521461 21370 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:17.564869 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 363) took 1227 ms. Trace:
W20260709 13:18:17.565009 21452 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:18:17.565339 21259 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:17.565807 21170 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:17.522677 21445 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:17.556761 21449 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:17.570793 18228 rpcz_store.cc:276] 0709 13:18:16.337687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.337816 (+   129us) service_pool.cc:224] Handling call
0709 13:18:16.338183 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.680257 (+342074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.680314 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:16.680942 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.761572 (+ 80630us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b180044f200. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:18:17.140415 (+378843us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:17.140470 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.140585 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.564582 (+423997us) raft_consensus.cc:1685] finished
0709 13:18:17.564600 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.564810 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":378964,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":3347,"spinlock_wait_cycles":36328704,"thread_start_us":720030,"threads_started":2,"wal-append.queue_time_us":484628}
W20260709 13:18:17.589213 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 247529us
I20260709 13:18:17.590327 18201 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:17.595173 18311 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:17.596976 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 62250.8us
I20260709 13:18:17.598067 18277 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:17.573124 21430 raft_consensus.cc:3055] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:17.605728 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:17.561245 21440 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:17.608016 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:17.602069 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:17.591899 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 282249us
I20260709 13:18:17.618518 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:17.606381 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:17.620501 18234 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:18:17.621531 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:17.621829 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:17.623692 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:17.625917 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:17.626698 18380 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 6: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:17.619421 18235 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:17.622597 18234 raft_consensus.cc:2376] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7. Re-sending same reply.
I20260709 13:18:17.631269 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:17.631939 18234 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:17.633895 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:17.634624 18234 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.574179 21370 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:17.575387 21229 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:17.575670 21268 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.587369 20837 raft_consensus.cc:697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:17.596393 21380 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:17.640646 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:17.642508 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:17.638546 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:17.645970 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:17.646240 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 44240.2us
I20260709 13:18:17.646440 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:17.653484 18237 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 6: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:17.653409 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:17.598428 21449 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.605381 21404 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:17.604893 21430 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:17.597227 21259 raft_consensus.cc:697] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:17.655596 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:17.651793 18231 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:17.650060 20829 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:17.656533 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:17.659864 18308 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:17.661278 18235 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:17.754808 18377 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:18:17.673100 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:17.657778 21462 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:17.792773 18927 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:17.659914 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:17.670051 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:17.780812 18229 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:17.703819 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:17.648890 18234 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:18:17.781550 18236 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:17.777575 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:17.672464 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:17.790189 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:17.791643 18385 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
W20260709 13:18:17.651769 21407 consensus_meta.cc:287] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 1.006s	user 0.010s	sys 0.004s
I20260709 13:18:17.704241 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:17.809582 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 149784us
W20260709 13:18:17.801419 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 50410.6us
I20260709 13:18:17.810812 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:17.812127 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:17.755914 21464 log.cc:927] Time spent T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:18:17.809620 18385 pending_rounds.cc:85] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 4
W20260709 13:18:17.699728 21214 consensus_meta.cc:287] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.587s	user 0.002s	sys 0.007s
W20260709 13:18:17.753592 21461 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.242s	user 0.000s	sys 0.002s
W20260709 13:18:17.738152 21453 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.288s	user 0.001s	sys 0.001s
I20260709 13:18:17.810211 18379 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
W20260709 13:18:17.857405 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.864490 18385 pending_rounds.cc:107] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:18:17.869570 18385 raft_consensus.cc:2889] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:17.869912 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.870388 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:17.845752 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 284144us
W20260709 13:18:17.866307 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54261.5us
I20260709 13:18:17.656366 21422 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:17.655124 21436 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:17.650688 21380 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:17.667534 21229 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:17.672086 21404 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:17.737988 21446 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.324s	user 0.002s	sys 0.000s
I20260709 13:18:17.876287 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:17.775497 21470 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:17.670962 18120 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 943649b738074d87a593c237cf998758 with cas_config_opid_index 3: aborting the task: latest config opid_index 5; task opid_index 3
I20260709 13:18:17.717294 21428 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:17.658917 21449 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:17.650637 21268 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.807192 21249 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:17.882236 18232 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:17.890412 18200 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:17.869164 21462 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:17.794284 21288 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:18:17.728971 21191 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.811151 21002 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.678846 21330 consensus_queue.cc:1059] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.210s
I20260709 13:18:17.881814 21404 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.712679 20837 consensus_queue.cc:237] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.881769 21435 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:17.879863 21456 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:17.908923 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 317309us
I20260709 13:18:17.887984 21214 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:17.865218 21407 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:17.752725 21466 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.208s
I20260709 13:18:17.889101 21470 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:17.812577 21417 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.920660 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:17.955557 18232 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:17.949702 18235 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:17.950006 18201 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:17.949890 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1960) took 1449 ms. Trace:
I20260709 13:18:17.923887 21404 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:17.918411 21474 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:17.958630 18303 rpcz_store.cc:276] 0709 13:18:16.500072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.190553 (+690481us) service_pool.cc:224] Handling call
0709 13:18:17.191029 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.234221 (+ 43192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.234249 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.234805 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.312879 (+ 78074us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:17.312933 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.313018 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.713489 (+400471us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:17.928875 (+215386us) raft_consensus.cc:1685] finished
0709 13:18:17.928902 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.949828 (+ 20926us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56722,"raft.queue_time_us":58981,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":6805,"spinlock_wait_cycles":4786944,"thread_start_us":62569,"threads_started":1,"wal-append.queue_time_us":132503}
I20260709 13:18:17.962824 18306 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:17.905663 21467 consensus_queue.cc:1059] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:18:17.921799 21259 consensus_queue.cc:237] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.961935 21474 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.973634 21002 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:17.974532 18228 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:17.978464 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:17.958925 21472 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.957762 21470 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:17.990155 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:18.006750 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:17.989998 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:17.999745 21457 log.cc:927] Time spent T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:18:17.893778 21430 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:17.964615 21473 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:18.004240 18232 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:18.069229 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:18.070132 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 173317us
W20260709 13:18:18.070833 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.008670 18379 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:18.010680 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:17.987119 21353 consensus_meta.cc:287] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.226s	user 0.016s	sys 0.000s
I20260709 13:18:18.002553 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:17.953949 21214 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:18.005424 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:18.005568 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:18.072645 18384 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:18.078042 21170 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.078557 21170 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:18.079628 21483 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:18.080479 21451 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.603s	user 0.000s	sys 0.002s
I20260709 13:18:18.081405 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:18.082515 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:18.083057 18232 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:18.080171 21483 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:18.071049 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 200438us
I20260709 13:18:18.123849 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:18.125030 18382 raft_consensus.cc:2410] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:18.087129 21430 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:18.090495 21168 consensus_meta.cc:287] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.833s	user 0.008s	sys 0.004s
I20260709 13:18:18.082685 21471 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:18.101504 21428 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:18.133463 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 57512.2us
I20260709 13:18:18.134788 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:18.135618 18232 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:18.062494 21472 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:18.111245 21469 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.085563 21353 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:18.074620 21445 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:18.133545 21168 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:18.156828 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:18.157425 18232 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:18.157527 21170 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:18.158329 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:18.158877 18232 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:18.159621 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:18.161840 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:18.139190 21249 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:18.167075 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:18.168366 18232 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:18.152614 21191 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:18.173714 18234 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:18.153538 21268 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:18.139698 21428 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:18.154567 21469 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:18.175350 18386 raft_consensus.cc:2410] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:18:18.257647 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:18.259296 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:18.261164 21449 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:18.262446 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:18.265506 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.184451 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:18.255167 21480 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:18:18.156224 21371 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:18:18.286051 18382 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:18.286958 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:18.287283 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:18.287967 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:18.288311 18232 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:18.289330 18312 raft_consensus.cc:2376] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10. Re-sending same reply.
I20260709 13:18:18.290048 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:18.293316 20829 raft_consensus.cc:3055] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:18.294037 20829 raft_consensus.cc:740] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:18.228106 21417 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:18.295858 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 206264us
I20260709 13:18:18.301138 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:18.302178 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:18.180677 21474 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:18.294999 20829 consensus_queue.cc:260] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:18.177794 21472 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:18.228431 21407 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:18.169147 21259 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 13:18:18.267328 21191 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:18.272410 21353 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:18.306293 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:18.471905 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.491128 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:18.490185 18304 raft_consensus.cc:2393] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:18.491670 18308 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:18.309445 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:18.492705 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:18.493595 18308 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:18.492743 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:18.496142 18304 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 3. Current term is 4. Ops: []
W20260709 13:18:18.320955 21370 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.001s
I20260709 13:18:18.424808 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:18.280718 21455 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.270316 21168 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:18.341490 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:18:18.489151 21439 consensus_meta.cc:287] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.986s	user 0.012s	sys 0.000s
W20260709 13:18:18.487852 21418 consensus_meta.cc:287] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.079s	user 0.012s	sys 0.000s
I20260709 13:18:18.507264 21470 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:18.486986 21438 consensus_meta.cc:287] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.065s	user 0.008s	sys 0.004s
I20260709 13:18:18.507264 21428 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:18.509902 21450 raft_consensus.cc:3055] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:18.517479 21440 consensus_meta.cc:287] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.874s	user 0.011s	sys 0.001s
I20260709 13:18:18.518800 18378 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:18.494733 21191 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:18.281677 21462 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:18.548846 21440 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:18.549945 21462 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:18.323158 21449 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:18.525939 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 389787us
W20260709 13:18:18.528275 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 186896us
W20260709 13:18:18.316540 21427 consensus_meta.cc:287] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.878s	user 0.012s	sys 0.001s
I20260709 13:18:18.345491 21445 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:18.540498 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:18.542805 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:18.353259 21214 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:18.342933 21469 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:18.497084 21370 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:18.328923 21483 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:18.564055 18225 tablet_service.cc:1558] Processing DeleteTablet for tablet 1dea3366ee674017a0bbfc9bce0d9a73 with delete_type TABLET_DATA_TOMBSTONED (TS b52e2477fc524694967c4a16afa983e3 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:42512
W20260709 13:18:18.785774 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.893425 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1534) took 1288 ms. Trace:
I20260709 13:18:18.899375 18228 rpcz_store.cc:276] 0709 13:18:17.604711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.604867 (+   156us) service_pool.cc:224] Handling call
0709 13:18:17.605168 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.986146 (+380978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.893085 (+906939us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54002f3ad4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:18.893339 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848844160}
I20260709 13:18:18.570293 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:18.630581 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1556) took 1017 ms. Trace:
I20260709 13:18:18.558322 18237 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:18.903157 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:18.624806 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:18.912355 18384 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:18.858772 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 302573us
I20260709 13:18:18.908198 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 462) took 1264 ms. Trace:
I20260709 13:18:18.913642 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:18.913949 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:18.920670 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:18.921746 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:18.902199 18229 rpcz_store.cc:276] 0709 13:18:17.612766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.279887 (+667121us) service_pool.cc:224] Handling call
0709 13:18:18.283618 (+  3731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.628876 (+345258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.628919 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:18.628978 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:18.629022 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.630300 (+  1278us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b540001bdd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:18.630339 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.630508 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":786996992}
I20260709 13:18:18.917879 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 362) took 2560 ms. Trace:
I20260709 13:18:18.913425 18306 rpcz_store.cc:276] 0709 13:18:17.643690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.643984 (+   294us) service_pool.cc:224] Handling call
0709 13:18:17.644352 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.963222 (+318870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.907885 (+944663us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b5400234e54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:18.908120 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":731991424}
I20260709 13:18:18.924988 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:18.929126 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:18.922816 18230 rpcz_store.cc:276] 0709 13:18:16.337360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.337508 (+   148us) service_pool.cc:224] Handling call
0709 13:18:16.803991 (+466483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.804212 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:17.149942 (+345730us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.464286 (+314344us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.464360 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:17.464417 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.464507 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.897151 (+1432644us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b5400059450. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:18.897303 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":432782,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":63,"raft.queue_time_us":113882,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"spinlock_wait_cycles":1071844224,"thread_start_us":629426,"threads_started":3,"wal-append.queue_time_us":240214,"wal-append.run_cpu_time_us":2662,"wal-append.run_wall_time_us":1220660}
W20260709 13:18:18.559864 21447 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 1.082s	user 0.000s	sys 0.003s
W20260709 13:18:18.619163 21458 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 1.146s	user 0.003s	sys 0.000s
W20260709 13:18:18.631493 21444 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 1.381s	user 0.000s	sys 0.019s
W20260709 13:18:18.621773 21459 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 1.146s	user 0.007s	sys 0.016s
I20260709 13:18:18.901131 21470 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:18.939406 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:18.943078 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:18.542073 21450 raft_consensus.cc:740] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:18.949370 18230 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:18.847551 21471 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.867457 21401 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:18.540872 21455 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:18.695791 21414 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:18.928771 21469 raft_consensus.cc:2764] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:18:18.671418 21504 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:18.967602 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:18.543579 21439 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:18.977589 21214 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.978183 21429 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:18.978353 21214 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:18.979602 21439 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:18.980347 18236 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:18.858039 21404 consensus_meta.cc:287] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.884s	user 0.014s	sys 0.000s
I20260709 13:18:18.970728 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1560) took 1046 ms. Trace:
I20260709 13:18:18.928506 21449 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:18.542268 21438 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:18.931494 21472 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:18.640317 21430 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.348s
I20260709 13:18:18.975137 21445 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:18.989178 18384 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:18:18.982709 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:19.009419 18230 rpcz_store.cc:276] 0709 13:18:17.924384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.948786 (+1024402us) service_pool.cc:224] Handling call
0709 13:18:18.949152 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.970368 (+ 21216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.970647 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.541440 21418 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.014333 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:18.977797 21483 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.017614 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1806) took 1947 ms. Trace:
I20260709 13:18:19.014626 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:18.928480 21427 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.027148 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1817) took 1940 ms. Trace:
W20260709 13:18:18.953470 21208 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.475s	user 0.013s	sys 0.040s
I20260709 13:18:18.975648 21470 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.021942 18381 rpcz_store.cc:276] 0709 13:18:17.070415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.072621 (+  2206us) service_pool.cc:224] Handling call
0709 13:18:17.072922 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.073253 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.073290 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.090541 (+ 17251us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.363660 (+273119us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:17.363723 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.363838 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.559080 (+1195242us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:18.988483 (+429403us) raft_consensus.cc:1685] finished
0709 13:18:18.988505 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.017527 (+ 29022us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":67726,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":3442,"spinlock_wait_cycles":45225728,"thread_start_us":272754,"threads_started":1,"wal-append.queue_time_us":354229}
I20260709 13:18:18.988636 21504 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.033233 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1546) took 1423 ms. Trace:
I20260709 13:18:19.033886 18236 rpcz_store.cc:276] 0709 13:18:17.609857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.803342 (+193485us) service_pool.cc:224] Handling call
0709 13:18:17.803751 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.981108 (+1177357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.032822 (+ 51714us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540001c7d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:19.033134 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2705461120}
I20260709 13:18:19.035239 21504 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:18.980388 21214 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.036301 18229 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:19.036259 18236 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:19.027626 18383 rpcz_store.cc:276] 0709 13:18:17.086636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.204438 (+117802us) service_pool.cc:224] Handling call
0709 13:18:17.204834 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.205209 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.205236 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.209076 (+  3840us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.473080 (+264004us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:17.473146 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.473227 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.618396 (+1145169us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:19.020773 (+402377us) raft_consensus.cc:1685] finished
0709 13:18:19.020811 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.027064 (+  6253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":429,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":6172,"spinlock_wait_cycles":67144064,"thread_start_us":227721,"threads_started":1,"wal-append.queue_time_us":245846}
I20260709 13:18:18.989086 21371 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:19.044044 21259 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:19.045324 21418 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:19.041213 21208 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.562s	user 0.014s	sys 0.050s
I20260709 13:18:19.045859 21380 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.047034 21380 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:19.048607 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:19.049533 21259 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:19.049925 21427 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.049978 21259 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:19.050704 21259 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:19.053217 21370 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:19.054488 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:19.025786 21469 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:19.010241 21472 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:19.019842 21440 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.013199 21445 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:19.029285 21170 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:18.976137 21471 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:18.975622 21414 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.011724 21404 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.059856 21472 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:19.072763 21511 tablet_replica.cc:333] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:18:19.073557 21438 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.074054 21511 raft_consensus.cc:2243] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.063400 21445 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:19.075045 21511 raft_consensus.cc:2272] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.058043 21449 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:18:19.075695 21471 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.064982 21170 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:19.078051 21170 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:19.079017 21511 ts_tablet_manager.cc:1916] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:19.060222 21469 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:19.080703 21469 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:19.043625 21470 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.068939 21370 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:19.038419 21483 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.042649 21450 consensus_queue.cc:260] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.086583 21445 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.146407 18233 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:19.030640 18230 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:19.111034 21450 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:19.149788 18231 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:19.174516 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 468) took 1088 ms. Trace:
I20260709 13:18:19.217671 18303 rpcz_store.cc:276] 0709 13:18:18.086077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.086289 (+   212us) service_pool.cc:224] Handling call
0709 13:18:18.116213 (+ 29924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:18.296361 (+180148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.296386 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:18.296888 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:18:18.701898 (+405010us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:18.701954 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.702051 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.173595 (+471544us) raft_consensus.cc:1685] finished
0709 13:18:19.173665 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.174158 (+   493us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179747,"raft.queue_time_us":208700,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":348957,"threads_started":1,"wal-append.queue_time_us":667226}
I20260709 13:18:19.054093 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 1983) took 2045 ms. Trace:
I20260709 13:18:19.220258 21259 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.220993 18305 rpcz_store.cc:276] 0709 13:18:17.008678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.071855 (+ 63177us) service_pool.cc:224] Handling call
0709 13:18:19.053888 (+1982033us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b5400233a54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:19.054027 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4388019072}
I20260709 13:18:19.175830 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1950) took 2718 ms. Trace:
I20260709 13:18:19.176864 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:19.223320 18309 rpcz_store.cc:276] 0709 13:18:16.457494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.457688 (+   194us) service_pool.cc:224] Handling call
0709 13:18:16.458151 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.797866 (+339715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.797895 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:16.798368 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.216092 (+417724us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:17.216134 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.216223 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.630893 (+1414670us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:19.057542 (+426649us) raft_consensus.cc:1685] finished
0709 13:18:19.057573 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.175437 (+117864us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":178002,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":7141120,"thread_start_us":747599,"threads_started":2,"wal-append.queue_time_us":439908}
I20260709 13:18:19.065721 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:19.190125 21513 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:19.194044 21168 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.200901 20837 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:19.202965 21157 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:19.206156 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:19.207427 21440 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.216034 21445 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:19.237737 21513 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:19.040462 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1564) took 1082 ms. Trace:
I20260709 13:18:19.115248 21483 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.236047 21440 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.240530 21157 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:19.235859 20837 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:19.244968 21430 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:19.223573 21259 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:19.244166 21440 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.249164 18381 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:19.235605 21168 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:19.226859 21370 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:19.252895 21370 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:19.252815 18236 rpcz_store.cc:276] 0709 13:18:17.957915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.035269 (+1077354us) service_pool.cc:224] Handling call
0709 13:18:19.035760 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.039955 (+  4195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.040378 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:19.254002 21370 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:19.255570 18236 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:19.256250 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1566) took 1294 ms. Trace:
I20260709 13:18:19.226075 21470 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.257859 18236 rpcz_store.cc:276] 0709 13:18:17.961831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.254707 (+1292876us) service_pool.cc:224] Handling call
0709 13:18:19.255242 (+   535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.255991 (+   749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.256163 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:19.262318 18236 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:19.267154 21168 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:19.228883 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 52616.7us
W20260709 13:18:19.227934 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 162128us
I20260709 13:18:19.272693 18383 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:19.274319 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1552) took 1662 ms. Trace:
I20260709 13:18:19.276221 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1376) took 1662 ms. Trace:
I20260709 13:18:19.248502 21430 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:19.278395 18381 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:19.282601 18230 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:19.283401 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1565) took 1325 ms. Trace:
I20260709 13:18:19.283205 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:19.285390 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:19.287495 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1561) took 1360 ms. Trace:
I20260709 13:18:19.287405 21472 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.281471 21430 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.280073 18235 rpcz_store.cc:276] 0709 13:18:17.614001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.551208 (+937207us) service_pool.cc:224] Handling call
0709 13:18:18.551457 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.613588 (+ 62131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.613635 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:18.613701 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:18.613751 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.275589 (+661838us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b54001897d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:19.275676 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.275963 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38495,"raft.queue_time_us":39631,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":53093120}
W20260709 13:18:19.287715 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.283871 18230 rpcz_store.cc:276] 0709 13:18:17.958241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.215974 (+1257733us) service_pool.cc:224] Handling call
0709 13:18:19.279354 (+ 63380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.283101 (+  3747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.283298 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:19.279943 18234 rpcz_store.cc:276] 0709 13:18:17.611612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.868061 (+256449us) service_pool.cc:224] Handling call
0709 13:18:17.868479 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.174483 (+306004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.273616 (+1099133us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b540037ebd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:19.274041 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701411584}
I20260709 13:18:19.297070 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:19.288134 18232 rpcz_store.cc:276] 0709 13:18:17.927215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.259007 (+331792us) service_pool.cc:224] Handling call
0709 13:18:19.287084 (+1028077us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b5400104fd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:19.287272 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49742080}
I20260709 13:18:19.278517 20837 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:19.295542 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:19.302742 21470 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.310663 18277 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:19.307626 21470 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.317301 18235 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:19.297694 21157 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:19.318363 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:19.325852 21469 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.326382 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1539) took 1720 ms. Trace:
I20260709 13:18:19.302536 21513 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:19.327349 21512 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:19.305320 21259 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:19.354846 21259 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:19.340673 18234 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:19.361653 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1548) took 1751 ms. Trace:
I20260709 13:18:19.362320 18237 rpcz_store.cc:276] 0709 13:18:17.610454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.805146 (+194692us) service_pool.cc:224] Handling call
0709 13:18:17.805444 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.911899 (+1106455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.361026 (+449127us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b5400104ad4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:19.361433 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731064576}
I20260709 13:18:19.364758 20837 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:19.366501 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 56271.4us
I20260709 13:18:19.367918 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:19.346747 21470 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.344723 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:19.370162 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1559) took 1445 ms. Trace:
I20260709 13:18:19.370409 21445 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:19.370795 18229 rpcz_store.cc:276] 0709 13:18:17.924085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.941190 (+1017105us) service_pool.cc:224] Handling call
0709 13:18:18.950060 (+  8870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.038376 (+ 88316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.369434 (+331058us) spinlock_profiling.cc:243] Waited 86 ms on lock 0x7b5400188dd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:19.369828 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197714176}
I20260709 13:18:19.375262 21472 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:19.341935 21168 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:19.381228 21168 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.382395 21280 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:19.383127 21280 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:19.384366 21168 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.396597 21280 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.399904 18351 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:19.402596 21472 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:19.390059 21465 raft_consensus.cc:3055] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:19.403846 21465 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:19.405649 21280 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.405464 21465 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:19.393955 21401 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:19.407357 20829 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:19.412528 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.413570 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:19.414685 21455 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.409765 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1555) took 1797 ms. Trace:
I20260709 13:18:19.409389 21465 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.420015 18231 rpcz_store.cc:276] 0709 13:18:17.612462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.878330 (+265868us) service_pool.cc:224] Handling call
0709 13:18:17.891393 (+ 13063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.216970 (+1325577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.409372 (+192402us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540021e154. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:19.409694 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2892545280}
I20260709 13:18:19.420643 21469 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:19.388671 21259 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:19.388281 21404 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.396127 21414 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:19.419281 18183 auto_rebalancer.cc:629] Failed to schedule move for tablet cbd66a28ecbc4386b9e1489688542ca9: Illegal state: Replica 8b4fbc44aa2649f0bcac5cd70f71951d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:19.409641 21401 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:19.428332 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:19.429543 21259 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:19.327006 18233 rpcz_store.cc:276] 0709 13:18:17.606320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.606436 (+   116us) service_pool.cc:224] Handling call
0709 13:18:17.606792 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.213507 (+1606715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.325962 (+112455us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54000ae6d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:19.326299 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3538349952}
I20260709 13:18:19.425666 21472 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:19.431730 21472 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:19.432380 21472 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:19.439543 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:19.449465 21445 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:19.391186 20837 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:19.390853 18277 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:19.385046 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:19.468611 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:19.410862 21370 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.486963 21406 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:19.487790 21406 raft_consensus.cc:697] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:18:19.489029 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.489141 21406 consensus_queue.cc:237] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:19.489688 21445 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:19.491655 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1993) took 1158 ms. Trace:
W20260709 13:18:19.493317 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.493095 21490 consensus_queue.cc:1059] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:19.494005 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.495713 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:19.496011 21490 raft_consensus.cc:3055] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:19.492134 18310 rpcz_store.cc:276] 0709 13:18:18.301586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.493877 (+192291us) service_pool.cc:224] Handling call
0709 13:18:18.494352 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.436826 (+942474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:19.436881 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:19.436941 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:19.436975 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.455468 (+ 18493us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b5400222ed4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:19.455510 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.459484 (+  3974us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2166228864}
W20260709 13:18:19.504812 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 65476.6us
I20260709 13:18:19.506145 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:19.507562 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:19.507628 21474 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:19.508653 21474 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.508774 21504 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:19.509591 21474 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:19.511000 21449 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:19.511191 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:19.511593 21449 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:19.512156 21449 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:19.512368 18201 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:19.515432 21168 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:19.517272 21422 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:19.517633 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:19.518747 21422 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:19.520871 18201 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:19.522305 21170 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.522991 18201 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:19.524289 21455 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:19.524847 21455 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.525319 21455 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:19.492594 21445 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:19.496486 21490 raft_consensus.cc:740] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:19.567238 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1558) took 1643 ms. Trace:
I20260709 13:18:19.496887 21371 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:19.580389 21170 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:19.580686 21445 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.581547 21445 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:19.580441 18384 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:19.477890 21430 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:19.588367 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 81007.3us
W20260709 13:18:19.588394 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 197677us
I20260709 13:18:19.571472 18228 rpcz_store.cc:276] 0709 13:18:17.923768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.901048 (+977280us) service_pool.cc:224] Handling call
0709 13:18:19.358379 (+457331us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b5800002a98. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:18:19.358777 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:19.359275 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:19.359311 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:19.360155 (+   844us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.564118 (+203963us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:19.564172 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.564263 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.566667 (+  2404us) raft_consensus.cc:1685] finished
0709 13:18:19.566693 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.566959 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2812160,"thread_start_us":203425,"threads_started":1,"wal-append.queue_time_us":203871}
I20260709 13:18:19.570899 21422 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:19.595796 21407 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:19.599501 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 214871us
I20260709 13:18:19.602221 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:19.600268 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:19.606664 18955 raft_consensus.cc:2410] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:19.596743 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:19.590157 21445 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:19.617678 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 94859.5us
I20260709 13:18:19.602972 21407 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:19.631639 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 136197us
I20260709 13:18:19.634974 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:19.636816 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:19.646309 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:19.648559 18383 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:19.631387 21407 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:19.650264 18201 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:19.657306 21511 ts_tablet_manager.cc:1929] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 13:18:19.634187 21430 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:19.657934 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:19.658749 18384 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
W20260709 13:18:19.659446 21380 consensus_meta.cc:287] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.612s	user 0.021s	sys 0.002s
I20260709 13:18:19.660629 21469 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.661011 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:19.661401 21469 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.657948 21511 log.cc:1199] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-0-root/wals/1dea3366ee674017a0bbfc9bce0d9a73
I20260709 13:18:19.664325 21511 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42512 (request call id 71) took 1100 ms. Trace:
I20260709 13:18:19.664729 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:19.665026 21511 rpcz_store.cc:276] 0709 13:18:18.563707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.563861 (+   154us) service_pool.cc:224] Handling call
0709 13:18:19.071372 (+507511us) ts_tablet_manager.cc:1151] Deleting tablet 1dea3366ee674017a0bbfc9bce0d9a73
0709 13:18:19.072282 (+   910us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:18:19.422443 (+350161us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:19.613301 (+190858us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:19.664243 (+ 50942us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":167488,"thread_start_us":111972,"threads_started":1}
I20260709 13:18:19.670694 21191 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:19.671118 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:19.671953 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:19.673312 21490 consensus_queue.cc:260] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:19.675253 21490 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:19.683246 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:19.686246 21501 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:19.686950 21414 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:19.687691 21414 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:19.688537 21492 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:19.689054 21414 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.689172 21493 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:19.694775 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47950.6us
I20260709 13:18:19.695144 21381 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:19.695883 21381 raft_consensus.cc:697] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:19.695997 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:19.687742 21510 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:19.702029 21510 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:19.703243 21510 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.703085 18135 catalog_manager.cc:5697] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 4 to 6, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 6 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:19.704692 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 48455.1us
I20260709 13:18:19.659848 21413 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.659680 21259 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:19.702046 21381 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:19.716768 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:19.717353 18308 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:19.717610 18383 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:19.720853 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:19.659762 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:19.750474 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:19.706619 21191 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:19.755605 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:19.756314 21413 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.761205 21413 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.761909 18386 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:19.757390 21370 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:19.764827 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:19.766108 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:19.767107 21470 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:19.767640 21470 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.768121 21470 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:19.768733 21422 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:19.769703 21422 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:19.768790 21427 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.773221 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:19.621681 21371 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:19.774477 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:19.775362 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 79500.2us
W20260709 13:18:19.777212 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 138614us
I20260709 13:18:19.776233 18135 catalog_manager.cc:5697] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 4 to 6, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 6 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.781872 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:19.783435 21401 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.784017 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:19.784652 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 162552us
I20260709 13:18:19.773886 21415 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:19.790158 18378 raft_consensus.cc:2410] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:18:19.804168 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.805075 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:19.806527 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:19.806596 18201 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:19.807749 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:19.809185 18386 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:19.810110 18385 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:19.812567 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:19.803689 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 371) took 1148 ms. Trace:
I20260709 13:18:19.784721 21445 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:19.789954 21510 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:19.820429 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:19.768224 18202 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:19.844862 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:19.810858 18135 catalog_manager.cc:5697] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 5 to 7, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 7 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.854373 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:19.866267 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:19.867869 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:19.886052 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 62708.7us
I20260709 13:18:19.887152 18382 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:19.897782 18384 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
W20260709 13:18:19.899001 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 85480.4us
I20260709 13:18:19.794525 21493 consensus_queue.cc:1059] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:18:19.803996 21472 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:19.905730 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 137605us
I20260709 13:18:19.907372 21438 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.907967 21168 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:19.912917 21483 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:19.913405 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:19.914275 21371 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:19.915441 21522 log.cc:927] Time spent T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:18:19.914908 18135 catalog_manager.cc:5697] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 4 to 6, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 6 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.916491 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:19.822566 21422 consensus_queue.cc:1059] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:18:19.920809 21455 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.922396 21462 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:19.923391 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 69156.8us
I20260709 13:18:19.920414 21401 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.931092 21469 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:19.933457 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:19.938859 21518 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.161s	user 0.000s	sys 0.002s
I20260709 13:18:19.938926 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:19.943398 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:19.950754 21168 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.970985 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:19.845454 21413 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:19.865453 21427 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.945961 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:19.944262 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:19.813444 18230 rpcz_store.cc:276] 0709 13:18:18.655155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.331874 (+676719us) service_pool.cc:224] Handling call
0709 13:18:19.332431 (+   557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.333034 (+   603us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:19.577572 (+244538us) log.cc:844] Serialized 14 byte log entry
0709 13:18:19.803311 (+225739us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:19.803364 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:19.803408 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.803483 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.803628 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":316061,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":7808,"thread_start_us":427941,"threads_started":2,"wal-append.queue_time_us":206681}
I20260709 13:18:19.974910 18380 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:19.977437 18383 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:19.978574 21413 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.979476 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:19.980727 18377 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 8: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:19.981307 21413 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.981994 21401 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:19.990880 21274 raft_consensus.cc:3055] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:19.991122 21427 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:19.991420 21274 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:19.994544 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 365) took 1430 ms. Trace:
I20260709 13:18:19.995831 18384 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:19.994956 18236 rpcz_store.cc:276] 0709 13:18:18.564401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.264055 (+699654us) service_pool.cc:224] Handling call
0709 13:18:19.293789 (+ 29734us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:19.343556 (+ 49767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:19.343612 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:19.344437 (+   825us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.617285 (+272848us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:19.617346 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.617428 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.938015 (+320587us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:19.994168 (+ 56153us) raft_consensus.cc:1685] finished
0709 13:18:19.994189 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.994467 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":200,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":330,"spinlock_wait_cycles":37906176,"thread_start_us":272190,"threads_started":1,"wal-append.queue_time_us":309366}
I20260709 13:18:19.996721 18386 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:19.999476 18384 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:20.003934 21483 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:20.004599 21483 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:19.994592 21371 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:18:20.002149 21472 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:20.006018 21483 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:19.992398 21427 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:20.029563 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 133702us
W20260709 13:18:20.032989 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 55821.5us
W20260709 13:18:20.034847 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 64002.4us
I20260709 13:18:20.010512 18135 catalog_manager.cc:5697] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 1 to 5, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 5 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:20.036794 18384 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:20.040864 18380 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:19.974156 21168 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:20.008345 21483 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:20.052227 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:20.058038 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:20.058890 21471 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.059494 21471 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.060094 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:20.061409 21422 consensus_queue.cc:1059] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:20.061720 21471 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.061564 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:20.062002 21448 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:20.062824 21448 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:20.063205 21406 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:20.063691 21406 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.064036 21406 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:20.061750 20829 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:18:20.061578 21394 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:18:20.068928 21394 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:20.069347 21394 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:18:20.069577 21474 consensus_meta.cc:287] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.001s
I20260709 13:18:20.070354 21394 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.071684 21394 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:20.070706 21474 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.072815 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:20.073297 21501 consensus_queue.cc:1059] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:20.074713 21430 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:20.075364 21430 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:20.075873 21430 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:20.076159 21413 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:20.076615 21438 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.078300 21414 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:20.079362 21438 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.079871 21456 raft_consensus.cc:3055] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:20.081841 18385 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
W20260709 13:18:20.083626 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.057705 18135 catalog_manager.cc:5697] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:20.042035 21401 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:20.095227 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.102986 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.080382 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:20.094362 18201 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:20.111598 18135 catalog_manager.cc:5697] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.995820 21462 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.114660 18135 catalog_manager.cc:5697] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 5 to 7, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 7 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:20.076663 21413 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:20.122184 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:20.085629 21456 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:20.103123 21438 raft_consensus.cc:3055] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:20.092162 21471 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:20.033922 21274 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:20.132313 18135 catalog_manager.cc:5697] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:20.139447 21474 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:20.108107 20829 consensus_queue.cc:1059] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:18:20.083727 21407 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:20.146389 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 88748.6us
I20260709 13:18:20.109058 21470 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.147975 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:20.149040 21455 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.149590 20837 consensus_queue.cc:1059] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:20.090008 21427 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.163769 18377 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:20.158255 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:20.146926 21450 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:18:20.138015 21422 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.129280 21438 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:20.158315 18135 catalog_manager.cc:5697] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 4 to 6, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 6 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:20.124647 21404 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:18:20.173260 18135 catalog_manager.cc:5697] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 5 to 6, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 6 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.145143 21401 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:18:20.210206 18377 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:20.207857 18135 catalog_manager.cc:5697] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:18:20.215338 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 57180.9us
I20260709 13:18:20.216070 21539 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:20.216223 18201 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:20.179373 21462 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.227082 18135 catalog_manager.cc:5697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 4 to 5, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 5 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.232023 18955 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:20.239195 21394 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:20.239863 21394 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:20.239945 21470 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.171638 21422 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:20.172039 21471 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.244010 18135 catalog_manager.cc:5697] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 2 to 6, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 6 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:20.216833 21455 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:20.240002 21427 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.254145 21544 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:20.254392 21545 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:20.254630 21544 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:20.254825 21545 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:20.218021 21413 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.257293 21413 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:20.258356 21471 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:20.259025 21449 consensus_meta.cc:287] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.001s
I20260709 13:18:20.258963 21538 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:20.259701 21449 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.246716 21401 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:18:20.249332 21462 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:20.261637 21462 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:20.262570 21462 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.263914 21462 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:20.252065 21539 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.259210 21407 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.255708 21544 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.268411 21544 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:20.269181 20837 consensus_queue.cc:1175] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b52e2477fc524694967c4a16afa983e3" responder_term: 9 status { last_received { term: 8 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:20.270684 21404 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:20.272059 21404 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:20.272310 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:20.273833 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:20.274230 18377 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:20.274706 18236 raft_consensus.cc:2393] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 7: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:20.208034 21450 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:18:20.275453 21450 consensus_queue.cc:1243] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer 8b4fbc44aa2649f0bcac5cd70f71951d log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:20.276093 21450 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:20.276494 21450 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:20.278286 21450 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.279014 21404 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:20.255791 21545 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.280208 21545 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:20.279871 21404 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:20.252418 18201 raft_consensus.cc:2686] T 1dea3366ee674017a0bbfc9bce0d9a73 P b52e2477fc524694967c4a16afa983e3: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:18:20.280834 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 64701.3us
I20260709 13:18:20.281920 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:20.282819 21455 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:20.285830 18386 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:20.241230 21394 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:20.289882 21536 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.251s	user 0.003s	sys 0.000s
W20260709 13:18:20.293344 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.297139 18183 auto_rebalancer.cc:629] Failed to schedule move for tablet d88cda52389848d584c846a8597f4977: Illegal state: Replica 459e82ee6b564cc19be6f73186938e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:20.302786 21456 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:20.305083 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.295917 18135 catalog_manager.cc:5697] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 1 to 4, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 4 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:20.321097 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.325408 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:20.327728 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:20.329800 21414 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:18:20.332581 21539 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.336659 21456 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:20.336805 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:20.337723 21406 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.339628 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:20.340477 18232 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:20.341053 21422 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:20.341885 18233 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:20.343189 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:20.343731 18233 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:20.345018 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:20.272194 20837 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:20.318069 21450 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:20.352017 18230 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:20.349628 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:20.353879 18135 catalog_manager.cc:5697] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.354671 18382 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:20.355525 18379 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:20.349004 18228 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:20.358439 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:20.369248 18236 raft_consensus.cc:2393] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:18:20.370105 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 59418.4us
I20260709 13:18:20.371014 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:20.371343 18135 catalog_manager.cc:5697] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 7 to 8, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 8 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:18:20.373803 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.375841 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:20.379472 21381 raft_consensus.cc:3055] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:20.379944 21381 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:20.381425 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:20.382218 18237 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:20.383077 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:20.383687 18237 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:20.385708 21406 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.387478 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:20.383077 21394 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:20.388149 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:20.388829 18232 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:20.389539 18380 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:20.390080 21430 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:20.392908 21539 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:20.393904 21542 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.394078 21168 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.394459 21542 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:20.396170 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:20.397531 18235 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:18:20.397634 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 221602us
I20260709 13:18:20.392238 21430 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:20.398633 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:20.397428 18229 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:20.325954 21448 consensus_queue.cc:1059] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:18:20.401255 18230 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 7: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:20.399464 18237 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:20.404167 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:20.403489 18380 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:20.406296 18233 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:20.396253 21168 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.362933 21449 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:20.418166 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:20.416946 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:20.422500 18236 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:20.423162 21542 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.423321 18382 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:20.432380 21274 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:20.437266 18201 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:20.437803 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:20.410959 21474 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:20.437956 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:20.419513 21406 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:18:20.419682 21512 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:18:20.448206 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:20.449043 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 44950us
I20260709 13:18:20.434262 21469 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.420928 20837 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.452045 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:20.449536 18308 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:18:20.403373 21381 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.453670 18382 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:18:20.441322 21422 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:20.462147 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:20.463084 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:20.463788 18230 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:20.469131 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:18:20.470715 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.463455 18926 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:20.448876 20829 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:20.469184 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:20.473234 18201 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:20.452287 21543 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:20.477031 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:20.459082 21168 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:20.468789 21539 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:18:20.480629 21470 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:20.482412 21422 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:20.482812 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.444869 21474 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.489871 18232 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
W20260709 13:18:20.497808 18183 auto_rebalancer.cc:629] Failed to schedule move for tablet fe9abdaa4bb845cd8d40c4f182cf98c9: Illegal state: Replica b52e2477fc524694967c4a16afa983e3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:18:20.499347 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 61482.9us
I20260709 13:18:20.476662 20829 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.503793 21288 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:20.504875 21448 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:20.508713 21168 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:20.489333 21191 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:20.509703 21381 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:20.511927 18201 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:20.516377 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.522365 20837 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.525314 21404 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:20.479363 21543 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:20.459143 21469 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.498772 21413 raft_consensus.cc:3055] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:20.577011 21413 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:20.525851 21438 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.578408 21438 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:20.578276 21413 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.579756 21413 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:20.492811 21422 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:20.541097 21168 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:20.581513 21168 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.582778 21168 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:20.550604 18308 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:20.553869 18229 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:20.557327 21448 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:20.586318 21448 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.559319 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:20.588920 18377 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:20.588841 21542 consensus_queue.cc:1059] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:20.559474 21406 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:20.590996 21542 raft_consensus.cc:3055] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:18:20.559909 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 67403.2us
I20260709 13:18:20.591424 21542 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:20.545810 21191 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.592962 21191 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:20.593052 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:20.594154 21469 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:20.536424 21288 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.594858 21288 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:20.536630 21430 raft_consensus.cc:3055] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:20.600687 21430 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:20.600957 21545 consensus_queue.cc:1059] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:20.601320 21401 consensus_queue.cc:1059] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:20.601764 21430 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.537370 20829 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:20.602337 21512 raft_consensus.cc:3055] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:20.602847 21512 raft_consensus.cc:740] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:20.602929 21430 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:20.603341 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 91555.4us
I20260709 13:18:20.600775 20837 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:20.603819 21512 consensus_queue.cc:260] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.604280 20837 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:20.604871 20837 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:20.605147 21512 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:20.590677 21406 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.606268 18276 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:20.606930 21470 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:20.607501 21406 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.608609 18121 catalog_manager.cc:5028] TS b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): tablet 1dea3366ee674017a0bbfc9bce0d9a73 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:18:20.609876 21549 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:20.610327 21549 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:20.610751 21549 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:20.611037 18308 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:20.607553 21470 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:20.575428 21474 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:20.630700 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 162174us
I20260709 13:18:20.639793 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:20.640726 18379 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:20.546464 21501 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:18:20.690042 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:20.592321 21542 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:20.705309 21542 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:20.707365 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:20.708387 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:20.709017 18305 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:20.702035 18303 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:18:20.702901 21470 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.603329 21543 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.720633 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:20.738412 18236 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:20.738828 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:20.740322 18384 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:18:20.741827 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.743741 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:20.746995 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:20.747705 18310 raft_consensus.cc:2410] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:18:20.748126 18383 raft_consensus.cc:2410] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:20.749043 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:20.757699 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:20.759750 18378 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:18:20.760763 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.758863 21422 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.770848 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:20.777815 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:20.778919 18379 raft_consensus.cc:2393] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:20.790623 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:20.739428 21552 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.791496 18377 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:20.792119 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47297.1us
I20260709 13:18:20.802788 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:20.804005 18310 raft_consensus.cc:2410] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:20.780882 21401 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:20.817385 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:20.821643 18309 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:20.823148 18385 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:20.798803 21545 raft_consensus.cc:3055] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:20.841630 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:20.844034 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.815071 21449 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:18:20.818035 21401 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:20.853732 21469 raft_consensus.cc:2764] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:18:20.854569 21474 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:20.854769 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.855072 21474 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.855557 21474 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:20.857827 21552 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.859707 18230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:20.860447 18230 raft_consensus.cc:606] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
W20260709 13:18:20.861445 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.853796 21401 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:20.867653 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:20.880659 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:20.881896 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:20.882747 18383 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:20.823470 21422 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.886492 18378 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:20.893751 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:20.900482 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 57109.4us
I20260709 13:18:20.902308 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:20.837937 21545 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:20.894600 18309 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:20.907428 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:20.910673 21449 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:20.914184 18308 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:20.887079 21469 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.919333 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:20.920092 18308 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:20.921339 21469 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:20.952744 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.942927 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:20.944195 18312 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:20.978894 21413 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:20.979548 21413 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.982573 21413 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.983722 18382 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:20.984241 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:20.986253 21413 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:18:20.988833 21557 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:18:20.966965 21533 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:18:21.003229 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.003036 21543 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:21.007660 21552 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:20.948863 21545 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.010419 21545 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:20.953233 21560 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:18:20.935644 21449 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:18:21.018461 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.019654 18310 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:21.022017 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.022924 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.023550 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.023680 18305 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:21.024088 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.025053 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.025358 18303 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:21.025919 18307 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:21.026968 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.029893 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:21.034628 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.043080 18377 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:21.052135 18201 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:21.054534 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 152331us
I20260709 13:18:21.055354 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:21.059902 18232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:21.057802 21427 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:18:21.084583 18232 raft_consensus.cc:606] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:21.084967 21449 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:21.080165 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.089170 18232 raft_consensus.cc:614] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:21.089442 18310 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
W20260709 13:18:21.091219 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 226451us
I20260709 13:18:21.082089 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.092425 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:21.097990 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.093267 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.061704 21455 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:20.966786 21401 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:20.953639 21549 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.120376 18383 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:21.092564 21449 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:21.129599 21449 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:21.132647 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.134044 21401 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:21.134624 20837 consensus_meta.cc:287] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 13:18:21.135739 21455 raft_consensus.cc:697] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:21.136235 21583 raft_consensus.cc:3055] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:21.200850 21583 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:21.201525 21455 consensus_queue.cc:237] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:21.138348 20829 consensus_meta.cc:287] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.535s	user 0.017s	sys 0.000s
I20260709 13:18:21.139853 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:21.142526 21586 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:21.206391 21586 raft_consensus.cc:697] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:21.206147 20829 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.207415 21586 consensus_queue.cc:237] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:21.149598 18202 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.762s (SENT) [suppressed 27 similar messages]
I20260709 13:18:21.151366 18386 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:21.137437 21549 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:21.163787 21381 consensus_meta.cc:287] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.614s	user 0.005s	sys 0.004s
I20260709 13:18:21.165514 21469 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:21.092065 21413 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:21.166714 21404 consensus_meta.cc:287] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.001s
W20260709 13:18:21.167935 21191 consensus_meta.cc:287] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.002s
I20260709 13:18:21.056339 21288 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:21.167780 18384 raft_consensus.cc:2955] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:18:21.238323 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:21.135030 20837 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:21.175506 18303 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:21.176288 18312 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:21.176246 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:21.176231 18305 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:21.180703 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.222560 21470 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:21.187544 18307 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:21.201898 21583 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.156621 21510 raft_consensus.cc:2955] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
W20260709 13:18:21.222923 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.222918 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 73374.4us
I20260709 13:18:21.264110 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.265123 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.265959 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.268220 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.270049 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:21.275301 18312 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:21.274627 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.276607 18305 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.277664 18310 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:21.259845 21422 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:18:21.284909 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 229654us
I20260709 13:18:21.272894 21575 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.294078 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:21.263577 20829 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:21.302166 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:21.305855 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.253708 21191 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.259181 21413 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.307091 18232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef83aa6f9534403ebe38156348430345"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:21.311254 18232 raft_consensus.cc:606] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:21.311668 18232 raft_consensus.cc:614] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:21.307447 18303 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:21.270013 21381 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:18:21.281252 21474 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.316540 21580 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:21.325323 21580 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:21.268885 21470 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.298731 21496 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.328359 18307 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:21.329650 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.337973 18303 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:21.298257 21422 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:21.332594 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:21.341090 18383 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.316730 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:21.334100 18306 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
W20260709 13:18:21.320468 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 398517us
I20260709 13:18:21.341202 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.343017 18312 raft_consensus.cc:2410] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:21.320426 21583 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.331200 18305 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:21.344861 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.311112 21469 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:21.299299 21575 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:21.359527 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.310387 21449 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:21.365538 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.365965 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.366487 18306 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:21.366974 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.367805 18305 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:21.321233 21288 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:21.389384 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.390130 18303 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:21.323261 21474 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:21.397442 18307 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:21.398654 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.401136 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.401757 18306 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:21.369787 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.372148 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.402391 18308 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:21.369639 18383 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:21.410681 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.368728 21579 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:18:21.418740 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.415062 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.416536 18311 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:21.399806 21555 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:18:21.422830 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.428998 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.430029 18312 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:21.434262 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.435510 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.344800 21496 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:21.436357 18305 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:21.435514 18306 raft_consensus.cc:2410] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:18:21.440267 18307 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.402410 21469 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:18:21.445425 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 55650.6us
I20260709 13:18:21.454666 18303 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:21.455281 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.455943 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.456338 18312 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:21.457345 18303 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:21.458961 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.471000 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.478509 18307 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:21.479565 18305 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:21.447284 21580 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.470487 20837 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:21.483667 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.492978 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.514412 18309 raft_consensus.cc:2393] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:21.496054 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:21.514784 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.515246 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.516068 18381 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:21.503966 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:21.509469 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.507625 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.529392 18303 raft_consensus.cc:2410] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:21.481446 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.530480 18305 raft_consensus.cc:2410] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:21.504251 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.537854 18378 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 8: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:21.513686 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:21.495906 18926 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:18:21.542145 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 46309.2us
I20260709 13:18:21.546826 18303 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:21.548026 18303 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:21.550460 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 104291us
I20260709 13:18:21.550632 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.551224 18306 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
W20260709 13:18:21.493595 21588 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:18:21.553267 18232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:21.553982 18303 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:21.554222 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:21.554781 18229 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:21.554850 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.555073 18303 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:21.553520 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.557906 18232 raft_consensus.cc:606] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:21.558352 18232 raft_consensus.cc:614] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:21.555228 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.492023 21496 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:21.493712 21413 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:21.564473 18303 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:21.565889 18305 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:21.566152 18306 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:21.562811 18309 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:21.493577 21470 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:21.444303 21422 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.553166 21492 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:21.569813 18312 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:21.584671 18229 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:21.587393 18304 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
W20260709 13:18:21.590867 21512 consensus_meta.cc:287] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.985s	user 0.012s	sys 0.004s
I20260709 13:18:21.591732 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:21.493069 21469 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.608248 21191 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:21.611008 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:18:21.578094 18275 consensus_peers.cc:597] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2682a7690fb640b1a9ad52d5fa19e281. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:21.614398 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 45450us
I20260709 13:18:21.623848 18308 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
W20260709 13:18:21.624789 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.617830 18235 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:18:21.635784 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:21.586073 21492 raft_consensus.cc:697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:21.637063 18381 raft_consensus.cc:1240] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:21.638221 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.638093 21492 consensus_queue.cc:237] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:21.639686 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:21.640463 18306 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:18:21.641364 21449 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:21.643348 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 276123us
I20260709 13:18:21.647030 21579 raft_consensus.cc:697] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:21.648322 21579 consensus_queue.cc:237] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.613222 21575 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:21.652793 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:21.653545 18386 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:21.653684 21580 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:21.654287 21580 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.658357 18236 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:18:21.658516 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.668215 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54721.6us
I20260709 13:18:21.669953 18236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:21.670742 18236 raft_consensus.cc:606] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:21.671088 18236 raft_consensus.cc:614] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:21.676733 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:21.679127 21550 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.679997 21550 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.683491 21427 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.684329 21427 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.692395 21438 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.693311 21438 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.698529 21438 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:21.699662 21550 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:21.691043 21427 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:21.705847 18235 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:21.664486 21589 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:18:21.708009 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:21.712437 18229 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:18:21.704768 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:21.718396 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:21.716473 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:21.799588 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.590233 21592 consensus_queue.cc:1059] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.143s
W20260709 13:18:21.811609 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 93308.4us
I20260709 13:18:21.711305 21580 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:21.819746 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:21.806351 21413 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:21.838163 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 194027us
I20260709 13:18:21.846789 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:21.847891 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:21.848227 18236 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:21.849785 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:21.850360 18236 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:21.852028 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:21.853139 18377 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:21.856216 18310 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:21.856467 18229 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:21.865670 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:21.867012 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:21.833317 21575 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:21.874660 18386 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:21.876214 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:21.880558 18234 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:21.866530 18377 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:21.876986 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:21.882385 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:21.837929 21542 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:21.883229 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:21.859026 21438 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:21.835610 21413 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:21.882997 21575 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.935207 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:21.920563 21483 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:21.887982 21542 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:21.930728 21562 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:18:21.951449 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 98384.2us
I20260709 13:18:21.965102 18236 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:18:21.942404 21575 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:21.942435 21427 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:21.976969 18235 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:21.949291 21542 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:21.955389 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.948964 21483 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:21.984505 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 101379us
I20260709 13:18:21.986434 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:21.992166 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.001636 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:22.016000 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.962518 21554 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.941560 21438 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.021689 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:22.024124 18235 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:21.996969 21483 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:22.026247 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:22.025477 21427 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:22.025640 21600 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:22.026301 21554 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.048405 18385 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:22.050012 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.036142 21512 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:22.036983 21603 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.054949 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:22.056505 18236 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:22.060947 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.033008 21583 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:18:22.063649 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:22.065852 18236 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.066433 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:22.069991 21438 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:22.072158 21554 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:22.076879 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:22.079169 21601 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:18:22.080188 21598 log.cc:927] Time spent T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:18:22.080371 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.032297 21605 consensus_queue.cc:1059] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:18:22.060410 20829 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.062743 21603 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:22.081647 21438 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:22.061861 21510 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:18:22.120643 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:22.062440 21602 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:22.093803 18234 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:18:22.094269 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.095129 18229 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:22.097796 18236 raft_consensus.cc:2410] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:22.101987 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:22.053970 21577 consensus_queue.cc:1059] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:18:22.121338 18233 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:22.152208 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:22.073200 21607 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.058188 21600 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:22.158504 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.096495 21583 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:22.115530 21427 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:22.128631 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 117751us
I20260709 13:18:22.077343 21586 raft_consensus.cc:2764] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:22.155723 18231 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:22.159981 21583 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:22.163448 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 131318us
I20260709 13:18:22.165491 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:22.165599 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 85323.9us
I20260709 13:18:22.160274 21413 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:22.123260 21602 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:22.118664 21595 raft_consensus.cc:3055] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:22.171763 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.170984 18233 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:22.170109 18201 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:22.178393 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 76536.3us
I20260709 13:18:22.117998 20829 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.172650 21583 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.193904 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:22.172792 21438 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:22.196177 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:22.202391 18308 raft_consensus.cc:2376] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8. Re-sending same reply.
I20260709 13:18:22.184121 18201 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:22.197573 18307 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:22.198437 18309 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:22.199074 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:22.204038 18306 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:22.204073 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:22.196899 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:22.204859 18307 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:22.205013 18311 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 8: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:22.177690 21602 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:22.216311 21611 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:18:22.209340 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:22.223742 18310 raft_consensus.cc:2376] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10. Re-sending same reply.
I20260709 13:18:22.209990 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:22.224237 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:22.211333 21577 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:22.213577 21613 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.153s	user 0.002s	sys 0.000s
I20260709 13:18:22.185101 21413 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:22.256690 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:22.257773 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:22.258572 18312 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:22.260027 21583 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.260914 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:22.262403 21583 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:22.265385 21483 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.261598 21542 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:22.270563 21542 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:22.267469 21602 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.210777 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:22.240242 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:22.275985 18305 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:22.226958 21470 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:22.234037 20829 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:22.241256 21621 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:22.242578 21603 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:22.244943 21427 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:22.251739 21600 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:22.252251 21493 raft_consensus.cc:3055] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:22.295680 18381 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:22.252082 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:22.297734 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:22.253031 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:22.298403 18381 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:22.253217 18233 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:18:22.253054 18304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1474) took 1224 ms (client timeout 1535 ms). Trace:
I20260709 13:18:22.254310 18236 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:22.255023 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:22.255771 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:22.256685 21596 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.420s	user 0.000s	sys 0.002s
I20260709 13:18:22.271010 18231 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:22.177188 21595 raft_consensus.cc:740] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:22.308199 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:22.308964 18308 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.308761 21595 consensus_queue.cc:260] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:22.310444 21595 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.222296 18201 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:22.261639 18228 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
W20260709 13:18:22.240782 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 69115.7us
I20260709 13:18:22.275674 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:22.314529 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.185377 21617 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:22.286649 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.277961 21470 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:22.319432 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 97272.6us
I20260709 13:18:22.288929 18383 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:22.293268 18960 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:22.275441 21422 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.026s	sys 0.034s
I20260709 13:18:22.321791 18306 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:22.321863 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.287323 21583 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:22.302922 18311 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:22.299815 18304 rpcz_store.cc:269] 0709 13:18:21.028607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.050212 (+ 21605us) service_pool.cc:224] Handling call
0709 13:18:22.252834 (+1202622us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54003c14d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:22.252967 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325991680}
I20260709 13:18:22.293078 21621 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.316672 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:22.346453 18307 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:22.296027 21493 raft_consensus.cc:740] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:22.320046 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:22.332185 21607 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:22.318856 21617 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.291817 21483 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:22.327994 18379 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:22.358589 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:22.325817 21622 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:18:22.323778 21422 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.026s	sys 0.034s
I20260709 13:18:22.329035 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:22.377390 18228 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:22.319005 21600 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:22.331250 21603 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:22.383292 21621 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:22.383536 21603 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:22.384105 21603 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:22.331084 20829 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:22.321930 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:22.390021 18229 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:22.332417 21580 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:22.332937 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:22.392246 18236 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.333868 21602 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:22.334208 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:22.335430 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:22.396274 18306 raft_consensus.cc:2410] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:18:22.336879 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:22.338833 18381 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:22.289150 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:22.340879 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:22.332232 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:22.398310 18310 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:18:22.344982 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 120891us
I20260709 13:18:22.325788 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:22.317495 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:22.350769 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:22.399698 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 67698.3us
I20260709 13:18:22.400067 18304 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:22.358278 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:22.359202 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:22.401944 18308 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:22.362037 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:22.341835 21427 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:18:22.363821 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:22.328852 18277 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:22.410020 18385 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:18:22.365278 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:22.411172 18309 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:22.366163 18235 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:22.357429 21626 ts_tablet_manager.cc:933] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:22.365345 21617 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:22.382553 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:22.349198 21605 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.391455 18229 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:22.420935 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:22.421643 18229 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:22.398090 18305 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:22.403445 18311 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:22.322732 21470 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:22.399581 18312 raft_consensus.cc:2376] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10. Re-sending same reply.
I20260709 13:18:22.399583 18202 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:22.361101 18384 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:22.426314 18230 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:22.406332 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:22.406080 21493 consensus_queue.cc:260] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:22.364563 18307 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.409232 21600 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:22.391453 21575 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:22.349876 21583 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:22.418110 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 89346.4us
I20260709 13:18:22.418378 18228 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:22.400452 21607 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:22.394440 21483 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:22.427693 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.430990 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:22.451737 18236 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:22.436033 21493 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:22.436430 21542 consensus_queue.cc:1175] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "459e82ee6b564cc19be6f73186938e79" responder_term: 8 status { last_received { term: 7 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:22.442090 18277 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.444284 18307 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:22.454252 21483 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:22.446056 21630 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:22.458685 21618 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.247s	user 0.002s	sys 0.000s
I20260709 13:18:22.460937 21580 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:22.426925 21605 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:22.462481 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.465895 21575 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:22.470470 18277 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:22.470755 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 71280us
I20260709 13:18:22.421252 20829 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:22.474203 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:22.496546 18312 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:22.483227 21627 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:18:22.500360 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:22.504820 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:22.502350 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.505954 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:22.513221 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:18:22.523293 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.429491 21413 consensus_queue.cc:1059] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:18:22.525292 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:22.512735 21624 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:22.534220 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:22.535169 18232 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.478596 21455 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:22.479794 20837 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:22.479976 21427 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:22.480718 21580 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:22.541409 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:22.528388 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:22.542811 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.493471 21583 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:22.552585 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:22.531682 20829 raft_consensus.cc:697] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:18:22.568408 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.549918 21621 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.558887 21624 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:22.570411 20829 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.559577 21550 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:22.495874 21630 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.567385 18385 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:22.560454 21626 tablet_copy_client.cc:323] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.130:34605
I20260709 13:18:22.552090 21622 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:22.561022 21629 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:22.580361 21622 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.561612 21609 raft_consensus.cc:2764] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:18:22.562436 21585 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:22.553846 21455 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:22.585480 21585 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:22.586519 21585 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.587208 21455 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:22.569173 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:22.588207 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:22.558939 21577 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:22.589416 21577 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:22.560089 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:22.590662 18237 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.590399 21577 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.593111 18232 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:18:22.480333 21607 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:22.594848 18312 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:18:22.595214 21607 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:22.546622 21580 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:22.549580 21616 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:22.575194 18277 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.598920 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:22.512735 21191 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:18:22.547557 21602 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:22.606408 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:18:22.636360 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 93611.8us
I20260709 13:18:22.637575 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.644053 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.645826 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.648006 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:22.576241 20837 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:22.576131 21621 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.605173 21381 raft_consensus.cc:2764] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:18:22.614554 21609 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:22.664045 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 57734.7us
I20260709 13:18:22.605671 21545 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:18:22.667353 21605 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:22.653770 21607 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:22.656790 20837 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.654428 21600 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:22.669683 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:22.670684 21628 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:22.636649 21483 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:22.661099 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:22.660418 21583 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:22.574154 21603 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.690043 21603 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:22.640295 21602 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:22.691749 21602 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.652429 21586 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:22.639396 21614 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:22.678215 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:22.698189 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.685489 20837 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:22.704773 21609 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:22.705248 21633 log.cc:927] Time spent T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:22.705456 21609 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:22.707194 21609 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:22.708693 21413 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:22.709431 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.685679 21600 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:22.711710 21474 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:22.711416 21600 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.712103 21474 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:22.713079 21474 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.714028 21474 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:22.715188 21614 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:22.716941 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.718041 21614 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:22.719182 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:22.719951 21614 raft_consensus.cc:2764] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:22.721215 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:22.725777 20837 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.728060 20837 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:22.728895 21609 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:22.729382 21609 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.729846 21609 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:22.731379 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.732661 18231 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:22.734457 21630 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:22.677274 21191 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.735636 21191 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.736994 21619 raft_consensus.cc:3055] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:22.737284 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:22.737715 21619 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:22.738178 21614 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:22.738942 21614 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:22.739094 21619 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:22.739918 21614 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.752892 18237 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:18:22.637091 21616 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 13:18:22.782492 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 254185us
I20260709 13:18:22.785920 18202 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:22.789099 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.737737 21191 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:22.796006 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:22.662298 21621 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:22.758114 21579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.106s	user 0.008s	sys 0.015s
I20260709 13:18:22.677048 21607 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:22.836279 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.762840 21624 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:22.754417 21628 raft_consensus.cc:697] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:22.909736 18233 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:22.906991 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:22.805864 21629 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:22.786998 21427 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:22.918828 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:22.872089 21609 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:22.855173 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.937577 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 291827us
W20260709 13:18:22.834784 21579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.010s	sys 0.018s
I20260709 13:18:22.869257 21607 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.885815 21630 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.887413 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:22.947459 18385 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:22.916399 21492 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:22.836308 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 50474.7us
I20260709 13:18:22.787499 21470 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.905216 21634 raft_consensus.cc:2764] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:22.938621 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:22.912269 21381 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.943581 18232 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
I20260709 13:18:22.913528 21483 consensus_queue.cc:1059] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:18:22.954880 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:22.888339 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:22.938814 21621 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:22.959283 18386 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:22.958380 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:22.940231 20829 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.954257 18201 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:22.970595 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:22.972378 21438 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:22.960832 21381 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.976650 21492 raft_consensus.cc:697] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:22.977243 21381 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:22.960506 21586 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:18:22.977694 21492 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:22.982300 18235 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:22.948961 21583 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:22.993885 21583 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:22.995640 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:23.002650 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:22.959311 21579 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:22.949087 21630 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:23.009227 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.010905 21449 raft_consensus.cc:3055] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:23.046890 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 45820.9us
W20260709 13:18:23.011356 21493 consensus_meta.cc:287] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.002s
I20260709 13:18:22.981235 21628 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:23.013329 21622 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:22.946820 21640 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:18:22.996098 21600 raft_consensus.cc:2764] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:18:22.999218 21621 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:23.004567 21602 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:23.047902 18201 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:22.983546 20829 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:23.018849 21617 consensus_meta.cc:287] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.005s
I20260709 13:18:23.052210 21612 raft_consensus.cc:3055] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:23.058311 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:23.055408 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:23.137688 18383 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:23.058857 18386 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:23.057108 18276 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:23.058948 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:23.015727 21586 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:23.059466 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 63894us
I20260709 13:18:23.079222 21630 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:23.058974 21413 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 13:18:23.084455 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.080904 21577 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:23.091914 21619 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.046834 20837 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:23.081664 21638 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:23.033468 21639 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:23.080631 21470 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:23.094913 21580 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.056682 21602 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:23.006609 21483 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:18:23.054476 21629 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:23.049283 21449 raft_consensus.cc:740] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:23.069828 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:23.047039 21381 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:23.100760 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52933.9us
W20260709 13:18:23.136108 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 164150us
I20260709 13:18:23.057124 21621 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:23.150079 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:23.017930 21427 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.128103 21550 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:23.142587 21612 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:23.156442 21577 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.186036 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:23.168093 21630 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.191754 18236 raft_consensus.cc:2955] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:18:23.202673 18381 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:23.120237 21617 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:23.204583 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 54617.1us
I20260709 13:18:23.183919 21413 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:23.149411 21586 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.176568 21629 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.188236 21550 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.188184 21621 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:23.211668 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 154632us
I20260709 13:18:23.199388 21577 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:23.171772 20837 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.196695 21609 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:23.230018 18234 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:23.200721 21603 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:23.230719 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:23.223428 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:23.231379 18307 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
I20260709 13:18:23.208243 21628 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:23.210598 21413 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:23.234086 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 52710us
I20260709 13:18:23.191165 21381 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.220415 21629 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:23.243281 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:23.244938 18305 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:23.245164 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:23.245426 18312 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:23.248415 18306 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:23.248706 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:23.249094 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:23.249424 18305 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:23.245561 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:23.245676 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:23.250356 18303 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:23.225553 21550 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:23.246382 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:23.250634 18309 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:23.238720 21628 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.235414 21616 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.289316 21609 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.298166 18310 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:18:23.299149 21654 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:18:23.243901 21413 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:23.301151 21658 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:23.301987 20837 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:23.302830 21510 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:23.303093 18304 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:18:23.289335 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:23.304965 21650 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 13:18:23.305688 21652 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:18:23.306147 21634 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:23.306209 18322 tablet_copy_service.cc:140] P 459e82ee6b564cc19be6f73186938e79: Received BeginTabletCopySession request for tablet 2682a7690fb640b1a9ad52d5fa19e281 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46642)
I20260709 13:18:23.237317 21612 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.237993 21474 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:23.318714 21381 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:23.322019 21586 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:23.235759 21449 consensus_queue.cc:260] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.388291 21621 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.226449 21602 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:23.292043 21638 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:23.234781 21603 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:23.335479 21631 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:23.340647 20829 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:23.343495 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:23.343953 21580 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:23.345021 21624 consensus_queue.cc:1059] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:18:23.345798 21653 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:18:23.211515 21630 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.351065 18200 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:23.391064 21579 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:23.391232 21634 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:23.353932 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 50509.2us
I20260709 13:18:23.355826 18312 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:23.357460 18303 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:23.479995 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:23.362170 18305 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:23.371941 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:23.372224 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:23.481518 18384 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:23.378007 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:23.290783 21438 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:23.294075 21662 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.373432 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:23.374243 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:23.249814 21470 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.121s
I20260709 13:18:23.389950 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:23.493606 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 103782us
I20260709 13:18:23.389011 21510 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.494446 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:23.495818 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:23.364578 21628 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:23.395681 18306 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:23.442544 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:23.500113 18310 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:23.433837 18322 tablet_copy_service.cc:161] P 459e82ee6b564cc19be6f73186938e79: Beginning new tablet copy session on tablet 2682a7690fb640b1a9ad52d5fa19e281 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46642: session id = e016302b7e734d74833a2bf7bab44838-2682a7690fb640b1a9ad52d5fa19e281
I20260709 13:18:23.489539 21662 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.500418 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:23.503311 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:23.503993 18231 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:18:23.462548 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 240325us
I20260709 13:18:23.352327 18233 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:23.506032 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:23.368767 21616 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.368645 21609 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:23.483980 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 133009us
I20260709 13:18:23.485958 18234 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:23.491955 18305 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:23.440080 21474 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:23.496681 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:23.459973 21603 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:23.498482 21422 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:23.482851 18385 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:23.506608 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:23.530256 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1603) took 1133 ms. Trace:
I20260709 13:18:23.391386 21577 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.481180 20837 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.427115 21655 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 13:18:23.544067 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.507392 18276 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:23.476117 21639 raft_consensus.cc:697] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:23.512991 18200 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:23.530632 18229 rpcz_store.cc:276] 0709 13:18:22.397097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.422300 (+ 25203us) service_pool.cc:224] Handling call
0709 13:18:22.422639 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.470460 (+ 47821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.470491 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:22.482111 (+ 11620us) log.cc:844] Serialized 26 byte log entry
0709 13:18:22.780802 (+298691us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:22.795902 (+ 15100us) log.cc:844] Serialized 14 byte log entry
0709 13:18:22.834663 (+ 38761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.834737 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:23.332619 (+497882us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b48001bc3d8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18719caa1 00007fa187193b37 00007fa1871939ca 00007fa18728b26f 00007fa18728af37 00007fa18729f55c 00007fa18729f508 00007fa18729f488 00007fa18729f443 00007fa18729e6ec 00007fa1861c8a96
0709 13:18:23.505230 (+172611us) raft_consensus.cc:1685] finished
0709 13:18:23.530050 (+ 24820us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.530194 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101170,"prepare.queue_time_us":14868,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":134276,"raft.run_cpu_time_us":6212,"raft.run_wall_time_us":854474,"spinlock_wait_cycles":10603264,"thread_start_us":244183,"threads_started":1,"wal-append.queue_time_us":456612}
I20260709 13:18:23.497422 21602 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:23.537997 18202 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:23.539199 18384 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:23.527375 21586 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:23.527606 21648 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:23.562848 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 49964.3us
I20260709 13:18:23.538321 21470 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:23.570358 18231 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:23.484608 21579 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.538915 21580 consensus_queue.cc:1059] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 13:18:23.591845 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 53925.4us
I20260709 13:18:23.597824 18202 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:23.582062 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:23.573259 21667 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:23.600361 21647 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:23.601373 21663 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:23.595453 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:23.604086 18231 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:23.540699 21191 raft_consensus.cc:3055] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:23.547794 21624 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:18:23.538373 21629 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:23.599473 21659 log.cc:927] Time spent T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:18:23.573185 21658 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.569455 21648 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:23.614787 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:23.549064 20837 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.574193 21381 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:18:23.538604 21634 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.592743 21422 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:23.667214 21609 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:23.667826 21455 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:23.669875 21579 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:23.671286 21577 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:23.583185 21586 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:18:23.613627 21667 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:23.690997 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 185079us
I20260709 13:18:23.692549 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:23.700500 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 85827.3us
I20260709 13:18:23.619654 21662 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:23.624027 21648 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:23.726141 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:23.726871 18237 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:23.606588 21191 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:23.713409 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 206077us
I20260709 13:18:23.729652 21191 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.731454 21191 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:23.738546 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:23.739355 18377 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:23.742843 18382 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:23.744243 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:23.745286 18383 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 8: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:23.746857 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:23.747684 18378 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:23.750780 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:23.752041 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:23.765151 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:23.768620 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:23.770937 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:23.701444 21381 consensus_queue.cc:1243] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:23.673568 21639 consensus_queue.cc:237] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.611590 21474 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.707520 21455 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:23.794605 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 70638us
I20260709 13:18:23.715654 21616 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:23.621235 21658 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.825850 21630 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:23.780484 21621 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:23.828666 21510 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:23.829325 21636 log.cc:927] Time spent T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:18:23.713512 21579 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:23.721985 21634 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:23.720745 21667 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:18:23.799912 21646 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:18:23.791953 21654 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:23.818794 18377 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:23.824795 21438 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:23.862141 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:23.865720 18232 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:23.831049 21669 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.837253 21630 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:23.800179 21577 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:18:23.802500 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:23.901854 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 133304us
I20260709 13:18:23.903622 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:23.858261 21667 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:23.834242 21580 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:18:23.920125 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:23.894081 21422 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:23.927153 18230 raft_consensus.cc:2368] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:18:23.922170 18202 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:23.927717 21422 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:23.931077 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.908372 21639 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:23.839551 21579 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.933312 21579 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:23.933691 21422 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:23.934567 21639 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:23.937191 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:23.900733 21662 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.941601 21455 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.946995 21648 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.960072 18232 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:23.973229 21648 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:23.977226 21619 consensus_meta.cc:287] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.806s	user 0.010s	sys 0.001s
I20260709 13:18:23.980747 21629 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:23.981877 18231 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:23.990317 21617 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:23.984869 21470 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:24.003760 18234 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:23.924773 21665 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.997563 18231 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:24.017611 18232 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:23.939281 21639 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:24.029844 21690 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:18:23.905949 21669 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:24.033694 21413 consensus_meta.cc:287] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.001s
I20260709 13:18:24.035720 21413 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.034699 21639 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.034466 21669 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:24.026093 21665 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:23.956210 21662 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.011826 21619 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.047447 18322 tablet_copy_source_session.cc:215] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:18:24.049418 21550 consensus_meta.cc:287] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.703s	user 0.012s	sys 0.000s
I20260709 13:18:24.050132 20837 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:24.050944 18380 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:24.179316 21422 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:24.038527 21483 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.000s	sys 0.009s
I20260709 13:18:24.055964 18309 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:24.211525 21422 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:24.211786 21483 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.000s	sys 0.015s
I20260709 13:18:24.067602 21647 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:24.224609 18382 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:24.213153 21449 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:24.217509 21585 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.226318 21619 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:24.226402 21585 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.230118 18237 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:24.231340 21585 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:24.233578 21619 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:24.225703 21550 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.234822 21665 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:24.235072 18233 raft_consensus.cc:2368] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:18:24.221203 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:24.049971 18230 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:24.235221 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:24.227916 18322 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:46642 (request call id 508) took 1041 ms. Trace:
I20260709 13:18:24.236526 18234 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:24.173494 21686 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
W20260709 13:18:24.213492 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.237432 18322 rpcz_store.cc:276] 0709 13:18:23.210788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.254317 (+ 43529us) service_pool.cc:224] Handling call
0709 13:18:24.227791 (+973474us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.238566 21662 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:24.054148 20829 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:24.239217 20829 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:24.240324 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:24.163957 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:24.242262 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 78637.9us
I20260709 13:18:24.243104 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:24.244180 18234 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:24.245251 21669 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.245927 21669 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.246940 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:24.247512 21658 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:24.248144 21669 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:24.143623 21583 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 13:18:24.248575 21658 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:24.248765 21669 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:24.248713 21630 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:24.249516 21669 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.250012 18276 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:24.251531 21616 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:24.252470 21616 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:24.253589 21616 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.240449 20829 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.257851 20829 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:24.258409 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:24.259150 21614 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.259196 18234 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
W20260709 13:18:24.259784 21671 log.cc:927] Time spent T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.569s	user 0.001s	sys 0.000s
I20260709 13:18:24.261336 21656 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.261850 21656 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.262518 21662 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:24.263046 21662 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.264060 21612 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:24.264428 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:24.259733 21614 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.265147 18309 raft_consensus.cc:2376] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7. Re-sending same reply.
I20260709 13:18:24.243330 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:24.265810 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:24.273974 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:24.275141 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:24.269660 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:24.276088 18308 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:24.270406 18305 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:18:24.053489 21603 consensus_meta.cc:287] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.005s
I20260709 13:18:24.277733 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:24.278924 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:24.279012 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:24.279438 18305 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:18:24.279759 18232 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:24.281145 21647 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:24.282203 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:24.282845 18304 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:24.283775 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:24.284458 18304 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:24.273358 18234 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:24.289683 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:24.290699 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:24.291544 18310 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:24.250072 21669 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:24.288311 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.285917 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:24.304067 18308 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:24.312333 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:24.265027 21662 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:24.314533 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:24.299821 18201 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:24.322036 18232 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:24.245287 21545 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.326879 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:24.332155 18311 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:24.328090 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:24.264083 21656 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:24.340034 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:24.346040 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:24.347242 18379 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:24.316165 21647 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:24.325299 21663 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.314518 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:24.352799 18308 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:24.353547 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:24.354204 18305 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:24.360881 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:24.304629 21603 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.361938 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:24.406374 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2158) took 1047 ms. Trace:
W20260709 13:18:24.361491 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 74202us
I20260709 13:18:24.395534 18308 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:24.407445 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:24.348420 21600 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:24.412626 18351 leader_election.cc:400] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:18:24.421430 18237 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:24.421720 18351 leader_election.cc:403] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:18:24.413311 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:24.422588 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:24.423103 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.423450 18237 raft_consensus.cc:2410] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:24.418563 18311 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:24.429365 21680 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:24.414502 18305 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:24.429636 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1436) took 1079 ms. Trace:
I20260709 13:18:24.430075 18233 rpcz_store.cc:276] 0709 13:18:23.349877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.505721 (+155844us) service_pool.cc:224] Handling call
0709 13:18:24.429432 (+923711us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b54002f3ad4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:24.429570 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630212224}
I20260709 13:18:24.432762 21695 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:24.433369 21695 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.433766 21695 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.435329 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:24.437394 18237 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:24.437559 21658 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.438056 21658 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.440779 21422 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:24.441434 21694 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.442031 21658 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:24.442020 21694 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:24.444641 21697 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:24.409314 21628 consensus_meta.cc:287] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.001s
I20260709 13:18:24.353456 21692 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.463886 18384 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:24.348837 21602 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:18:24.351227 21648 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:24.428923 21689 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:24.432942 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 515) took 1179 ms. Trace:
I20260709 13:18:24.340021 21585 consensus_queue.cc:1059] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:18:24.339874 21545 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.315925 21630 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:18:24.417958 18381 rpcz_store.cc:276] 0709 13:18:23.358792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.359041 (+   249us) service_pool.cc:224] Handling call
0709 13:18:23.359445 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:23.359889 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.359924 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:23.368250 (+  8326us) log.cc:844] Serialized 26 byte log entry
0709 13:18:23.557067 (+188817us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:23.557112 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.557193 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:24.258967 (+701774us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:24.362732 (+103765us) raft_consensus.cc:1685] finished
0709 13:18:24.362756 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.406271 (+ 43515us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4361,"raft.queue_time_us":122,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":9634,"spinlock_wait_cycles":9061248,"thread_start_us":167943,"threads_started":1,"wal-append.queue_time_us":191219}
I20260709 13:18:24.450778 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:24.476789 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 57102.4us
I20260709 13:18:24.495226 18377 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:24.484767 18307 rpcz_store.cc:276] 0709 13:18:23.253472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.302523 (+ 49051us) service_pool.cc:224] Handling call
0709 13:18:24.432170 (+1129647us) spinlock_profiling.cc:243] Waited 9.88 ms on lock 0x7b58000e1398. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:18:24.432367 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.432574 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.432600 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.432646 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:24.432687 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.432758 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.432881 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22734080}
I20260709 13:18:24.387187 21580 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:18:24.354322 21663 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.477756 21617 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.385720 21470 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:24.532471 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:24.525764 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:24.534451 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:24.535440 18307 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:24.502140 21413 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:24.503350 21689 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:24.472259 21628 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:24.478206 21692 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:24.471849 21697 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:24.540381 21639 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:24.682282 21695 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.587656 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:24.564061 18306 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:24.687357 18307 raft_consensus.cc:2368] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:18:24.654976 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:24.688441 18228 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
W20260709 13:18:24.643890 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 133468us
I20260709 13:18:24.690739 18381 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:24.623420 18305 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:24.692373 18311 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:24.513675 21585 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:24.520925 21648 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:18:24.630659 21634 consensus_meta.cc:287] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.000s
I20260709 13:18:24.742486 18304 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
W20260709 13:18:24.678750 21701 log.cc:927] Time spent T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 13:18:24.629243 21700 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:18:24.743832 18304 pending_rounds.cc:85] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 5
W20260709 13:18:24.601878 21667 consensus_meta.cc:287] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.675s	user 0.009s	sys 0.000s
W20260709 13:18:24.596758 21682 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:18:24.658870 21614 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:24.689642 21629 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.755370 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:24.755437 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:24.629494 21438 consensus_meta.cc:287] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.760s	user 0.006s	sys 0.007s
I20260709 13:18:24.745776 18304 pending_rounds.cc:107] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:18:24.736737 21603 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:24.775980 18304 raft_consensus.cc:2889] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:24.566323 21694 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:24.691332 21695 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:24.745129 21684 log.cc:927] Time spent T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.502s	user 0.000s	sys 0.006s
I20260709 13:18:24.738464 21656 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:24.604110 21600 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:24.531714 21617 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:24.757323 21698 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.155s	user 0.007s	sys 0.000s
I20260709 13:18:24.786150 21656 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:24.788559 21711 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:18:24.789443 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:24.790599 21413 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:24.790939 21413 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.791246 21413 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:24.791314 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:24.793057 20829 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:24.793387 21708 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:18:24.793568 21619 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:24.803123 21483 raft_consensus.cc:3055] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:24.803807 21483 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:24.808897 21648 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.810683 21483 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.811995 21483 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:24.812705 21663 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:24.813326 18386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1919) took 1079 ms. Trace:
I20260709 13:18:24.779263 21438 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:24.815585 21692 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:24.817026 21710 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.817356 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1506) took 1570 ms. Trace:
I20260709 13:18:24.817559 21710 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.817803 18312 rpcz_store.cc:276] 0709 13:18:23.247253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.248846 (+  1593us) service_pool.cc:224] Handling call
0709 13:18:24.817153 (+1568307us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b54000bd6d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:24.817284 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121571072}
I20260709 13:18:24.821051 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:24.821728 18380 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:24.793423 20829 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.822485 20829 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:24.564579 21470 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:24.813737 18386 rpcz_store.cc:276] 0709 13:18:23.733860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.737298 (+  3438us) service_pool.cc:224] Handling call
0709 13:18:23.737718 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:23.798831 (+ 61113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.798867 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:23.824876 (+ 26009us) log.cc:844] Serialized 26 byte log entry
0709 13:18:24.428200 (+603324us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b18003ad440. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:18:24.506685 (+ 78485us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:24.529324 (+ 22639us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.812693 (+283369us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b18003ad440. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa18226b060 00007fa18227d716 00007fa18228e287 00007fa18228e208
0709 13:18:24.812923 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.813021 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:24.813071 (+    50us) raft_consensus.cc:1685] finished
0709 13:18:24.813085 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.813235 (+   150us) inbound_call.cc:177] Queueing success response
0709 13:18:24.818577 (+  5342us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b18003ad440. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
Metrics: {"mutex_wait_us":81244,"prepare.queue_time_us":22561,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":385000,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":6702,"spinlock_wait_cycles":30688128,"thread_start_us":78264,"threads_started":1,"wal-append.queue_time_us":692180}
I20260709 13:18:24.838980 20829 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.825227 21583 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:24.852660 20829 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:24.832974 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 354903us
I20260709 13:18:24.865233 21717 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:24.870258 21626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2682a7690fb640b1a9ad52d5fa19e281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:24.762193 21667 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.813648 21628 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:24.898147 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:24.779870 21629 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.900374 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:24.819779 21710 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:24.901022 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:24.908849 18312 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:24.911222 21600 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:24.912387 21703 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:24.912972 21703 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:24.913900 21647 consensus_meta.cc:287] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.001s
I20260709 13:18:24.914425 21647 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:24.902642 18233 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:24.899102 18232 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:18:24.903813 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:24.916671 18229 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
W20260709 13:18:24.895265 21704 log.cc:927] Time spent T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:18:24.919737 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:24.920459 18307 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
I20260709 13:18:24.921195 18234 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:24.892113 21680 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:24.935050 18312 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
W20260709 13:18:24.940869 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 573518us
I20260709 13:18:24.947398 21697 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:24.949258 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:24.949927 18959 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:24.951329 18200 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:24.952328 21697 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:24.952741 21697 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:24.953128 21697 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:24.895080 21689 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:24.956293 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 163933us
I20260709 13:18:24.961423 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:24.962507 20829 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:24.962967 20829 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.963327 20829 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.964726 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:24.989916 21617 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:24.990310 21663 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:24.994100 18377 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:25.003829 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:25.004676 18959 raft_consensus.cc:2393] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:18:24.990926 21663 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.009157 21697 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:25.021828 18233 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
W20260709 13:18:25.036952 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 67768.9us
I20260709 13:18:25.044210 20829 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.125741 20829 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:25.123093 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 158459us
W20260709 13:18:25.124276 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 86329.5us
I20260709 13:18:25.131428 18351 leader_election.cc:400] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:18:25.131949 18351 leader_election.cc:403] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:18:25.127827 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:24.993248 21647 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 13:18:25.070178 21624 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.146245 20829 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:25.148818 20829 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:25.149344 20829 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:25.149852 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:25.152628 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:25.147502 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:25.125025 21607 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:25.156363 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:25.158955 18233 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:25.158768 20829 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.123126 21703 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:25.130738 21680 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.144306 21665 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:25.070514 21710 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:18:25.147681 21713 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:25.234079 21720 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:25.162747 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:25.223371 21697 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:25.237799 21449 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.238317 21449 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.160966 21586 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:25.229030 21663 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:25.250010 21586 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.250252 21663 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.251097 21663 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.229609 21658 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.141264 21648 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:18:25.391139 21658 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.149142 21695 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
W20260709 13:18:25.400719 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 272979us
W20260709 13:18:25.246394 21669 consensus_meta.cc:287] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.922s	user 0.008s	sys 0.004s
I20260709 13:18:25.438508 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:25.438329 20829 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:25.442981 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:25.153736 21603 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:18:25.126353 21614 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:25.223774 21705 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:25.396291 21483 consensus_meta.cc:287] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.584s	user 0.006s	sys 0.003s
I20260709 13:18:25.393573 21663 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:25.578159 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1451) took 1225 ms. Trace:
I20260709 13:18:25.240470 21449 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:25.438102 21697 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:25.576078 21585 consensus_meta.cc:287] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.836s	user 0.009s	sys 0.002s
I20260709 13:18:25.608490 18234 rpcz_store.cc:276] 0709 13:18:24.352608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.368613 (+ 16005us) service_pool.cc:224] Handling call
0709 13:18:24.368913 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.921679 (+552766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.577799 (+656120us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b540001ccd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:25.578075 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263688448}
I20260709 13:18:25.437042 21470 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:25.576020 21600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.013s	sys 0.013s
I20260709 13:18:25.395295 21667 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:25.157788 21624 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:25.586608 21621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.002s	sys 0.014s
W20260709 13:18:25.609515 18928 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.027s	sys 0.017s
W20260709 13:18:25.653697 18928 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.027s	sys 0.018s
I20260709 13:18:25.655057 21585 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:18:25.650846 21697 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.651078 21449 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:25.657997 21449 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.658433 21449 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:25.664598 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2161) took 1375 ms. Trace:
I20260709 13:18:25.664757 21586 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:25.666810 18382 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1927) took 1917 ms (client timeout 1841 ms). Trace:
I20260709 13:18:25.665140 18384 rpcz_store.cc:276] 0709 13:18:24.289542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.289682 (+   140us) service_pool.cc:224] Handling call
0709 13:18:24.289958 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.464479 (+174521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.664220 (+1199741us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b5400129654. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:25.664470 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399363456}
W20260709 13:18:25.667526 18382 rpcz_store.cc:269] 0709 13:18:23.749937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.750461 (+   524us) service_pool.cc:224] Handling call
0709 13:18:25.666557 (+1916096us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b5400075654. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:25.666689 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087630080}
I20260709 13:18:25.666940 21697 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:25.259806 21665 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:25.684162 18926 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.007s	sys 0.042s
W20260709 13:18:25.684623 18926 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.008s	sys 0.043s
W20260709 13:18:25.673344 21621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.003s	sys 0.015s
I20260709 13:18:25.228195 21680 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:25.672459 21600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.013s	sys 0.013s
I20260709 13:18:25.691026 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:25.693400 18384 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
W20260709 13:18:25.706030 21730 log.cc:927] Time spent T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.459s	user 0.000s	sys 0.000s
I20260709 13:18:25.689947 21381 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:25.714457 21626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54020 (request call id 280) took 3490 ms. Trace:
I20260709 13:18:25.714648 21381 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:25.714936 21626 rpcz_store.cc:276] 0709 13:18:22.272533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.276623 (+  4090us) service_pool.cc:224] Handling call
0709 13:18:22.419473 (+142850us) ts_tablet_manager.cc:934] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
0709 13:18:24.868697 (+2449224us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:24.900293 (+ 31596us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:24.918959 (+ 18666us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:25.574378 (+655419us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:25.672745 (+ 98367us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:25.702718 (+ 29973us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:25.714353 (+ 11635us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":18085,"tablet-copy.queue_time_us":44223,"thread_start_us":123088,"threads_started":2}
I20260709 13:18:25.716436 21626 tablet_copy_client.cc:806] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
W20260709 13:18:25.701776 21607 consensus_meta.cc:287] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.003s
I20260709 13:18:25.717088 21626 tablet_copy_client.cc:670] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:25.591970 21669 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:25.723500 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 280572us
I20260709 13:18:25.626694 21705 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:25.733881 18927 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.044s	sys 0.061s
W20260709 13:18:25.736312 18927 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.045s	sys 0.061s
I20260709 13:18:25.736178 18277 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:25.734403 21474 raft_consensus.cc:3055] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:18:25.738236 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 573781us
I20260709 13:18:25.729398 21735 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:25.740671 21474 raft_consensus.cc:740] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:25.752326 20829 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:25.755213 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1926) took 2006 ms. Trace:
I20260709 13:18:25.741297 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:25.755313 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:25.757876 18383 rpcz_store.cc:276] 0709 13:18:23.749299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.753631 (+  4332us) service_pool.cc:224] Handling call
0709 13:18:23.754023 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.934039 (+180016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.934074 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:23.934111 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:23.934140 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.754972 (+1820832us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540012a054. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:25.755025 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.755152 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413363968}
I20260709 13:18:25.763127 20829 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:25.762413 18235 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:25.743206 21621 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:25.771917 18277 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:25.774139 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:18:25.754696 21709 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 1.076s	user 0.010s	sys 0.005s
I20260709 13:18:25.746784 21640 raft_consensus.cc:3055] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:25.741904 21381 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:25.740829 21733 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.756026 21735 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:25.748438 21656 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:25.788379 20829 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:25.777863 21619 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:25.778366 21640 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:25.778213 21621 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:25.792696 21640 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.794122 21621 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:25.773840 21662 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:25.794857 21662 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.795219 21662 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:25.795809 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1441) took 1994 ms. Trace:
I20260709 13:18:25.796219 18230 rpcz_store.cc:276] 0709 13:18:23.801350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.927816 (+126466us) service_pool.cc:224] Handling call
0709 13:18:24.049477 (+121661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.236274 (+186797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.795635 (+1559361us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b540029c7d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:25.795754 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279060352}
I20260709 13:18:25.797968 18309 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:18:25.798357 18309 pending_rounds.cc:85] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 6
I20260709 13:18:25.798602 18309 pending_rounds.cc:107] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:18:25.798851 18309 raft_consensus.cc:2889] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:25.742887 21474 consensus_queue.cc:260] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.803731 21474 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:25.803766 21681 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:25.778926 21413 consensus_meta.cc:287] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.985s	user 0.013s	sys 0.000s
I20260709 13:18:25.761914 21736 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:25.808197 18308 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:25.810184 18303 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:18:25.811350 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:25.818746 20829 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.774075 21688 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.819811 20829 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.777890 21694 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:25.827924 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:25.790890 21703 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:25.804368 21681 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.807255 21735 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:25.842553 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 404114us
I20260709 13:18:25.817461 21736 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:25.826242 21694 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.855154 18312 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:25.826071 21688 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.818224 21413 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.860773 18312 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
W20260709 13:18:25.845064 21731 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:18:25.815184 21733 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.841899 21656 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:25.886104 18385 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1911) took 2838 ms (client timeout 1934 ms). Trace:
I20260709 13:18:25.849361 21736 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:25.850832 21694 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:25.857669 21624 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:25.889325 18385 rpcz_store.cc:269] 0709 13:18:23.033811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.034942 (+  1131us) service_pool.cc:224] Handling call
0709 13:18:25.871631 (+2836689us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400080554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:25.871784 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789030656}
W20260709 13:18:25.882444 21616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.626s	user 0.012s	sys 0.014s
W20260709 13:18:25.895059 21713 consensus_meta.cc:287] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.660s	user 0.007s	sys 0.004s
I20260709 13:18:25.921213 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2065) took 1645 ms. Trace:
I20260709 13:18:25.921746 18310 rpcz_store.cc:276] 0709 13:18:24.276162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.292559 (+ 16397us) service_pool.cc:224] Handling call
0709 13:18:24.298244 (+  5685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.319430 (+ 21186us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:24.346148 (+ 26718us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.536378 (+190230us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.542699 (+  6321us) log.cc:844] Serialized 26 byte log entry
0709 13:18:24.542855 (+   156us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:24.888899 (+346044us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.917975 (+ 29076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.918442 (+   467us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.753971 (+835529us) spinlock_profiling.cc:243] Waited 9.99 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:25.920907 (+166936us) raft_consensus.cc:1685] finished
0709 13:18:25.920943 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.921133 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194362,"prepare.queue_time_us":316508,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":59173,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":36185,"spinlock_wait_cycles":22981504,"thread_start_us":305308,"threads_started":2,"wal-append.queue_time_us":264021}
W20260709 13:18:25.904357 21616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.648s	user 0.012s	sys 0.015s
I20260709 13:18:25.891860 21665 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:25.908522 21728 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:18:25.884994 21191 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:18:25.900380 21658 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:25.891136 21607 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:18:25.905640 21669 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:25.897254 21427 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:18:25.956014 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:25.950148 21729 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:18:25.920789 21713 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:18:25.897667 21656 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:25.960649 18310 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
W20260709 13:18:25.953606 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 89444.2us
I20260709 13:18:25.918848 21680 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:25.968133 21705 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:25.970643 18926 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:25.972256 18926 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:25.973975 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:25.984532 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1524) took 1196 ms. Trace:
I20260709 13:18:25.966650 21607 consensus_queue.cc:1243] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer 8b4fbc44aa2649f0bcac5cd70f71951d log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:25.990612 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:25.984982 18305 rpcz_store.cc:276] 0709 13:18:24.787709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.824917 (+ 37208us) service_pool.cc:224] Handling call
0709 13:18:24.825952 (+  1035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.830887 (+  4935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.830930 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.831449 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:18:25.154558 (+323109us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:25.154596 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.154657 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.984311 (+829654us) raft_consensus.cc:1685] finished
0709 13:18:25.984331 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.984450 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4467,"raft.queue_time_us":4578,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":19679,"thread_start_us":259626,"threads_started":1,"wal-append.queue_time_us":752776}
I20260709 13:18:25.991840 18310 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:25.997008 21703 raft_consensus.cc:697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:18:25.997822 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 142155us
I20260709 13:18:26.013247 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:26.016350 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.011776 21713 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:26.017376 21703 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:26.018298 18378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 2164) took 1723 ms (client timeout 1846 ms). Trace:
W20260709 13:18:26.018813 18378 rpcz_store.cc:269] 0709 13:18:24.295146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.326578 (+ 31432us) service_pool.cc:224] Handling call
0709 13:18:26.016196 (+1689618us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b5800050198. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa1872390a0 00007fa187238984 00007fa1807b36d4 00007fa1807b3662
0709 13:18:26.018242 (+  2046us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3091840}
I20260709 13:18:26.018087 21713 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.020526 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:26.022820 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 50671.4us
I20260709 13:18:26.025064 21680 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:26.024951 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:26.027216 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:26.009847 21705 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.029989 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.014024 21740 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:26.034147 21713 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:26.033947 21740 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.020097 21580 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.032438 18351 leader_election.cc:400] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:18:26.038784 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:26.040410 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:26.040558 21742 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:26.041059 21721 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:18:26.044824 21662 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.047686 21662 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.048380 21713 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:26.027825 21681 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.035826 21686 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:26.049408 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:26.049799 21686 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:26.050957 21579 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:26.051884 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:26.053108 21474 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:26.054190 21629 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.055531 21713 consensus_queue.cc:1059] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:26.056586 21713 raft_consensus.cc:3055] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:26.057036 21713 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:26.056402 21647 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:18:26.057590 18228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1433) took 2708 ms (client timeout 2103 ms). Trace:
I20260709 13:18:26.057976 21742 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:26.058374 21742 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:26.059435 21545 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.060098 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:26.016793 21754 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:26.057996 18228 rpcz_store.cc:269] 0709 13:18:23.348967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.350301 (+  1334us) service_pool.cc:224] Handling call
0709 13:18:26.057382 (+2707081us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540037d7d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:26.057484 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2523057408}
I20260709 13:18:26.047741 21640 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.065315 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:26.029392 21680 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:26.071298 18305 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:18:26.064208 21754 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.074095 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:26.077037 21746 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:26.078315 21734 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.078796 21734 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:26.081419 21734 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.074452 21754 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.028216 21449 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.080816 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:26.036499 21705 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:26.089617 21744 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:18:26.098327 21680 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:26.098786 21680 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:26.098985 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 503943us
I20260709 13:18:26.059266 21742 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.100381 21742 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:26.102126 20829 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:26.107323 21743 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:18:26.108251 21733 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.099200 21680 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.075342 21413 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.114319 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.119037 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.119302 18308 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:26.075505 21721 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:26.135897 20829 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:26.136653 20829 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.118180 21545 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.122232 21755 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:26.123380 21626 tablet_copy_client.cc:538] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:18:26.124214 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.124845 21474 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.154439 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 2166) took 1708 ms. Trace:
I20260709 13:18:26.131407 21735 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:26.138298 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:26.154247 18306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 2071) took 1805 ms (client timeout 1846 ms). Trace:
I20260709 13:18:26.129395 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:26.133579 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.163594 18308 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:26.165098 18308 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:18:26.166172 18308 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:18:26.154911 18377 rpcz_store.cc:276] 0709 13:18:24.446370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.506732 (+ 60362us) service_pool.cc:224] Handling call
0709 13:18:26.154246 (+1647514us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b5400075154. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:26.154370 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1059582336}
I20260709 13:18:26.161056 18311 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:18:26.162417 18306 rpcz_store.cc:269] 0709 13:18:24.349283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.349752 (+   469us) service_pool.cc:224] Handling call
0709 13:18:26.154024 (+1804272us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54002a1f54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:26.154178 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336422656}
I20260709 13:18:26.157591 20829 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.171554 18308 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:18:26.129423 21656 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.176824 18307 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:26.181667 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2064) took 1905 ms. Trace:
I20260709 13:18:26.182060 18304 rpcz_store.cc:276] 0709 13:18:24.275909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.284967 (+  9058us) service_pool.cc:224] Handling call
0709 13:18:24.333701 (+ 48734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.781200 (+447499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.181429 (+1400229us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b5400350f54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:26.181598 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929028992}
I20260709 13:18:26.183971 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.184646 18307 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:26.189297 18385 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:18:26.189625 18385 pending_rounds.cc:85] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 4
I20260709 13:18:26.189828 18385 pending_rounds.cc:107] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:18:26.190037 18385 raft_consensus.cc:2889] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:26.089504 21713 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.192589 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.192683 18308 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:26.195576 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:26.196749 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.197809 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.199733 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.202325 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.204010 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.204767 18386 raft_consensus.cc:2368] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9.
I20260709 13:18:26.205984 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.206334 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.150095 21669 consensus_queue.cc:1059] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:18:26.207141 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:26.181934 21579 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:26.182308 21647 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:26.182173 21583 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.193576 21686 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:26.150360 21545 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.213747 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.176345 21740 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:26.219518 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 81937.4us
I20260709 13:18:26.229436 18201 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:26.164204 21474 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.199410 21710 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:26.231950 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.232179 21710 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.232605 18386 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:26.232771 21474 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:26.233623 21474 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:26.235956 21624 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:26.236465 21624 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.224694 21679 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:18:26.237214 21624 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:26.229884 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:26.228395 21647 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.241186 18380 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:26.242672 21647 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:26.243882 21621 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:26.244413 21621 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:26.245476 21621 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.245903 21686 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:26.248162 21686 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:26.249560 21705 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:26.249661 21583 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.224589 21579 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.251711 21583 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:26.252437 21579 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:26.224386 21695 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:26.253517 21695 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:26.253894 21695 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:26.254315 21580 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:26.259678 21624 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.261965 18385 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
W20260709 13:18:26.263149 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.231170 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.231393 21449 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:26.261473 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1521) took 1523 ms. Trace:
I20260709 13:18:26.226495 21713 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:26.266960 18311 rpcz_store.cc:276] 0709 13:18:24.737875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.738606 (+   731us) service_pool.cc:224] Handling call
0709 13:18:26.154741 (+1416135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.167750 (+ 13009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.261289 (+ 93539us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54002a1f50. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:26.261417 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3222262656}
I20260709 13:18:26.234179 21710 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:26.224848 18383 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:26.271519 21721 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:26.271915 21721 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:26.265676 18382 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:26.267664 18386 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:18:26.272714 21721 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.267664 18230 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:26.273967 21721 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:26.234953 18381 raft_consensus.cc:2410] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:18:26.273339 18386 pending_rounds.cc:85] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 5
I20260709 13:18:26.278491 18386 pending_rounds.cc:107] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:18:26.278791 18386 raft_consensus.cc:2889] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:26.268649 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.261511 21735 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.281234 21629 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.302659 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.284618 21624 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.320011 21624 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.320605 21624 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:26.322680 21624 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:26.304620 21736 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.317459 21427 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.325070 21754 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:26.325943 18306 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:26.306352 21680 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:26.309726 21694 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:26.333741 21614 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.334285 21614 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.334918 21694 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:26.310585 21656 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.335726 21656 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.311342 21655 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:26.336889 21550 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.337199 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:26.337852 21656 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.326550 21191 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.325484 21736 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.329655 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.332268 21689 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:26.327867 21629 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.338032 18382 raft_consensus.cc:2410] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:18:26.325222 21427 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.345554 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:26.289731 18276 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.131:44265 timed out after 1.712s (SENT) [suppressed 11 similar messages]
W20260709 13:18:26.394750 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 105067us
I20260709 13:18:26.398676 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:26.399992 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.326689 21607 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:26.404426 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:26.396965 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:26.326357 21438 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:26.405023 18308 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:26.405457 18234 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:26.336390 21614 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:26.406409 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.407112 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.409415 18382 raft_consensus.cc:2393] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:26.407524 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:26.411813 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 190004us
I20260709 13:18:26.364753 21689 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:26.422055 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:26.424322 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.336908 21655 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.392347 21734 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:26.430815 21734 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.431519 18959 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:26.410121 21438 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.439111 21624 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:26.439648 21624 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.440054 21624 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:26.440639 21754 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.359771 21191 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.285254 21622 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:26.424546 21600 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:18:26.445825 21600 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:26.449079 21680 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:26.449273 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.445621 21622 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.452844 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.459069 18380 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:26.418550 21767 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:18:26.460391 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:26.461462 18381 raft_consensus.cc:2393] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:26.407727 21757 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:18:26.462393 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.425973 21550 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:26.425858 21721 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:18:26.463730 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.465843 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.467257 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.455745 21621 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:26.468487 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.450349 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:26.446383 21600 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:26.464478 18381 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:26.470227 21600 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.470929 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.471619 21600 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.471724 18381 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:26.469259 21665 raft_consensus.cc:3055] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:26.473031 21665 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:26.474393 18381 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:26.477891 18381 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:26.470520 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.474179 21665 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.460249 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:26.492475 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:26.493062 18380 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:26.480814 18385 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 8: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:26.410207 21607 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.495431 18385 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:22.937732 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:26.485416 21689 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.486663 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:26.487900 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:26.504796 18960 raft_consensus.cc:2368] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8.
I20260709 13:18:26.505954 21689 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:26.525983 18235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1431) took 3178 ms (client timeout 1984 ms). Trace:
W20260709 13:18:26.527238 18235 rpcz_store.cc:269] 0709 13:18:23.347234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.352756 (+  5522us) service_pool.cc:224] Handling call
0709 13:18:26.525799 (+3173043us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b54001045d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:26.525904 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5123046656}
W20260709 13:18:26.524914 21747 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.542s	user 0.002s	sys 0.002s
I20260709 13:18:26.490567 18384 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:26.532678 18384 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:26.533007 21413 raft_consensus.cc:3055] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:26.533385 21413 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:26.534220 21413 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.535461 21413 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.535897 18308 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:18:26.537106 21665 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.541687 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:26.544238 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:26.544839 21629 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.545600 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:26.546794 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.545594 18131 catalog_manager.cc:5697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.548583 21681 consensus_queue.cc:1059] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:26.549207 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:26.549425 21681 raft_consensus.cc:3055] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:26.549813 21681 raft_consensus.cc:740] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:26.550633 21681 consensus_queue.cc:260] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:26.551960 21681 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.552572 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:26.553177 18310 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.553318 21545 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.549831 18382 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:26.555790 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.556876 21639 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:26.557375 21639 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:26.559406 21639 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:26.559878 21639 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.470449 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.560233 18310 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:26.561317 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.561647 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:26.562255 18386 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.560273 21639 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:26.566136 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 168554us
I20260709 13:18:26.569422 21438 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.553267 21688 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.574055 21191 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.582679 21607 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:26.591157 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.612843 21626 tablet_bootstrap.cc:492] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:18:26.616626 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.617446 18230 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:26.623597 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:26.624691 21699 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:26.625365 21699 raft_consensus.cc:697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 9 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:26.626272 21721 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:26.626477 21699 consensus_queue.cc:237] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:26.626952 21721 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:26.629554 21721 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:26.631024 21721 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:26.633284 21721 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:26.634150 21474 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:26.634505 21474 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:26.635337 21474 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.637560 21622 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:26.639997 21640 consensus_meta.cc:287] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.566s	user 0.018s	sys 0.004s
W20260709 13:18:26.640594 21737 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.004s	sys 0.009s
W20260709 13:18:26.640957 21737 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.004s	sys 0.009s
I20260709 13:18:26.641201 21655 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.645133 21427 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.646778 18385 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:18:26.649664 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 227692us
I20260709 13:18:26.651800 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.653282 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.653836 18303 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:26.654906 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.656318 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.656867 18303 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:26.660547 18236 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:26.603123 18131 catalog_manager.cc:5697] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.674661 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.678149 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:26.676397 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 157356us
I20260709 13:18:26.666925 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.661842 18237 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:26.652328 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:26.677268 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 44253.2us
I20260709 13:18:26.689281 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:26.691941 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:26.695948 18310 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:26.700500 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.640038 18382 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
I20260709 13:18:26.703733 18308 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:26.707422 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:26.716816 18380 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:26.688700 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.716470 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:26.717499 18235 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:26.706632 18303 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:26.712289 18234 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:18:26.690295 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.691607 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.720376 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.720575 18311 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
W20260709 13:18:26.707978 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.721740 18305 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:18:26.722600 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 70370.1us
I20260709 13:18:26.723331 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:26.700376 18306 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:26.717674 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.725737 18131 catalog_manager.cc:5697] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.702183 18201 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:26.719044 18382 raft_consensus.cc:2410] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:18:26.733095 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.734848 18386 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:18:26.739538 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.735407 18378 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:26.721148 18237 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:26.721803 18926 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:26.737318 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:26.737824 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.742033 18310 raft_consensus.cc:2393] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:18:26.742319 18926 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:26.742748 18383 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:26.743892 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.741341 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:26.740276 18386 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:26.727221 18131 catalog_manager.cc:5697] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 3 to 4, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 4 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.750409 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.750293 18131 catalog_manager.cc:5697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.751711 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.751992 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.752308 18236 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:26.751945 18131 catalog_manager.cc:5697] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.755551 18276 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:26.757109 18276 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:26.753504 18234 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:26.758476 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.759135 18235 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
W20260709 13:18:26.748704 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.763175 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.764598 21750 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:26.745783 21427 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:26.765022 21614 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:26.765497 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.766112 18234 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:26.766589 21545 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:26.766966 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.767048 21545 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.767721 21545 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:26.769520 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.770098 18228 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:26.770864 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.771545 18228 raft_consensus.cc:2410] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:18:26.771605 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:26.772294 18306 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:26.772818 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.772936 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.773200 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.773833 18309 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:26.774789 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.775665 18305 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:26.776304 18303 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:26.749363 21765 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.776980 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:26.777531 18377 raft_consensus.cc:2410] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:18:26.777169 21765 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.777894 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.779611 21765 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:26.765154 21750 raft_consensus.cc:697] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:26.781731 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:26.783082 21655 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:26.783767 18202 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:26.765141 18131 catalog_manager.cc:5697] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.677922 21639 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.784606 21607 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:26.784956 21639 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:26.785156 21607 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:26.785496 21639 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:26.786109 21607 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.786435 21639 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.788573 21688 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:26.788937 18201 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:26.789395 21713 consensus_meta.cc:287] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.003s
I20260709 13:18:26.789729 18201 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:26.789824 21191 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:26.790290 18379 raft_consensus.cc:2410] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:18:26.790606 21550 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:26.790726 21680 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:26.791320 21191 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:26.791419 21680 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:26.791951 21191 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:26.781404 21750 consensus_queue.cc:237] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:26.795248 18232 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:26.805177 18234 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:18:26.791699 18201 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:26.781335 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:26.799690 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:26.798630 18228 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:26.808982 18236 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.777523 18308 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:26.811725 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.808812 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:26.812484 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:26.813150 18237 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.814637 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.815549 18306 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:26.749154 21737 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:26.817381 18231 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:26.817476 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:26.751135 21640 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:26.814718 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:26.683391 21695 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.792249 21550 raft_consensus.cc:697] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:26.820153 18235 raft_consensus.cc:2376] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10. Re-sending same reply.
I20260709 13:18:26.823939 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.815465 21655 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:26.822624 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:26.795135 21545 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.795735 21622 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:26.835125 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:26.745667 21699 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:18:26.811447 21413 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:26.827337 21686 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:26.840728 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.880229 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:26.881398 18135 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39288 (request call id 178) took 26073 ms (client timeout 15000 ms). Trace:
I20260709 13:18:26.881646 18304 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:26.796029 21740 consensus_queue.cc:1059] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 13:18:26.877050 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 43861.7us
I20260709 13:18:26.843961 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:18:26.878157 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 63518.1us
I20260709 13:18:26.823706 21665 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:26.884482 18237 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
W20260709 13:18:26.893813 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 50403us
I20260709 13:18:26.890688 18276 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:26.818034 21614 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:26.891690 18381 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:26.881026 18385 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:26.841966 21737 raft_consensus.cc:697] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:26.895828 18202 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:26.819734 21697 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:18:26.912251 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.897185 18276 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:26.898329 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:26.911341 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:26.897524 18236 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:26.916013 18202 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:26.894035 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:26.917667 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.918220 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:26.848459 21413 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.844074 21629 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:26.792397 21680 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.922250 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:26.922946 18228 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:26.923305 18306 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:26.852753 21655 raft_consensus.cc:697] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:26.841631 21736 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:18:26.924410 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:26.925086 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.925393 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.927260 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.888449 21449 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:26.924196 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.936266 18311 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:26.887336 21686 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:26.937393 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.937999 18311 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:26.938294 21686 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:26.938725 21629 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:26.921741 21413 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:26.941403 21733 raft_consensus.cc:2764] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:18:26.942775 21545 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.943627 21550 consensus_queue.cc:237] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.922087 21656 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:26.945008 21656 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.912282 21735 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:26.839936 21630 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:18:26.932621 18309 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:26.932786 18310 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:26.919899 21622 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:26.899092 21648 raft_consensus.cc:3055] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:26.930795 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.898273 21422 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:26.948215 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.949424 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.950505 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.920130 21438 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:26.933403 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.958051 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:26.973392 18385 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:26.961153 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:26.881966 18135 rpcz_store.cc:269] 0709 13:18:00.770438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.772468 (+  2030us) service_pool.cc:224] Handling call
0709 13:18:26.843810 (+26071342us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:20.959476 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:20.960166 (+   690us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:20.960225 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:18:20.960277 (+    52us) tablet.cc:662] Decoding operations
0709 13:18:20.961976 (+  1699us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:20.962063 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:20.962090 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:18:20.963293 (+  1203us) tablet.cc:701] Row locks acquired
0709 13:18:20.963347 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:18:20.963499 (+   152us) write_op.cc:270] Start()
0709 13:18:20.963638 (+   139us) write_op.cc:276] Timestamp: P: 1783603100963438 usec, L: 0
0709 13:18:20.963657 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:18:20.964308 (+   651us) log.cc:844] Serialized 6800 byte log entry
0709 13:18:21.409362 (+445054us) op_driver.cc:464] REPLICATION: finished
0709 13:18:21.608709 (+199347us) write_op.cc:301] APPLY: starting
0709 13:18:21.608840 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:21.609200 (+   360us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:21.609363 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:21.703293 (+ 93930us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:21.703731 (+   438us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:18:21.703785 (+    54us) write_op.cc:312] APPLY: finished
0709 13:18:21.704316 (+   531us) log.cc:844] Serialized 118 byte log entry
0709 13:18:21.721459 (+ 17143us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:21.806196 (+ 84737us) write_op.cc:454] Released schema lock
0709 13:18:21.816239 (+ 10043us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:21.882050 (+ 65811us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:21.885625 (+  3575us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":44,"spinlock_wait_cycles":13568,"child_traces":[["op",{"apply.queue_time_us":176732,"apply.run_cpu_time_us":6461,"apply.run_wall_time_us":227832,"num_ops":17,"prepare.queue_time_us":243299,"prepare.run_cpu_time_us":17349,"prepare.run_wall_time_us":126816,"raft.queue_time_us":129183,"raft.run_cpu_time_us":51676,"raft.run_wall_time_us":135644,"replication_time_us":445443,"thread_start_us":313352,"threads_started":4,"wal-append.queue_time_us":161324,"wal-append.run_cpu_time_us":31496,"wal-append.run_wall_time_us":1693217}]]}
I20260709 13:18:26.929224 21740 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:26.928640 21600 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:26.928294 21688 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:26.840123 21191 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:26.978261 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:26.925887 21767 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:18:26.958941 21735 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.992775 18385 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:27.042213 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.043121 18228 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:26.959677 21449 raft_consensus.cc:697] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:26.931286 21717 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:18:26.967643 21648 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:26.976101 21740 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:27.038739 21621 consensus_meta.cc:287] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.570s	user 0.012s	sys 0.000s
I20260709 13:18:26.993880 21600 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:27.060021 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.041258 21735 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.071998 18384 raft_consensus.cc:2410] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:27.078914 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.049324 21656 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:26.962420 21655 consensus_queue.cc:237] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.064005 21740 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.087066 21474 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.101580 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.071980 21600 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:27.000537 21737 consensus_queue.cc:237] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:27.125576 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:27.128126 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 231005us
I20260709 13:18:27.128921 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:27.129820 18305 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:27.131032 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:27.134521 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 214304us
I20260709 13:18:27.135869 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:27.142840 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.143607 18382 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 8: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:27.144340 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.144694 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.145310 18378 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:27.146301 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.146942 18378 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:27.157225 18276 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:27.143256 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:27.159612 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.160547 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.164346 18382 raft_consensus.cc:2410] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:18:27.164412 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.165163 18378 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:27.166220 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.163142 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:27.167657 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:27.175372 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.181919 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:27.183779 21782 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:18:27.188757 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.192694 21713 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.193228 21713 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.195236 21713 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:27.196080 21769 log.cc:927] Time spent T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:18:27.199364 18382 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:27.140743 21736 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:27.202891 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.138463 21695 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:27.208652 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 282098us
I20260709 13:18:27.168536 21621 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:27.211885 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:27.234357 18305 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.234828 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:27.235796 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:27.236590 21607 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:27.237059 21607 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.237423 21607 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:27.241222 21413 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.243821 18303 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:27.121475 21648 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.180771 21545 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:27.128495 21449 consensus_queue.cc:237] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.197651 21686 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:27.251020 18305 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:27.265376 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:27.244954 18202 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:27.266192 18305 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:27.214866 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:27.267017 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:27.267423 18228 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.206039 21713 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:27.205389 21736 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.278858 18228 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:27.245549 21550 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:27.246148 21621 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.291402 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.273910 21767 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:27.264497 21686 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:27.273455 21630 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:27.278738 21736 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:27.290280 21648 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:27.290982 21689 consensus_meta.cc:287] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.784s	user 0.003s	sys 0.007s
I20260709 13:18:27.312592 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:27.287245 21550 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.289542 21413 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:27.294493 21621 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:27.306226 21767 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.308331 21686 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:27.308162 21630 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:27.318298 21550 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.335485 21767 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.410691 18237 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:27.371553 21630 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.334059 21713 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:27.426265 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:27.333096 21740 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.419273 21713 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.446372 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.447616 18236 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 8: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:27.429668 21688 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.465363 21607 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.467592 21607 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:27.468353 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.469129 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.469515 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:27.470212 18231 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:27.470571 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.471216 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.471666 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:27.452155 21797 log.cc:927] Time spent T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:18:27.484942 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:27.459986 21688 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.502462 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.505997 18231 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:27.507586 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.509004 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:27.512472 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:27.473940 21791 log.cc:927] Time spent T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:18:27.516788 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.519526 18235 raft_consensus.cc:2410] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:18:27.521411 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.533221 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:27.534200 21765 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:27.534617 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:27.535394 21765 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:27.535741 21765 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:27.536083 21765 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:27.524467 21624 consensus_meta.cc:287] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.084s	user 0.016s	sys 0.010s
I20260709 13:18:27.536962 21624 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.538614 18233 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:18:27.539258 21624 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:27.540010 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:27.541215 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.541838 18228 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:27.542615 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:27.545452 21740 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:27.547029 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:27.548883 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.549707 21740 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:27.551158 21740 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:27.553022 21736 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.554489 18305 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:27.548992 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:27.555112 18380 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:27.556720 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:18:27.557984 21792 log.cc:927] Time spent T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
I20260709 13:18:27.558930 21736 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:27.557078 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:27.560483 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:27.562382 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.563169 18235 raft_consensus.cc:2410] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:27.564378 21474 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:27.570771 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:27.560840 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:27.572644 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:27.576817 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:27.568101 21740 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:27.579263 18277 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:27.582405 21789 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 13:18:27.523078 21735 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.590566 21767 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.576015 21413 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:18:27.597826 21665 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:27.607056 18349 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:27.600597 21681 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:27.586354 21621 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.573489 21474 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:27.603559 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:27.599915 18200 leader_election.cc:400] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8.
I20260709 13:18:27.564405 21800 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:27.607092 18229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87ce294aa3d9426291ec809884e80749"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:27.602303 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:27.610908 18200 leader_election.cc:403] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:18:27.577147 21449 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:27.627344 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:27.599912 21740 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:27.626246 18200 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:27.630422 21790 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:27.578936 21736 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:27.633014 18231 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 8: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:27.633277 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.609587 21786 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:27.609371 21665 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:27.641839 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.642819 18384 raft_consensus.cc:2368] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9.
I20260709 13:18:27.640913 18276 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:27.629604 21449 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:27.609454 21681 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.612697 21474 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:27.639868 18200 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:27.628997 21639 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8.
I20260709 13:18:27.647900 18229 raft_consensus.cc:606] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:27.635227 21740 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.632836 21545 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:27.634038 21784 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:27.661013 18229 raft_consensus.cc:614] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:27.637357 21607 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:27.673496 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:27.674531 21621 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:27.675310 21621 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:27.675707 21621 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.676038 21621 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.649545 21681 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:27.639056 21736 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:27.659415 21600 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
I20260709 13:18:27.693809 21600 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.639266 21786 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:27.694963 18229 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:27.650656 21449 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:27.708201 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.713922 18384 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:27.666522 21680 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:27.721455 18378 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:27.696013 21736 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:27.659932 21713 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.724588 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.707029 21786 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:27.731498 21600 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:27.736789 21735 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:27.756165 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 116369us
I20260709 13:18:27.757972 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.758380 18308 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:27.674813 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:27.707403 21796 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.717159 21413 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:27.762562 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:27.760030 18382 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 12: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:27.771078 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.772027 18382 raft_consensus.cc:2410] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:18:27.773116 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:27.767398 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 163895us
I20260709 13:18:27.766968 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.775135 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:27.775280 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:27.775416 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:27.777082 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:27.777493 18308 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:27.777493 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:27.848106 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 207273us
I20260709 13:18:27.850080 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:27.854106 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:27.770222 21413 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:27.878383 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 247090us
I20260709 13:18:27.769685 21686 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.776579 21688 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:27.880189 18277 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:27.775650 21796 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:27.867738 21413 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:27.852469 21818 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:27.888465 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:27.889438 21820 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:18:27.895630 21740 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:27.900490 21815 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:18:27.870217 21790 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:27.879930 21767 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:27.884110 21600 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:27.872706 21817 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:18:27.922310 18236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:27.923090 18236 raft_consensus.cc:606] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:27.918990 18277 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:27.925596 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 71566.1us
I20260709 13:18:27.908759 21818 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.916309 21784 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:27.930606 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:27.928032 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:27.937815 18228 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:27.938782 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:27.932178 21818 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:27.916816 21822 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:27.967602 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 47330.8us
I20260709 13:18:27.928149 21819 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:27.981858 18228 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:27.982421 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2093) took 1057 ms. Trace:
I20260709 13:18:27.990533 18276 leader_election.cc:400] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9.
I20260709 13:18:27.991011 18276 leader_election.cc:403] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:27.980417 21550 consensus_meta.cc:287] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.002s
I20260709 13:18:27.991482 18228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:27.968380 21658 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:27.995141 18228 raft_consensus.cc:606] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:27.995900 18228 raft_consensus.cc:614] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:27.990027 18307 rpcz_store.cc:276] 0709 13:18:26.924753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.924886 (+   133us) service_pool.cc:224] Handling call
0709 13:18:26.925210 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:27.137952 (+212742us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:27.316200 (+178248us) log.cc:844] Serialized 14 byte log entry
0709 13:18:27.634029 (+317829us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:27.634626 (+   597us) log.cc:844] Serialized 52 byte log entry
0709 13:18:27.636501 (+  1875us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:27.641740 (+  5239us) log.cc:844] Serialized 14 byte log entry
0709 13:18:27.642108 (+   368us) log.cc:844] Serialized 14 byte log entry
0709 13:18:27.981306 (+339198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.981393 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.981439 (+    46us) raft_consensus.cc:1685] finished
0709 13:18:27.981456 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.982364 (+   908us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11934,"prepare.queue_time_us":275779,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":111960,"raft.run_cpu_time_us":446,"raft.run_wall_time_us":42663,"spinlock_wait_cycles":16597760,"thread_start_us":900059,"threads_started":4,"wal-append.queue_time_us":349794}
I20260709 13:18:27.997198 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2200) took 1023 ms. Trace:
I20260709 13:18:28.012162 18378 rpcz_store.cc:276] 0709 13:18:26.973882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.204041 (+230159us) service_pool.cc:224] Handling call
0709 13:18:27.204309 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.721913 (+517604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.996898 (+274985us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b540019bc54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:27.997125 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1188911488}
I20260709 13:18:28.004284 21658 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9.
I20260709 13:18:28.005141 21824 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:28.005908 21600 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.998031 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:28.014492 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:28.008901 21681 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.028789 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:28.020493 21686 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:28.058167 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 139241us
I20260709 13:18:27.995990 21550 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.060895 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:28.061618 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.062759 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:28.062754 18349 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:27.996940 21817 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.013391 21621 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:28.064603 18377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1951) took 1708 ms (client timeout 2153 ms). Trace:
I20260709 13:18:28.033515 21831 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:28.064870 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.064895 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:27.983629 21790 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.050261 21820 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:28.071566 18377 rpcz_store.cc:269] 0709 13:18:26.355873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.469873 (+114000us) service_pool.cc:224] Handling call
0709 13:18:28.064404 (+1594531us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400277254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:28.064546 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":530874752}
I20260709 13:18:28.082267 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:28.029856 21765 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.024963 21824 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.065804 21826 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:28.074586 21787 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.803s	user 0.001s	sys 0.006s
I20260709 13:18:28.100543 21828 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:28.092590 21658 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.031432 21600 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:28.074663 21630 consensus_meta.cc:287] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.003s
I20260709 13:18:28.115852 18378 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:28.084640 21825 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.081275 18228 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:28.070549 21822 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:28.095256 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:28.097698 21786 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.077816 18382 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:28.073496 21686 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:28.077438 21621 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.065742 21680 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.122576 18277 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:28.083158 21740 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.105824 21821 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:18:28.126469 18351 leader_election.cc:336] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Timed out: RequestConsensusVote RPC to 127.16.188.129:43781 timed out after 1.984s (SENT)
I20260709 13:18:28.072368 21817 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.107560 21658 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:28.130609 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1474) took 1450 ms. Trace:
I20260709 13:18:28.139175 18230 rpcz_store.cc:276] 0709 13:18:26.680260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.094990 (+1414730us) service_pool.cc:224] Handling call
0709 13:18:28.130530 (+ 35540us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:28.136859 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:28.140671 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:28.111550 21834 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:28.144497 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:28.131634 21767 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:28.149221 18230 raft_consensus.cc:2368] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:18:28.151062 18351 leader_election.cc:400] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:18:28.151446 18351 leader_election.cc:403] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:18:28.128899 21822 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:28.161486 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:28.136075 21820 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:28.083818 21831 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.127846 21630 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.146270 21624 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.183285 21832 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:28.184868 21630 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:28.186633 18380 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1968) took 1531 ms (client timeout 1830 ms). Trace:
I20260709 13:18:28.186959 21413 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:28.187117 18380 rpcz_store.cc:269] 0709 13:18:26.654769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.807776 (+153007us) service_pool.cc:224] Handling call
0709 13:18:28.186430 (+1378654us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b540019a854. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:28.186558 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638079744}
I20260709 13:18:28.163084 21821 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:28.190387 18237 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:28.167876 21822 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:28.162753 21686 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:28.167282 21688 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:28.138113 21680 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.196317 21630 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:28.196972 21658 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:28.197544 21413 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:28.198077 21681 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:28.198999 21765 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.172554 21829 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:28.167600 21767 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.194324 21624 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.173559 21474 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.167541 21550 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:28.171060 21785 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:18:28.195214 21648 consensus_meta.cc:287] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.879s	user 0.012s	sys 0.002s
I20260709 13:18:28.130348 21825 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.215046 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1464) took 1600 ms. Trace:
I20260709 13:18:28.253801 18233 rpcz_store.cc:276] 0709 13:18:26.614998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.616623 (+  1625us) service_pool.cc:224] Handling call
0709 13:18:26.616941 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.539013 (+922072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.214698 (+675685us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b540001bdd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:28.214969 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2119109504}
W20260709 13:18:28.254611 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 76519us
W20260709 13:18:28.208726 21665 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.001s
I20260709 13:18:28.216691 21630 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.221602 21817 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.222328 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 2088) took 1299 ms. Trace:
I20260709 13:18:28.192692 21821 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:28.225198 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2173) took 1880 ms. Trace:
I20260709 13:18:28.256104 21765 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:28.259963 18303 rpcz_store.cc:276] 0709 13:18:26.923145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.924190 (+  1045us) service_pool.cc:224] Handling call
0709 13:18:28.222111 (+1297921us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b540013f454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:28.222260 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":715879296}
I20260709 13:18:28.257907 18383 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:28.261236 18381 rpcz_store.cc:276] 0709 13:18:26.344894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.481789 (+136895us) service_pool.cc:224] Handling call
0709 13:18:26.485042 (+  3253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.896587 (+411545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.224876 (+1328289us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54000f2654. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:28.225118 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934618368}
I20260709 13:18:28.260221 21665 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.268690 18384 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:28.269824 21680 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.271384 21624 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:28.271533 21825 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.272177 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:28.299726 18309 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:28.273145 21821 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:28.264549 21474 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.213532 21688 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:28.268733 21736 consensus_meta.cc:287] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.006s
I20260709 13:18:28.260690 21837 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.272984 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:28.253875 21785 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.300944 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:28.334465 18379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1931) took 2147 ms (client timeout 1712 ms). Trace:
I20260709 13:18:28.340719 18303 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:28.301278 18229 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:28.337077 21736 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:28.347678 18307 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:28.347826 21736 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:28.335865 21648 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.348847 21648 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:28.349532 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:28.352337 21648 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:28.305539 21600 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.298291 21680 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.359288 21680 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.360110 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:28.305395 21824 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.306687 21831 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.281810 21818 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:28.340724 18379 rpcz_store.cc:269] 0709 13:18:26.187353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.188812 (+  1459us) service_pool.cc:224] Handling call
0709 13:18:28.307811 (+2118999us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b5400074754. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:28.334375 (+ 26564us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341141248}
I20260709 13:18:28.344340 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2075) took 1654 ms. Trace:
I20260709 13:18:28.345227 21767 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:28.363605 18304 rpcz_store.cc:276] 0709 13:18:26.690057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.736413 (+ 46356us) service_pool.cc:224] Handling call
0709 13:18:26.793613 (+ 57200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.882185 (+ 88572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.343977 (+1461792us) spinlock_profiling.cc:243] Waited 87.8 ms on lock 0x7b54001de554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:28.344250 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202025856}
I20260709 13:18:28.302891 21630 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:28.366703 18386 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:18:28.366847 21831 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:28.367234 18303 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:28.367885 21831 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:28.368268 21831 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:28.369148 21831 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.370296 21831 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:28.370877 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:28.372190 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:28.373247 21449 consensus_meta.cc:287] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.654s	user 0.012s	sys 0.000s
I20260709 13:18:28.373766 21449 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:28.376140 21449 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.377035 21665 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:28.380674 18303 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:28.381265 21640 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.381865 21640 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:28.382222 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:28.383802 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.384606 18303 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:28.385679 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.386694 18303 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:28.268704 21686 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.382395 21817 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:28.306828 21843 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:18:28.395969 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.405095 18304 raft_consensus.cc:2393] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:28.407119 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:28.391954 21817 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:28.416604 21845 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:18:28.401701 21665 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:28.418782 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:28.417785 21785 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:28.421573 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.392822 21630 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:28.342374 21837 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.415398 21818 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:28.440629 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.441289 21449 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.443077 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.460769 18309 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:28.420678 21767 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:28.461894 18304 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:28.461867 18377 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:28.466503 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:28.467315 18309 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:28.469357 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:28.470213 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:28.472016 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:28.472779 18380 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:28.474262 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:28.474897 18309 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:28.471096 18377 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
W20260709 13:18:28.480628 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 224279us
I20260709 13:18:28.483904 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:28.488862 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:28.463466 21831 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.427054 21665 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:28.432076 21630 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:28.498481 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 61383.5us
I20260709 13:18:28.499984 18380 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:28.473970 21733 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:28.496318 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 70873us
I20260709 13:18:28.467595 21449 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.523131 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:28.524994 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:28.482196 21736 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:28.512948 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:28.525621 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.469744 21767 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:28.527855 18306 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:28.511680 21680 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.530900 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:28.531975 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:28.532436 18306 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:28.529655 18304 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:28.533785 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:28.463845 21817 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.536450 18229 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:28.537271 18304 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:28.539925 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:28.503722 21831 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.545848 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:28.583261 18380 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:28.574410 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:28.576932 21624 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:28.574469 21818 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:18:28.552268 18276 leader_election.cc:336] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Timed out: RequestConsensusVote RPC to 127.16.188.131:44265 timed out after 1.847s (SENT)
I20260709 13:18:28.578208 21680 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:28.578895 21713 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.579313 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:28.579908 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:28.590309 18233 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:18:28.580559 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:28.591323 18382 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:28.545722 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:28.535218 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 53864.9us
I20260709 13:18:28.529179 21688 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:28.586828 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 76321us
W20260709 13:18:28.587925 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 62986.1us
I20260709 13:18:28.605394 18201 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:28.606402 18377 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 8: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:28.541829 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:28.607383 18234 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:28.540136 18304 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:28.541352 18306 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:28.584607 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:28.520648 21733 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:28.538115 21828 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:28.595337 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:28.575086 21695 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:28.596547 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:28.535105 21736 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:28.612843 18304 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:28.530309 21785 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:28.625885 21785 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:28.602516 21824 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:28.624354 21828 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:28.627717 18382 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:28.629160 21828 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:28.629443 21655 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:28.617136 21817 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:28.629992 18382 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:28.631230 18382 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:28.609138 18380 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:28.623899 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:28.633448 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:28.634488 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:28.635398 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:28.635928 18237 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:28.637214 18380 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:28.637722 21449 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.639051 18380 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:28.644313 18381 raft_consensus.cc:2410] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:28.626363 21785 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:28.647367 21630 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:28.652182 21796 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.656832 21819 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:28.663645 18237 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:28.667029 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:28.610810 21818 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:28.666115 18234 raft_consensus.cc:2410] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:18:28.670976 18131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 84) took 8459 ms. Trace:
I20260709 13:18:28.673481 21818 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.674542 21831 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.675547 21713 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:28.676662 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1561) took 1235 ms. Trace:
I20260709 13:18:28.582953 21617 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:18:28.677215 18308 rpcz_store.cc:276] 0709 13:18:27.440919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.778335 (+337416us) service_pool.cc:224] Handling call
0709 13:18:27.856310 (+ 77975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.857164 (+   854us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:27.857433 (+   269us) log.cc:844] Serialized 14 byte log entry
0709 13:18:27.857784 (+   351us) log.cc:844] Serialized 14 byte log entry
0709 13:18:28.655895 (+798111us) spinlock_profiling.cc:243] Waited 6.55 ms on lock 0x7b1800117040. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa181e29d70 00007fa181e1d293 00007fa181e12cea 00007fa181e1323a 00007fa18227da2a 00007fa18228d0bf 00007fa18228d038
0709 13:18:28.656242 (+   347us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:28.656310 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:28.656383 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.656481 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.676608 (+ 20127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7620,"prepare.queue_time_us":25139,"prepare.run_cpu_time_us":162,"prepare.run_wall_time_us":6688,"raft.queue_time_us":190,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":28328064}
I20260709 13:18:28.624169 21695 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.678735 21695 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:28.673935 18131 rpcz_store.cc:276] 0709 13:18:20.240270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.268883 (+ 28613us) service_pool.cc:224] Handling call
0709 13:18:28.670891 (+8402008us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:26.992801 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:27.166750 (+173949us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:27.172425 (+  5675us) write_op.cc:435] Acquired schema lock
0709 13:18:27.179956 (+  7531us) tablet.cc:662] Decoding operations
0709 13:18:27.427113 (+247157us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:27.438722 (+ 11609us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:27.441218 (+  2496us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:18:27.564301 (+123083us) tablet.cc:701] Row locks acquired
0709 13:18:27.564318 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:18:27.564532 (+   214us) write_op.cc:270] Start()
0709 13:18:27.566851 (+  2319us) write_op.cc:276] Timestamp: P: 1783603107564451 usec, L: 0
0709 13:18:27.568702 (+  1851us) op_driver.cc:348] REPLICATION: starting
0709 13:18:27.600650 (+ 31948us) log.cc:844] Serialized 2851 byte log entry
0709 13:18:28.096990 (+496340us) op_driver.cc:464] REPLICATION: finished
0709 13:18:28.156805 (+ 59815us) write_op.cc:301] APPLY: starting
0709 13:18:28.156925 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:28.157169 (+   244us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:28.157334 (+   165us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:28.251317 (+ 93983us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:28.268662 (+ 17345us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:18:28.268712 (+    50us) write_op.cc:312] APPLY: finished
0709 13:18:28.268998 (+   286us) log.cc:844] Serialized 58 byte log entry
0709 13:18:28.269170 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:28.269294 (+   124us) write_op.cc:454] Released schema lock
0709 13:18:28.269346 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:28.269717 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:28.269746 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3804045,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":48246,"apply.run_cpu_time_us":4275,"apply.run_wall_time_us":124131,"num_ops":7,"prepare.queue_time_us":161674,"prepare.run_cpu_time_us":36686,"prepare.run_wall_time_us":755709,"raft.queue_time_us":125239,"raft.run_cpu_time_us":6867,"raft.run_wall_time_us":26874,"replication_time_us":526836,"thread_start_us":311253,"threads_started":4,"wal-append.queue_time_us":128208}]]}
I20260709 13:18:28.669543 21785 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:28.681892 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 59443.1us
I20260709 13:18:28.682379 18382 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:28.686771 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 93475us
I20260709 13:18:28.685979 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:28.703151 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:28.682874 21665 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:28.710584 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 95418.7us
I20260709 13:18:28.716133 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:28.716876 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:28.717414 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:28.718264 18202 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:28.701792 21784 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:28.727311 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 122079us
I20260709 13:18:28.685441 21713 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:18:28.728410 18201 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:28.736362 21856 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:28.738335 21630 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:18:28.707574 21796 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:28.689304 21831 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:18:28.741521 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.713850 21837 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.730479 21784 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:28.741206 21665 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:28.770936 18236 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:18:28.781441 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1664) took 1243 ms. Trace:
I20260709 13:18:28.781847 18231 rpcz_store.cc:276] 0709 13:18:27.527815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.548627 (+ 20812us) service_pool.cc:224] Handling call
0709 13:18:28.770545 (+1221918us) spinlock_profiling.cc:243] Waited 79.3 ms on lock 0x7b5400329454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:28.770740 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182328064}
I20260709 13:18:28.770450 21713 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:28.789283 21713 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:28.790310 21733 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:28.790169 21713 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.791468 21713 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:28.795854 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:28.799849 18276 leader_election.cc:336] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Timed out: RequestConsensusVote RPC to 127.16.188.131:44265 timed out after 2.090s (SENT)
W20260709 13:18:28.803967 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 197741us
I20260709 13:18:28.747170 21796 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.773021 21857 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:28.836556 21786 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:28.840440 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.857334 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2199) took 1892 ms. Trace:
I20260709 13:18:28.820142 21837 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:28.858474 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:28.857811 18385 rpcz_store.cc:276] 0709 13:18:26.965371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.203377 (+238006us) service_pool.cc:224] Handling call
0709 13:18:27.203644 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.283782 (+ 80138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.283837 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.284403 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:18:27.328895 (+ 44492us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:27.328961 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.856989 (+1528028us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b5400075654. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:28.857031 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:28.857071 (+    40us) raft_consensus.cc:1685] finished
0709 13:18:28.857083 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.857281 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2237,"raft.queue_time_us":7375,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":4237,"spinlock_wait_cycles":168304512,"thread_start_us":10623,"threads_started":1,"wal-append.queue_time_us":99755,"wal-append.run_cpu_time_us":1549,"wal-append.run_wall_time_us":1001585}
I20260709 13:18:28.781071 21617 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:28.839434 21767 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:28.865314 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.866173 18304 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:28.867017 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:28.867167 18383 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:28.868742 18304 raft_consensus.cc:2368] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12.
I20260709 13:18:28.869776 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.870570 18304 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
W20260709 13:18:28.849485 21823 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.835s	user 0.000s	sys 0.004s
W20260709 13:18:28.847995 21832 consensus_meta.cc:287] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.000s
I20260709 13:18:28.795116 21665 raft_consensus.cc:697] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:28.864310 21617 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.834931 21736 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:28.875622 18385 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:28.792893 21821 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.858492 21837 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.820393 21855 consensus_queue.cc:1059] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:18:28.871397 21648 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:28.869485 21680 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:28.879904 21832 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:18:28.913797 18303 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
W20260709 13:18:28.916669 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 188379us
I20260709 13:18:28.919605 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 1981) took 1283 ms. Trace:
I20260709 13:18:28.920302 18384 rpcz_store.cc:276] 0709 13:18:27.635915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.758985 (+123070us) service_pool.cc:224] Handling call
0709 13:18:28.919399 (+1160414us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b540004bfd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:28.919536 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133035776}
I20260709 13:18:28.883922 21617 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:28.878247 21614 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:18:28.908164 21818 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.925299 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2105) took 1498 ms. Trace:
W20260709 13:18:28.915778 21822 consensus_meta.cc:287] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.702s	user 0.013s	sys 0.001s
I20260709 13:18:28.928457 18312 rpcz_store.cc:276] 0709 13:18:27.427344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.734429 (+307085us) service_pool.cc:224] Handling call
0709 13:18:27.734813 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.735264 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.735297 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.756229 (+ 20932us) log.cc:844] Serialized 26 byte log entry
0709 13:18:27.912922 (+156693us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:27.912981 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.913073 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:28.848788 (+935715us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:28.917754 (+ 68966us) raft_consensus.cc:1685] finished
0709 13:18:28.917776 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.925220 (+  7444us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2320,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":15926144,"thread_start_us":93172,"threads_started":1,"wal-append.queue_time_us":205476}
I20260709 13:18:28.933931 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:28.913980 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 225885us
I20260709 13:18:28.915686 21785 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:28.934597 18312 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:28.941228 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.935422 21832 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:28.947098 21832 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:28.949674 21832 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:28.926733 21640 consensus_meta.cc:287] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.001s
I20260709 13:18:28.960317 21640 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.961790 18231 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 12: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:28.873314 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.945950 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.963260 18312 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:28.964323 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:28.965582 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.966298 18312 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:18:28.967213 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:28.968326 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.970855 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:28.975693 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.914258 21648 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:28.979597 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:28.928937 21840 raft_consensus.cc:3055] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:28.915372 21854 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:18:28.917084 21680 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.982904 18304 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:28.987926 18304 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:28.990144 18304 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:28.979077 21545 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:28.994784 18312 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:28.998369 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1986) took 1360 ms. Trace:
I20260709 13:18:28.928741 21855 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:18:28.961790 21856 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:28.998879 18378 rpcz_store.cc:276] 0709 13:18:27.637518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.013522 (+376004us) service_pool.cc:224] Handling call
0709 13:18:28.015544 (+  2022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.123960 (+108416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.993125 (+869165us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b540033e354. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:28.998269 (+  5144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230193536}
I20260709 13:18:28.981603 21735 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:28.935050 21818 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.008908 18379 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:28.992699 21545 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.984835 21840 raft_consensus.cc:740] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:28.935109 21822 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:28.979265 21800 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:28.992714 21830 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:29.002799 21832 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:28.980657 21785 consensus_queue.cc:1059] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:18:29.033723 21630 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:29.021106 21735 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:29.016820 21686 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:29.036693 18308 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:29.037161 21600 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:29.041015 21629 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:29.054780 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 2107) took 1541 ms. Trace:
I20260709 13:18:29.149403 18305 rpcz_store.cc:276] 0709 13:18:27.513851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.546768 (+ 32917us) service_pool.cc:224] Handling call
0709 13:18:29.054565 (+1507797us) spinlock_profiling.cc:243] Waited 6.71 ms on lock 0x7b54002a1554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:29.054716 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15438720}
I20260709 13:18:28.978461 21665 consensus_queue.cc:237] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:29.103039 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 384805us
I20260709 13:18:29.042943 21550 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:29.155661 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 153747us
I20260709 13:18:29.105713 21796 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:29.160149 18202 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:29.051733 21830 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:29.048496 21800 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:29.055163 21832 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:29.147339 21614 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.106441 21630 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:18:29.099136 21686 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:29.177132 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 249251us
I20260709 13:18:29.158844 21785 raft_consensus.cc:3055] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:29.162374 21655 raft_consensus.cc:3055] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:29.203167 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:29.176127 21868 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:29.213558 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:29.216712 18305 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:29.119946 21856 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.223582 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:29.158370 21600 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.179262 21640 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:29.233035 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:29.234724 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:29.235752 18311 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:29.207190 21655 raft_consensus.cc:740] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:29.214085 21821 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:29.164436 21629 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.147571 21840 consensus_queue.cc:260] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:29.205291 21785 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:29.199863 21870 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:18:29.249989 21840 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:29.247393 18385 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:29.250643 21735 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:29.250973 21736 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:29.236856 21837 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:29.251492 21736 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:29.252535 21736 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.253669 21736 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:29.254659 21832 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:29.255087 21629 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:29.256958 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:29.256983 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 97599us
I20260709 13:18:29.222275 21449 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:29.250073 21817 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:29.181697 21614 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.260250 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:29.261618 18380 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:29.266047 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:29.267086 18377 raft_consensus.cc:2410] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:18:29.263151 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:29.269444 18385 raft_consensus.cc:2410] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:18:29.280128 18380 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:29.281733 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:29.283919 18380 raft_consensus.cc:2376] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8. Re-sending same reply.
I20260709 13:18:29.291077 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:29.303138 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 101764us
I20260709 13:18:29.316581 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:29.320472 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:29.336611 18201 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:29.337452 18380 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:29.338853 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:29.340387 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:29.256332 21830 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:29.354491 18377 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:29.355530 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:29.260943 21817 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:29.349937 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:29.353171 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:29.356426 18377 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 8: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:29.240446 21877 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:18:29.306391 21832 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.342058 21813 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 1.602s	user 0.001s	sys 0.009s
I20260709 13:18:29.379707 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:29.370832 18201 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:29.380384 18385 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 3.
I20260709 13:18:29.351609 21870 raft_consensus.cc:2764] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:18:29.271131 21735 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:18:29.272047 21630 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:18:29.362758 21796 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.404069 18380 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:29.314787 21629 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:18:29.269285 21449 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:29.392182 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:29.413084 18385 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:29.363778 21733 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:29.270226 21876 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 13:18:29.391824 18201 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:29.350543 21656 consensus_queue.cc:1059] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:18:29.391263 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:29.410769 18380 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:29.426230 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:29.428895 18380 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:18:29.429373 18380 pending_rounds.cc:85] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 5
I20260709 13:18:29.429632 18380 pending_rounds.cc:107] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:18:29.429908 18380 raft_consensus.cc:2889] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:29.431690 18380 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:29.434299 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:29.392457 21640 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.399529 21821 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:29.378201 21832 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.413506 21870 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:29.451169 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 98207.8us
I20260709 13:18:29.397581 21867 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:29.409132 21688 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:18:29.438560 21872 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:18:29.409641 21868 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:29.458971 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:29.459429 18276 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:29.476399 18385 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:29.383751 21655 consensus_queue.cc:260] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.480556 18276 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:29.413802 21796 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.455159 21800 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:29.458178 21870 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:29.457055 21733 raft_consensus.cc:3055] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:29.455466 21640 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:29.435628 21817 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.518086 21600 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:29.521782 21821 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:29.518807 21884 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:29.525715 21870 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:29.626888 21821 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:29.628410 21821 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.540758 21655 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:29.571393 21879 log.cc:927] Time spent T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:18:29.626937 21884 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:29.634922 21884 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:29.603166 21875 log.cc:927] Time spent T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:18:29.604184 21871 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:18:29.642405 21640 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:29.610442 21614 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:29.571729 21656 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:29.584067 21862 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:18:29.526847 21733 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:18:29.645776 21784 consensus_meta.cc:287] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.853s	user 0.013s	sys 0.000s
I20260709 13:18:29.571293 21688 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:29.643567 21686 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:29.531880 21885 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.141s
I20260709 13:18:29.663793 21817 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:29.476964 21867 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
W20260709 13:18:29.677770 21713 consensus_meta.cc:287] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.886s	user 0.014s	sys 0.003s
I20260709 13:18:29.694846 21796 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:29.690955 21832 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:29.646104 21868 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.701606 21870 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.701773 21867 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:29.703521 21870 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:29.493824 18276 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:29.664436 18386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 1985) took 2027 ms. Trace:
I20260709 13:18:29.741979 18386 rpcz_store.cc:276] 0709 13:18:27.637023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.003103 (+366080us) service_pool.cc:224] Handling call
0709 13:18:28.003498 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:28.367189 (+363691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.664045 (+1296856us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b540033d954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:29.664353 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":834640640}
I20260709 13:18:29.678576 21656 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:29.745517 21614 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:18:29.745750 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 274941us
I20260709 13:18:29.746331 21656 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:29.744240 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 250300us
I20260709 13:18:29.755836 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:29.757648 18276 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:29.739259 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2102) took 2502 ms. Trace:
I20260709 13:18:29.764735 18310 rpcz_store.cc:276] 0709 13:18:27.236897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.291068 (+ 54171us) service_pool.cc:224] Handling call
0709 13:18:27.291425 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.392127 (+100702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.392173 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.408919 (+ 16746us) log.cc:844] Serialized 26 byte log entry
0709 13:18:27.632116 (+223197us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:27.639293 (+  7177us) log.cc:844] Serialized 14 byte log entry
0709 13:18:27.776392 (+137099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.776470 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.157301 (+1380831us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:29.522919 (+365618us) raft_consensus.cc:1685] finished
0709 13:18:29.738223 (+215304us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.738796 (+   573us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2445,"prepare.queue_time_us":8956,"prepare.run_wall_time_us":41,"raft.queue_time_us":35445,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":31952,"spinlock_wait_cycles":21798784,"thread_start_us":449521,"threads_started":3,"wal-append.queue_time_us":298619}
I20260709 13:18:29.802559 21897 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:29.804894 21614 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:29.805680 21614 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:29.806180 21614 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:29.683327 21784 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:29.813725 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.817253 21897 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:29.818090 21897 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:29.819273 21800 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:29.820186 21800 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:29.821405 21870 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:29.823980 21870 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:29.820452 21897 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.815992 21784 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:29.835532 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 407218us
I20260709 13:18:29.835287 18384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:18:29.836655 21867 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:29.838521 21449 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:29.668895 21600 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.845345 21688 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.847092 21903 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.849959 21898 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:18:29.856766 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 92935.2us
I20260709 13:18:29.865111 18384 raft_consensus.cc:606] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:29.867530 18384 raft_consensus.cc:614] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:29.868175 21898 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.863572 21695 consensus_meta.cc:287] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 1.172s	user 0.016s	sys 0.008s
I20260709 13:18:29.884881 21903 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.888103 21903 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:29.889499 21800 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.891682 21695 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.896052 21870 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:29.896726 21911 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:29.918615 21449 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:29.919750 21449 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:29.922556 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1495) took 1993 ms. Trace:
I20260709 13:18:29.897702 18201 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:29.923074 18236 rpcz_store.cc:276] 0709 13:18:27.928902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.929313 (+   411us) service_pool.cc:224] Handling call
0709 13:18:28.770689 (+841376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:28.782727 (+ 12038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.922103 (+1139376us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b5400329450. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:29.922322 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1934286592}
I20260709 13:18:29.924129 21870 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:29.923887 21884 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.924850 21870 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.925323 21889 consensus_queue.cc:1059] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:29.899111 21600 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:29.927764 21640 raft_consensus.cc:3055] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:29.928355 21640 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:29.930158 21600 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:29.899530 21665 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:29.930039 21640 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.902298 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1680) took 1323 ms. Trace:
I20260709 13:18:29.933712 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 549) took 1904 ms. Trace:
I20260709 13:18:29.926357 21870 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:29.934751 21818 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:29.905146 21840 consensus_meta.cc:287] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.654s	user 0.004s	sys 0.013s
W20260709 13:18:29.936487 18308 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1577) took 1221 ms (client timeout 1617 ms). Trace:
W20260709 13:18:29.939133 18308 rpcz_store.cc:269] 0709 13:18:28.715179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.717832 (+  2653us) service_pool.cc:224] Handling call
0709 13:18:29.935990 (+1218158us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400222ed4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:29.936256 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677039488}
W20260709 13:18:29.937603 18303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 2111) took 1736 ms (client timeout 2191 ms). Trace:
W20260709 13:18:29.941006 18303 rpcz_store.cc:269] 0709 13:18:28.201246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.408592 (+207346us) service_pool.cc:224] Handling call
0709 13:18:29.937144 (+1528552us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54000bc2d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:29.937391 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1122315136}
I20260709 13:18:29.941408 21550 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:29.934257 18307 rpcz_store.cc:276] 0709 13:18:28.029304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.030266 (+   962us) service_pool.cc:224] Handling call
0709 13:18:28.030560 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.348228 (+317668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.933048 (+1584820us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b540011c954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:29.933465 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":728759168}
I20260709 13:18:29.943239 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:29.932812 18233 rpcz_store.cc:276] 0709 13:18:28.578331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.043294 (+464963us) service_pool.cc:224] Handling call
0709 13:18:29.043549 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.255814 (+212265us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:29.256130 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.398163 (+142033us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:29.398253 (+    90us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:29.398340 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.901652 (+503312us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540001b8d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:29.901738 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.901979 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32773,"prepare.queue_time_us":557,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":46,"raft.queue_time_us":44196,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":21158,"spinlock_wait_cycles":503426560,"thread_start_us":125704,"threads_started":1,"wal-append.queue_time_us":202406}
I20260709 13:18:29.945497 21545 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:29.946130 21784 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:29.946871 21784 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:29.948388 21784 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.954246 21897 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:29.914520 21695 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:29.914244 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:29.915700 21617 consensus_meta.cc:287] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.980s	user 0.014s	sys 0.005s
I20260709 13:18:29.917862 21898 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:29.821079 21733 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.897883 21867 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:29.942164 21550 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:29.926966 21884 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:29.985463 21617 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:29.995535 21617 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:29.998759 21898 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:30.000876 21624 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:30.002102 21624 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.004931 21912 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.005394 21624 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:30.006301 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.006646 21821 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:29.958252 21648 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:30.015537 21733 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:30.015829 21614 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:29.987183 21818 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.018824 21818 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.026494 21867 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:30.028677 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 115060us
I20260709 13:18:30.031528 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:30.032195 21819 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:30.032927 18307 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:29.923015 21449 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:30.031657 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:30.035502 18303 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:30.032975 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:30.043955 18308 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:18:30.046082 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 67736.4us
I20260709 13:18:30.058502 21818 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:30.058996 21867 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:30.012079 21821 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.064888 21857 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:30.065418 21857 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:30.065687 21822 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:30.066566 21614 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:30.066906 21857 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.008301 21912 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:30.072407 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 139507us
I20260709 13:18:30.074371 21821 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:30.072947 21912 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:30.083511 21856 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:30.084353 21856 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.087421 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:18:30.089073 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 56553.3us
I20260709 13:18:30.090026 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:30.090817 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.092171 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.093317 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.093389 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.093883 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.096374 18201 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:30.098464 21617 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:30.105181 21785 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.107621 21785 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:30.108564 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.107497 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:30.112437 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.125468 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.126220 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.114118 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:30.126497 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.126788 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.129161 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2212) took 1672 ms. Trace:
I20260709 13:18:30.123804 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 555) took 1177 ms. Trace:
I20260709 13:18:30.079195 21818 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.172792 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 73564.3us
W20260709 13:18:30.125144 18379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 2203) took 1675 ms (client timeout 2126 ms). Trace:
I20260709 13:18:30.166143 18382 rpcz_store.cc:276] 0709 13:18:28.456431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.631805 (+175374us) service_pool.cc:224] Handling call
0709 13:18:28.632043 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.684789 (+ 52746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.128565 (+1443776us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b540012af54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:30.128963 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115217280}
W20260709 13:18:30.161656 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 65471.8us
I20260709 13:18:30.166136 18960 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
W20260709 13:18:30.174481 18379 rpcz_store.cc:269] 0709 13:18:28.449658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.450218 (+   560us) service_pool.cc:224] Handling call
0709 13:18:30.124660 (+1674442us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54000ba4d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:30.124906 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037447552}
I20260709 13:18:30.145675 21640 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:30.121759 21736 consensus_meta.cc:287] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.867s	user 0.011s	sys 0.011s
I20260709 13:18:30.161480 21857 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:30.147804 21656 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:30.136221 21856 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:30.117483 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.129487 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:30.183224 21784 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:30.131031 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.176090 21870 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.195386 21818 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.198519 21656 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:30.214890 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1675) took 1631 ms. Trace:
I20260709 13:18:30.213567 21427 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:30.253954 21550 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.225982 18277 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:30.261459 18275 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:30.262235 21626 tablet_bootstrap.cc:492] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.205582 21624 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.263417 21624 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.264019 21626 tablet_bootstrap.cc:492] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:18:30.264777 21680 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:30.166708 18312 rpcz_store.cc:276] 0709 13:18:28.945981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.003928 (+ 57947us) service_pool.cc:224] Handling call
0709 13:18:29.029246 (+ 25318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:29.029493 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:29.210015 (+180522us) log.cc:844] Serialized 14 byte log entry
0709 13:18:30.122793 (+912778us) spinlock_profiling.cc:243] Waited 9.76 ms on lock 0x7b18001bef80. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181e1b4bc 00007fa17f16948b 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f183455 00007fa18226b060 00007fa18227d716 00007fa18228e287
0709 13:18:30.123030 (+   237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:30.123158 (+   128us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:30.123280 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.123414 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.123591 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7798,"prepare.queue_time_us":312501,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":77767,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6901,"spinlock_wait_cycles":22440192,"thread_start_us":428023,"threads_started":3,"wal-append.queue_time_us":482905}
I20260709 13:18:30.229693 21736 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:30.271174 21736 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.274217 21877 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.237016 18228 rpcz_store.cc:276] 0709 13:18:28.577083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.935792 (+358709us) service_pool.cc:224] Handling call
0709 13:18:28.937202 (+  1410us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:29.918842 (+981640us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b1800461500. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181e1b4bc 00007fa17f16948b 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f183455 00007fa18226b060 00007fa18226bbfb 00007fa18227664b
0709 13:18:29.919196 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.919235 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:29.920164 (+   929us) log.cc:844] Serialized 52 byte log entry
0709 13:18:30.081213 (+161049us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:30.081276 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.163347 (+ 82071us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.196042 (+ 32695us) raft_consensus.cc:1685] finished
0709 13:18:30.196064 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.208359 (+ 12295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9645,"raft.queue_time_us":179017,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":17100,"spinlock_wait_cycles":48003456,"thread_start_us":337159,"threads_started":2,"wal-append.queue_time_us":206450}
I20260709 13:18:30.225582 21870 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:30.282016 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1494) took 2338 ms. Trace:
I20260709 13:18:30.282506 18235 rpcz_store.cc:276] 0709 13:18:27.928310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.928449 (+   139us) service_pool.cc:224] Handling call
0709 13:18:27.932292 (+  3843us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.949699 (+ 17407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.949725 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.889450 (+1939725us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b2c000014c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:18:29.890586 (+  1136us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.981176 (+ 90590us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:30.163674 (+182498us) log.cc:844] Serialized 14 byte log entry
0709 13:18:30.189012 (+ 25338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.199346 (+ 10334us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.203217 (+  3871us) raft_consensus.cc:1685] finished
0709 13:18:30.206856 (+  3639us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.266388 (+ 59532us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5104,"raft.queue_time_us":27305,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":17015,"spinlock_wait_cycles":7504128,"thread_start_us":192765,"threads_started":2,"wal-append.queue_time_us":196132}
I20260709 13:18:30.209368 21856 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.270141 21550 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:30.286304 21892 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.725s	user 0.004s	sys 0.004s
I20260709 13:18:30.287241 21912 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:30.287729 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1677) took 1710 ms. Trace:
I20260709 13:18:30.279817 21736 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:30.288210 18231 rpcz_store.cc:276] 0709 13:18:28.577579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.795540 (+217961us) service_pool.cc:224] Handling call
0709 13:18:30.287273 (+1491733us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540026b954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:30.287461 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379449216}
I20260709 13:18:30.275599 21877 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.308772 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 552) took 2259 ms. Trace:
I20260709 13:18:30.266667 21656 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:30.313095 18275 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:30.321621 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:30.322665 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:30.323889 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 120284us
I20260709 13:18:30.330674 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.331333 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.331902 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.332357 18378 raft_consensus.cc:2410] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:30.332829 18382 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:30.313271 18309 rpcz_store.cc:276] 0709 13:18:28.047722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.476809 (+429087us) service_pool.cc:224] Handling call
0709 13:18:28.477166 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.679631 (+202465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.679658 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:28.679694 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:28.679723 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.296358 (+1616635us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400233f54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:30.296445 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.306735 (+ 10290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465176448}
I20260709 13:18:30.334590 18235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:30.323339 18233 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:30.339632 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:30.342007 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.316437 21733 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:30.335618 18235 raft_consensus.cc:606] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:30.348831 18235 raft_consensus.cc:614] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:30.337129 21889 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:30.356666 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 99836.2us
I20260709 13:18:30.356928 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:30.357733 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 44727.4us
I20260709 13:18:30.359272 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:30.360296 21737 consensus_queue.cc:1059] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:30.362541 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:30.365213 21818 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:30.354303 18381 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:30.365520 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.343142 21624 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:30.373204 18236 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 12: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:30.340384 21680 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.338717 21688 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.325057 21856 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.374548 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.379530 18237 raft_consensus.cc:2368] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12.
I20260709 13:18:30.365638 21897 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:30.374298 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 415) took 3556 ms. Trace:
I20260709 13:18:30.379599 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.386731 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.382189 18231 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:30.389102 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:30.389868 18381 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:30.392798 21889 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:30.389132 21735 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:30.394878 21735 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:30.396641 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2127) took 1120 ms. Trace:
I20260709 13:18:30.376137 21626 ts_tablet_manager.cc:1403] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 3.764s	user 0.068s	sys 0.055s
I20260709 13:18:30.399022 18228 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:30.408077 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.408787 18382 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:18:30.409150 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:30.397053 21866 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 1.128s	user 0.004s	sys 0.000s
I20260709 13:18:30.381949 18232 rpcz_store.cc:276] 0709 13:18:26.813112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.813491 (+   379us) service_pool.cc:224] Handling call
0709 13:18:26.819265 (+  5774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.831909 (+ 12644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.831960 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.922040 (+1090080us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b1800458b60. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1542a6 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a
0709 13:18:28.218809 (+296769us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b48001bc3d8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18719caa1 00007fa187193b37 00007fa1871939ca 00007fa18728b26f 00007fa18728af37 00007fa18729f55c 00007fa18729f508 00007fa18729f488 00007fa18729f443 00007fa18729e6ec 00007fa1861c8a96
0709 13:18:30.100936 (+1882127us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b2c000014c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:18:30.101631 (+   695us) log.cc:844] Serialized 26 byte log entry
0709 13:18:30.192434 (+ 90803us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:30.196257 (+  3823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.199905 (+  3648us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.364598 (+164693us) raft_consensus.cc:1685] finished
0709 13:18:30.364621 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.365902 (+  1281us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b540037e6d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:30.369556 (+  3654us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150,"raft.queue_time_us":4157,"raft.run_cpu_time_us":5610,"raft.run_wall_time_us":1392228,"spinlock_wait_cycles":27498880,"thread_start_us":89776,"threads_started":1,"wal-append.queue_time_us":254962}
I20260709 13:18:30.423545 21688 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.430028 18377 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:30.431639 21688 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:30.432535 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:30.433888 18378 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:30.434907 18275 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:30.435316 21856 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:30.437799 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:30.397161 18304 rpcz_store.cc:276] 0709 13:18:29.229785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.233431 (+  3646us) service_pool.cc:224] Handling call
0709 13:18:29.233908 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.351023 (+117115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.351067 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.351703 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 13:18:30.000051 (+648348us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:30.000170 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.258022 (+257852us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54003309d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:30.258076 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.258130 (+    54us) raft_consensus.cc:1685] finished
0709 13:18:30.258147 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.349880 (+ 91733us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26035,"raft.queue_time_us":18292,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":9193,"spinlock_wait_cycles":237702016,"thread_start_us":512528,"threads_started":1,"wal-append.queue_time_us":528300}
I20260709 13:18:30.418627 21733 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:30.401471 21680 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.452160 21692 raft_consensus.cc:3055] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:30.452689 21897 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:30.453176 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.450474 21912 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.452230 21920 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 13:18:30.458328 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 95922.2us
I20260709 13:18:30.459182 18381 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:30.462953 18233 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:30.469873 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1671) took 1928 ms. Trace:
I20260709 13:18:30.470408 18230 rpcz_store.cc:276] 0709 13:18:28.541780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.541968 (+   188us) service_pool.cc:224] Handling call
0709 13:18:28.542321 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:28.683414 (+141093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.683445 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:28.684047 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.017560 (+333513us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:29.025525 (+  7965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.025631 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.380108 (+1354477us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:30.468560 (+ 88452us) raft_consensus.cc:1685] finished
0709 13:18:30.468584 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.469653 (+  1069us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32510,"raft.queue_time_us":33978,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":7446272,"thread_start_us":408582,"threads_started":2,"wal-append.queue_time_us":559964}
I20260709 13:18:30.473647 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:30.475369 21784 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:30.475980 21830 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.476145 21784 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:30.476711 21830 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.477519 21821 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:30.477924 21821 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:30.478076 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.479105 21830 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:30.479605 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.469583 21912 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.482288 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.482640 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.483321 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.484120 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:30.461416 21692 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:30.490768 21821 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.459263 21889 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:30.487089 18309 raft_consensus.cc:1240] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:30.487596 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.489315 21680 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:30.489939 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 63156us
I20260709 13:18:30.496119 18232 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:30.499010 21912 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:30.397336 21735 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:30.500622 21626 raft_consensus.cc:359] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:30.503144 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.503705 18954 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:30.493513 21692 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:30.508927 21877 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:30.493559 21821 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:30.494839 21830 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.529744 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:30.530499 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:30.525847 18275 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:30.532925 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.542773 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:30.513123 21856 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.517654 21889 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:30.534492 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.547945 18385 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:30.548462 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:30.525879 21626 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
W20260709 13:18:30.559376 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.565359 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.565150 21889 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.566103 21830 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.567917 21889 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:30.568866 18384 raft_consensus.cc:2393] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:30.569871 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.570804 18384 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:30.571801 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.573580 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.574600 18232 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:30.575448 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.569914 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:30.577222 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 57184.8us
I20260709 13:18:30.580626 18386 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:30.581282 18230 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:30.576450 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.590951 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:30.596935 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.595016 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.598286 18381 raft_consensus.cc:2393] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:30.581100 21818 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:30.587754 21733 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:30.610679 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.611812 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.591565 21889 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:30.615373 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.617625 18228 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:30.615315 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:30.625239 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.626242 18234 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:30.580940 21881 consensus_queue.cc:1059] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:18:30.606798 21692 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.588724 21856 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:30.636991 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 87880.6us
I20260709 13:18:30.642414 18381 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:30.619417 21680 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.639622 18235 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:30.620075 21733 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:30.647356 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.620832 21830 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:30.676898 21817 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.677789 21817 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.681771 21614 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.682648 21614 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.685712 18228 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:30.688185 18232 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:30.692701 21680 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.691928 21817 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:30.695075 21680 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:30.689726 21614 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:30.700670 21889 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.702916 21889 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:30.661940 18233 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:30.708619 18229 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:30.600677 21626 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:30.625707 21818 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:30.725693 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.649641 21733 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:30.719470 18202 leader_election.cc:336] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.511s (SENT)
I20260709 13:18:30.758119 18230 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
W20260709 13:18:30.729878 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 68764.7us
I20260709 13:18:30.745460 18349 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:30.719908 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.756556 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.660655 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.699258 21656 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:30.754580 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.770155 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:30.778542 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:30.779371 18386 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:30.780198 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:30.783412 18381 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:30.790311 18386 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:30.790153 18378 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:30.794528 18236 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:30.800056 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.806598 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.808157 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.809175 18381 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 12: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:30.804240 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:30.786593 21817 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:30.820034 21912 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:30.820369 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.821345 21656 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:30.821558 18382 raft_consensus.cc:2393] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 8: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:30.822525 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.823272 18383 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:30.819048 21817 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.826786 21817 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:30.829083 21921 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.369s	user 0.005s	sys 0.000s
I20260709 13:18:30.834486 21912 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:30.835222 21912 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:30.850766 18202 leader_election.cc:336] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.601s (SENT)
I20260709 13:18:30.861905 21856 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:30.866868 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.867699 18234 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:30.867846 18231 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:30.868681 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.868952 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.868753 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.869570 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:30.871047 21929 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:18:30.871228 21656 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.871507 18234 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:30.871773 21656 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.873376 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.874250 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:30.874550 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.875288 18309 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:30.876300 18377 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:30.878499 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:30.880191 21626 ts_tablet_manager.cc:1434] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.470s	user 0.005s	sys 0.004s
I20260709 13:18:30.917294 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:30.906538 18378 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:30.927896 21836 raft_consensus.cc:3055] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:30.933531 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:30.945318 21736 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.946255 21912 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:30.946069 21736 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:30.968389 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:30.969390 18232 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:31.004679 21855 consensus_queue.cc:1059] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:18:31.009409 21817 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:31.012880 18377 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:31.015880 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:31.016827 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 49924.3us
I20260709 13:18:31.022001 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.036484 18233 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:30.928478 21836 raft_consensus.cc:740] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:18:31.067773 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 86348.9us
I20260709 13:18:30.996307 21818 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:31.071750 21855 raft_consensus.cc:3055] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:31.072219 21855 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:31.072477 21897 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.073189 21855 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:31.073352 21897 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.074770 21855 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:31.069700 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:31.081468 21897 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:31.031675 21912 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:31.094960 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:31.111577 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:31.116655 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:31.119900 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:31.114705 21912 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.126971 21912 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:31.131397 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:31.077558 21836 consensus_queue.cc:260] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:31.138126 21817 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:31.138772 21817 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:31.139107 21817 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.139456 21817 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:31.143751 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.145674 18381 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:31.148464 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 374919us
I20260709 13:18:31.149587 18377 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:31.108148 21656 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:31.157155 18378 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
W20260709 13:18:31.157909 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.159180 18235 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:31.160444 18233 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:31.172143 18381 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:31.151505 21856 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:31.150771 21733 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:31.189575 18383 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:18:31.190130 18383 pending_rounds.cc:85] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 3
I20260709 13:18:31.201949 18381 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:31.198288 21733 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:31.196660 18383 pending_rounds.cc:107] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:18:31.210098 18383 raft_consensus.cc:2889] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:31.210671 18383 pending_rounds.cc:107] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:18:31.211107 18383 raft_consensus.cc:2889] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:31.233758 18381 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:31.237118 21889 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.241725 18383 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:31.205235 21856 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.254596 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.256021 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.262482 18381 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:18:31.263033 18381 pending_rounds.cc:85] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 4
I20260709 13:18:31.263320 18381 pending_rounds.cc:107] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:18:31.263600 18381 raft_consensus.cc:2889] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:31.266584 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:31.268778 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.269626 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.270084 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:31.239797 21733 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.272539 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.268872 18234 raft_consensus.cc:2376] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12. Re-sending same reply.
I20260709 13:18:31.269533 18229 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:31.274727 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.276027 18230 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:31.285348 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:31.287329 18228 raft_consensus.cc:2368] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12.
I20260709 13:18:31.268451 21818 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.245093 21889 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.274462 21934 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.264606 21656 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:31.296160 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.301359 18235 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
W20260709 13:18:31.296018 18202 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.087s (SENT) [suppressed 48 similar messages]
I20260709 13:18:31.312665 18233 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:31.314438 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:31.314498 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:31.278559 21733 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.331040 21889 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:31.331475 21735 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:31.331753 21889 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.293910 21818 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.305426 21656 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.354782 21856 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:31.305225 21934 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:31.371456 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 247131us
I20260709 13:18:31.373981 18201 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:31.332245 21889 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:31.354836 21933 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.410s	user 0.009s	sys 0.015s
I20260709 13:18:31.385422 18322 tablet_copy_service.cc:342] P 459e82ee6b564cc19be6f73186938e79: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-2682a7690fb640b1a9ad52d5fa19e281 received from {username='slave'} at 127.0.0.1:46642
I20260709 13:18:31.388680 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:31.391677 21656 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:31.392095 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:31.393713 21818 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:31.397926 21889 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:31.405421 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 126629us
I20260709 13:18:31.421658 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:31.422386 18228 raft_consensus.cc:2368] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12.
I20260709 13:18:31.424160 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.398799 21856 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.426527 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.427830 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:31.428435 18228 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:31.429225 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.424295 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:31.431622 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 49773us
I20260709 13:18:31.372223 21817 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.415156 21889 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:31.431417 18322 tablet_copy_service.cc:434] P 459e82ee6b564cc19be6f73186938e79: ending tablet copy session e016302b7e734d74833a2bf7bab44838-2682a7690fb640b1a9ad52d5fa19e281 on tablet 2682a7690fb640b1a9ad52d5fa19e281 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:18:31.435644 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:31.451771 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.403139 21944 consensus_queue.cc:1059] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:18:31.455456 21934 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:31.457691 21948 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:31.437681 21656 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.467749 18228 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:31.471342 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:31.471377 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 97459.1us
I20260709 13:18:31.472565 18232 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:31.473093 18201 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:31.471989 18234 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:31.434648 21856 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.484678 18228 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:31.484601 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.488451 18276 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:31.490716 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:31.491470 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:31.492326 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:31.491493 18377 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:31.492472 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:31.493031 18380 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:31.491495 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:31.494774 18379 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:31.496085 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:31.496333 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:31.497138 18380 raft_consensus.cc:2368] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9.
I20260709 13:18:31.498570 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:31.498808 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:31.499779 18379 raft_consensus.cc:2410] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:18:31.500028 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:31.500749 18378 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:31.501173 18228 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:31.481169 21656 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.506017 21656 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:31.513098 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.514078 21818 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.514564 21818 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.517875 21856 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:31.518754 21856 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:31.519098 21856 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:31.519433 21856 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:31.522477 18276 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:31.523257 21656 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:31.523711 21656 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.524044 21656 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.524333 21912 consensus_queue.cc:1059] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:31.462070 21733 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:31.527060 18234 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:31.522173 18351 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:31.475982 21948 raft_consensus.cc:3055] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:31.480690 21736 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:31.540113 21821 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:31.592042 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.596165 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.596304 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:31.603251 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:31.608340 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.627717 21947 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:31.627916 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.628230 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.574355 21948 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:31.540557 21818 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:31.649044 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:31.679566 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.543233 21934 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:18:31.627609 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:31.656548 21952 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.656440 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:31.561146 21733 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:18:31.487754 21944 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:18:31.659998 21817 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:31.660494 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.662882 21656 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:31.663697 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 141617us
I20260709 13:18:31.649415 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:31.587431 21821 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:31.681927 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 208934us
I20260709 13:18:31.695995 18201 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:31.683660 18304 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
W20260709 13:18:31.579165 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54407.5us
I20260709 13:18:31.545423 21945 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.136s
I20260709 13:18:31.701499 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.704771 18307 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.706437 18306 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:31.707621 18303 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:31.699337 21821 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:31.735703 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.736580 21945 consensus_queue.cc:1243] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:31.737211 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.738306 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.739240 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.739765 18303 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:31.707973 18311 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:31.716734 21944 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:31.741592 21944 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:31.742507 21944 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.743818 21944 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:31.744364 21817 raft_consensus.cc:3055] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:31.745030 21817 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:31.746394 21736 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.746224 21817 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.746975 21736 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:31.747973 21817 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.706753 21912 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:18:31.749938 18310 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:31.753293 21818 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:31.754276 18236 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:31.755328 21818 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:31.756830 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:31.757987 21945 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:31.758684 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.764264 21736 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:31.765050 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.765808 18303 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:31.766175 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.768379 18310 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:31.769246 21836 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:31.770076 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.771346 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.774472 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.774947 18955 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:31.776158 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.777298 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:31.778350 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.779325 18234 raft_consensus.cc:2410] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:18:31.775103 18304 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:31.781410 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.782084 18304 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:31.782972 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.783578 18304 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:31.784415 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.723294 18307 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:31.766796 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.725041 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.725283 21952 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.716449 21948 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.792850 21948 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:31.793183 21952 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:31.733086 21857 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:31.724059 18308 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:31.795404 18304 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:31.791023 18306 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
W20260709 13:18:31.797648 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 90439.6us
I20260709 13:18:31.802376 18276 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:31.790197 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:31.725142 21946 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:18:31.799160 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:31.813248 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.814015 18228 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:31.809373 18276 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:31.806903 18310 raft_consensus.cc:2393] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 4: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:31.810390 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.816399 18308 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:31.775175 21889 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:31.825942 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.827067 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:31.714175 21897 raft_consensus.cc:3055] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:31.829226 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:31.830222 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:31.830686 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.831709 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.825915 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:31.826574 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:31.826721 18236 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:31.823578 18311 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:31.828146 18235 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
W20260709 13:18:31.827706 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 71303.5us
I20260709 13:18:31.834524 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.835141 18311 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:31.835883 18237 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:31.827503 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.836256 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.837141 18304 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:31.838008 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.839505 18276 leader_election.cc:400] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9.
I20260709 13:18:31.839658 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.839870 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.840271 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.841281 18307 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:31.841692 18230 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:31.841958 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:31.842638 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.843047 18276 leader_election.cc:403] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:18:31.843636 18304 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:31.822651 21952 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:31.846743 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:31.844901 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.849983 18304 raft_consensus.cc:2410] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:31.808712 21856 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.828050 21736 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:31.849102 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:31.829113 21897 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:31.850236 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.851153 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.851709 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.852329 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:31.844740 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:31.854329 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.844799 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.859841 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.860683 18228 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:31.860774 18232 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:31.861192 18233 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:31.861662 18311 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:31.867267 21821 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:31.868914 21856 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:31.847661 21656 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:31.869830 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.847121 21952 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.870494 21952 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:31.870711 18234 raft_consensus.cc:2410] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:18:31.870929 18312 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:31.846596 21889 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:31.850020 21857 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:31.873167 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:31.874855 18303 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:31.876114 18303 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:31.877453 18303 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:31.879645 18312 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:31.864168 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:31.881798 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 57014.1us
I20260709 13:18:31.856011 21951 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:31.865052 18310 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:31.885088 18202 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:31.888121 18305 raft_consensus.cc:2368] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8.
I20260709 13:18:31.891772 18312 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:18:31.891877 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2248) took 1178 ms. Trace:
I20260709 13:18:31.891101 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:31.895416 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:31.855279 21736 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.893784 18202 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:31.898384 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.901486 18307 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:31.902933 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:31.894266 21735 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.909010 18133 catalog_manager.cc:5697] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 7 to 10, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 10 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:31.911090 18133 catalog_manager.cc:5697] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:31.912747 18306 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:31.915938 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.892375 18382 rpcz_store.cc:276] 0709 13:18:30.713689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.148039 (+434350us) service_pool.cc:224] Handling call
0709 13:18:31.166970 (+ 18931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.207850 (+ 40880us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:31.222208 (+ 14358us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.481902 (+259694us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.583122 (+101220us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.583352 (+   230us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:31.583648 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.594004 (+ 10356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.594111 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.656034 (+ 61923us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b18003d4080. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:18:31.891624 (+235590us) raft_consensus.cc:1685] finished
0709 13:18:31.891659 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.891806 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7085,"prepare.queue_time_us":14919,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":2538,"raft.queue_time_us":163105,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":263,"spinlock_wait_cycles":3848832,"thread_start_us":193646,"threads_started":2,"wal-append.queue_time_us":196155}
W20260709 13:18:31.919207 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:31.920181 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.896641 21818 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:31.899446 21856 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:31.945530 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 249630us
I20260709 13:18:31.896906 21889 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:31.949234 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:31.963232 18386 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.901217 21736 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:31.922025 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:31.946288 18133 catalog_manager.cc:5697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 5 to 7, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 7 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:31.948709 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:31.949909 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:31.922927 18277 connection.cc:256] RPC call timeout handler was delayed by -1.0691890250002416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24230000000000002s for a response
I20260709 13:18:31.958544 18311 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:31.950649 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:31.984167 18378 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:31.915681 21953 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.980701 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:31.993114 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.994817 18382 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:31.997324 18381 raft_consensus.cc:2410] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:18:31.937132 21951 raft_consensus.cc:2764] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:18:31.937469 21818 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:32.011266 18383 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:31.945313 21856 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:32.018986 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 97049.2us
I20260709 13:18:32.026118 18133 catalog_manager.cc:5697] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 1 to 11. New cstate: current_term: 11 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:18:32.028781 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 130659us
I20260709 13:18:31.945429 21934 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:31.944986 21945 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:31.962754 21889 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:32.020414 21818 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:32.050616 18386 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:32.047694 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:32.067022 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:32.043428 21856 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.027788 21944 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:32.083266 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 251075us
I20260709 13:18:32.031280 21949 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:32.047868 21889 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:32.081051 21954 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.000602 21897 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:32.093299 21960 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:18:32.097858 21950 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:32.100209 21963 log.cc:927] Time spent T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:32.113394 18133 catalog_manager.cc:5697] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 6 to 9, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 9 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:32.043251 21934 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.047508 21821 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.122388 18276 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:32.010442 21953 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:32.043104 21945 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:32.086293 21944 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:18:32.152904 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 204248us
I20260709 13:18:32.154006 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:32.156010 18383 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:32.125223 21950 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.164079 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:32.177362 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:32.141845 21934 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:32.145531 21945 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.180914 18276 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:32.148396 21944 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:32.151793 21897 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:32.145107 21969 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:18:32.173180 21950 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:32.184823 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:32.187858 21733 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:32.198520 21733 raft_consensus.cc:697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:32.199558 18133 catalog_manager.cc:5697] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 6 to 9, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 9 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:32.184334 21976 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:32.201058 21976 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.201514 21976 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:32.201404 18133 catalog_manager.cc:5697] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 6 to 7, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 7 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:32.174139 21821 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:32.202301 21953 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:32.176726 21817 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:32.209110 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 183771us
I20260709 13:18:32.214710 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:32.178637 21974 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:32.139276 21954 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:32.237964 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 171022us
I20260709 13:18:32.199769 21733 consensus_queue.cc:237] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.245219 18133 catalog_manager.cc:5697] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 5 to 8, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 8 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:32.208642 21821 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.250975 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:32.248483 18201 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:32.253296 21857 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:32.253930 21857 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:32.256628 21972 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.257086 21949 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:32.257716 21949 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:32.258714 21949 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.260660 21821 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:32.261173 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:32.262219 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:32.262988 21969 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:32.263406 21969 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:32.264158 21969 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.264423 21975 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:32.263350 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:32.265815 21975 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:32.265611 18133 catalog_manager.cc:5697] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:32.266309 21975 raft_consensus.cc:697] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:32.267318 21975 consensus_queue.cc:237] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.267462 18133 catalog_manager.cc:5697] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:32.270202 21951 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:32.270726 21951 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:32.272128 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:32.273145 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:32.273412 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:32.273885 18955 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:32.274294 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:32.275223 18200 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:32.276986 21971 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:32.277473 21971 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:32.277874 21971 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.275751 21736 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.280030 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:32.281037 21736 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.281703 21857 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:32.282965 18133 catalog_manager.cc:5697] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 2 to 8, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 8 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:32.282099 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:32.229413 21817 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.276957 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:32.294427 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:32.231395 21974 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:32.300113 18382 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:32.207569 21956 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:18:32.305692 18384 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:32.303769 18310 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
W20260709 13:18:32.309052 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.278705 21951 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:32.311474 18133 catalog_manager.cc:5697] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 5 to 8, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 8 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:32.284403 21735 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9.
I20260709 13:18:32.323321 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:32.306382 21974 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:32.325479 21948 consensus_meta.cc:287] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.001s
I20260709 13:18:32.330446 18382 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:32.273218 21947 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:32.297863 21912 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.302232 21817 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:32.304683 21857 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:32.362581 21889 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.365587 21889 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:32.349963 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 73077us
I20260709 13:18:32.347689 21692 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:32.334491 21969 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.370203 21952 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.338681 21656 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.355793 21818 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.291647 21856 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.346796 21821 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.356843 21979 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:32.293212 21954 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.311589 21977 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:32.372848 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 124453us
I20260709 13:18:32.354107 18133 catalog_manager.cc:5697] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 6 to 10, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 10 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:32.376506 21969 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:32.373440 21692 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.378468 21736 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.390306 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:32.400209 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 64081.2us
I20260709 13:18:32.257236 21972 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.371037 21912 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.496701 21912 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.380870 21981 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.497561 21981 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.393487 21979 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.403810 21736 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.400069 21692 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.397008 21977 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:32.426120 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.484094 21971 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:32.429041 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54945.5us
I20260709 13:18:32.503794 18276 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:32.505029 18351 leader_election.cc:400] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12.
I20260709 13:18:32.505446 18351 leader_election.cc:403] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:18:32.431304 21944 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.437252 18201 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:32.511698 21944 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.437853 21985 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:32.512413 21949 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:32.437991 21818 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:32.512593 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 75497.1us
I20260709 13:18:32.512948 21949 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:32.512714 21985 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:32.440397 21821 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.447654 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:32.514220 18201 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:32.515196 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 67614.1us
I20260709 13:18:32.514746 21985 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:32.515326 21984 consensus_queue.cc:1059] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:32.515807 18201 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:32.516240 21984 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:32.451426 21952 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.516201 21956 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:32.516845 18277 leader_election.cc:400] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12.
I20260709 13:18:32.517270 18277 leader_election.cc:403] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:18:32.517104 21952 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:32.517379 18380 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:32.517999 21954 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:32.451833 18133 catalog_manager.cc:5697] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 5 to 9, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 9 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:32.518366 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:32.519555 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:32.519091 18133 catalog_manager.cc:5697] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:32.449556 21817 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.503455 21977 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.521008 21733 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:32.521432 21733 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.521791 21733 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:32.522317 21817 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:32.400547 21656 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.522956 21956 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:32.523866 21976 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:32.507937 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:32.524849 18379 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 8: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:32.525110 18385 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:32.526288 21976 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.469520 21950 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:32.475257 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.527769 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.464032 21945 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:32.528738 21950 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:32.530009 21945 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:32.530143 18202 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.191s (SENT)
I20260709 13:18:32.405186 21947 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:32.530714 18386 raft_consensus.cc:1240] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:32.502981 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:32.531414 18377 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:32.531540 21656 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.532611 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:32.533437 21656 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:32.533800 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:32.534611 21953 consensus_queue.cc:1059] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:32.535498 21953 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.535676 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:32.536659 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:32.536204 18133 catalog_manager.cc:5697] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 7 to 9, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 9 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:32.507978 21736 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.500742 21979 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:32.537490 21950 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:32.537958 21950 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.538343 21950 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:32.536001 21953 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:32.538759 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:32.539572 18229 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:32.508834 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:32.400671 21934 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.513566 21949 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.541335 21953 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.442284 21856 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.504237 21942 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.542140 21934 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.542344 21942 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:32.542773 21971 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:32.540431 18383 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:32.544646 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:32.545369 18310 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:18:32.494724 21972 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:32.516867 21981 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.462755 21974 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:32.536677 21888 raft_consensus.cc:3055] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:32.546733 21888 raft_consensus.cc:740] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:32.506692 21987 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:32.542555 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:32.536819 21947 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12.
I20260709 13:18:32.586516 21984 raft_consensus.cc:697] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:32.587198 21974 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:32.587628 21987 raft_consensus.cc:697] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:32.588331 18201 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:32.588917 21987 consensus_queue.cc:237] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.590485 18201 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:32.550118 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:32.554049 21888 consensus_queue.cc:260] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:32.543395 18133 catalog_manager.cc:5697] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 6 to 8, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 8 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:32.592938 21889 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:32.593521 21889 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:32.593426 21888 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.593822 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:32.594058 18133 catalog_manager.cc:5697] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 5 to 6, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 6 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:32.595223 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:32.595871 18234 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:32.554342 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:32.544669 21945 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:32.597309 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:32.595248 21951 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:32.598110 21951 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.598320 21857 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:32.598531 21951 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:32.598852 21857 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:32.599325 21857 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:32.576800 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:32.576853 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:32.569010 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:32.593538 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:32.602433 18235 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:32.602747 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.600405 21961 raft_consensus.cc:3055] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:32.585759 21954 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12.
I20260709 13:18:32.603678 21961 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:32.604113 21889 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.573505 21942 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:18:32.597421 21945 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.587700 21984 consensus_queue.cc:237] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.605012 21961 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.606089 21945 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:32.606765 21961 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.587199 18386 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 3.
I20260709 13:18:32.597119 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:32.585541 21692 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:32.609264 21944 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:32.609994 18955 raft_consensus.cc:2368] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7.
I20260709 13:18:32.611156 21692 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:32.612133 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:32.579805 18377 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:32.617377 21934 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:32.618400 21981 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:32.618674 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:32.619060 21981 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:32.619298 18384 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:32.620157 21981 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.621522 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:32.621850 21981 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.618438 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:32.620826 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:32.631917 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:32.633574 18377 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:32.623160 18383 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:32.596335 18133 catalog_manager.cc:5697] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:32.619098 18276 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:32.658968 18276 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:32.640957 18201 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:32.534607 18277 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:32.648615 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.650048 18351 connection.cc:256] RPC call timeout handler was delayed by -1.228318285000114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2917s for a response
I20260709 13:18:32.655185 21979 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.656141 18385 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:32.548748 18927 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:18:32.666090 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 117447us
I20260709 13:18:32.666211 18235 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:32.667989 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:32.668649 18310 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
W20260709 13:18:32.671167 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 62840.2us
I20260709 13:18:32.671101 18133 catalog_manager.cc:5697] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:32.674049 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:32.674621 18310 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.678808 21979 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:32.682868 18133 catalog_manager.cc:5697] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 4 to 7, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 7 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:32.686571 21856 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:32.687925 21856 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:32.688552 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:32.689289 18237 raft_consensus.cc:2393] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:32.688575 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:32.701141 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 166618us
I20260709 13:18:32.702255 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:32.705866 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:18:32.707429 18351 connection.cc:256] RPC call timeout handler was delayed by -1.1548288740000316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260709 13:18:32.708809 18351 connection.cc:256] RPC call timeout handler was delayed by -1.1116288739999618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 13:18:32.712239 21950 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.712890 21952 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:32.714046 18386 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 12: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:32.713897 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:32.714496 18234 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:32.685026 21944 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:32.715113 21949 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.716347 21738 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:32.716846 21738 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.716889 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:32.717187 21949 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.717710 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:32.718173 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:32.714354 21950 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:32.718827 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:32.719432 18236 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.719295 21951 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.721837 18233 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:32.717301 21738 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:32.722832 21733 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:32.717358 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:32.716970 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:32.778664 21733 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.681516 21942 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:32.673049 21934 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:32.716424 18200 leader_election.cc:400] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7.
I20260709 13:18:32.788012 18200 leader_election.cc:403] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:32.778968 21951 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:32.691306 21974 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:18:32.779538 18231 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.681332 21954 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:32.787745 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:32.793536 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:32.790926 18276 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:32.790079 18384 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
W20260709 13:18:32.790591 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.791260 18230 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:32.698820 21988 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:32.796198 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 66397.4us
I20260709 13:18:32.797871 18310 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:32.798481 18276 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:32.799803 18234 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:32.804222 18228 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
W20260709 13:18:32.805385 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 118343us
W20260709 13:18:32.806792 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 90503.6us
I20260709 13:18:32.812400 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:32.791008 21942 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.790942 21934 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.815955 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:32.817114 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:32.824071 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:32.831311 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:32.795384 21736 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:32.836772 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 49874.7us
I20260709 13:18:32.843148 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:32.843787 18385 raft_consensus.cc:2376] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10. Re-sending same reply.
I20260709 13:18:32.805469 21656 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:32.854279 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:32.855141 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:32.838253 18236 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:32.807158 21954 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:32.861426 18383 raft_consensus.cc:2368] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11.
I20260709 13:18:32.854884 18380 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:32.812785 21821 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:32.864126 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:32.842315 21897 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:32.867105 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:32.856573 21656 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.867552 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:32.867604 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:32.868198 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:32.875555 18383 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.868486 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:32.868711 18381 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:32.869113 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:32.876469 18377 raft_consensus.cc:2393] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:32.874722 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:32.836447 21733 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:32.869187 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:32.876310 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:32.829988 21889 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.822132 21950 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:32.822624 21934 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:32.822443 21942 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:32.878242 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:32.899869 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.975726 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:32.860411 21944 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:32.967931 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:32.839567 21956 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:32.968196 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 104133us
I20260709 13:18:32.861794 21735 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:32.870242 21736 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:18:32.972759 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 148770us
I20260709 13:18:32.982930 18379 raft_consensus.cc:2368] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11.
I20260709 13:18:32.992504 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:32.988466 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:32.988781 18236 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:18:32.989217 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:32.879293 21656 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.874408 21897 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:33.002589 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:32.966691 21979 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:32.983227 21956 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.014143 21947 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:33.031461 21947 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:33.031875 21947 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:32.869218 21738 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:33.000147 21976 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:33.003115 21897 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:33.036439 21992 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:18:32.965176 21977 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.004259 21735 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:33.094630 21735 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.012892 21736 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:33.050837 21733 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:33.051134 21956 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:33.110066 21738 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:18:33.124796 18378 raft_consensus.cc:2368] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9.
I20260709 13:18:33.124555 21944 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:33.127038 22001 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 13:18:33.128681 21994 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:18:33.130594 21821 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:33.131806 21821 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:33.137629 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 350391us
I20260709 13:18:33.112165 21733 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:33.175472 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:33.184878 21971 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.185622 21971 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.215644 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:33.236289 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.221591 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:33.216470 18229 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:18:33.227149 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.259955 21961 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.260838 21961 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.160490 21985 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.279829 18231 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:33.173547 21733 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:33.281819 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 403628us
I20260709 13:18:33.287873 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:33.301365 18377 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:33.302510 18229 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:18:33.305403 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:33.334259 18310 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:33.302783 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:33.336568 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:33.327836 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 335409us
W20260709 13:18:33.331676 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 43945.6us
I20260709 13:18:33.341296 18377 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:33.342494 18377 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:33.165915 21954 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.322338 21912 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.322890 22005 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:33.353118 21821 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:33.354252 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:33.382659 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 323317us
W20260709 13:18:33.393280 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.299816 21985 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:33.396944 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 124107us
W20260709 13:18:33.378048 21857 consensus_meta.cc:287] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.778s	user 0.009s	sys 0.004s
W20260709 13:18:33.398296 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 44197.9us
I20260709 13:18:33.402770 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:33.388199 18310 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
W20260709 13:18:33.419585 18383 consensus_meta.cc:287] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.000s
I20260709 13:18:33.419957 18383 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:33.271518 21736 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.429803 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:33.460350 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 186562us
I20260709 13:18:33.430590 22008 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:33.445242 21821 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:33.390061 21912 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.449446 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:33.418761 21979 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:18:33.449342 21999 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:33.501462 18377 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:18:33.424230 21857 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.402065 22005 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:33.507726 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 78021.9us
I20260709 13:18:33.516896 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:33.515674 18377 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:33.518218 18229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:33.568763 18229 raft_consensus.cc:606] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:33.480649 21971 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:33.483948 21977 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:33.455080 21950 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:18:33.569257 18229 raft_consensus.cc:614] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:33.572008 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 74004us
W20260709 13:18:33.573101 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 56247.1us
I20260709 13:18:33.524647 21817 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:33.587978 18377 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:33.588853 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:33.589663 18231 raft_consensus.cc:2410] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:18:33.519565 21821 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:18:33.569243 22008 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:33.452231 21735 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 13:18:33.572389 21949 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.606379 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:33.606501 21949 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.610008 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:33.611573 18381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:18:33.612319 18381 raft_consensus.cc:606] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:33.612704 18381 raft_consensus.cc:614] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:33.612805 18236 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:33.613957 21949 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:33.593135 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:33.602937 22008 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:18:33.614751 21981 consensus_meta.cc:287] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.992s	user 0.000s	sys 0.019s
I20260709 13:18:33.618849 21735 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:33.617446 21857 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:33.601424 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:33.656757 22008 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:33.621201 22011 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:18:33.622005 22018 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:18:33.618798 21947 consensus_meta.cc:287] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.002s
I20260709 13:18:33.617614 21912 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:33.627767 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:33.631040 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:33.633360 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:33.594868 21961 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:33.508942 21999 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:33.657006 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63884.6us
I20260709 13:18:33.660791 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:33.660262 18381 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:33.664353 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:33.666437 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:33.667287 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:33.658916 21945 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 1.052s	user 0.012s	sys 0.001s
I20260709 13:18:33.670217 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:33.727361 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:33.670853 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:33.728363 18311 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:33.671289 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:33.673044 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:33.670459 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:33.729972 18230 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:33.730559 18385 raft_consensus.cc:2368] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12.
I20260709 13:18:33.682106 18234 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:33.681866 18236 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:33.682376 18233 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:33.691239 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:33.691736 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:33.693670 18201 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:33.697014 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:33.709347 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:33.734912 18235 raft_consensus.cc:2410] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:18:33.672806 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:33.699064 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:33.735436 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:33.693163 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:33.738790 18386 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:33.735549 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:33.739614 18231 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:33.737619 18229 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:33.676083 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:33.700564 18310 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:33.743798 18306 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:33.691504 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:33.705799 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:33.669106 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:33.738178 18311 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:18:33.748661 18202 leader_election.cc:336] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.080s (SENT)
W20260709 13:18:33.794975 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.795238 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:33.795540 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 98675us
I20260709 13:18:33.796862 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:33.797418 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 103830us
I20260709 13:18:33.794318 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:33.798522 18310 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:18:33.690310 21889 consensus_meta.cc:287] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.708s	user 0.008s	sys 0.003s
W20260709 13:18:33.796025 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 65328.5us
I20260709 13:18:33.801088 18234 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:33.802240 18201 leader_election.cc:400] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11.
I20260709 13:18:33.816447 18201 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:33.803946 21692 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:33.690446 21934 consensus_meta.cc:287] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.690s	user 0.005s	sys 0.005s
I20260709 13:18:33.696758 21999 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:33.804877 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:33.805189 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:33.828039 21934 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.705508 21895 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:33.829115 18309 raft_consensus.cc:2368] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7.
I20260709 13:18:33.718228 21979 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:33.689695 22022 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:33.685575 21985 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:33.810659 18306 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:33.844417 18233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:33.812214 18305 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:33.845682 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:33.818032 18307 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
W20260709 13:18:33.684473 21942 consensus_meta.cc:287] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.684s	user 0.004s	sys 0.004s
W20260709 13:18:33.672569 22004 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.330s	user 0.001s	sys 0.001s
I20260709 13:18:33.804443 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:33.715687 22027 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:18:33.859498 18230 raft_consensus.cc:3055] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:33.859880 18230 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:33.860467 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1566) took 1169 ms. Trace:
I20260709 13:18:33.860705 18230 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.861901 18230 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.819489 18231 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
W20260709 13:18:33.824113 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 390943us
I20260709 13:18:33.860976 18237 rpcz_store.cc:276] 0709 13:18:32.690787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.692432 (+  1645us) service_pool.cc:224] Handling call
0709 13:18:32.719456 (+ 27024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:32.795789 (+ 76333us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:32.810803 (+ 15014us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.036466 (+225663us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b180007c840. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e1323a 00007fa18227da2a
0709 13:18:33.530036 (+493570us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:33.530835 (+   799us) log.cc:844] Serialized 26 byte log entry
0709 13:18:33.568898 (+ 38063us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:33.568940 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.569016 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.860131 (+291115us) raft_consensus.cc:1685] finished
0709 13:18:33.860253 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.860398 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110138,"prepare.queue_time_us":14883,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":9735,"raft.queue_time_us":155473,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":22687,"spinlock_wait_cycles":21961088,"thread_start_us":463944,"threads_started":1,"wal-append.queue_time_us":638249}
I20260709 13:18:33.862857 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:33.863173 18231 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:33.864231 21817 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:33.864977 21817 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:33.865906 18304 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:33.866132 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:33.866946 21950 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:33.867991 21656 consensus_meta.cc:287] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.853s	user 0.011s	sys 0.000s
I20260709 13:18:33.868371 21656 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.869661 18303 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:33.870456 21656 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:33.668478 21735 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.874109 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:33.681093 22028 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:18:33.830075 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:33.827943 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:33.839856 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:33.689975 22005 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:33.845731 18233 raft_consensus.cc:606] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:33.846558 18311 raft_consensus.cc:2368] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8.
I20260709 13:18:33.881246 18233 raft_consensus.cc:614] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:33.670042 22029 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.197s
I20260709 13:18:33.872160 21942 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:33.698182 22000 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.715s	user 0.000s	sys 0.004s
I20260709 13:18:33.887364 21999 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:33.715154 22019 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:18:33.845985 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:33.892208 18306 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:33.825006 21889 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7.
I20260709 13:18:33.795674 21949 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:33.882130 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:18:33.802021 21897 consensus_meta.cc:287] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.689s	user 0.004s	sys 0.006s
W20260709 13:18:33.856141 21956 consensus_meta.cc:287] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.723s	user 0.012s	sys 0.000s
I20260709 13:18:33.841347 18236 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:33.876439 21895 raft_consensus.cc:697] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:33.904116 18228 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:33.904383 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:33.705962 21945 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.842403 21961 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:33.842314 21971 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:33.916755 18236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:18:33.888590 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:33.877199 21988 consensus_meta.cc:287] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 1.068s	user 0.012s	sys 0.003s
I20260709 13:18:33.681288 21947 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:33.889739 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 141128us
I20260709 13:18:33.842492 21692 raft_consensus.cc:697] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:33.894006 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:33.882205 21733 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.597s	user 0.013s	sys 0.002s
I20260709 13:18:33.895025 18230 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:18:33.946177 18230 pending_rounds.cc:85] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 5
I20260709 13:18:33.894922 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:33.946427 18230 pending_rounds.cc:107] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:18:33.946698 18230 raft_consensus.cc:2889] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:33.899664 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:33.902400 18310 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:33.883808 18229 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:33.840319 21912 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:33.892625 21951 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:18:33.904171 18237 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:33.886567 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:33.905138 18306 raft_consensus.cc:2376] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9. Re-sending same reply.
I20260709 13:18:33.905758 22037 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:33.909649 21949 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:33.917374 18236 raft_consensus.cc:606] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:33.949877 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:33.923832 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46128 (request call id 436) took 1060 ms. Trace:
W20260709 13:18:33.949818 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 50245.5us
I20260709 13:18:33.956219 18228 rpcz_store.cc:276] 0709 13:18:32.863976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.874482 (+ 10506us) service_pool.cc:224] Handling call
0709 13:18:33.923610 (+1049128us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540037e6d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:33.923754 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361548032}
W20260709 13:18:33.956710 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 70212.8us
I20260709 13:18:33.957104 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:33.957849 18201 leader_election.cc:400] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11.
I20260709 13:18:33.957301 18383 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:33.940057 21988 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:33.939322 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:33.895601 21942 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:33.943181 18381 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:18:33.943841 18202 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.087s (SENT)
I20260709 13:18:33.944828 18384 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:33.958698 18201 leader_election.cc:403] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:18:33.959693 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:18:33.962189 18306 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:33.968084 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:33.969142 21951 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11.
I20260709 13:18:33.969496 18201 leader_election.cc:400] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9.
I20260709 13:18:33.969795 18201 leader_election.cc:403] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:18:33.877341 21979 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:33.980261 21979 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:33.952682 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:33.959602 22029 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:33.981166 18310 raft_consensus.cc:2368] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7.
I20260709 13:18:33.981487 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:33.950148 21985 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.959821 21912 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.953213 21692 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:33.997479 21735 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:33.969372 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:33.998723 22036 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.119s	user 0.000s	sys 0.002s
I20260709 13:18:33.955055 22037 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.000762 22037 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:33.971202 18201 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:33.959781 21971 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.953424 21733 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.002367 21971 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:34.002889 21971 raft_consensus.cc:697] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:34.003185 21733 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:34.004942 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:34.006211 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:34.007545 21999 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:33.969861 21951 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:33.977074 21948 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.974267 21934 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:33.981125 22029 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:33.962114 21950 raft_consensus.cc:2764] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:18:33.905463 21897 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.993525 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:33.970191 21949 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:33.948030 22021 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.906670 21956 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.031689 18303 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:34.007699 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:34.009477 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 2259) took 1156 ms. Trace:
I20260709 13:18:33.977324 21961 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:18:34.011587 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 67774.7us
I20260709 13:18:34.032688 18384 rpcz_store.cc:276] 0709 13:18:32.852917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.854849 (+  1932us) service_pool.cc:224] Handling call
0709 13:18:34.009312 (+1154463us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540019bc54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:34.009425 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2462331776}
I20260709 13:18:33.993657 18381 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:18:34.014703 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:34.042315 18383 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:34.015379 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:34.019788 18311 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:34.003753 21971 consensus_queue.cc:237] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.026434 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:34.031543 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:33.974728 21895 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:34.035233 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:34.045014 18926 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:34.050971 18303 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:34.035825 18201 leader_election.cc:400] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12.
I20260709 13:18:34.035977 21951 consensus_queue.cc:1059] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:34.044011 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:34.053153 18311 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:34.054065 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:34.055054 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:34.055974 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:34.056579 18312 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:34.045949 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:34.047431 18382 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:34.047456 18310 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:34.057571 18307 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:34.049157 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:34.047061 18306 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:34.051697 18201 leader_election.cc:403] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:18:34.022617 21979 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:34.066511 18308 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:34.068179 18381 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:34.060083 21881 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:34.073730 21881 raft_consensus.cc:697] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:34.074379 22029 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:34.074591 21881 consensus_queue.cc:237] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:34.033479 22008 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.077715 18309 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:34.078970 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:34.080494 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:34.081789 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 46090.1us
I20260709 13:18:34.082712 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:34.085008 18303 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:34.046729 21985 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:34.088490 18383 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:34.088240 21961 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:34.091805 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:34.089553 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:34.090085 21951 raft_consensus.cc:3055] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:34.093595 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:34.096832 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 118617us
I20260709 13:18:34.096904 18383 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:34.098979 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:34.067371 21979 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:34.081446 21950 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:34.112591 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:34.113682 21950 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:34.085040 21977 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:34.088454 22012 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:34.090973 22003 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:34.090174 22035 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:18:34.096941 21856 consensus_queue.cc:1059] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:18:34.096678 21951 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:34.045905 22021 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:34.126163 18385 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:34.097016 21889 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:34.168218 18383 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:18:34.270460 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:34.274483 18380 raft_consensus.cc:2368] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11.
I20260709 13:18:34.275833 18236 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:34.224063 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:34.278102 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:34.253732 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 147916us
I20260709 13:18:34.185503 18310 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
W20260709 13:18:34.282677 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.284101 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:34.288213 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:34.291210 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:34.117228 21979 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:34.294421 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:34.294466 18236 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:34.297169 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:34.116994 22008 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:34.298815 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:34.300777 21951 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.302181 21951 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:34.272792 21889 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.304808 21889 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:34.280663 22003 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:34.306062 22003 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:34.307547 21948 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9.
I20260709 13:18:34.122169 22012 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:34.308799 22012 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.310807 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:34.311312 18385 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:34.311470 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 222008us
I20260709 13:18:34.271664 21912 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:34.279721 21881 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.309964 22012 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.318965 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:34.272116 21947 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:34.237327 21945 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:34.328676 18380 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:34.280112 21956 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:34.343801 18385 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
W20260709 13:18:34.378136 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 48568.9us
I20260709 13:18:34.381093 18236 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:34.350330 22049 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.304s	user 0.002s	sys 0.000s
I20260709 13:18:34.407613 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:34.408656 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:34.409405 18306 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:18:34.396477 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.415632 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:34.416442 18230 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
W20260709 13:18:34.416738 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 134695us
I20260709 13:18:34.349162 22029 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:34.422276 22029 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.410343 21897 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:34.429040 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 45010.4us
I20260709 13:18:34.389134 21951 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:18:34.350507 21881 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:34.420966 22057 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:34.436005 18277 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:34.424103 22035 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:34.483086 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47169.5us
I20260709 13:18:34.431123 22029 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:34.485195 22043 log.cc:927] Time spent T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 13:18:34.482867 22010 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:34.501978 21881 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:34.505389 21889 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:34.506361 22037 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.505s	user 0.000s	sys 0.010s
I20260709 13:18:34.442080 21733 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:18:34.508831 22037 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.510382 18384 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:18:34.511945 22037 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:34.443596 22057 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:34.514477 18276 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:34.485925 21912 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:34.447580 22060 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:34.531301 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:34.556681 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 130679us
I20260709 13:18:34.442299 22031 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:18:34.513209 22053 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:34.439116 21856 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:34.567829 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:34.614256 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:34.599581 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 85345us
I20260709 13:18:34.608950 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:34.610155 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:34.495977 22035 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.681631 22035 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:34.616950 18202 leader_election.cc:400] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7.
W20260709 13:18:34.682585 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 65826.2us
I20260709 13:18:34.683413 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:34.615584 21954 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:34.686213 21954 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:34.687080 21954 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:34.617565 22045 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:18:34.691114 21971 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:34.691817 21971 raft_consensus.cc:993] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: : Instructing follower 459e82ee6b564cc19be6f73186938e79 to start an election
I20260709 13:18:34.692214 21971 raft_consensus.cc:1081] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Signalling peer 459e82ee6b564cc19be6f73186938e79 to start an election
I20260709 13:18:34.705129 18202 leader_election.cc:400] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8.
I20260709 13:18:34.706240 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:34.709095 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:34.709872 18384 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:34.711258 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:34.712054 18377 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:18:34.714000 18377 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:34.618754 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:34.619771 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:34.619942 22031 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:34.620225 18233 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 11: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:34.534570 22010 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:18:34.717767 18926 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:34.621111 21856 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:34.561594 22051 log.cc:927] Time spent T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:34.560672 22059 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.128s
I20260709 13:18:34.549995 22060 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:34.622989 21912 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:34.623607 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 55878.3us
I20260709 13:18:34.624486 18276 leader_election.cc:400] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11.
I20260709 13:18:34.729367 18276 leader_election.cc:403] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:18:34.635741 21961 consensus_meta.cc:287] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.541s	user 0.002s	sys 0.006s
W20260709 13:18:34.312300 21944 consensus_queue.cc:1175] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "459e82ee6b564cc19be6f73186938e79" responder_term: 9 status { last_received { term: 7 index: 4 } last_committed_idx: 3 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:34.640693 22057 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.641986 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:34.557572 21976 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:34.650695 22050 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.414s	user 0.000s	sys 0.002s
I20260709 13:18:34.657490 22021 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:34.667265 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 326491us
I20260709 13:18:34.668095 21947 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.670527 18380 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:34.672653 21999 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:34.724936 18232 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:34.529125 21736 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
W20260709 13:18:34.730230 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 319985us
I20260709 13:18:34.735985 18202 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:34.737637 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:34.642815 22061 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:34.730595 18201 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:34.725883 22031 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:18:34.747284 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 123025us
I20260709 13:18:34.628168 21979 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.738693 21881 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:34.758471 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:34.778425 18235 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:34.774964 18303 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:34.733574 22012 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:34.782562 18303 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:34.775650 18277 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:34.774641 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:34.786393 18308 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:34.741331 21961 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12.
I20260709 13:18:34.738569 21951 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:18:34.782744 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 46868.9us
I20260709 13:18:34.789574 22054 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:34.790144 22054 raft_consensus.cc:697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:34.790599 21934 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:34.791368 21897 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:34.791759 22009 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:18:34.788213 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 57697us
I20260709 13:18:34.732329 22058 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.794788 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:34.794595 18202 leader_election.cc:400] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7.
I20260709 13:18:34.756011 21999 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:34.796602 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:34.801867 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:34.781387 21976 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:34.783310 21881 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.792352 22009 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:34.783064 22012 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:18:34.857111 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 60634.2us
I20260709 13:18:34.856776 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:34.772601 21947 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.865481 18378 raft_consensus.cc:2368] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9.
I20260709 13:18:34.793892 21889 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:34.796617 21971 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:34.778697 21944 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:18:34.773226 22016 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:18:34.861137 22066 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:34.802795 21951 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.791083 22054 consensus_queue.cc:237] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:34.873667 21999 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.863693 21961 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:18:34.792744 22008 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:18:34.851348 22024 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:34.781616 22061 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:34.880666 22007 consensus_queue.cc:1059] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:18:34.619221 22053 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.857071 21881 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.792404 21956 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
W20260709 13:18:34.888329 18237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.037s	sys 0.079s
W20260709 13:18:34.919658 18237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.038s	sys 0.079s
I20260709 13:18:34.887431 22066 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.863579 22012 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:34.890259 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 96288us
I20260709 13:18:34.866405 22037 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:34.882831 21735 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:34.901327 21971 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:34.891884 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 90089.4us
I20260709 13:18:34.934993 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:34.899101 22065 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:34.938818 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:34.939644 18380 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:34.930058 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:34.944051 18235 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:18:34.848475 22058 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:34.932829 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 67320.7us
I20260709 13:18:34.946269 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:34.922441 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 140801us
I20260709 13:18:34.949769 18377 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:34.954391 18234 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:34.863191 22031 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.978197 22061 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:34.979321 21971 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.980582 22053 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:34.986860 21976 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:34.930534 21954 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:34.988869 21954 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:34.990264 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:34.990397 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:34.990952 21954 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:34.997035 22060 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:34.997952 22010 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:34.998170 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:34.998605 22010 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:34.925704 22066 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.004693 22002 raft_consensus.cc:3055] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:35.005275 22002 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:34.927846 21999 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.946353 21985 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:18:34.961354 22071 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:18:34.964983 22003 consensus_meta.cc:287] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.658s	user 0.011s	sys 0.000s
I20260709 13:18:34.965380 21979 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:34.969063 21856 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:34.969763 21961 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:34.970012 21951 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:34.970721 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:34.971215 21947 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:34.971771 21857 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:34.972064 21889 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:34.936235 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:34.999758 22010 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.010509 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:35.014895 18232 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
W20260709 13:18:35.015499 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 61630.3us
W20260709 13:18:35.015540 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 60916.7us
W20260709 13:18:35.026957 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.041795 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 253884us
I20260709 13:18:34.946321 21735 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:35.052157 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:34.926920 22029 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:35.073166 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 137036us
I20260709 13:18:35.056074 21985 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:35.080996 18277 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:35.087270 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:35.009083 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:35.083993 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:35.090428 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:35.084794 18927 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:35.093917 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 123290us
I20260709 13:18:35.094700 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:34.938405 22009 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:35.051790 22003 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.132004 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:35.096889 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:35.108114 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:35.095422 18277 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:35.139225 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 44036.9us
I20260709 13:18:35.076136 22037 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:35.142771 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:35.006464 22002 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:35.153054 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:35.128192 21692 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.140884 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:35.140486 18232 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:35.157905 18230 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:35.159399 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:35.159799 18378 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:18:35.105422 21817 raft_consensus.cc:2764] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:18:35.163443 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:35.164566 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:35.165987 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 57967us
I20260709 13:18:35.166121 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:35.166697 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:35.166857 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:35.169665 18276 leader_election.cc:400] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9.
I20260709 13:18:35.170090 18276 leader_election.cc:403] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:18:35.141603 21897 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:35.174357 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:35.138588 22060 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:35.142004 22070 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.154s	user 0.000s	sys 0.004s
I20260709 13:18:35.092967 21956 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.178867 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:35.095925 21954 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:35.097002 22063 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:18:35.104547 21948 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:35.188796 18236 raft_consensus.cc:2410] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:35.105592 21979 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:35.189517 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:35.151927 21961 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.147957 21736 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:18:35.200806 18228 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:35.197614 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:35.210601 18229 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:35.171180 21944 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:35.173285 22037 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:35.171599 21733 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:35.192893 22076 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:35.198649 21856 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:35.153910 22034 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
W20260709 13:18:35.233949 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 44541us
W20260709 13:18:35.231074 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 66645.7us
I20260709 13:18:35.164294 21888 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:18:35.255144 18955 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 11 LEARNER]: Advancing to term 12
W20260709 13:18:35.263593 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 69753us
I20260709 13:18:35.224228 22002 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.230598 21897 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.287318 18202 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:35.209929 21948 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.230648 21979 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:35.323546 18236 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:18:35.324085 18236 pending_rounds.cc:85] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 4
I20260709 13:18:35.324316 18236 pending_rounds.cc:107] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:18:35.324589 18236 raft_consensus.cc:2889] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:35.198304 22053 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:18:35.205973 22060 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.237008 22076 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:35.334362 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47123.5us
I20260709 13:18:35.335807 18380 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:35.221174 22016 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:18:35.240298 22077 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:35.241814 22078 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:35.332604 18955 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 12 LEARNER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:35.241984 22058 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:35.227264 21961 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.345727 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:35.345860 18234 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:35.352825 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:35.353420 22029 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:35.361616 22080 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:35.205602 21735 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.366209 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:35.189253 21985 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.370636 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1736) took 1097 ms. Trace:
W20260709 13:18:35.375779 21912 consensus_meta.cc:287] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.002s
I20260709 13:18:35.321025 21948 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:35.385632 22024 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11.
I20260709 13:18:35.386344 21979 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.356393 22031 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:35.388536 22060 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:35.389039 22037 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:35.391709 22055 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:35.337004 21733 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.344362 22076 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:35.400254 22035 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:35.377628 22066 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.402199 21961 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:35.377357 22003 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:35.413362 18237 rpcz_store.cc:276] 0709 13:18:34.272746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.272901 (+   155us) service_pool.cc:224] Handling call
0709 13:18:34.297625 (+ 24724us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:34.920154 (+622529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.920189 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:34.924400 (+  4211us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.154371 (+229971us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:35.193613 (+ 39242us) log.cc:844] Serialized 14 byte log entry
0709 13:18:35.193863 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.193949 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:35.370415 (+176466us) raft_consensus.cc:1685] finished
0709 13:18:35.370442 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.370577 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31406,"prepare.queue_time_us":43706,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":6263,"raft.queue_time_us":120875,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":21967,"spinlock_wait_cycles":3456,"thread_start_us":797817,"threads_started":2,"wal-append.queue_time_us":310341}
W20260709 13:18:35.421649 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.423036 18351 connection.cc:256] RPC call timeout handler was delayed by -1.1296270779998849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 13:18:35.453748 18351 connection.cc:256] RPC call timeout handler was delayed by -1.1143270779998602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 13:18:35.454134 18351 connection.cc:256] RPC call timeout handler was delayed by -1.0648270780000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 13:18:35.454483 18351 connection.cc:256] RPC call timeout handler was delayed by -1.0063270779999129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
I20260709 13:18:35.425390 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:35.338963 22079 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:35.435307 22029 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:35.425977 21912 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:35.450484 22087 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.413056 22012 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.455746 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:35.459836 22024 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:35.460431 22024 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.460899 22087 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.462327 22029 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.468758 22092 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:35.451087 22035 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:35.480791 22035 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.481832 22035 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:35.487603 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:35.451606 21733 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:35.458667 22078 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:18:35.500808 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 182944us
I20260709 13:18:35.505447 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:35.508392 18384 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:35.446107 22090 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:18:35.516182 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:35.516297 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:18:35.498638 21881 consensus_meta.cc:287] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.568s	user 0.012s	sys 0.000s
I20260709 13:18:35.507323 22009 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:35.533568 21985 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:35.536677 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:35.538100 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:35.527293 21881 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:35.511363 22092 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:35.525090 21817 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:35.529188 21947 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:35.534374 21985 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.575357 22087 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:35.577072 21945 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:35.577759 21945 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:35.536065 22076 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.586264 22076 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:35.590360 21733 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:35.590862 21897 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9.
I20260709 13:18:35.603444 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:35.604662 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:35.606104 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:35.606771 18310 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:35.572528 21947 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:35.608469 21947 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.608361 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:35.609915 18304 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:18:35.610056 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:35.610954 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:35.611788 21956 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:35.613708 18311 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:35.618803 18305 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:35.622294 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:35.623850 18310 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:35.626978 18307 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:35.630805 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:35.634367 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:35.635599 18312 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.635689 18307 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:35.634106 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:35.637933 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:35.634166 21897 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.639748 21897 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.640950 21881 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:35.644793 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:35.645367 18384 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.510069 22078 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.648643 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:35.617975 21985 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:35.554888 22009 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:35.677906 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 139861us
I20260709 13:18:35.679589 18233 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:35.691435 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:35.647351 21897 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:35.688125 18312 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:35.706800 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:35.707616 18312 raft_consensus.cc:2393] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:35.681773 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:35.708231 18309 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:35.709527 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:35.726220 18307 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:18:35.727391 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:35.728601 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:35.728813 18310 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:18:35.729764 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:35.730017 21951 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:35.731068 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:35.678335 22080 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:35.731441 18384 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:18:35.731675 18305 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:35.732836 18926 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:35.730535 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:35.733779 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 52084.2us
I20260709 13:18:35.734484 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:35.735343 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:35.736064 22108 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:35.737468 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:35.737401 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:35.738876 18385 raft_consensus.cc:2410] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:35.739118 21985 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.740765 21817 raft_consensus.cc:2764] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:18:35.741798 18310 raft_consensus.cc:2368] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9.
I20260709 13:18:35.730501 18307 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:35.748602 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:35.750859 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:35.647598 22087 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:18:35.752970 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:35.754585 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:35.750032 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:35.757956 18309 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:35.758298 18380 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:35.759697 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:35.760603 18309 raft_consensus.cc:2410] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:35.762727 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:35.683531 21912 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:18:35.770799 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:35.771575 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:35.772212 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:35.773178 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:35.730464 21951 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:35.758122 22112 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:35.791052 21985 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:35.777505 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:35.837024 18309 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:35.780783 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:35.779616 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:18:35.838281 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 57576.4us
I20260709 13:18:35.838743 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:35.759598 22108 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:35.788341 18303 raft_consensus.cc:2410] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:18:35.788937 22097 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:18:35.777680 21817 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:18:35.789892 22102 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:18:35.774976 22090 raft_consensus.cc:2764] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:18:35.798221 22029 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:35.803027 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.775425 18202 leader_election.cc:400] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9.
I20260709 13:18:35.871528 18202 leader_election.cc:403] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:35.872051 18201 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:35.872484 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 97193.6us
I20260709 13:18:35.873245 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:35.873258 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:35.874198 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:35.760123 21895 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:35.839416 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:35.839550 18377 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:18:35.856644 21692 consensus_meta.cc:287] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.682s	user 0.017s	sys 0.001s
I20260709 13:18:35.757148 22066 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:35.842595 18304 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:35.842852 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:35.885007 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:35.886441 18382 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:35.886569 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:35.848809 18379 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:35.764757 22012 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:35.765407 22113 raft_consensus.cc:2764] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:18:35.777590 22003 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.856988 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:35.821493 22051 log.cc:927] Time spent T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:18:35.804373 22079 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:35.875941 18309 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:35.839779 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:35.881978 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:35.767668 21979 consensus_queue.cc:1059] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:18:35.855439 22080 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:35.883035 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:35.872128 22108 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:35.903466 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:35.885035 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 105504us
I20260709 13:18:35.890410 21951 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.859891 22060 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:35.899691 18383 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.899772 18377 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:35.881158 22053 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:35.880997 21889 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9.
I20260709 13:18:35.859700 21733 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:18:35.883543 21961 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:35.858476 21947 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.892233 21692 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:35.897156 21817 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:35.895051 22029 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.934260 18383 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:35.920266 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:35.922448 22099 log.cc:927] Time spent T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.190s	user 0.002s	sys 0.000s
I20260709 13:18:35.895290 22069 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:35.932694 21889 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:35.924889 22078 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:35.894560 21895 raft_consensus.cc:697] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:35.919340 18382 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:18:35.922189 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:35.900714 22080 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.943570 22080 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:35.921129 22104 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:18:35.944716 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:35.894529 21856 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:35.945537 22037 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:35.940706 18955 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:35.943585 22121 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:35.921612 21961 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.946600 21961 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:35.950304 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:35.921032 22060 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:35.942726 21948 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 13:18:35.936556 21951 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:35.965209 18201 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:35.939752 22077 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:35.974433 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.974817 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:35.929462 22106 consensus_queue.cc:1059] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:18:35.981886 18201 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:35.937613 22029 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:35.960791 22079 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:36.021417 18275 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:35.953969 21889 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:35.980691 22069 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:36.028465 18309 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:36.035709 18305 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:36.047567 18309 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:35.977674 21948 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.019466 22113 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:36.056221 22100 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.396s	user 0.000s	sys 0.004s
I20260709 13:18:36.026883 22106 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:36.072696 22106 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:35.993098 22012 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:18:35.993256 22075 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:18:36.057487 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 107256us
I20260709 13:18:36.028972 21736 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:36.064025 21948 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:36.064770 18235 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:35.987766 21895 consensus_queue.cc:237] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:36.034169 21856 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:36.065994 22060 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:36.023742 21817 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.067584 21889 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:36.069267 22120 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:18:36.070353 22117 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:18:36.034049 22057 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:36.078758 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:35.988341 22077 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.053671 22121 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:36.073736 22106 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
W20260709 13:18:36.173098 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 191300us
I20260709 13:18:36.087968 18305 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:18:36.175427 22129 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:36.175971 22106 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:36.162147 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.179628 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.180975 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:36.181099 18233 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:36.182786 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:36.185176 22080 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.185736 18311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:43794
I20260709 13:18:36.186362 18311 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:36.186735 18311 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:36.187868 18312 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:36.190588 21985 raft_consensus.cc:3055] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:36.190991 21985 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:36.169673 21947 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:36.193207 21948 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.193811 21948 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:36.196530 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 117841us
I20260709 13:18:36.197571 22029 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:36.197769 22077 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:36.198868 21947 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:36.197847 21948 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:36.200348 22054 raft_consensus.cc:3055] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:36.200735 22054 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:36.201661 22054 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.203681 22080 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:36.205343 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:36.205717 18233 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:36.206349 21961 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.185308 22121 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.213963 18234 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:36.210536 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:36.216025 18311 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.059993 22113 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.055514 22037 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:36.173277 22012 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.234858 22012 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:36.237334 22012 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:36.225276 22009 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:36.229458 18228 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:36.191911 21985 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.240538 21985 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:36.232282 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:36.128384 22079 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:36.247447 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.217728 22080 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.259703 18308 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:36.262362 18308 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:18:36.209847 22092 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:36.264814 22092 raft_consensus.cc:697] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:36.266047 22092 consensus_queue.cc:237] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:36.273301 22101 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.712s	user 0.004s	sys 0.000s
I20260709 13:18:36.208483 21961 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:36.287129 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:36.288092 18230 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:36.289253 18311 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:36.208729 22069 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:36.289608 18308 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:36.216862 22127 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:36.228135 22113 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.292627 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:36.292737 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:36.295578 18230 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:36.209658 22090 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:18:36.242621 21947 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:36.307147 21945 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:36.308542 22024 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:36.311326 21947 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.312909 22079 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.313737 21947 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:36.293195 22069 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:36.316815 18308 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:36.320875 22003 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:36.320779 22069 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.322235 22069 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:36.322494 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:36.323143 18230 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.328852 18308 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:18:36.221262 22129 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:18:36.352619 18230 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:18:36.358493 22054 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:36.370600 22115 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.480s	user 0.000s	sys 0.002s
I20260709 13:18:36.373332 22037 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.375778 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1753) took 1036 ms. Trace:
I20260709 13:18:36.376187 18236 rpcz_store.cc:276] 0709 13:18:35.339334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.339478 (+   144us) service_pool.cc:224] Handling call
0709 13:18:35.339864 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.401588 (+ 61724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.401654 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.422358 (+ 20704us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.637617 (+215259us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:35.637658 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.375331 (+737673us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b540005a354. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:36.375387 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.375438 (+    51us) raft_consensus.cc:1685] finished
0709 13:18:36.375450 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.375711 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":445,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"spinlock_wait_cycles":140665088,"thread_start_us":192169,"threads_started":1,"wal-append.queue_time_us":204198}
W20260709 13:18:36.387981 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.405153 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.407608 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1582) took 1248 ms. Trace:
I20260709 13:18:36.291901 22080 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.408294 18235 rpcz_store.cc:276] 0709 13:18:35.158940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.159176 (+   236us) service_pool.cc:224] Handling call
0709 13:18:36.407296 (+1248120us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b540037e1d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:36.407523 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2075508992}
W20260709 13:18:36.416163 22114 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.634s	user 0.002s	sys 0.000s
I20260709 13:18:36.297631 22127 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:36.352798 21881 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:18:36.438496 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:36.417541 22113 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.420886 18306 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: [10.8-12.9]
I20260709 13:18:36.446188 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:36.441787 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 231291us
I20260709 13:18:36.446496 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:36.447551 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:36.450670 18377 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:36.453150 18385 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:36.454329 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:36.459373 18380 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:36.462280 18377 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:36.466668 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:36.454365 22127 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:36.470628 22080 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:36.472280 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:36.472954 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:36.473187 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1755) took 1128 ms. Trace:
I20260709 13:18:36.475800 18201 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:36.476280 18235 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:36.475400 18231 rpcz_store.cc:276] 0709 13:18:35.345267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.352691 (+  7424us) service_pool.cc:224] Handling call
0709 13:18:35.353033 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.379525 (+ 26492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.379553 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.589227 (+209674us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b1800435ac0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1542a6 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a
0709 13:18:35.589621 (+   394us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b2c000014c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:18:35.590070 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.704667 (+114597us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:35.704719 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.704809 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.415438 (+710629us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:36.472995 (+ 57557us) raft_consensus.cc:1685] finished
0709 13:18:36.473016 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.473132 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26135,"raft.queue_time_us":26477,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":59380224,"thread_start_us":114206,"threads_started":1,"wal-append.queue_time_us":187612}
I20260709 13:18:36.479070 18380 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:36.483071 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:36.485117 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:36.488478 18235 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:18:36.488927 18235 pending_rounds.cc:85] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 5
I20260709 13:18:36.489256 18235 pending_rounds.cc:107] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:18:36.489535 18235 raft_consensus.cc:2889] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.491487 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:36.491804 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:36.492414 18235 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:36.493480 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:36.493655 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:36.496279 18236 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:36.498557 18236 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:18:36.492331 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.500703 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:36.544692 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.546617 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:36.494558 22129 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:36.494853 21889 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.478794 22035 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.500906 22009 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.500676 22078 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.478590 21999 consensus_queue.cc:1059] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:18:36.563238 22076 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:36.563735 22003 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:36.570451 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:36.564779 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54768.1us
I20260709 13:18:36.582158 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:36.547694 18957 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:36.494148 22127 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:18:36.554560 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.589197 18235 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:18:36.585301 22144 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:18:36.585676 22054 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:36.607743 22010 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:36.604347 21889 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:36.648473 22054 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.955263 22054 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:36.956023 22054 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:36.604161 22035 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:36.719255 22113 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:36.720566 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2212) took 1004 ms. Trace:
I20260709 13:18:36.822947 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:36.793120 18233 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:36.834782 18349 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:18:36.967466 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 132774us
W20260709 13:18:36.791074 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.974727 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:36.975972 18379 raft_consensus.cc:2410] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:18:36.963629 18311 rpcz_store.cc:276] 0709 13:18:35.716541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.293956 (+577415us) service_pool.cc:224] Handling call
0709 13:18:36.294294 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.294538 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.294561 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.331089 (+ 36528us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.577504 (+246415us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:36.577544 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.577648 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.720206 (+142558us) raft_consensus.cc:1685] finished
0709 13:18:36.720237 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.720463 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":135845,"threads_started":1,"wal-append.queue_time_us":277186}
I20260709 13:18:36.979039 22113 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:36.979709 22113 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:36.610849 22119 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.749s	user 0.002s	sys 0.002s
I20260709 13:18:36.988926 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1645) took 1387 ms. Trace:
I20260709 13:18:36.712220 22139 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:36.641804 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 59746.9us
I20260709 13:18:37.032266 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:36.679163 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:36.683888 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:36.606940 18234 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:37.043840 18234 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:36.697985 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:37.046073 18382 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:36.699849 18381 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:36.685405 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:36.840054 21985 consensus_meta.cc:287] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.599s	user 0.012s	sys 0.001s
W20260709 13:18:36.724817 22146 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:18:37.039150 18306 rpcz_store.cc:276] 0709 13:18:35.601929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.033468 (+431539us) service_pool.cc:224] Handling call
0709 13:18:36.420599 (+387131us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:36.444259 (+ 23660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.988540 (+544281us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54000bc7d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:36.988831 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889203456}
I20260709 13:18:36.605847 21961 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:36.700542 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:36.640740 22076 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:36.645064 22127 raft_consensus.cc:697] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:37.059412 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:36.650142 22092 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:37.064137 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:37.079873 18236 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:37.064936 18234 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.081899 18234 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:36.795150 21999 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.985172 22108 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:36.962831 21889 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:37.074127 18955 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:36.834030 22069 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:36.605509 22129 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:36.607666 22078 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.102662 22128 consensus_queue.cc:1059] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:18:37.083290 22092 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:37.086323 18954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53364 (request call id 250) took 1356 ms. Trace:
I20260709 13:18:37.087602 18961 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 12 LEARNER]: Advancing to term 13
I20260709 13:18:37.073410 22139 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:37.091837 22127 consensus_queue.cc:237] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.093230 22076 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.094937 22130 raft_consensus.cc:3055] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:37.063411 22008 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.073151 22113 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:37.102798 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1647) took 1500 ms. Trace:
I20260709 13:18:37.103209 18305 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:37.110109 18384 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:37.181243 18304 rpcz_store.cc:276] 0709 13:18:35.602484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.610709 (+  8225us) service_pool.cc:224] Handling call
0709 13:18:37.102543 (+1491834us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b540013ef54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:37.102721 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2843008}
I20260709 13:18:36.606786 22009 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.183799 22009 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:37.121248 18378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.022s	sys 0.126s
W20260709 13:18:37.184348 18378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.022s	sys 0.126s
W20260709 13:18:36.600473 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 54001.4us
I20260709 13:18:37.191870 22008 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.193347 22129 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.197798 22078 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:37.125303 22037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.099s	sys 0.128s
W20260709 13:18:37.143258 18237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.005s	sys 0.013s
I20260709 13:18:37.121061 22090 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:37.167088 22140 raft_consensus.cc:3055] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:37.157585 18234 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:36.963064 22054 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:37.122156 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.138260 22108 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:37.142902 21889 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:37.180775 18382 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:18:37.236460 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:37.232896 22037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.100s	sys 0.129s
I20260709 13:18:37.237737 18961 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 13 LEARNER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
W20260709 13:18:37.233071 18237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.005s	sys 0.013s
I20260709 13:18:37.243342 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:37.246266 18233 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:37.248318 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:37.257165 18230 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 6: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:18:37.251988 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 415945us
W20260709 13:18:37.239471 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 200485us
I20260709 13:18:37.142311 22069 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.139411 21999 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.163192 22130 raft_consensus.cc:740] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:37.342469 18230 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:37.451359 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:37.359025 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:37.357519 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:37.322113 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.358393 18235 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:37.343583 18233 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:18:37.474445 18233 pending_rounds.cc:85] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 6
I20260709 13:18:37.474905 18233 pending_rounds.cc:107] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:18:37.475313 18233 raft_consensus.cc:2889] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:37.401778 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 214860us
I20260709 13:18:37.294543 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:37.254335 18961 pending_rounds.cc:85] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Aborting all ops after (but not including) 7
I20260709 13:18:37.480369 18961 pending_rounds.cc:107] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:18:37.480926 18961 raft_consensus.cc:2889] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 13 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:37.482412 18232 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:18:37.478370 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 412855us
I20260709 13:18:37.236078 22140 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:37.259874 22108 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:37.500028 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:37.377007 22169 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.262694 22053 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:37.365882 22054 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:37.264392 21961 raft_consensus.cc:697] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:37.295392 22156 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.277s
I20260709 13:18:37.314579 22121 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:37.238695 22090 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:37.314414 21985 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.232s
I20260709 13:18:37.332176 22113 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.229s
I20260709 13:18:37.262532 21889 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.331326 22092 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.323403 22037 consensus_queue.cc:1059] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.223s
I20260709 13:18:37.600420 18277 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:37.506498 18380 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
W20260709 13:18:37.595773 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:37.572124 18231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.004s	sys 0.029s
W20260709 13:18:37.629428 18231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.006s	sys 0.031s
I20260709 13:18:37.367982 22167 consensus_queue.cc:1059] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.194s
W20260709 13:18:37.605273 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 1.12868e+06us
W20260709 13:18:37.626377 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 182252us
I20260709 13:18:37.634845 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:37.401403 22139 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:37.599731 22080 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.644119 18351 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.155s (SENT) [suppressed 13 similar messages]
I20260709 13:18:37.599548 21733 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.505898 21934 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.598941 22010 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.491895 22168 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.606693 22076 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.655465 18234 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:37.633528 22128 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.599249 22077 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.544528 21976 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.684195 22037 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:37.690990 21961 consensus_queue.cc:237] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.639771 21736 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:37.637710 22079 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.653820 22167 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.640187 22054 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:37.701932 18234 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:37.633554 22121 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.625895 22169 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.689705 22031 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.543994 22140 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.641031 22053 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.681876 22080 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.711226 22054 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:37.652257 22170 consensus_queue.cc:1059] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 13:18:37.681800 21934 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.681705 21733 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.687774 21976 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.684474 22010 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:37.772184 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 295877us
I20260709 13:18:37.688606 22168 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.697146 22076 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.704285 22077 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.692912 22128 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.711445 22079 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:37.796718 22121 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:37.146167 18954 rpcz_store.cc:276] 0709 13:18:35.729916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.730057 (+   141us) service_pool.cc:224] Handling call
0709 13:18:35.730412 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.820979 (+ 90567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.841950 (+ 20971us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.896284 (+ 54334us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.174571 (+278287us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:36.215600 (+ 41029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.225437 (+  9837us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.085294 (+859857us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b540091b520. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821e8dbe 00007fa1821f3930 00007fa1821f38d8 00007fa1821f3858 00007fa1821f3813 00007fa1821f2a9c 00007fa1880de626 00007fa1880d8dd8 00007fa18222f7cb 00007fa1822322c0
0709 13:18:37.085603 (+   309us) raft_consensus.cc:1685] finished
0709 13:18:37.085644 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.086192 (+   548us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2222,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":37673,"spinlock_wait_cycles":54577920,"thread_start_us":243115,"threads_started":1,"wal-append.queue_time_us":288401}
I20260709 13:18:37.774045 22177 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.764704 22031 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.783641 22140 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:37.713814 22167 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.771653 22093 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:18:37.801621 22170 raft_consensus.cc:3055] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:37.793713 21999 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:37.820499 22170 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:37.836859 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 198982us
W20260709 13:18:37.837920 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 203865us
I20260709 13:18:37.839339 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:37.835458 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 89051.1us
I20260709 13:18:37.823833 22054 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.851272 22031 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:37.851611 22054 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:37.853708 22168 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:37.854054 22053 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:37.862150 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:37.864188 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 220092us
I20260709 13:18:37.864677 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:37.865967 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 79195.2us
I20260709 13:18:37.866777 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:37.867797 18276 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:37.870055 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.843833 21889 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:37.854569 21999 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:37.869951 18276 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:37.857226 22127 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.874850 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:37.865681 22174 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:18:37.862803 21934 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:37.857942 22179 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:37.816437 22177 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:37.892268 22177 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:37.875664 22090 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:37.874387 21979 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.876691 22184 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:18:37.893208 21979 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.879945 21999 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:37.895272 21979 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:37.883109 21733 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:37.873595 22170 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.897006 22170 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:37.897051 21999 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:37.881410 22127 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.900296 22127 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:37.900679 22169 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:37.879099 21736 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:37.901532 21736 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:37.901875 21736 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:37.883502 22079 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:37.900240 22179 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.905022 22077 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:37.906715 22179 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:37.884142 21985 raft_consensus.cc:3055] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:37.906806 22108 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:37.885466 22167 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:37.886490 22010 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:37.908262 18379 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:37.877485 22031 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:37.909484 22171 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:18:37.910837 22176 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:18:37.911520 22173 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:18:37.914654 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1765) took 1428 ms. Trace:
I20260709 13:18:37.915102 18231 rpcz_store.cc:276] 0709 13:18:36.486730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.487182 (+   452us) service_pool.cc:224] Handling call
0709 13:18:36.487557 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.548389 (+ 60832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.548437 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.589836 (+ 41399us) log.cc:844] Serialized 26 byte log entry
0709 13:18:37.630893 (+1041057us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:37.630955 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.631050 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.914429 (+283379us) raft_consensus.cc:1685] finished
0709 13:18:37.914452 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.914598 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59557,"raft.queue_time_us":91669,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":13588,"thread_start_us":1040476,"threads_started":1,"wal-append.queue_time_us":1165480}
W20260709 13:18:37.888783 22172 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:18:37.832305 22182 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:18:37.889415 22186 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:37.890153 22076 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:37.868872 22037 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.873184 22053 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:37.936077 22053 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:37.936270 22037 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.937574 22053 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.907383 21985 raft_consensus.cc:740] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:37.878835 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:37.885993 18961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54020 (request call id 306) took 1452 ms. Trace:
I20260709 13:18:37.926090 22087 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:37.967129 22087 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:37.966929 18961 rpcz_store.cc:276] 0709 13:18:36.434066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.435783 (+  1717us) service_pool.cc:224] Handling call
0709 13:18:37.087451 (+651668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.481993 (+394542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.885815 (+403822us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54006f72d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:37.885936 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1479259520}
I20260709 13:18:37.968138 22087 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.966857 21985 consensus_queue.cc:260] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.969231 22031 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:37.969733 21985 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:37.925789 22167 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.979223 22167 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:37.985185 22130 consensus_queue.cc:260] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:37.935247 22175 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.148s	user 0.001s	sys 0.001s
I20260709 13:18:37.938469 22140 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:37.875445 22178 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.963335 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 80581.6us
W20260709 13:18:37.924273 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:37.987532 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 148304us
I20260709 13:18:38.037582 18277 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:37.988828 22128 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:38.040270 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:38.053607 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.060149 18383 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:38.064810 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:38.041091 22170 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.053936 22182 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:38.064180 22031 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:38.065896 22192 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.054747 22128 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:38.061630 22130 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:38.106328 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:38.038254 22140 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.078912 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:38.074874 22184 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:38.074959 22167 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.080894 22182 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:38.076272 22170 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.097209 22031 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:38.097999 22192 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.112648 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:38.039182 22178 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.121059 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:38.124765 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:38.129187 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:38.130069 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:38.083845 22092 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:38.132920 18382 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:38.104391 22037 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:38.143116 22205 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:38.146051 18276 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:38.144038 22205 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 13:18:38.132453 22159 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.988s	user 0.001s	sys 0.014s
I20260709 13:18:38.150076 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:38.150745 18383 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:38.114521 22128 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.151986 21736 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.154496 22182 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:38.135576 22184 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:38.176497 18276 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:38.174034 21897 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:38.193394 18380 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:18:38.193948 18380 pending_rounds.cc:85] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 7
I20260709 13:18:38.194317 18380 pending_rounds.cc:107] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:18:38.194728 18380 raft_consensus.cc:2889] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:38.139597 22092 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.191303 22194 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:38.201709 22009 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:38.202205 22009 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.202684 22009 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:38.205099 22207 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.205660 22207 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:38.191684 22198 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:18:38.199545 22194 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:38.195408 22192 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.201056 22031 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:38.211071 22194 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.209797 22182 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.229507 21736 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.231122 22140 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:38.184316 22184 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:38.232707 22009 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.234779 22184 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:38.221096 22208 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:18:38.236320 22035 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.237444 22170 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.238652 22009 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.239053 22178 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:38.241201 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.252045 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:38.254381 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:38.255043 18383 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:38.221410 22031 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.264001 22031 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:38.249773 22170 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.260604 22194 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:38.274048 22170 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.281167 22008 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.282220 22170 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.282609 22092 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:38.279656 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:38.287956 18383 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:38.250066 22140 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:38.289386 22140 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.290196 22128 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:38.292062 22140 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:38.240819 22182 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.295567 22182 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.299518 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:38.300213 18377 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
W20260709 13:18:38.309549 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 179610us
I20260709 13:18:38.310582 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:38.302127 22059 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.319811 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.321895 22009 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:18:38.367116 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 56645.1us
W20260709 13:18:38.370710 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.378654 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:38.382179 18310 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 12. Ops: []
I20260709 13:18:38.383698 18303 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:38.384230 18312 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 13:18:38.385319 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.385696 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:38.386229 18312 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:38.371097 22208 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:38.387244 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.387959 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.388211 18311 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:38.386943 18306 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:38.389533 18310 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:38.390262 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:38.390967 18307 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:38.386008 18303 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:38.398012 18303 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:38.399494 18303 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:38.401152 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.406378 18312 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:38.413138 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.413883 18306 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:38.415916 18306 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:38.419991 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.423779 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.369237 22059 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.382081 22206 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:38.449726 22209 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
W20260709 13:18:38.486451 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.379123 22200 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:18:38.494712 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.498203 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.499117 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:38.504444 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.514778 18310 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:38.472108 22206 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.514672 18311 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:38.516623 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.520126 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:38.521466 18312 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:38.522910 18311 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:38.417759 22208 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:38.522199 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:38.523762 18312 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:38.517745 22206 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:38.533457 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.534039 18307 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:38.534721 18310 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:38.535017 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.527999 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.414189 22201 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.147s
I20260709 13:18:38.537693 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.541499 22059 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.542795 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.545702 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:38.546648 22069 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.549106 18312 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
W20260709 13:18:38.549419 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.551124 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.550166 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.552178 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.552784 18312 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:38.552906 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.553683 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.554903 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.555188 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.555527 18312 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:38.553930 22128 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.556111 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.557507 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.557610 18311 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:38.557408 22128 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.550784 22090 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:38.560621 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.561414 18307 raft_consensus.cc:2410] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:18:38.562685 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.563347 18307 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:18:38.564617 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.564103 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:38.565636 18307 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:38.566376 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.566939 18307 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:38.567844 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.569095 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:38.569639 18307 raft_consensus.cc:2376] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12. Re-sending same reply.
I20260709 13:18:38.570467 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:38.570874 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.571154 18307 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:38.572160 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.572292 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.572829 18307 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:38.572594 22090 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.574926 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.575678 18311 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:38.575947 22090 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:38.576385 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:38.576949 22214 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:18:38.580621 22208 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:38.581012 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:38.581393 21985 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:38.581813 22037 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:38.582931 22178 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:38.583230 22037 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:38.586617 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.577087 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.588552 18307 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
W20260709 13:18:38.577569 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.573707 18303 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:38.589458 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.590490 18311 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:38.590865 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.592625 18307 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:38.595531 18276 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:38.596181 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:38.596681 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:38.598619 22130 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:38.602322 22130 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.602788 22130 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:38.583050 21985 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:18:38.597851 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:38.605962 22003 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:38.606395 22003 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.606750 22003 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:38.592718 18311 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:18:38.559859 22128 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:38.610363 18202 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:38.611438 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:38.612656 21985 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:38.613077 21985 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:38.613445 21985 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:38.614130 22178 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:38.615483 22178 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:38.616693 22092 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:38.617043 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:38.617758 22092 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:38.618098 22092 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:38.618372 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:38.618467 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.619243 18304 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:38.618993 22003 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.618909 22092 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.619745 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:38.620535 22092 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:38.626569 22178 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:38.632128 22178 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:38.631985 18234 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1592) took 1390 ms (client timeout 1799 ms). Trace:
I20260709 13:18:38.633034 22178 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:38.633600 22178 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:38.632869 18234 rpcz_store.cc:269] 0709 13:18:37.241789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.242861 (+  1072us) service_pool.cc:224] Handling call
0709 13:18:38.631730 (+1388869us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540029c7d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:38.631894 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919969152}
I20260709 13:18:38.624745 22164 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:38.634564 22164 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:38.635003 22164 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:38.635749 22080 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.637689 18231 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:38.639887 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.640543 18229 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:38.640928 22178 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:38.641708 18233 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:38.642076 22003 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.646628 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2199) took 2985 ms. Trace:
I20260709 13:18:38.584961 22090 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:38.647003 18305 rpcz_store.cc:276] 0709 13:18:35.660907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.211439 (+550532us) service_pool.cc:224] Handling call
0709 13:18:37.102911 (+891472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.181474 (+ 78563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.646465 (+1464991us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b540013ef50. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:38.646575 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1972553600}
I20260709 13:18:38.648192 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.652100 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1604) took 1161 ms. Trace:
I20260709 13:18:38.652601 18235 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:18:38.652529 18236 rpcz_store.cc:276] 0709 13:18:37.491272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.636254 (+1144982us) service_pool.cc:224] Handling call
0709 13:18:38.636582 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.651789 (+ 15207us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:38.651818 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.651859 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:38.651895 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.651953 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.652049 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14855}
I20260709 13:18:38.610013 22208 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:38.654806 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.655962 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.656605 18235 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:38.610721 22201 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:38.666836 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:38.654292 22208 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.670374 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.677021 18235 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:38.673091 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:38.678893 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:38.679335 22059 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.679915 22059 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.682296 22059 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.684556 22009 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.685261 22092 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:38.685135 22009 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.654691 22179 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:38.685858 22092 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:38.692410 22009 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.693313 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:38.694262 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:38.694314 22222 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:38.695137 22222 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:38.696771 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:38.697484 22222 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:38.698226 22092 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:38.674947 22035 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:38.699096 22035 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.701270 22035 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.702986 22201 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:38.704766 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:38.704980 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:38.707211 22031 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.680454 22182 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:38.709147 22182 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:38.704075 22201 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.711494 22182 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:38.658349 22090 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.714072 22092 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:38.714558 22090 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:38.714644 22092 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.675792 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:38.717206 22092 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:38.720777 18306 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:18:38.730991 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 111294us
I20260709 13:18:38.687484 22208 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:38.731973 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:38.735090 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:38.738958 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.738888 18202 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:38.736845 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.746913 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.748196 18311 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:38.750137 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.757033 18351 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:38.727921 22192 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:38.761180 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.766417 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:38.764447 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.769531 18233 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:38.769686 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.770514 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.765625 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:38.764933 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:38.771333 18233 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:38.771621 18305 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:38.766965 18231 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:38.759359 18309 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:38.765637 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.761293 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.751489 22182 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:38.774183 18237 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:38.753952 22035 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:38.737735 22092 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.755170 22090 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:38.775063 18236 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:38.785370 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.777057 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:38.776234 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.787102 18233 raft_consensus.cc:2410] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:18:38.782356 18202 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:38.787271 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:38.764986 22220 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:38.797629 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:38.798895 18236 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:38.790359 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.800436 18231 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:38.808434 18305 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:38.775372 22182 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.763652 22222 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:18:38.760706 22059 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:38.781728 22035 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.778517 22224 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:38.834009 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 70851.5us
I20260709 13:18:38.773741 22192 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:38.842278 22035 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:38.843026 22035 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.843518 22035 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:38.843999 22035 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.827111 22221 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:18:38.820132 22182 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:38.825232 22170 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:18:38.856001 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 79204.6us
I20260709 13:18:38.856938 18201 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:38.792562 22092 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.846728 21961 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:38.866110 21961 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.866606 21961 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:38.861429 22164 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:38.871572 22164 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:38.873878 22164 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:38.860978 22170 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:38.876178 22170 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.836660 22059 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:38.865417 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.878235 18228 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:38.879207 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.879942 18228 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 11: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:38.872804 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:38.862139 22228 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:38.841136 22220 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:18:38.890520 18236 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:38.891717 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:38.892324 18236 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:38.874725 22108 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:38.894503 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 112217us
I20260709 13:18:38.923157 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:38.915881 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 74065.5us
I20260709 13:18:38.924140 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:38.919296 18236 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:38.921412 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:38.928274 18228 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:38.921767 18201 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:38.936349 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:38.935621 18200 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:38.942714 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:38.920943 22224 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:38.950841 18201 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:38.954463 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:38.922291 22090 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:38.963760 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:38.939528 22108 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.955524 22077 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.967191 22234 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.962111 22222 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:38.955653 22232 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:18:38.998466 22232 consensus_queue.cc:1243] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer 8b4fbc44aa2649f0bcac5cd70f71951d log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:38.999034 22232 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:39.001439 22059 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:39.002051 22059 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:39.002411 22059 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.002749 22059 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:38.976924 22224 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:38.965102 22194 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:39.005439 22224 raft_consensus.cc:3055] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:38.982309 22231 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.974148 22108 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.008386 22108 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:39.009465 22090 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.982089 22077 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:38.990027 22222 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:39.012959 22077 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:39.013167 22222 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:39.012578 22228 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:39.014083 22228 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:39.018357 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.018605 22220 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:39.018880 18957 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:39.019109 22220 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.020480 22240 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:39.020987 22240 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:39.021387 22240 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:39.019502 22220 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:39.028553 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.006387 22231 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.005908 22224 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:38.973614 22235 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:39.005445 22194 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:39.076687 22192 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:39.077353 22228 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:39.078269 22194 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:39.081275 22092 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:39.081629 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:39.071235 22206 consensus_meta.cc:287] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 13:18:39.040887 22231 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.070945 22106 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:39.080006 21961 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:39.074407 22053 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.013s	sys 0.013s
I20260709 13:18:39.080194 22130 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:39.098167 22053 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.014s	sys 0.013s
I20260709 13:18:39.031529 22234 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.129045 18232 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
W20260709 13:18:39.111480 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 175923us
W20260709 13:18:39.119073 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 155336us
I20260709 13:18:39.131385 18200 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:39.132704 18200 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:18:39.116047 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 161669us
I20260709 13:18:39.134039 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:39.134533 18386 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:39.135665 22196 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.145169 22235 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:39.156208 22235 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.157660 22235 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:39.141714 22053 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:39.136322 22196 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:39.161468 21976 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:39.162359 22196 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:39.156883 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:39.157474 18275 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:39.165050 22196 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:39.166963 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:39.099442 22106 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:39.169368 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 2334) took 2213 ms. Trace:
I20260709 13:18:39.157486 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:39.169955 18379 rpcz_store.cc:276] 0709 13:18:36.955522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.031812 (+ 76290us) service_pool.cc:224] Handling call
0709 13:18:39.169096 (+2137284us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b5400081954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:39.169250 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997110656}
I20260709 13:18:39.172354 22106 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:39.153810 22130 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:39.113001 21985 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.173844 22207 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:39.175455 21961 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:39.175926 21985 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:39.197610 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:39.198804 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:39.200842 18383 raft_consensus.cc:2410] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:18:39.087590 22206 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.198405 18379 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:39.090746 22035 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:39.208585 21985 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:39.212682 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 45791.1us
I20260709 13:18:39.224045 22053 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:39.226677 21985 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:39.105671 22224 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.227746 22240 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:39.228223 22224 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:39.229094 21985 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:39.229796 18381 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:39.230387 22053 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.230813 22053 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:39.238303 22206 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:39.239478 18308 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:39.239995 22130 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:39.242892 22182 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.244230 18229 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 12: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:18:39.245491 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 294750us
I20260709 13:18:39.235877 22059 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.252048 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:39.246726 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:39.225310 22178 consensus_meta.cc:287] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.000s
I20260709 13:18:39.260893 18235 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:39.288826 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:39.267750 22206 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:18:39.316051 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 69406.6us
I20260709 13:18:39.251359 22192 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:18:39.315066 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:39.250667 22220 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.283605 22234 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:39.289091 22240 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:39.283609 22207 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.268121 21976 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:39.342252 18380 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:39.263092 22178 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.376793 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:39.316808 22206 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:39.496294 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:39.345053 22213 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 1.032s	user 0.005s	sys 0.000s
I20260709 13:18:39.580964 22247 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:39.581146 22206 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:39.590965 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:39.595458 18237 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:39.597088 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:39.601481 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 85562.4us
W20260709 13:18:39.515868 22208 consensus_meta.cc:287] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.002s
W20260709 13:18:39.569366 22222 consensus_meta.cc:287] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.001s
I20260709 13:18:39.729352 22222 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.730686 18386 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:39.611631 22245 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:39.732656 22245 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.735670 22245 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:39.630489 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.611629 22077 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:18:39.640537 22254 log.cc:927] Time spent T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.298s	user 0.000s	sys 0.000s
W20260709 13:18:39.641817 22244 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.335s	user 0.000s	sys 0.000s
I20260709 13:18:39.642906 22247 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:39.739856 22247 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.646098 22178 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:39.646832 18378 raft_consensus.cc:2393] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:39.514159 22207 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.777531 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:39.779011 18237 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:39.784889 22222 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:39.798905 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 466) took 1046 ms. Trace:
I20260709 13:18:39.821381 18234 rpcz_store.cc:276] 0709 13:18:38.752908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.753438 (+   530us) service_pool.cc:224] Handling call
0709 13:18:38.753764 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.754168 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.754196 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:39.025837 (+271641us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b18004621c0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1542a6 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a
0709 13:18:39.026384 (+   547us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b2c000014c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:18:39.027042 (+   658us) log.cc:844] Serialized 26 byte log entry
0709 13:18:39.283218 (+256176us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:39.317514 (+ 34296us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.581937 (+264423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.582019 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.798599 (+216580us) raft_consensus.cc:1685] finished
0709 13:18:39.798638 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.798818 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":269822,"prepare.queue_time_us":32411,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":365188,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":5396,"spinlock_wait_cycles":235171072,"thread_start_us":255671,"threads_started":1,"wal-append.queue_time_us":753911}
I20260709 13:18:39.825646 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:39.669672 22252 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:18:39.582577 22230 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:39.674235 22220 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:39.370693 22182 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:39.934821 22182 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.935529 22182 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.938516 22182 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:39.683282 22249 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:18:39.705731 22035 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:39.708879 22234 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.941402 22234 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.698531 22053 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.946755 22053 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:39.443307 22240 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.951172 22240 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:39.954074 22240 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:39.564939 21976 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:39.957309 21976 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:39.727742 22208 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:39.784557 22262 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:18:39.795768 22207 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:39.830911 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:39.962019 18385 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
W20260709 13:18:39.663080 22231 consensus_meta.cc:287] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.000s
I20260709 13:18:39.963821 22231 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:39.965615 18235 raft_consensus.cc:2368] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
I20260709 13:18:39.960134 22208 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:39.852267 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:39.973905 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:39.681684 22059 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:39.719316 22232 consensus_meta.cc:287] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.000s
I20260709 13:18:39.944320 22234 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:39.817725 22235 consensus_meta.cc:287] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.659s	user 0.012s	sys 0.000s
I20260709 13:18:39.988160 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:40.199615 18385 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:18:39.993242 18234 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:40.091241 18276 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:18:40.217876 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 126782us
W20260709 13:18:40.007999 22224 consensus_meta.cc:287] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.779s	user 0.011s	sys 0.002s
I20260709 13:18:40.068815 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1661) took 1684 ms. Trace:
W20260709 13:18:40.168443 18926 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.064s	sys 0.118s
W20260709 13:18:40.334565 18926 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.064s	sys 0.118s
I20260709 13:18:40.334169 18308 rpcz_store.cc:276] 0709 13:18:38.384070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.384220 (+   150us) service_pool.cc:224] Handling call
0709 13:18:38.384499 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.239975 (+855476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.068395 (+828420us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b54000ca8d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:40.068726 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1965615360}
W20260709 13:18:40.188094 18927 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.032s	user 0.051s	sys 0.149s
W20260709 13:18:40.336139 18927 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.180s	user 0.051s	sys 0.149s
W20260709 13:18:40.335361 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 991813us
W20260709 13:18:40.336550 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 1.18084e+06us
I20260709 13:18:40.089022 22208 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:40.192934 22207 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:40.197640 22232 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:40.344228 21912 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:39.920033 22206 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:40.190097 22231 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:40.344147 22242 log.cc:927] Time spent T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:18:40.412045 21912 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.357635 22202 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.205231 22235 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:40.428961 22202 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:40.462291 22206 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:40.463809 22265 consensus_queue.cc:1059] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:40.469658 22202 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:40.404245 22207 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:40.472779 22207 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:40.404444 22208 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:40.484815 22235 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:40.072947 18228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.035s	sys 0.082s
W20260709 13:18:40.531157 18228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.210s	user 0.035s	sys 0.082s
I20260709 13:18:40.064209 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1778) took 1305 ms. Trace:
I20260709 13:18:40.533743 18229 rpcz_store.cc:276] 0709 13:18:38.759248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.759430 (+   182us) service_pool.cc:224] Handling call
0709 13:18:40.063861 (+1304431us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b540037ebd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:40.064122 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1088812416}
I20260709 13:18:40.534602 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1796) took 1695 ms. Trace:
W20260709 13:18:40.092666 18201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.096s	sys 0.163s
W20260709 13:18:40.059835 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.537168 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:40.535482 18231 rpcz_store.cc:276] 0709 13:18:38.839384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.938239 (+ 98855us) service_pool.cc:224] Handling call
0709 13:18:38.966132 (+ 27893us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:39.108460 (+142328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.108816 (+   356us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:39.113196 (+  4380us) log.cc:844] Serialized 26 byte log entry
0709 13:18:39.370619 (+257423us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:39.370664 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.370756 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.533436 (+1162680us) raft_consensus.cc:1685] finished
0709 13:18:40.533491 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.534195 (+   704us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3535,"raft.queue_time_us":38760,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":334479,"threads_started":2,"wal-append.queue_time_us":1275783}
W20260709 13:18:40.088304 18236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.040s	sys 0.075s
W20260709 13:18:40.552621 18236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.041s	sys 0.076s
I20260709 13:18:40.125274 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:40.539253 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:40.539847 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 470) took 1779 ms. Trace:
I20260709 13:18:40.478731 22208 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:40.545791 22235 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:18:40.536208 18201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.231s	user 0.097s	sys 0.163s
I20260709 13:18:40.529829 18131 catalog_manager.cc:5697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.094411 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:40.423323 21912 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:40.573755 21961 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.981s	user 0.021s	sys 0.032s
W20260709 13:18:40.598575 22256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.006s	sys 0.037s
I20260709 13:18:40.568987 18230 rpcz_store.cc:276] 0709 13:18:38.759856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.766855 (+  6999us) service_pool.cc:224] Handling call
0709 13:18:38.767205 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:38.893489 (+126284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.893525 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:38.894274 (+   749us) log.cc:844] Serialized 52 byte log entry
0709 13:18:39.178072 (+283798us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:39.202539 (+ 24467us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.225686 (+ 23147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.225789 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.539050 (+1313261us) raft_consensus.cc:1685] finished
0709 13:18:40.539102 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.539579 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22761,"prepare.queue_time_us":24595,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":42,"raft.queue_time_us":42665,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":19762,"thread_start_us":374357,"threads_started":2,"wal-append.queue_time_us":1176914}
I20260709 13:18:40.597227 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1623) took 1215 ms. Trace:
I20260709 13:18:40.603448 18234 rpcz_store.cc:276] 0709 13:18:39.378441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.538516 (+1160075us) service_pool.cc:224] Handling call
0709 13:18:40.594093 (+ 55577us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.573460 22207 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:40.612908 22256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.007s	sys 0.038s
W20260709 13:18:40.605365 21961 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.022s	sys 0.032s
W20260709 13:18:40.622727 18382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.004s	sys 0.012s
I20260709 13:18:40.631063 22077 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:40.595530 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 1.30051e+06us
I20260709 13:18:40.631999 22077 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:40.637609 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:40.638854 18231 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:40.639487 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1629) took 1259 ms. Trace:
I20260709 13:18:40.639901 18231 rpcz_store.cc:276] 0709 13:18:39.380161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.599702 (+1219541us) service_pool.cc:224] Handling call
0709 13:18:40.639402 (+ 39700us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.641234 18237 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:40.641580 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:40.644197 18231 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:18:40.642066 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1637) took 1003 ms. Trace:
W20260709 13:18:40.649868 18382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.005s	sys 0.013s
W20260709 13:18:40.644013 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 281545us
I20260709 13:18:40.652269 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1635) took 1013 ms. Trace:
I20260709 13:18:40.653021 18231 rpcz_store.cc:276] 0709 13:18:39.637466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.640959 (+1003493us) service_pool.cc:224] Handling call
0709 13:18:40.650609 (+  9650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.654498 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:40.655506 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1631) took 1274 ms. Trace:
I20260709 13:18:40.655910 18231 rpcz_store.cc:276] 0709 13:18:39.380793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.653961 (+1273168us) service_pool.cc:224] Handling call
0709 13:18:40.655432 (+  1471us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.657136 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:40.658324 18231 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:40.658785 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1622) took 1280 ms. Trace:
I20260709 13:18:40.659186 18231 rpcz_store.cc:276] 0709 13:18:39.378189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.656710 (+1278521us) service_pool.cc:224] Handling call
0709 13:18:40.658712 (+  2002us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.661302 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:40.662442 18229 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 4.
I20260709 13:18:40.663050 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1630) took 1282 ms. Trace:
I20260709 13:18:40.663519 18229 rpcz_store.cc:276] 0709 13:18:39.380467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.660767 (+1280300us) service_pool.cc:224] Handling call
0709 13:18:40.662977 (+  2210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.665710 18201 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:40.668167 22057 raft_consensus.cc:2764] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:18:40.669191 22247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.004s	sys 0.020s
W20260709 13:18:40.669709 22247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.004s	sys 0.020s
W20260709 13:18:40.671053 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 324953us
I20260709 13:18:40.632985 22235 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:40.678789 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1607) took 2045 ms. Trace:
I20260709 13:18:40.679275 18232 rpcz_store.cc:276] 0709 13:18:38.633696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.639182 (+  5486us) service_pool.cc:224] Handling call
0709 13:18:38.639466 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.129595 (+490129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.678209 (+1548614us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54001888d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:40.678573 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125439872}
I20260709 13:18:40.689150 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1795) took 1860 ms. Trace:
I20260709 13:18:40.689998 22235 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:40.685979 22166 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.689642 18236 rpcz_store.cc:276] 0709 13:18:38.828389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.930259 (+101870us) service_pool.cc:224] Handling call
0709 13:18:38.930530 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.930725 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:39.263572 (+332847us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.687747 (+1424175us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.688584 (+   837us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:40.688676 (+    92us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:40.688748 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.688842 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.689084 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59708,"prepare.queue_time_us":78190,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":364620,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"spinlock_wait_cycles":103701760,"thread_start_us":1545323,"threads_started":4,"wal-append.queue_time_us":429418}
I20260709 13:18:40.691886 22077 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:40.693074 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:40.694173 18234 raft_consensus.cc:2376] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10. Re-sending same reply.
I20260709 13:18:40.694849 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1638) took 1056 ms. Trace:
I20260709 13:18:40.695194 18234 rpcz_store.cc:276] 0709 13:18:39.638532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.652453 (+1013921us) service_pool.cc:224] Handling call
0709 13:18:40.694744 (+ 42291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.697118 22278 raft_consensus.cc:3055] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:40.697911 22278 raft_consensus.cc:740] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:40.701455 18232 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:18:40.651446 18237 rpcz_store.cc:276] 0709 13:18:39.638236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.124877 (+486641us) service_pool.cc:224] Handling call
0709 13:18:40.641973 (+517096us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.691486 22166 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:40.708189 22207 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:40.708915 22274 raft_consensus.cc:1064] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:18:40.711122 22207 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:40.712476 22164 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:40.713500 22164 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:40.714392 22274 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:40.716646 18306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1676) took 2218 ms (client timeout 2360 ms). Trace:
I20260709 13:18:40.717063 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1628) took 1323 ms. Trace:
I20260709 13:18:40.717521 18232 rpcz_store.cc:276] 0709 13:18:39.379874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.680357 (+1300483us) service_pool.cc:224] Handling call
0709 13:18:40.700716 (+ 20359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.703452 (+  2736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.703661 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:40.691483 18202 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.039s	user 0.010s	sys 0.010s
W20260709 13:18:40.718595 18202 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.011s	sys 0.010s
W20260709 13:18:40.719264 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.724018 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:40.730393 18237 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:40.742107 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1634) took 1227 ms. Trace:
I20260709 13:18:40.742512 18237 rpcz_store.cc:276] 0709 13:18:39.514644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.729397 (+1214753us) service_pool.cc:224] Handling call
0709 13:18:40.730042 (+   645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.741803 (+ 11761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.742028 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:40.726922 22057 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:40.726497 22078 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:40.744750 22078 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:40.746428 21961 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:40.727520 21912 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:40.732378 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.717103 18306 rpcz_store.cc:269] 0709 13:18:38.498128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.498878 (+   750us) service_pool.cc:224] Handling call
0709 13:18:40.716068 (+2217190us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54003c14d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:40.716360 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472144128}
I20260709 13:18:40.741003 22031 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:40.747622 18230 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
W20260709 13:18:40.754458 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 82128.7us
I20260709 13:18:40.743820 22057 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:40.762174 22057 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:40.747325 22078 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:40.764439 21912 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:40.767975 18229 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:18:40.768877 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1627) took 1389 ms. Trace:
I20260709 13:18:40.769208 18229 rpcz_store.cc:276] 0709 13:18:39.379577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.664316 (+1284739us) service_pool.cc:224] Handling call
0709 13:18:40.753094 (+ 88778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.768576 (+ 15482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.768789 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:40.771983 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.780498 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 472) took 2003 ms. Trace:
I20260709 13:18:40.790064 22258 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:40.785491 18233 rpcz_store.cc:276] 0709 13:18:38.775075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.817034 (+ 41959us) service_pool.cc:224] Handling call
0709 13:18:38.817368 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.859635 (+ 42267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.859684 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.859738 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:38.859788 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.776465 (+1916677us) spinlock_profiling.cc:243] Waited 42 ms on lock 0x7b5400104fd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:40.776561 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.777858 (+  1297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96671488}
I20260709 13:18:40.736761 22278 consensus_queue.cc:260] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:40.757381 21961 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:40.801203 22166 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:40.803082 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:40.803455 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:40.803972 18237 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:40.804713 22281 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:40.805560 22281 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:40.815125 22258 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:40.816929 21961 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:40.817133 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:40.818022 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:40.818861 18229 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:40.825860 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 652) took 1823 ms. Trace:
I20260709 13:18:40.826381 22278 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.826488 18307 rpcz_store.cc:276] 0709 13:18:39.002424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.017763 (+ 15339us) service_pool.cc:224] Handling call
0709 13:18:39.018037 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.082323 (+ 64286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.082360 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:39.082407 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:39.082439 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.825266 (+1742827us) spinlock_profiling.cc:243] Waited 64 ms on lock 0x7b540011c454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:40.825345 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.825593 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147313920}
I20260709 13:18:40.830255 18237 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:40.831990 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:40.834429 22233 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:40.841276 22281 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:40.842722 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:40.844698 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:40.845901 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:40.847801 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:40.834939 22233 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:40.848605 18961 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.850096 22233 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:40.851423 22164 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:40.851552 22233 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:40.853225 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:40.854480 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.856571 18237 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:40.856760 22258 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:40.857904 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:40.858174 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 62321.7us
I20260709 13:18:40.866003 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:40.866772 18385 consensus_meta.cc:287] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.593s	user 0.013s	sys 0.002s
I20260709 13:18:40.867242 18385 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:40.869638 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:40.871650 18235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1615) took 1563 ms (client timeout 1888 ms). Trace:
I20260709 13:18:40.876910 21912 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.877669 21912 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:40.883853 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 75606.6us
I20260709 13:18:40.888278 18961 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
W20260709 13:18:40.872150 18235 rpcz_store.cc:269] 0709 13:18:39.314484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.314790 (+   306us) service_pool.cc:224] Handling call
0709 13:18:40.871119 (+1556329us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b540029d6d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:40.871384 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1489339776}
I20260709 13:18:40.880419 21912 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:40.899626 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 132183us
I20260709 13:18:40.912905 22200 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:40.915024 22024 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.915727 22205 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:40.890029 22273 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:40.935709 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:40.938572 22234 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:40.939504 22234 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:40.941042 22273 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:40.943940 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2157) took 1724 ms. Trace:
I20260709 13:18:40.948213 18386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2152) took 1779 ms. Trace:
I20260709 13:18:40.947098 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2165) took 1207 ms. Trace:
I20260709 13:18:40.936084 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:40.963219 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.944494 18381 rpcz_store.cc:276] 0709 13:18:39.219507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.219686 (+   179us) service_pool.cc:224] Handling call
0709 13:18:39.220000 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.230186 (+ 10186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.943237 (+1713051us) spinlock_profiling.cc:243] Waited 9.61 ms on lock 0x7b54000cdad4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:40.943630 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22112640}
I20260709 13:18:40.958102 18235 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:40.953598 18386 rpcz_store.cc:276] 0709 13:18:39.174701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.180081 (+  5380us) service_pool.cc:224] Handling call
0709 13:18:39.202528 (+ 22447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.731074 (+528546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.947649 (+1216575us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b540033e354. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:40.947981 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214207360}
I20260709 13:18:40.952750 22031 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.961179 22273 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:40.954257 18382 rpcz_store.cc:276] 0709 13:18:39.739884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.740279 (+   395us) service_pool.cc:224] Handling call
0709 13:18:39.740660 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:39.741086 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.741125 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:39.741676 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.946357 (+1204681us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b5400014b20. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dd090 00007fa1821ea6b8 00007fa18227392b 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c
0709 13:18:40.946469 (+   112us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:40.946548 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.946643 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.946715 (+    72us) raft_consensus.cc:1685] finished
0709 13:18:40.946729 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.947027 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30793,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":115,"spinlock_wait_cycles":73900288,"thread_start_us":941159,"threads_started":1,"wal-append.queue_time_us":896056}
I20260709 13:18:40.976605 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:40.966158 22207 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:40.950309 22205 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:40.983209 18237 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:40.983992 22024 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:40.995455 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:40.996376 18306 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:18:40.996914 22024 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:41.002156 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1632) took 1621 ms. Trace:
I20260709 13:18:41.002729 18229 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:40.983896 22273 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:41.002602 18236 rpcz_store.cc:276] 0709 13:18:39.381098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.692865 (+1311767us) service_pool.cc:224] Handling call
0709 13:18:40.693360 (+   495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.693921 (+   561us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:40.693955 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.694549 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.758122 (+ 63573us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:40.758167 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.758238 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.001929 (+243691us) raft_consensus.cc:1685] finished
0709 13:18:41.001947 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.002076 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":63160,"threads_started":1,"wal-append.queue_time_us":167519}
I20260709 13:18:41.005582 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:41.004940 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:41.009200 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:41.010067 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:41.009779 18229 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:41.015347 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.015568 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:41.021870 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1633) took 1584 ms. Trace:
I20260709 13:18:41.017750 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.022375 18234 rpcz_store.cc:276] 0709 13:18:39.437918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.695942 (+1258024us) service_pool.cc:224] Handling call
0709 13:18:40.704365 (+  8423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.777515 (+ 73150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.777544 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.796183 (+ 18639us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.993712 (+197529us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:40.993772 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.993857 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.021631 (+ 27774us) raft_consensus.cc:1685] finished
0709 13:18:41.021653 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.021811 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10634,"raft.queue_time_us":21594,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":485,"thread_start_us":146408,"threads_started":1,"wal-append.queue_time_us":172560}
I20260709 13:18:41.011802 22077 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:41.025782 22077 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:41.006253 21976 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:41.028247 22077 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:40.998621 22031 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:41.030135 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.031605 22031 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:40.974339 22200 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:41.006479 22024 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:41.033488 22024 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:41.034447 22200 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:41.009158 22207 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:41.036904 22234 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:41.038326 18381 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:41.028894 21976 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:41.041396 21976 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:41.028813 18235 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:18:41.044996 18131 catalog_manager.cc:5697] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 2 to 5, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 5 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:41.046470 18230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1617) took 1704 ms (client timeout 2128 ms). Trace:
W20260709 13:18:41.046962 18230 rpcz_store.cc:269] 0709 13:18:39.342201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.723452 (+1381251us) service_pool.cc:224] Handling call
0709 13:18:41.046298 (+322846us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b540005a354. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:41.046405 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13750528}
I20260709 13:18:41.047254 18131 catalog_manager.cc:5697] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.049649 18131 catalog_manager.cc:5697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.051252 18131 catalog_manager.cc:5697] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.053568 22194 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.052996 18131 catalog_manager.cc:5697] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.054296 22194 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:41.036376 22024 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:41.024734 22273 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:41.057564 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.063112 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.064119 18385 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:41.058887 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:41.065407 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47031.3us
I20260709 13:18:41.056452 18200 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:41.058439 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.059088 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.070307 18382 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
W20260709 13:18:41.072702 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 107314us
I20260709 13:18:41.059357 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.073925 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.074510 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.075325 18384 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:41.075956 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:41.075037 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.077354 18306 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
W20260709 13:18:41.079753 18378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2141) took 2393 ms (client timeout 2445 ms). Trace:
W20260709 13:18:41.080240 18378 rpcz_store.cc:269] 0709 13:18:38.686545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.686955 (+   410us) service_pool.cc:224] Handling call
0709 13:18:41.079358 (+2392403us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54000f2654. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:41.079544 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2190741888}
I20260709 13:18:41.080998 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.081739 22246 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:41.081866 18385 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 4.
I20260709 13:18:41.028693 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:18:41.083494 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 69989.5us
I20260709 13:18:41.083720 22208 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:41.084338 22208 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:41.085532 22208 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:41.089107 22098 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:41.089685 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.090339 22098 raft_consensus.cc:3055] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:41.090845 22098 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:41.091557 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:41.092228 18308 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:41.090193 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.092736 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.093807 18385 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:41.092995 18386 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:41.095831 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.097307 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.098104 18307 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:41.100791 18381 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:41.091872 22098 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:41.102648 22098 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:41.102180 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.103204 18305 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:18:41.103641 18386 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:41.105499 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:41.107340 22179 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:41.107697 22207 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:41.111227 22179 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:41.118983 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:41.068135 22194 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:41.128798 18386 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:18:41.129951 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:41.129351 18386 pending_rounds.cc:85] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 5
I20260709 13:18:41.135217 18307 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:41.143262 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.145364 18306 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:41.148192 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.142912 18386 pending_rounds.cc:107] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:18:41.150187 18386 raft_consensus.cc:2889] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.151575 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:41.158031 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.140494 22205 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:41.167184 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 111094us
I20260709 13:18:41.156694 22233 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:41.171711 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:41.173687 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:41.184629 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.184893 18955 raft_consensus.cc:2410] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:41.185525 18381 raft_consensus.cc:2410] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:18:41.185627 22259 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 1.542s	user 0.006s	sys 0.021s
I20260709 13:18:41.188225 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1797) took 2342 ms. Trace:
I20260709 13:18:41.188622 18228 rpcz_store.cc:276] 0709 13:18:38.845791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.177159 (+331368us) service_pool.cc:224] Handling call
0709 13:18:39.177530 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:39.225044 (+ 47514us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:39.238938 (+ 13894us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.604872 (+1365934us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.684119 (+ 79247us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.688468 (+  4349us) log.cc:844] Serialized 26 byte log entry
0709 13:18:40.688683 (+   215us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:40.688892 (+   209us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.689094 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.689231 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.184784 (+495553us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:41.187962 (+  3178us) raft_consensus.cc:1685] finished
0709 13:18:41.187984 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.188165 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104061,"prepare.queue_time_us":359476,"prepare.run_cpu_time_us":207,"prepare.run_wall_time_us":3418,"raft.queue_time_us":403947,"raft.run_cpu_time_us":698,"raft.run_wall_time_us":102936,"spinlock_wait_cycles":65947008,"thread_start_us":1349072,"threads_started":3,"wal-append.queue_time_us":198332}
I20260709 13:18:41.169873 22233 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:41.194058 22233 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:41.208684 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.209280 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 43594.8us
I20260709 13:18:41.200350 18382 raft_consensus.cc:2393] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:41.204385 18229 raft_consensus.cc:2410] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:18:41.201407 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 49970.1us
W20260709 13:18:41.196430 18133 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39288 (request call id 179) took 20252 ms (client timeout 15000 ms). Trace:
I20260709 13:18:41.219803 18308 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:41.221015 18307 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:41.224862 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:41.223930 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 52609.3us
I20260709 13:18:41.235498 18306 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:18:41.240829 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:41.241449 22288 log.cc:927] Time spent T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:18:41.241822 18303 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:41.243249 22273 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:41.243944 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.244588 18386 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:41.248428 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:41.248783 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:41.249500 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.248814 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1626) took 1865 ms. Trace:
I20260709 13:18:41.253228 18306 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:41.254096 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.254974 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:41.255570 18385 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:41.250511 18231 rpcz_store.cc:276] 0709 13:18:39.379266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.659855 (+1280589us) service_pool.cc:224] Handling call
0709 13:18:40.660482 (+   627us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:40.755467 (+ 94985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.755497 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:40.794901 (+ 39404us) log.cc:844] Serialized 52 byte log entry
0709 13:18:40.974663 (+179762us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:40.987588 (+ 12925us) log.cc:844] Serialized 14 byte log entry
0709 13:18:40.987833 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.987914 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.244808 (+256894us) raft_consensus.cc:1685] finished
0709 13:18:41.244830 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.244992 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13537,"prepare.queue_time_us":11899,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":9754,"raft.run_cpu_time_us":438,"raft.run_wall_time_us":440,"thread_start_us":122311,"threads_started":1,"wal-append.queue_time_us":207909}
I20260709 13:18:41.257328 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:41.257714 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 114753us
I20260709 13:18:41.253438 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:41.261046 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.262473 18308 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:41.264786 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:41.253106 22234 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:41.265288 18382 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:41.265499 18303 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:41.274758 18307 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:41.278492 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.279363 18378 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:41.274366 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:41.286073 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.286223 18957 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 13 LEARNER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:41.286738 18384 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:41.261425 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:41.287703 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:41.292053 18381 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:41.275007 22234 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:41.293967 22234 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.294340 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.295480 18386 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:41.301056 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:41.302228 18384 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:41.303771 22098 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:41.304358 22098 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:41.306864 22098 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:41.310603 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.310793 18309 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:41.311527 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.312417 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:41.312775 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.313109 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.314260 18304 raft_consensus.cc:2393] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:41.313299 18309 raft_consensus.cc:2368] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11.
I20260709 13:18:41.315590 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:41.316062 18311 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:41.316642 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:41.316941 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:41.318248 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:41.319360 18275 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:41.320969 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:41.322723 22273 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:41.323483 22273 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:41.333765 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.335420 18307 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:41.341161 18927 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:41.344413 18385 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
W20260709 13:18:41.342926 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 77761.9us
I20260709 13:18:41.355911 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.358480 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:41.367054 18200 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:41.367774 18381 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.361109 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:41.351646 22256 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:41.302299 22179 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:41.382413 18306 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
W20260709 13:18:41.383826 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 92126.7us
I20260709 13:18:41.386022 18303 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
W20260709 13:18:41.213472 18133 rpcz_store.cc:269] 0709 13:18:20.943626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.970811 (+ 27185us) service_pool.cc:224] Handling call
0709 13:18:41.196133 (+20225322us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:33.635141 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:33.682233 (+ 47092us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:33.682327 (+    94us) write_op.cc:435] Acquired schema lock
0709 13:18:33.682385 (+    58us) tablet.cc:662] Decoding operations
0709 13:18:33.808916 (+126531us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:33.808997 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:33.809024 (+    27us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:18:33.810715 (+  1691us) tablet.cc:701] Row locks acquired
0709 13:18:33.810767 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:18:33.810963 (+   196us) write_op.cc:270] Start()
0709 13:18:33.811136 (+   173us) write_op.cc:276] Timestamp: P: 1783603113810878 usec, L: 0
0709 13:18:33.811158 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:18:33.924789 (+113631us) log.cc:844] Serialized 8364 byte log entry
0709 13:18:35.459687 (+1534898us) op_driver.cc:464] REPLICATION: finished
0709 13:18:35.625305 (+165618us) write_op.cc:301] APPLY: starting
0709 13:18:35.625411 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:35.625841 (+   430us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:35.625984 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:35.705354 (+ 79370us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:35.902771 (+197417us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:18:35.918999 (+ 16228us) write_op.cc:312] APPLY: finished
0709 13:18:35.976083 (+ 57084us) log.cc:844] Serialized 144 byte log entry
0709 13:18:36.014512 (+ 38429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:36.033841 (+ 19329us) write_op.cc:454] Released schema lock
0709 13:18:36.059883 (+ 26042us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:36.062960 (+  3077us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:36.062995 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15791,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":149557,"apply.run_cpu_time_us":8029,"apply.run_wall_time_us":437592,"num_ops":21,"prepare.queue_time_us":468475,"prepare.run_cpu_time_us":27849,"prepare.run_wall_time_us":525928,"raft.queue_time_us":474837,"raft.run_cpu_time_us":15409,"raft.run_wall_time_us":218898,"replication_time_us":1634000,"thread_start_us":721795,"threads_started":4,"wal-append.queue_time_us":161758,"wal-append.run_cpu_time_us":36126,"wal-append.run_wall_time_us":2899384}]]}
I20260709 13:18:41.385080 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.397087 18228 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:18:41.398011 22228 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:41.398335 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:41.399636 22003 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:41.400218 22003 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:41.401002 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:41.401300 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:41.401765 18378 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.402107 18383 raft_consensus.cc:2393] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:41.398406 22228 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:41.402135 18380 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:41.405859 18961 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:41.407002 22228 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:41.407212 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.408146 18383 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:41.408473 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.376142 22256 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:41.409121 18377 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:41.413050 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.415302 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.416060 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.413951 18385 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:41.420193 18380 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:41.412546 22256 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:41.426626 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.428257 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.429639 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.430467 18386 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:41.429625 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:41.438199 22179 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:41.440851 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:41.440990 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:41.441468 18236 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:41.442898 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:41.444797 22054 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:41.445202 22054 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:41.445073 22234 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:41.445708 22054 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.447775 18229 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:41.452740 18381 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:41.454859 18378 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
W20260709 13:18:41.459515 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.464609 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:41.464913 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.467935 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:41.468933 18386 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.472092 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:41.473047 18378 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:41.401293 22003 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:41.479092 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.459303 22234 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:41.481274 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.482787 18229 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:41.483721 18381 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:18:41.485214 18305 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:41.484067 18381 pending_rounds.cc:85] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 7
I20260709 13:18:41.486663 18381 pending_rounds.cc:107] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:18:41.486891 18381 raft_consensus.cc:2889] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.450912 22233 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:41.484731 18377 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:41.494369 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:41.495144 18229 raft_consensus.cc:2393] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:41.496997 18380 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:41.497354 18380 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:41.500537 18379 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:41.501513 18236 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:18:41.509194 18305 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: [10.7-11.8]
I20260709 13:18:41.515811 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:41.498374 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 55607.6us
I20260709 13:18:41.504343 21895 consensus_queue.cc:1059] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:18:41.505743 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.506449 18229 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:41.506955 18380 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:41.508947 18384 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:41.509171 18381 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:41.521709 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.523239 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.524852 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:41.525686 18380 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:41.527493 18377 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:41.529346 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.530022 18385 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 4.
I20260709 13:18:41.531721 18305 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:18:41.513111 22234 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:41.533035 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.523754 21895 raft_consensus.cc:3055] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:41.536572 18381 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:41.537607 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:41.538477 18229 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:41.541831 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.543056 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.526508 22233 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:41.545975 18377 raft_consensus.cc:2410] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:18:41.546758 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.549029 18377 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:41.549520 18385 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:41.556614 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:41.557304 18236 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:41.559127 18379 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 8: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:41.559012 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.533619 22234 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:41.559864 18381 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:41.560838 22302 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:18:41.537684 21895 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:41.566406 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:41.573521 18307 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:18:41.574616 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.575749 18308 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:18:41.575793 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:41.576401 18310 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.577013 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.577016 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.563446 22234 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:41.585769 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:41.791903 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.793606 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.606932 18310 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
W20260709 13:18:41.603262 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.697883 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:41.601765 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.797011 18384 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:41.794950 18378 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:41.611354 18380 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:18:41.799013 18380 pending_rounds.cc:85] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 6
I20260709 13:18:41.610209 18311 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:41.602020 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.601645 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.803397 18309 raft_consensus.cc:2393] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:41.803264 18229 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:41.803197 18386 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:41.795884 18379 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:18:41.806216 18380 pending_rounds.cc:107] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:18:41.806499 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.609804 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:41.806774 18380 raft_consensus.cc:2889] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.630750 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.807592 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.601871 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:41.684820 18382 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
W20260709 13:18:41.744174 22295 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:18:41.820118 18310 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:41.821643 18382 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:41.762101 22299 log.cc:927] Time spent T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:18:41.822268 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.835559 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:41.837255 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:41.840896 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:41.841624 18381 raft_consensus.cc:2393] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:41.743330 22302 consensus_queue.cc:1243] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:41.845538 18303 raft_consensus.cc:2376] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10. Re-sending same reply.
I20260709 13:18:41.847005 18236 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:41.693995 22228 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:41.849947 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:41.850646 18228 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:41.850138 22228 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:41.851325 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:41.851714 18380 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:41.852226 18304 raft_consensus.cc:2393] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:41.630370 22054 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:41.859699 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.857828 18310 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:41.861965 18306 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:41.862422 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:41.862957 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.863270 22054 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:41.863626 18306 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:18:41.864993 18385 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:41.867327 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.880031 18311 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:41.868381 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:41.883349 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.885748 18304 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:41.888788 18311 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:41.788303 21895 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:41.894544 21895 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:41.901172 22269 consensus_queue.cc:1175] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" responder_term: 7 status { last_received { term: 6 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:41.904915 18304 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:41.861975 22228 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:41.860021 22256 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:41.942349 22256 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:41.913419 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:41.626147 18201 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:41.943671 22208 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:41.943845 22003 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:41.944026 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 66524.4us
I20260709 13:18:41.867703 22233 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:41.922755 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:41.939378 22228 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:41.921723 22234 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:41.944324 22003 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:41.944146 22208 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:18:41.958931 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 120703us
I20260709 13:18:41.954250 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:41.957755 18310 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
W20260709 13:18:41.944764 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 379303us
I20260709 13:18:41.949297 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:41.959640 22003 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:41.957383 22233 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:18:41.977272 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.977886 18377 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:41.981525 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:41.961146 22208 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:41.985284 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:41.984140 18349 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:41.976845 22273 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:41.993733 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 92644.6us
W20260709 13:18:42.005477 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 379446us
I20260709 13:18:42.009876 18201 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:42.011513 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:42.018733 18349 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:42.019690 22312 raft_consensus.cc:2764] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:18:42.021521 22319 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:42.023490 18926 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:42.039561 22304 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:42.015846 22317 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:42.053328 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:42.040700 22320 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:42.060108 22003 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.057739 18276 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:42.043552 22158 raft_consensus.cc:3055] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:42.054329 22319 consensus_queue.cc:1059] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:18:42.048393 22233 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.075457 22320 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.076056 22320 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:42.076112 22233 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:42.026000 22228 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.078943 22234 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:42.049877 22054 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:42.048743 22313 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:18:42.075222 22158 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:42.080307 22313 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:42.080724 22313 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:42.081744 22313 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.082497 22054 raft_consensus.cc:697] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:42.083278 22313 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:42.083586 22054 consensus_queue.cc:237] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.085536 18351 leader_election.cc:400] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 6. Current term is 7.
I20260709 13:18:42.086436 22302 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:42.087350 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:42.089417 18276 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:18:42.104864 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.107296 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:42.110258 22319 raft_consensus.cc:3055] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:42.110697 22319 raft_consensus.cc:740] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:42.111572 22319 consensus_queue.cc:260] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.053938 22317 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:42.130487 18276 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:42.130808 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:42.134536 22325 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:42.135160 22325 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:42.135692 22325 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:42.141167 18131 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 85) took 11734 ms (client timeout 15000 ms). Trace:
I20260709 13:18:42.142318 22003 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:42.120347 22273 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:42.099736 22321 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:42.127763 22317 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:42.145133 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 56857.8us
I20260709 13:18:42.131572 22319 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:42.154017 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 172611us
W20260709 13:18:42.169545 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 47136.7us
W20260709 13:18:42.155580 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 149294us
I20260709 13:18:42.080854 22158 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.145618 22273 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:42.150110 22321 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.181751 22322 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:42.141727 18131 rpcz_store.cc:269] 0709 13:18:30.406435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.406827 (+   392us) service_pool.cc:224] Handling call
0709 13:18:42.140494 (+11733667us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:41.180969 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:41.181658 (+   689us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:41.181711 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:18:41.181754 (+    43us) tablet.cc:662] Decoding operations
0709 13:18:41.182691 (+   937us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:41.182799 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:41.182830 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:18:41.183480 (+   650us) tablet.cc:701] Row locks acquired
0709 13:18:41.183529 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:18:41.183729 (+   200us) write_op.cc:270] Start()
0709 13:18:41.183870 (+   141us) write_op.cc:276] Timestamp: P: 1783603121183667 usec, L: 0
0709 13:18:41.183891 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:18:41.280800 (+ 96909us) log.cc:844] Serialized 2465 byte log entry
0709 13:18:41.307283 (+ 26483us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa17f1690ac 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b
0709 13:18:41.781167 (+473884us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b54002ae254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa18226ee28 00007fa185ca9581 00007fa185ca8d58 00007fa185cad9f1 00007fa185cad9a9 00007fa185cad939 00007fa185cad901 00007fa185cacb2d 000000000038f354 000000000038f199
0709 13:18:41.865220 (+ 84053us) op_driver.cc:464] REPLICATION: finished
0709 13:18:42.003264 (+138044us) write_op.cc:301] APPLY: starting
0709 13:18:42.003398 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:42.003655 (+   257us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:42.008899 (+  5244us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:42.063499 (+ 54600us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b54002ae254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa18227032a 00007fa1821f5f14 00007fa1821f5ec3 00007fa1821f5e38 00007fa1821f5df3 00007fa1821f50dc 00007fa18221ee16 00007fa182206cbb 00007fa1821f139d 00007fa1821f4d75
0709 13:18:42.088714 (+ 25215us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:42.089104 (+   390us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:18:42.089160 (+    56us) write_op.cc:312] APPLY: finished
0709 13:18:42.089546 (+   386us) log.cc:844] Serialized 52 byte log entry
0709 13:18:42.107996 (+ 18450us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.108134 (+   138us) write_op.cc:454] Released schema lock
0709 13:18:42.108201 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:42.108728 (+   527us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.108766 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2734309,"reported_tablets":9,"spinlock_wait_cycles":727296,"child_traces":[["op",{"apply.queue_time_us":123369,"apply.run_cpu_time_us":4040,"apply.run_wall_time_us":113741,"num_ops":6,"prepare.queue_time_us":119775,"prepare.run_cpu_time_us":30959,"prepare.run_wall_time_us":600436,"raft.queue_time_us":306132,"raft.run_cpu_time_us":20864,"raft.run_wall_time_us":226462,"replication_time_us":662919,"spinlock_wait_cycles":85309952,"thread_start_us":387814,"threads_started":4,"wal-append.queue_time_us":190211}]]}
I20260709 13:18:42.179589 22273 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.184917 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:42.189900 22331 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:42.179399 22321 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:42.202656 18201 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:42.204695 22322 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:42.207005 22321 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.212682 22309 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.213445 22309 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.204154 18201 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:42.215823 22309 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:42.216905 22322 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:42.217118 22321 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:42.217387 22322 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:42.217918 22322 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:42.225554 22234 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:42.226068 22234 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:42.227072 22234 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.228466 22234 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:42.232113 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:42.235353 22003 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:42.235766 22003 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:42.236145 22003 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.241396 18201 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:42.192787 22158 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.256711 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:42.258864 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:42.259560 18960 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:42.192320 22330 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:42.264780 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.264873 22330 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:42.265563 22330 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:42.269078 18961 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:18:42.269158 22320 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.274103 22320 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:42.274721 22320 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:42.275707 22320 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:18:42.278133 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 93306.7us
W20260709 13:18:42.280131 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.271482 22003 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.269768 22309 consensus_queue.cc:1059] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:18:42.295040 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 124702us
I20260709 13:18:42.295776 18349 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:42.299628 22329 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:42.300249 22329 raft_consensus.cc:697] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:42.301280 22329 consensus_queue.cc:237] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.302311 22003 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:42.303244 22003 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:42.303493 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:42.304060 22003 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:42.282472 22317 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.306926 22325 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.277526 22208 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.308647 22317 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:42.310427 22208 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:42.315837 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:42.298751 18276 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:42.319718 22208 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:42.320298 22208 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:42.320770 22208 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:42.324754 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.325397 22317 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:42.326725 18312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "b52e2477fc524694967c4a16afa983e3"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:18:42.326889 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:42.327543 18312 raft_consensus.cc:606] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Received request to transfer leadership to TS b52e2477fc524694967c4a16afa983e3
I20260709 13:18:42.328050 18312 raft_consensus.cc:614] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:42.328959 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 70223.5us
I20260709 13:18:42.329782 22324 raft_consensus.cc:3055] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:42.330257 22324 raft_consensus.cc:740] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:42.330603 22321 consensus_queue.cc:1059] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:42.331467 22321 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:42.329298 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:42.331177 22324 consensus_queue.cc:260] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.333102 22324 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.333609 22309 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:42.334327 22309 consensus_queue.cc:1243] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:42.334998 22273 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.334429 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:42.336199 18312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd151355294e450f85a51ac658d4a465"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:18:42.337179 22228 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:42.337761 22228 raft_consensus.cc:697] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:42.338714 22228 consensus_queue.cc:237] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.331844 22321 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:42.338676 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:42.341225 22321 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.342512 18277 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:42.342941 22321 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:42.344836 22320 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:42.345590 22312 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:42.346129 22312 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.346524 22312 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.338905 22331 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:42.347515 22331 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.347858 22331 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.349654 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:42.298596 22233 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:18:42.351145 22317 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:42.335527 22309 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:42.355149 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:42.355792 18229 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.357604 18953 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 5.
I20260709 13:18:42.352295 22309 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:42.331166 18276 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:42.382618 18229 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:42.384316 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:42.386039 18236 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:42.390385 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.431493 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.439617 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:42.440153 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.441124 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:42.440115 18234 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:42.442018 18229 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:42.441318 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.440415 18231 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:42.448468 18349 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:18:42.449486 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 118396us
I20260709 13:18:42.450309 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:18:42.438633 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 133369us
W20260709 13:18:42.447840 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.439886 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:18:42.454936 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.388118 22309 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.456892 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:42.457543 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:42.318169 22003 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.463296 18229 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
W20260709 13:18:42.465080 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 78444.4us
I20260709 13:18:42.465924 18230 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:18:42.441526 22320 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:42.475757 22334 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:42.479228 22335 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:42.455427 18351 connection.cc:256] RPC call timeout handler was delayed by -2.2320055469999716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.236s for a response
I20260709 13:18:42.480630 18232 pending_rounds.cc:85] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 3
I20260709 13:18:42.502403 18232 pending_rounds.cc:107] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 7.4
W20260709 13:18:42.481626 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 240320us
I20260709 13:18:42.483417 22282 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.501602 22334 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:42.505227 22334 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:42.505080 22282 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.506492 22273 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:42.507638 22282 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:42.484014 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:42.502849 22335 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:42.509443 22335 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:42.513651 22208 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.515839 22208 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:42.518924 18201 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:42.523528 22330 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.528738 22317 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:42.530071 22336 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:42.530442 18312 raft_consensus.cc:606] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:42.530936 18312 raft_consensus.cc:614] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:42.532232 18201 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:42.538368 22335 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:42.502429 18351 connection.cc:256] RPC call timeout handler was delayed by -1.7286447890001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
I20260709 13:18:42.503258 18232 raft_consensus.cc:2889] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:42.539613 18351 connection.cc:256] RPC call timeout handler was delayed by -1.7160447890000796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 13:18:42.538506 22336 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:42.539719 18232 pending_rounds.cc:107] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:18:42.540356 22336 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.541100 22336 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:42.541757 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.540408 18232 raft_consensus.cc:2889] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:42.544059 18201 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:42.466801 22324 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:42.494496 22320 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.544950 22320 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:42.544917 22324 raft_consensus.cc:697] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:42.546149 18201 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:42.546329 22324 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.540557 22325 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:42.556787 18351 connection.cc:256] RPC call timeout handler was delayed by -1.708844789000068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 13:18:42.537640 22334 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.559782 22334 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:42.557358 18351 connection.cc:256] RPC call timeout handler was delayed by -1.664744789000224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 13:18:42.560918 18351 connection.cc:256] RPC call timeout handler was delayed by -1.6332447890001731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 13:18:42.561317 18351 connection.cc:256] RPC call timeout handler was delayed by -1.6123997469999267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:18:42.561672 18351 connection.cc:256] RPC call timeout handler was delayed by -1.6089447890001338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
W20260709 13:18:42.562077 18351 connection.cc:256] RPC call timeout handler was delayed by -1.5999447890001193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
I20260709 13:18:42.490097 22003 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:42.539479 22322 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.537616 18236 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
W20260709 13:18:42.562750 18351 connection.cc:256] RPC call timeout handler was delayed by -1.5324447890002375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
W20260709 13:18:42.578366 18351 connection.cc:256] RPC call timeout handler was delayed by -1.4613447890001225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
I20260709 13:18:42.570397 18231 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
W20260709 13:18:42.499876 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.579684 18351 connection.cc:256] RPC call timeout handler was delayed by -1.4604447890001211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 13:18:42.582369 18351 connection.cc:256] RPC call timeout handler was delayed by -1.4359997470000962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
I20260709 13:18:42.582231 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:18:42.583280 18351 connection.cc:256] RPC call timeout handler was delayed by -1.4235447890000614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 13:18:42.583909 18351 connection.cc:256] RPC call timeout handler was delayed by -1.4019447890000265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 13:18:42.585592 18351 connection.cc:256] RPC call timeout handler was delayed by -1.3794447890002175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 13:18:42.587401 18351 connection.cc:256] RPC call timeout handler was delayed by -1.3254447890001302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
W20260709 13:18:42.576467 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 71744.5us
W20260709 13:18:42.587785 18351 connection.cc:256] RPC call timeout handler was delayed by -1.2730997470000602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
W20260709 13:18:42.588622 18351 connection.cc:256] RPC call timeout handler was delayed by -1.2552447890000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260709 13:18:42.589218 18351 connection.cc:256] RPC call timeout handler was delayed by -1.2442997470000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
I20260709 13:18:42.590034 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:42.590438 22338 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:42.590812 18377 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:42.591243 22335 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:42.590075 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 13:18:42.589555 18351 connection.cc:256] RPC call timeout handler was delayed by -1.2363447890002135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 13:18:42.593278 18351 connection.cc:256] RPC call timeout handler was delayed by -1.2289997469999889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 13:18:42.593556 18351 connection.cc:256] RPC call timeout handler was delayed by -1.2120447890001742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
W20260709 13:18:42.593856 18351 connection.cc:256] RPC call timeout handler was delayed by -1.1101997470000242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
W20260709 13:18:42.594338 18351 connection.cc:256] RPC call timeout handler was delayed by -1.1047997470000155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 13:18:42.594686 18351 connection.cc:256] RPC call timeout handler was delayed by -1.0966997470000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260709 13:18:42.593911 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:42.597847 18926 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:42.603116 18228 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 12: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:42.587159 22003 raft_consensus.cc:2764] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:18:42.611469 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:18:42.616283 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 166071us
I20260709 13:18:42.607509 21895 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:42.624935 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 78884.3us
I20260709 13:18:42.602821 22336 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.642390 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:42.622574 21895 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.643092 18231 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.512439 18134 catalog_manager.cc:5697] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 6 to 7, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 7 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:42.652148 18134 catalog_manager.cc:5697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 5 to 7, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 7 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:42.655244 18134 catalog_manager.cc:5697] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:42.646723 21895 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.672673 22346 consensus_queue.cc:1059] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:18:42.673944 22346 raft_consensus.cc:3055] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:42.674275 22346 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:42.675105 22346 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.675175 18134 catalog_manager.cc:5697] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:42.668107 18231 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:42.677241 22344 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:42.677433 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:42.677985 21895 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.678701 22344 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:42.682436 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:42.682988 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:42.683817 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:42.684966 22344 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:42.685683 22344 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:42.684921 18134 catalog_manager.cc:5697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 5 to 6, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 6 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:42.686137 22344 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.686801 22343 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:42.683632 18377 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.687088 18134 catalog_manager.cc:5697] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 4 to 6, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 6 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:42.690176 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:42.690986 22334 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.691638 22334 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:42.692044 22334 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.621341 22208 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:18:42.691021 21895 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:42.649629 22348 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:18:42.697091 18377 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
W20260709 13:18:42.698832 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.704543 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 68512.4us
I20260709 13:18:42.701050 18926 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:42.629108 22234 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:18:42.676409 22346 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.683748 22331 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.715999 18953 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:42.688228 22309 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.711314 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:42.685007 22330 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:42.727077 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:42.728229 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.729171 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 90940.3us
I20260709 13:18:42.729925 18201 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:42.730997 18201 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:42.737113 22098 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:42.737605 22098 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:42.738696 22098 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.746440 22338 raft_consensus.cc:2764] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:18:42.747257 22338 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:42.748111 22338 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:42.749701 22309 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:42.749958 22322 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:42.750628 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 110501us
I20260709 13:18:42.716545 21895 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:42.759690 22335 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:42.759877 21895 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:42.761802 18276 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:42.725315 22348 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.765846 21895 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.766248 22348 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.768579 22335 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:42.764916 22158 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.770057 22158 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:42.770776 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.707803 22343 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:18:42.773087 18307 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:42.760545 22336 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:42.768309 22348 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:42.775794 22334 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:42.777618 18351 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.595s (SENT) [suppressed 25 similar messages]
I20260709 13:18:42.783211 18276 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:42.786047 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:18:42.779909 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 47473.7us
I20260709 13:18:42.807545 22324 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:42.808259 22324 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:42.809567 22324 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.811285 22324 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.813318 22317 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:42.816035 22158 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:42.817276 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:42.817981 18377 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:42.819455 18926 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:42.821616 18307 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:42.821992 22278 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.822415 22278 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.822544 22314 consensus_queue.cc:1059] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:42.823711 22314 raft_consensus.cc:3055] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:42.824064 22314 raft_consensus.cc:740] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:42.823995 22269 consensus_queue.cc:1059] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:42.822829 22278 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.825163 22269 raft_consensus.cc:3055] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:42.825520 22269 raft_consensus.cc:740] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:42.826457 22269 consensus_queue.cc:260] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.827909 22269 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:42.803761 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:42.765055 22312 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.831918 22273 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:42.835049 22346 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:18:42.854475 18351 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.652s (SENT)
I20260709 13:18:42.837081 22348 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:42.862311 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 79140.2us
I20260709 13:18:42.864880 18276 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:42.841202 22208 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:42.847048 22336 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:42.847292 22317 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.872845 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:18:42.874526 18202 leader_election.cc:336] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.532s (SENT)
I20260709 13:18:42.869906 18201 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:42.855283 22346 raft_consensus.cc:697] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:18:42.882587 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.882504 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:18:42.880798 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 94821.5us
I20260709 13:18:42.835145 22320 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.863816 22273 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:42.868046 22208 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:42.881350 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:42.829110 22314 consensus_queue.cc:260] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.876930 22321 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:42.892274 22355 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:18:42.887256 22335 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:42.915709 18276 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:42.893678 22208 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:42.918799 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 44313.6us
I20260709 13:18:42.883970 22317 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.966441 22317 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:42.967859 22330 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:42.968243 22330 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:42.969007 22330 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.969820 22344 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.973907 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:42.972325 22356 consensus_queue.cc:1059] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 13:18:42.924057 22352 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:18:42.926594 22320 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:42.935591 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.977353 22343 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:42.977807 22343 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:42.978545 22343 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.935154 22273 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.900163 22321 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:42.980731 22321 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.900626 22342 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:42.982571 22342 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:42.983019 22342 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.898061 22003 raft_consensus.cc:2764] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:18:42.938532 22322 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:18:42.908178 22351 log.cc:927] Time spent T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:18:42.941269 22334 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:42.942379 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:42.942011 22208 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:42.914381 22331 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:42.948486 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.950569 22346 consensus_queue.cc:237] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:42.957293 22355 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:42.976707 18312 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:42.876523 22348 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:42.921949 18351 leader_election.cc:336] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.799s (SENT)
I20260709 13:18:42.937589 22312 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:42.940375 22362 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:43.005321 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 121515us
I20260709 13:18:43.016397 21895 consensus_queue.cc:1059] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:43.018735 22314 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:43.021723 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 99812.2us
I20260709 13:18:42.990142 22336 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:42.990342 22344 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:43.027189 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 157385us
I20260709 13:18:43.030647 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:43.027205 22003 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:43.031635 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.032212 22003 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:43.033031 22322 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:43.033485 22322 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.033782 22336 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.034917 22357 consensus_queue.cc:1059] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:43.035800 22003 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:43.036386 22003 raft_consensus.cc:3055] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:43.036767 22003 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:43.036798 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:43.037727 22003 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.039014 22003 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:43.039600 18201 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:43.039654 22330 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:42.990226 22278 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:43.046592 22278 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:43.047847 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.048653 18377 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.053226 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:43.053891 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.054838 22344 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:43.020998 22355 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:43.057221 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:43.058066 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:43.058718 22355 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:43.059106 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:43.059626 18232 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:43.060904 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:43.061988 18231 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:43.063050 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:43.063956 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.059267 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:43.064997 21895 raft_consensus.cc:3055] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:43.065440 21895 raft_consensus.cc:740] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:43.066282 21895 consensus_queue.cc:260] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:43.067543 21895 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.070228 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:43.078949 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:43.081449 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:43.084174 18232 raft_consensus.cc:2368] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10.
I20260709 13:18:43.083861 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:43.084836 18231 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:43.086795 18377 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
W20260709 13:18:43.086985 18351 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.969s (SENT)
I20260709 13:18:43.089571 22363 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:43.090030 22348 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:43.091611 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:43.095397 22208 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:43.033836 22322 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:43.101147 18202 leader_election.cc:336] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.763s (SENT)
W20260709 13:18:43.116453 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 176651us
I20260709 13:18:43.117678 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:43.124678 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.127233 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.131657 18385 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:43.092547 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 53263.4us
I20260709 13:18:43.119767 18926 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:43.136045 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.136958 18382 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.121208 22363 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:43.140353 22278 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:43.140388 22324 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:43.133497 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:43.160055 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:43.158954 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.162202 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.163453 18385 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:43.148355 22348 consensus_queue.cc:1059] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:18:43.152542 22321 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:43.168624 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 81668us
W20260709 13:18:43.169710 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.167956 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.174729 22343 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:43.186028 22357 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:43.187153 22364 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:43.187732 22364 raft_consensus.cc:697] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:43.180896 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.189097 18379 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:43.181706 22324 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.183175 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.157271 22363 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:43.192575 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.195462 18312 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:43.193153 18382 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:43.194612 18385 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:43.200965 18312 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:43.201725 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:43.202481 18232 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:43.166137 22278 raft_consensus.cc:697] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:43.209333 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:43.206137 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.214134 22273 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:43.220196 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:43.221824 18384 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:43.165939 22003 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 13:18:43.235198 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 101831us
I20260709 13:18:43.238826 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:43.164628 22342 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:43.190367 22348 raft_consensus.cc:3055] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:43.241194 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:43.200738 22356 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:43.241442 18231 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:43.243325 18276 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:43.255941 18276 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:43.256796 18276 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:43.245092 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:43.257632 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:43.246850 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.247999 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:43.259953 18304 raft_consensus.cc:2376] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12. Re-sending same reply.
I20260709 13:18:43.248739 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.261369 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:43.262002 18311 raft_consensus.cc:2376] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13. Re-sending same reply.
I20260709 13:18:43.262498 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:43.262758 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.263273 18311 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:43.263917 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:43.258890 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.245280 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.258520 18312 raft_consensus.cc:2376] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14. Re-sending same reply.
I20260709 13:18:43.265352 18308 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:43.266062 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.259097 18230 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:18:43.266137 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.270615 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:43.271257 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:43.203120 22324 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.271764 18230 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:43.274541 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:43.275103 18307 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:43.273543 18312 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:43.279953 18310 raft_consensus.cc:2376] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10. Re-sending same reply.
I20260709 13:18:43.274753 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:43.276460 18306 raft_consensus.cc:2376] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11. Re-sending same reply.
I20260709 13:18:43.268570 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:43.268754 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 99942.9us
I20260709 13:18:43.268643 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.278592 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.278856 18231 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:43.274927 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.271951 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:43.281840 18309 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.243907 22348 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:43.261121 22335 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:43.285382 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.287720 18304 raft_consensus.cc:2393] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:43.286685 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.288146 18311 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:43.267697 22320 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:18:43.301170 22365 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:43.301337 22338 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:43.302799 18309 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:43.289494 18308 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:43.287744 18305 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.267977 22334 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:43.291111 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:43.311918 18228 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.293990 22348 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.294605 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:43.295469 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.303704 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.306345 18379 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:43.306196 18232 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
W20260709 13:18:43.308373 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 100170us
I20260709 13:18:43.269251 22344 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:43.315944 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.315824 22375 consensus_queue.cc:1059] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:18:43.317627 22348 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:43.320086 22342 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:43.322295 22324 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:43.237150 22364 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:43.325376 22282 consensus_queue.cc:1059] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:43.328573 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:43.327780 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:43.338343 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:43.292900 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:43.341141 18230 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.342355 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.344777 18231 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
W20260709 13:18:43.345788 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 59507.2us
I20260709 13:18:43.347539 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.347957 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.348163 18381 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:43.344919 22342 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.348984 22342 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.351749 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:43.352036 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:43.337441 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 50132.2us
I20260709 13:18:43.352422 18377 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:43.352773 18382 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:43.355472 18377 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:18:43.356832 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:43.367449 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:43.320434 22208 raft_consensus.cc:3055] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:43.278044 22355 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:18:43.370688 18309 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:43.268332 22356 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:43.389456 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:43.317619 22375 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:43.376845 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:43.368633 18276 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:43.395911 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:43.275027 22278 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:43.384315 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:43.386831 18381 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:43.387264 18277 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:43.387697 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.380390 18303 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:43.350718 22372 raft_consensus.cc:3055] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:43.393592 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.360260 22344 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:43.381579 18308 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:43.344348 22334 raft_consensus.cc:697] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:43.400484 18310 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:43.375697 22208 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:43.402195 18277 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:43.350749 22158 consensus_queue.cc:1059] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:18:43.406929 22370 consensus_queue.cc:1059] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:18:43.407750 22158 raft_consensus.cc:3055] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:43.408188 22158 raft_consensus.cc:740] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:43.402599 22098 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:43.405102 18305 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:43.406399 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:43.411248 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:43.412375 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:43.414201 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:43.394369 22375 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:43.408363 22370 raft_consensus.cc:3055] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:43.430362 22370 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:43.431291 22370 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:43.402837 22330 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:43.422173 22360 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:43.413053 22098 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:43.420715 22321 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:43.429370 22375 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.400240 22372 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:43.433727 18230 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:43.420748 22273 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:43.395023 22364 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 13:18:43.422668 18351 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.155s (SENT)
I20260709 13:18:43.409262 22366 consensus_queue.cc:1059] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:18:43.433598 22362 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:43.439504 22208 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.441391 22356 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:43.443481 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:43.412109 22320 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:43.413443 22335 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:43.422434 18277 leader_election.cc:400] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10.
W20260709 13:18:43.486264 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63984.9us
I20260709 13:18:43.487025 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:43.452487 22334 consensus_queue.cc:237] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.453918 22344 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.456024 22342 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:43.458817 18306 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:43.459424 22319 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:43.409272 22158 consensus_queue.cc:260] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:43.470289 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.509579 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:43.479377 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.510265 18380 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:43.510776 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.511468 18382 raft_consensus.cc:2368] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10.
W20260709 13:18:43.511664 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.479612 18953 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:18:43.463426 22370 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:43.480958 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.505391 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:43.513538 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 99689.4us
I20260709 13:18:43.479516 22362 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:43.509810 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.518103 18276 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:43.528961 18383 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:43.529210 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:43.530494 18386 raft_consensus.cc:2410] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:18:43.531716 18276 leader_election.cc:400] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10.
W20260709 13:18:43.528301 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 145889us
I20260709 13:18:43.532054 18276 leader_election.cc:403] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:18:43.516227 22208 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.535365 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:43.513305 22360 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:43.513286 22330 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:43.518342 22346 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:43.534860 22375 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:43.534336 22335 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:43.517310 22362 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:43.572613 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:43.530179 22342 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:18:43.574631 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:43.545499 22366 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10.
W20260709 13:18:43.575724 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.516932 22319 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:43.577584 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.539985 22273 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:18:43.592476 22158 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:43.604884 22385 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:18:43.605211 22356 raft_consensus.cc:3055] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:18:43.605749 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.579990 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.584550 22322 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.566993 22335 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:43.590597 22363 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.548487 22343 consensus_queue.cc:1059] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:18:43.564744 22364 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:43.487881 22372 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:43.565862 21895 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:18:43.599673 22381 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:18:43.654572 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:43.655519 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:43.656085 18234 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:43.656543 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.661149 18236 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 12: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:43.602593 22342 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:18:43.612799 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 79526.4us
I20260709 13:18:43.667464 18230 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:43.640296 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 65804.4us
I20260709 13:18:43.593741 22319 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:43.648643 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.646637 22336 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.664194 18235 raft_consensus.cc:2368] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10.
I20260709 13:18:43.679497 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:43.629945 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.605652 22356 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:43.602011 22273 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:43.609119 22324 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:43.646334 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 72378.8us
I20260709 13:18:43.685662 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:43.646931 22335 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.618942 18228 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:43.665688 22386 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:18:43.672246 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 99799.5us
I20260709 13:18:43.693830 18383 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:43.693679 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:18:43.674642 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.683846 18385 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:18:43.694986 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:43.671742 18305 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:18:43.666599 22342 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:43.595709 22362 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:43.711412 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.600270 22330 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.717116 22386 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:43.718204 22386 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.677891 22387 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:43.688195 22336 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:43.721058 22391 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:43.688417 22273 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:43.694482 22343 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:43.728209 18277 leader_election.cc:400] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10.
I20260709 13:18:43.728286 18230 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:43.729192 18237 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:43.731671 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:43.725875 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:43.738190 18230 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:18:43.738652 18230 pending_rounds.cc:85] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 4
I20260709 13:18:43.738956 18230 pending_rounds.cc:107] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:18:43.739249 18230 raft_consensus.cc:2889] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:43.740756 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:43.731777 22234 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.746865 22234 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.747372 22363 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:43.749392 22234 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:43.749766 22362 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:43.750348 22356 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.751896 22356 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.733628 22387 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:43.754359 22387 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.726619 22348 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:43.693274 22324 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.758845 22324 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:43.761044 22320 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:43.768615 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:43.769734 18233 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:18:43.770124 18233 pending_rounds.cc:85] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 5
I20260709 13:18:43.770157 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:43.771582 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:43.773283 18230 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:43.774587 18230 raft_consensus.cc:3055] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:43.774956 18230 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:43.775708 18230 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:43.770638 18233 pending_rounds.cc:107] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:18:43.776734 18233 raft_consensus.cc:2889] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:43.777379 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:43.778628 18378 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:43.776945 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:43.780714 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:43.781579 18385 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:43.781785 18234 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:18:43.782697 18380 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:43.782855 18232 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:43.784669 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:43.781978 18230 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.786121 18385 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:43.801013 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 60366.2us
I20260709 13:18:43.724690 22392 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:43.807401 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:43.814064 18201 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:43.824972 22348 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:43.825301 22336 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:43.825726 22382 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:43.826189 22372 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:43.829095 18235 raft_consensus.cc:2393] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 14: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:43.776014 22335 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:43.721146 22366 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:18:43.832155 18953 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:43.856757 22335 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:43.835000 22355 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:43.857147 18385 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:43.836175 22364 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:43.857909 22364 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.858315 22364 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.858798 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:43.849848 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:43.859347 22273 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.859961 22348 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:43.734028 22391 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:43.861133 22322 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:43.861085 22348 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.861954 22322 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:43.863540 22391 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:43.865252 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:43.866043 18961 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 5: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:43.731911 22346 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:18:43.852073 18305 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:43.783049 22312 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:18:43.849843 22395 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.093s	user 0.000s	sys 0.002s
I20260709 13:18:43.833572 22390 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.853600 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.868901 22390 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:43.869654 18378 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:43.868397 22312 raft_consensus.cc:697] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:43.870301 18953 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
W20260709 13:18:43.872363 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.870878 18201 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:43.873363 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 66035.9us
I20260709 13:18:43.874856 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:43.874905 18201 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:43.877637 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:43.878821 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 152989us
W20260709 13:18:43.869663 22402 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:18:43.913208 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:43.913757 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:43.916992 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.918500 18386 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:43.918532 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:43.919848 18276 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:43.881594 22375 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:43.873178 22392 raft_consensus.cc:697] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:43.923877 18230 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:18:43.925410 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:43.951169 18230 pending_rounds.cc:85] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 7
I20260709 13:18:43.952157 18230 pending_rounds.cc:107] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:18:43.952661 18230 raft_consensus.cc:2889] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:43.952342 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:43.926011 22336 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:43.932247 22396 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:43.932657 22324 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:43.767338 22342 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:43.933987 22273 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:43.880576 22282 consensus_queue.cc:1059] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:18:43.935976 18927 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:43.924443 22322 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:18:43.924206 22382 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:43.911259 22355 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:18:43.944383 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.911813 22363 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:43.960650 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:43.961585 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:43.991751 18377 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:43.963650 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:43.970749 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:43.974844 22314 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.881706 22335 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:18:43.981118 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:43.942878 22344 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:43.986274 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:18:43.990195 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54292.4us
I20260709 13:18:44.003175 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:44.009207 18230 raft_consensus.cc:3055] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:44.013048 18230 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:44.015297 18230 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:44.019161 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 48546.7us
I20260709 13:18:44.020010 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:43.989076 22375 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:43.998975 22370 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:43.998720 22338 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:44.024704 18277 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:44.031107 18377 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
W20260709 13:18:44.063036 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 59932.5us
I20260709 13:18:44.084995 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:44.001569 22314 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:44.089658 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.089279 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 64675.1us
I20260709 13:18:44.096484 18377 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:44.105254 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:44.117839 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 131675us
I20260709 13:18:44.119369 22419 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:44.120471 22415 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:44.121275 22415 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:44.122462 22415 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.120497 22419 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.128062 22419 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.021230 22344 raft_consensus.cc:697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:44.053471 22355 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:44.001901 22312 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.136751 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:44.116647 22387 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:44.025432 22397 consensus_queue.cc:1059] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.233s
I20260709 13:18:44.010869 22319 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 13:18:44.134616 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:44.161623 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:44.129460 22396 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:44.151206 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:44.120501 18202 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:44.103863 22278 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.129719 22282 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.135488 22366 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:44.132845 22390 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.141589 22343 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:44.180617 22324 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:18:44.194165 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 73762.5us
W20260709 13:18:44.198151 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.156498 22377 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:44.189891 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 72454.8us
I20260709 13:18:44.200863 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:44.201560 18378 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:18:44.202589 18381 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:18:44.162689 22411 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.153805 22408 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:44.202725 18926 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:44.216604 18384 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:44.210727 22421 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:44.189854 22386 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:44.189428 22397 raft_consensus.cc:3055] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:18:44.211872 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.211840 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 50375.7us
I20260709 13:18:44.088241 22392 consensus_queue.cc:237] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:44.144505 22360 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:18:44.154280 22321 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:18:44.206012 22324 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:44.226897 22343 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:44.234879 22411 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.218515 22322 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:44.215961 22403 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:44.189627 22278 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:44.238906 22408 raft_consensus.cc:697] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:44.201118 22372 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:18:44.238755 22397 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:44.193338 22282 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:44.170403 22375 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.252167 22419 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:44.289561 18232 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:18:44.297446 18232 raft_consensus.cc:3055] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:44.298099 18232 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:44.226744 22344 consensus_queue.cc:237] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:44.256449 22421 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.279822 22322 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:44.311968 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 113855us
I20260709 13:18:44.307392 18232 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.314884 18377 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:44.290388 22403 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:44.342900 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:44.343465 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:44.344385 18232 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:44.349052 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:44.288057 22419 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.320502 18311 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:44.323205 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:44.352795 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.275324 22355 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.362646 18307 raft_consensus.cc:2410] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 13:18:44.369055 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.342048 22343 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.342286 21895 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.377580 18311 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:18:44.362938 22386 raft_consensus.cc:697] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:44.301090 22336 raft_consensus.cc:697] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:44.370591 18304 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:44.399116 18232 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:44.400830 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.403896 18306 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:44.347158 22314 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:44.372792 22406 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 13:18:44.312762 22324 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:44.419081 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 94487.1us
I20260709 13:18:44.391271 22423 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:44.429380 22410 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:18:44.414414 22389 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:44.458180 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 111474us
I20260709 13:18:44.415940 22424 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:44.463891 18351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.026s	sys 0.031s
W20260709 13:18:44.464329 18351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.026s	sys 0.031s
W20260709 13:18:44.464648 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 550925us
I20260709 13:18:44.401943 22343 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:44.467099 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:44.437582 22411 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:44.406527 21895 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:44.441238 22423 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.468353 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:44.482283 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:44.411993 22322 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:44.473845 22401 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:18:44.364236 22408 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:44.472493 22324 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:44.477694 22409 log.cc:927] Time spent T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:18:44.470237 22234 raft_consensus.cc:2764] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:18:44.488346 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:44.498575 18386 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 4.
I20260709 13:18:44.490986 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:44.500011 18232 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:44.493008 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:44.311801 22397 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.476704 22423 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:44.513785 18926 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:44.506654 22426 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.140s
W20260709 13:18:44.509176 22364 consensus_meta.cc:287] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.650s	user 0.009s	sys 0.003s
I20260709 13:18:44.488973 22278 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.512765 22422 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:44.485626 22411 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:44.500914 18229 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:44.519608 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:44.538269 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:44.463445 22389 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.510839 22338 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:44.498701 22404 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:18:44.536242 18386 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:44.512223 22428 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.118s
W20260709 13:18:44.527566 22418 log.cc:927] Time spent T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:18:44.543493 18384 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:18:44.469547 22424 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.544960 18233 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:44.485164 22336 consensus_queue.cc:237] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.545223 22421 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.459151 22403 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.530534 22397 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:44.544075 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 77932.7us
I20260709 13:18:44.545032 18232 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
W20260709 13:18:44.539275 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.561523 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.563740 18384 pending_rounds.cc:85] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 6
I20260709 13:18:44.564579 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1843) took 1204 ms. Trace:
I20260709 13:18:44.480422 22386 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:44.583240 18384 pending_rounds.cc:107] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:18:44.583644 18384 raft_consensus.cc:2889] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:44.558385 22437 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:18:44.585425 18231 rpcz_store.cc:276] 0709 13:18:43.360131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.360968 (+   837us) service_pool.cc:224] Handling call
0709 13:18:43.391132 (+ 30164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.678313 (+287181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.678343 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.689306 (+ 10963us) log.cc:844] Serialized 26 byte log entry
0709 13:18:43.870506 (+181200us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:43.870543 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.870605 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.564272 (+693667us) raft_consensus.cc:1685] finished
0709 13:18:44.564302 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.564484 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53230,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":436491,"threads_started":2,"wal-append.queue_time_us":279302}
I20260709 13:18:44.548712 22422 raft_consensus.cc:697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:44.589265 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:44.591558 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:44.558230 22436 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:44.532330 22364 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.547631 22321 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:18:44.601159 22440 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:18:44.597769 22424 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:44.622242 18311 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:44.555085 22415 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.643764 18306 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:18:44.650331 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.636579 18229 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:44.650525 22363 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:18:44.650362 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.651584 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.651216 22363 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.651989 18229 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:44.653553 22363 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.581312 22419 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.656162 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.656903 18307 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:44.658224 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:44.569036 22411 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:44.660257 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:44.660873 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.602882 22387 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:44.627924 22436 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.663682 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:44.671959 18231 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:44.672364 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.665735 18311 raft_consensus.cc:2376] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11. Re-sending same reply.
I20260709 13:18:44.673058 18307 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:44.662945 18228 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:44.668629 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.677937 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:44.678555 18311 raft_consensus.cc:2376] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8. Re-sending same reply.
I20260709 13:18:44.678889 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:44.679382 18377 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:18:44.679768 18307 raft_consensus.cc:2393] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:44.679836 18377 pending_rounds.cc:85] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 6
I20260709 13:18:44.680320 18377 pending_rounds.cc:107] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:18:44.680615 18377 raft_consensus.cc:2889] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:44.681346 18236 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:44.658733 22344 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.682976 22420 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:44.683550 22455 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.684103 22439 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:44.684741 22447 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:18:44.704480 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.662750 22421 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.701817 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.671466 22436 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:44.707672 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:44.658433 22419 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:18:44.709438 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.656028 22415 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.711755 18307 raft_consensus.cc:2376] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9. Re-sending same reply.
I20260709 13:18:44.688823 21895 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:44.706552 22343 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:44.713304 22457 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:18:44.718621 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:44.717519 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.717546 18308 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:44.727169 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.726492 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:44.731427 18953 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:44.732090 18308 raft_consensus.cc:2376] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12. Re-sending same reply.
I20260709 13:18:44.733497 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.711351 22421 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.715459 22372 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.740551 22372 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:44.730604 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 141432us
I20260709 13:18:44.742762 22372 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:44.744853 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.746069 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.746764 18306 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 5: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:44.743360 18202 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:44.735399 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.710500 22363 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:18:44.750906 18308 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:18:44.704320 22344 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.753355 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:44.747459 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:44.757401 22357 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:18:44.757704 22463 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:44.758658 22454 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:44.785329 22364 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.760809 18304 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:44.761479 22158 raft_consensus.cc:3055] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:44.776124 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:44.706607 22455 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.791080 22375 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:18:44.791910 22366 consensus_meta.cc:287] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.599s	user 0.007s	sys 0.004s
I20260709 13:18:44.763227 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.793133 22455 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.793772 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.794448 18308 raft_consensus.cc:2376] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12. Re-sending same reply.
I20260709 13:18:44.795348 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:44.796175 18308 raft_consensus.cc:2410] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:18:44.772864 22424 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:18:44.797617 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.719326 22422 consensus_queue.cc:237] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.752806 22411 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.789609 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.801303 18304 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:44.802290 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:44.803004 18304 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:44.803761 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.790148 22158 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:44.805814 22421 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.790621 22463 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:44.806620 22389 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.810324 22282 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:44.791231 22273 consensus_meta.cc:287] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.806s	user 0.000s	sys 0.012s
I20260709 13:18:44.805406 22158 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:44.804349 18304 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:44.788602 18202 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:44.812777 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.816700 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.792333 22366 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:44.818194 18307 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:44.821117 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.822558 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.783775 22322 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:18:44.811314 22406 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:44.706920 22439 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.823025 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.804154 22423 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:44.814621 18306 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:44.827389 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:44.823467 18307 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:44.834838 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.835896 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.816808 22421 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:44.837343 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.838073 18307 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:44.833374 22322 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:44.839255 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.839923 18304 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:18:44.812299 22357 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:18:44.841893 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:44.844167 18307 raft_consensus.cc:2376] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11. Re-sending same reply.
I20260709 13:18:44.839716 22421 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:44.846253 22421 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:44.846231 22322 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.851269 22423 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:44.854159 22370 consensus_meta.cc:287] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.789s	user 0.013s	sys 0.000s
I20260709 13:18:44.854619 22370 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:44.856345 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.857316 18307 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:44.863214 18312 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:44.867640 18304 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:44.839589 22158 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:44.867866 18307 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:18:44.877923 18307 pending_rounds.cc:85] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 8
I20260709 13:18:44.880009 18308 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:44.881697 22424 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:44.878996 22336 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.894078 22336 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.903359 22344 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.905382 22415 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.878240 18307 pending_rounds.cc:107] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 13.9
I20260709 13:18:44.911223 18307 raft_consensus.cc:2917] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Aborting config change with OpId 13.9: Aborted: Op aborted by new leader
I20260709 13:18:44.896863 22470 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:18:44.922643 22436 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:44.926518 22421 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:44.906921 22234 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:18:44.931111 22463 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:44.933123 22336 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.935469 22436 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.936672 22421 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.940112 22439 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:44.940443 22346 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.912971 18307 raft_consensus.cc:2889] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:44.942231 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:44.971309 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.988626 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:44.991786 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.992552 18307 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:44.995772 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:44.996271 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:45.001675 18304 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 14: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:45.002594 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:45.003113 18304 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:44.996903 18307 raft_consensus.cc:2410] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:18:44.997691 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:45.009374 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:45.010663 18304 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:45.011569 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:45.012688 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:44.992059 22421 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:45.011775 22335 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.014139 22322 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:45.015060 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:45.026755 18307 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:45.021442 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.023916 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:44.991448 22158 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.036859 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:45.030476 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.000757 22386 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.032250 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:45.032464 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.038661 18232 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:18:45.026453 22322 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.031354 22438 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:45.039695 22322 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:45.026778 22324 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:45.026237 22335 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.037721 18229 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
W20260709 13:18:45.034373 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.035251 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:45.047796 18202 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:45.049860 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:45.050948 22282 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.054502 22282 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:45.056869 22336 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:45.048933 22158 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:45.057665 22336 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:45.056766 22324 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:45.058393 22324 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:45.059118 22158 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:45.058754 22324 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:45.060894 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:45.061906 18303 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:18:45.062206 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:45.058782 22336 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.067443 22282 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.048905 22436 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.051071 22386 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.072443 22436 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:45.074258 22412 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.881s	user 0.002s	sys 0.002s
I20260709 13:18:45.074617 22386 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.022102 22422 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:45.061124 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:45.005843 22346 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.051883 22421 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:45.082532 18380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2232) took 1207 ms. Trace:
I20260709 13:18:45.083189 18229 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
I20260709 13:18:45.150080 18310 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:45.078454 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.151700 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:45.148909 18380 rpcz_store.cc:276] 0709 13:18:43.875457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.876410 (+   953us) service_pool.cc:224] Handling call
0709 13:18:43.876767 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.882216 (+  5449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.882258 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.889354 (+  7096us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.006725 (+117371us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:44.006774 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.006852 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.073655 (+1066803us) spinlock_profiling.cc:243] Waited 8.62 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:45.075460 (+  1805us) raft_consensus.cc:1685] finished
0709 13:18:45.075480 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.082453 (+  6973us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":809,"raft.queue_time_us":9366,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":23262,"spinlock_wait_cycles":19814656,"thread_start_us":77847,"threads_started":1,"wal-append.queue_time_us":207044}
I20260709 13:18:45.155467 22346 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.083848 22411 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:45.156883 22411 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.157248 22411 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:45.152671 18231 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:18:45.163637 18953 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:45.074743 22436 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.171546 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:45.175191 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 96853.6us
I20260709 13:18:45.176759 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.161510 22432 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.183388 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:45.166901 22422 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:45.163110 22357 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:45.170671 22335 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.194907 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:45.192994 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:45.197825 18310 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:45.197952 18306 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:45.196385 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:45.172847 22441 consensus_queue.cc:1059] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:18:45.200707 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.202756 22386 raft_consensus.cc:3055] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:45.203047 22470 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:45.203307 22386 raft_consensus.cc:740] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:45.204681 22386 consensus_queue.cc:260] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:45.206877 22322 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.199064 22357 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.214731 22357 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.216418 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.218679 18309 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:45.188165 22454 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.219524 22470 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:45.196969 22336 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.223547 22336 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.225739 22336 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.193230 22234 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:45.228083 18927 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:45.230104 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.236961 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:45.237689 18309 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:18:45.239693 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:45.216861 22468 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.420s	user 0.004s	sys 0.011s
I20260709 13:18:45.241523 18306 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:18:45.243543 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:45.246397 18927 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:45.249812 18927 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:45.192075 22432 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.241118 22436 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:45.245312 22422 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:45.254056 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:45.221823 22411 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.248387 22438 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:45.255558 22423 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:45.257014 22436 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.251992 22458 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:45.251605 22370 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:45.269608 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:45.248188 22324 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.272790 22458 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:45.266650 22234 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:45.252228 22454 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.266583 22436 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:45.267001 22322 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.275413 22458 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.268154 22370 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.278793 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:45.270401 22423 raft_consensus.cc:697] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:45.285717 22324 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:45.286181 22454 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.287569 22423 consensus_queue.cc:237] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:45.280424 22370 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:45.288748 22476 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.227s	user 0.002s	sys 0.004s
I20260709 13:18:45.290479 22421 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:45.291500 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.292111 18380 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:18:45.279807 22438 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:45.293174 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:45.293742 18377 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.294355 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:45.298776 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.299506 18384 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 5.
I20260709 13:18:45.300480 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.300876 18308 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:45.305886 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1853) took 1018 ms. Trace:
I20260709 13:18:45.306844 22375 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:45.307411 22375 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.308691 22419 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.309106 18229 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:45.309254 22419 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.306278 18237 rpcz_store.cc:276] 0709 13:18:44.287555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.287702 (+   147us) service_pool.cc:224] Handling call
0709 13:18:44.288083 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:44.402727 (+114644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.402783 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:44.402853 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:44.402900 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.305604 (+902704us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400103bd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:45.305660 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.305809 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262873984}
I20260709 13:18:45.311406 22391 raft_consensus.cc:3055] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:45.311815 22391 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:45.313073 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:45.313711 18236 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:45.313829 18235 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:45.315053 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:45.280234 22458 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:45.312649 22391 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.321978 22411 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:45.323964 22342 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.324329 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:45.325661 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:45.318109 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:45.316848 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:45.332470 18377 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
I20260709 13:18:45.327440 18235 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:18:45.334221 18926 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:45.336622 18237 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:18:45.340945 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 62227us
I20260709 13:18:45.344321 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.351567 22403 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:45.356956 22403 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:45.358361 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.360212 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.345588 22282 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:45.359956 22411 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:45.368961 22282 raft_consensus.cc:697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:45.373548 22282 consensus_queue.cc:237] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:45.375021 22403 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.379223 18960 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:45.380663 18957 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:18:45.381022 18957 pending_rounds.cc:85] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Aborting all ops after (but not including) 8
I20260709 13:18:45.381247 22386 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.385938 22370 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:45.388923 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:45.381294 18957 pending_rounds.cc:107] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 13.9
I20260709 13:18:45.389477 18304 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:45.389541 18957 raft_consensus.cc:2917] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Aborting config change with OpId 13.9: Aborted: Op aborted by new leader
I20260709 13:18:45.360882 22234 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:45.366394 22438 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:45.391031 22321 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:45.391382 22407 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 1.235s	user 0.000s	sys 0.017s
I20260709 13:18:45.391527 22321 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.392650 18383 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:45.390012 18957 raft_consensus.cc:2889] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 14 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:45.393707 18379 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:45.400039 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.401635 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.403880 18304 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:45.406829 18927 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:18:45.409557 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 49435.1us
I20260709 13:18:45.410117 18378 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:45.413885 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 683) took 1686 ms. Trace:
I20260709 13:18:45.414240 18382 rpcz_store.cc:276] 0709 13:18:43.727959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.728120 (+   161us) service_pool.cc:224] Handling call
0709 13:18:43.728425 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.728780 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.728809 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.735658 (+  6849us) log.cc:844] Serialized 26 byte log entry
0709 13:18:43.975221 (+239563us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:43.975261 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.975325 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.391032 (+1415707us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b24001d47e8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f00c9c4 00007fa17f00aacb 00007fa17f1c5dc9 00007fa17f1c5a55 00007fa17f1c509d 00007fa181df710e 00007fa181e0e88c 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221
0709 13:18:45.392457 (+  1425us) raft_consensus.cc:1685] finished
0709 13:18:45.392484 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.413804 (+ 21320us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":294,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6660,"spinlock_wait_cycles":3271936,"thread_start_us":147470,"threads_started":1,"wal-append.queue_time_us":286296}
I20260709 13:18:45.428048 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.433414 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.435420 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.436329 18378 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:45.437706 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.441965 22370 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:45.427394 22382 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.271s	user 0.023s	sys 0.013s
W20260709 13:18:45.444072 22382 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.295s	user 0.023s	sys 0.015s
I20260709 13:18:45.421991 22494 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:45.454548 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.455570 18382 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
W20260709 13:18:45.455892 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 50509.2us
I20260709 13:18:45.465853 18378 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:45.462955 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:45.466998 18382 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:45.469146 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.471560 18385 raft_consensus.cc:2410] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:18:45.471499 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 43511.3us
I20260709 13:18:45.468075 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:45.472661 18382 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:45.472741 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.477072 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:45.469146 22438 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:18:45.478451 22422 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:45.486651 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:45.501981 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.471128 22234 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:45.525514 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:45.526814 22208 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:45.537273 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.485477 22433 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:45.545238 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.551419 18382 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:45.531001 22411 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:45.542299 22433 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.558147 22433 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.563375 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.565289 18383 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:18:45.541111 22098 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:45.553201 22324 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:45.561156 22321 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.547873 22422 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:45.566547 22411 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.553999 22335 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:18:45.587826 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:45.594321 18235 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:45.586035 22346 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.573776 22098 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.591185 18234 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:45.584164 22435 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.557696 22436 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:45.592686 18232 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:45.590101 18237 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:45.594339 18233 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:45.593866 22411 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:45.572105 22234 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:45.607671 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:45.609272 18229 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:45.580713 22438 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:18:45.585048 22470 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:18:45.584910 22424 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:18:45.598574 22098 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:45.625273 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:45.631662 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.616086 22422 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:18:45.639560 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.599581 22346 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.641817 22494 raft_consensus.cc:697] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:18:45.646826 22489 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:18:45.649503 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.630925 22424 consensus_queue.cc:1243] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer 459e82ee6b564cc19be6f73186938e79 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:45.611380 22435 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.647915 22234 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:18:45.673637 22477 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.608s	user 0.003s	sys 0.000s
I20260709 13:18:45.652935 22470 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:18:45.669693 22486 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:18:45.663272 22364 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:45.693464 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.696066 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46642 (request call id 696) took 1676 ms. Trace:
I20260709 13:18:45.699855 18305 rpcz_store.cc:276] 0709 13:18:44.019341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.019638 (+   297us) service_pool.cc:224] Handling call
0709 13:18:45.695829 (+1676191us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b540013f954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:45.695969 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353788800}
I20260709 13:18:45.674711 22494 consensus_queue.cc:237] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:45.718214 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 184228us
I20260709 13:18:45.671023 22424 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:18:45.701108 22234 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:45.725364 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:45.726260 18305 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:45.723544 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.705013 22364 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:45.762053 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 112634us
I20260709 13:18:45.763218 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:45.771692 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:45.768445 18305 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
I20260709 13:18:45.738413 22355 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:45.777277 18927 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:45.778538 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:45.783156 18382 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:45.760751 22464 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.777901 22470 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:45.773659 22436 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.781213 22234 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:45.804661 22346 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.804654 18382 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
I20260709 13:18:45.805708 22510 consensus_queue.cc:1059] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:18:45.818151 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:45.800707 22491 log.cc:927] Time spent T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:18:45.780330 22422 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:18:45.784027 22438 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:18:45.795089 22501 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:45.823334 22501 raft_consensus.cc:697] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:45.824259 22501 consensus_queue.cc:237] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:45.819530 22458 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.501s	user 0.014s	sys 0.000s
I20260709 13:18:45.827498 22458 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.828692 22511 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:18:45.828847 22509 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:45.829545 22458 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:45.830016 22510 raft_consensus.cc:3055] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:45.821585 22234 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:45.830613 22510 raft_consensus.cc:740] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:45.831545 22403 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:45.832055 22403 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:45.833002 22403 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.837045 22403 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.837514 22438 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:45.837961 22438 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.838294 22438 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.831244 22234 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.796682 22424 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:18:45.788653 22355 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:45.801990 22470 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:45.831763 22510 consensus_queue.cc:260] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.848498 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2401) took 1890 ms. Trace:
I20260709 13:18:45.849061 18377 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:45.796841 22464 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.813899 22499 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:18:45.843120 22312 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.857666 22499 consensus_queue.cc:1243] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:45.857813 22312 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.858814 22464 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.851953 18379 rpcz_store.cc:276] 0709 13:18:43.958421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.961242 (+  2821us) service_pool.cc:224] Handling call
0709 13:18:45.393541 (+1432299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.394080 (+   539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.848275 (+454195us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400081950. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:45.848433 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3234770688}
I20260709 13:18:45.850433 22342 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:45.865702 22342 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.843374 22511 consensus_queue.cc:1059] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:18:45.834450 22433 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.876215 18305 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:45.877285 18202 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:45.878906 22421 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:45.879393 22421 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.879782 22421 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:45.880460 22382 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:45.883190 22419 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.884845 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:45.886108 18380 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:18:45.887171 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.888360 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.889318 22342 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:45.889825 22386 consensus_meta.cc:287] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.508s	user 0.013s	sys 0.000s
I20260709 13:18:45.890743 22511 raft_consensus.cc:3055] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:45.891165 22511 raft_consensus.cc:740] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:18:45.891491 22500 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
I20260709 13:18:45.864403 22355 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:45.892951 22375 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.893291 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.847723 22458 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:45.851555 22470 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.897096 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.910497 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:45.851886 22324 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:45.898013 22510 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:45.898772 18927 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:45.899770 22098 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.900337 22503 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:45.902062 22411 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.904315 22386 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.906967 22421 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.860363 22312 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:45.913893 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.857712 22364 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:45.915598 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:45.927719 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:18:45.917675 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.895663 22458 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:45.922778 18201 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:45.913551 22342 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.939415 18382 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:18:45.941002 18303 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:18:45.921059 22464 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:45.945984 18303 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: [6.4-10.6]
I20260709 13:18:45.947889 18304 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:45.950275 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:45.951154 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:45.962287 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.953022 18303 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:45.914996 22355 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:18:45.942615 22496 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:45.944378 22442 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.981714 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:45.991643 22458 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.992846 22438 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.930085 22386 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.994072 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:45.926431 22518 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:45.981714 18308 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:45.997794 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:46.008986 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 86305.6us
I20260709 13:18:46.009379 18311 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
W20260709 13:18:46.010064 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 80963.5us
I20260709 13:18:45.999291 18307 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:46.010828 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:45.946852 22408 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.999912 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:46.012482 18303 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:46.014681 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:45.995247 22496 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:45.948019 22342 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:46.023401 18927 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:46.022012 22408 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:46.028735 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:46.029101 18305 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:18:46.028405 22408 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:46.031809 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:45.951838 22464 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:45.949045 22324 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:46.043889 18201 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:46.045754 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:46.024394 22436 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:46.030236 22495 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:46.028878 22496 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:46.035828 22518 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:46.065657 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:46.067812 18304 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:46.035030 22517 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:46.035715 22438 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:46.031661 22360 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:18:46.057822 22408 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:46.007987 22442 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:46.061342 22098 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:46.067600 22495 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.064043 22436 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.066687 22392 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:46.096211 18303 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
W20260709 13:18:46.090776 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 55076.2us
I20260709 13:18:46.118516 18304 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:18:46.064185 22441 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:18:46.136556 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 92791.6us
I20260709 13:18:46.071403 22518 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:46.087949 22520 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:18:46.135489 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 76577.1us
I20260709 13:18:46.122134 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:46.098033 22408 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:46.138618 18201 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:46.146399 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:46.097733 22519 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:46.123207 22433 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:46.132877 22495 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:46.131235 22436 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:46.169878 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:46.151902 22408 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:46.174939 18377 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:46.141160 22518 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:46.140367 22336 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:18:46.156883 22421 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:46.192551 18303 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:46.193634 18312 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:46.196682 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:46.166006 22411 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:46.195300 18311 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:46.206013 18309 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:46.155584 22525 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:46.172148 22530 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:46.191560 22513 log.cc:927] Time spent T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:18:46.190469 22464 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:46.233992 18383 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:46.235906 18383 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:18:46.237169 18383 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:46.238302 18383 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:46.240327 18383 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:46.218809 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:46.242697 22524 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:18:46.243014 18383 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:18:46.244653 22516 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:18:46.247110 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:46.248097 18305 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:46.248966 22342 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:46.251181 22435 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:46.216899 18377 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:18:46.220705 22438 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:46.221555 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:46.201479 22433 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:46.225267 22496 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:46.270625 22496 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:46.227180 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:46.229184 22530 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:46.191792 22529 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:46.220037 22527 log.cc:927] Time spent T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:46.284848 22470 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:46.225381 22436 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:46.291390 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 49832.3us
I20260709 13:18:46.288139 22470 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:46.300734 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:46.228680 22386 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:46.281926 22422 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:46.317625 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:18:46.370525 22403 consensus_meta.cc:287] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.006s
I20260709 13:18:46.301009 22510 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:18:46.379199 22470 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:46.379954 22470 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:46.381063 22470 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:46.389767 22495 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:46.393189 22495 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:46.435246 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:46.441491 22436 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:46.446523 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:46.447667 18303 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:46.449927 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:46.451987 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:46.452744 18303 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:46.348004 22411 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:18:46.321910 22438 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:46.461495 22438 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.461851 22438 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:46.465368 22530 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:18:46.479161 18303 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:46.481673 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:46.482635 18303 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:46.491169 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:46.474099 22433 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:46.492084 18305 raft_consensus.cc:2393] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:18:46.504717 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.512955 18305 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:46.519241 18303 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:46.505102 22442 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:46.542840 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.545049 22324 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:46.547106 22536 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:46.547680 22536 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:46.551002 22536 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:46.552215 22355 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:46.552951 22355 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:46.555560 22355 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:46.564770 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:46.564661 22511 consensus_queue.cc:260] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:46.568708 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.570008 18955 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:46.577394 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:46.580637 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:46.581318 18386 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:46.584085 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:46.569476 22338 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.637650 18377 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:18:46.669760 18377 pending_rounds.cc:85] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 6
I20260709 13:18:46.670077 18377 pending_rounds.cc:107] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:18:46.670418 18377 raft_consensus.cc:2889] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:46.638312 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:46.672091 18383 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:46.583197 22511 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:46.577885 22536 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.680666 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:46.679998 22533 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:46.686827 22533 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:46.688956 22533 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:46.689065 22518 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:46.690601 18960 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:18:46.684675 18276 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:46.579649 22529 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:46.716786 22529 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:46.669535 22346 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.582846 22355 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:46.731691 18201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.006s	sys 0.016s
W20260709 13:18:46.732100 18201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.006s	sys 0.016s
W20260709 13:18:46.696164 22321 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.070s	sys 0.106s
I20260709 13:18:46.744649 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:46.745639 18377 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:18:46.730173 22408 consensus_meta.cc:287] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.002s
I20260709 13:18:46.718189 22324 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.718504 22442 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:46.737123 22321 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.070s	sys 0.106s
I20260709 13:18:46.681437 22338 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:46.753333 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:46.755668 22452 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.005s	sys 0.008s
I20260709 13:18:46.741187 22355 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:46.763921 18236 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:46.755636 22442 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.699555 22536 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:46.738947 22346 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:46.765156 18383 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:46.741683 22464 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:18:46.770421 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:46.772097 18377 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:46.752754 22408 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:46.799985 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:46.803000 18383 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:46.769767 22442 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:46.755972 22324 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:46.805351 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:46.763716 22452 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.005s	sys 0.008s
I20260709 13:18:46.809978 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:46.811475 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:46.797997 22427 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:46.806303 22546 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:18:46.825929 22338 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:46.837231 22324 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:46.847630 22518 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:46.849874 22408 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:46.851533 22529 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:46.819810 22427 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:46.984225 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:46.994591 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.994947 22470 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:46.859042 22321 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:46.918397 22529 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.913702 22403 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:18:47.138896 18303 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.072s	sys 0.150s
W20260709 13:18:47.141415 18303 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.072s	sys 0.150s
I20260709 13:18:47.000797 22411 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:47.158526 22411 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.153798 18200 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:47.046681 22545 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:47.154145 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:47.163582 22545 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:47.154356 22338 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.166108 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:47.165982 22338 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.154763 22434 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:47.154886 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:47.170885 18955 raft_consensus.cc:2393] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:18:47.155467 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:47.004526 22470 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.060638 22355 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:47.142333 22529 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:47.013386 22321 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.055766 22536 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:47.160630 22346 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:47.166198 22545 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:47.154542 22438 consensus_meta.cc:287] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.002s
I20260709 13:18:47.187891 22438 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.179288 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:47.191026 18310 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:47.192766 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:47.193672 22470 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:47.179973 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:47.195551 18308 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:47.196343 18382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.013s	sys 0.022s
W20260709 13:18:47.196707 18382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.013s	sys 0.022s
I20260709 13:18:47.196741 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:47.011829 22377 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:47.139995 22427 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:47.186858 22355 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:47.201231 22355 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:47.201817 22355 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:47.204602 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1856) took 2880 ms. Trace:
I20260709 13:18:47.205193 18228 rpcz_store.cc:276] 0709 13:18:44.324245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.324624 (+   379us) service_pool.cc:224] Handling call
0709 13:18:44.352063 (+ 27439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.673965 (+321902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.204307 (+2530342us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54000d1454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:47.204486 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":714359168}
I20260709 13:18:47.206286 22438 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:47.206720 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.207217 18386 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 12: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:47.207541 18228 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:47.213936 22529 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:47.214661 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.215524 18229 raft_consensus.cc:2410] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:47.217063 22442 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.215528 22338 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:47.216220 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.219151 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.219276 22442 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:47.219898 22490 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 1.595s	user 0.004s	sys 0.006s
I20260709 13:18:47.220575 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.221236 18229 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:47.168092 22403 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.222927 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:47.223542 18228 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:47.169188 22411 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:47.221268 18961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53364 (request call id 281) took 1844 ms. Trace:
I20260709 13:18:47.226954 18382 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:47.224805 18961 rpcz_store.cc:276] 0709 13:18:45.376564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.377355 (+   791us) service_pool.cc:224] Handling call
0709 13:18:45.377668 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.377994 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.378023 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.378422 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.504018 (+125596us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:45.504073 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.504136 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.219300 (+1715164us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:47.220903 (+  1603us) raft_consensus.cc:1685] finished
0709 13:18:47.220931 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.221184 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4090,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":7797120,"thread_start_us":125218,"threads_started":1,"wal-append.queue_time_us":210614}
I20260709 13:18:47.179477 22434 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.228609 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:47.197789 18310 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:47.233601 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.234709 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.235927 18229 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:47.238587 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:47.243312 18308 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:47.244685 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:47.247120 18229 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:47.248535 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:47.252399 18228 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
I20260709 13:18:47.253556 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:47.264566 18310 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:47.266456 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:47.267308 18310 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:47.276325 18310 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:47.277909 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:47.279801 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:47.284865 18228 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:47.226363 22377 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.283354 22423 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:47.292724 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:47.293562 18229 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:18:47.297026 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:47.298197 18229 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:47.299232 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:47.300902 18310 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:18:47.306634 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 152932us
I20260709 13:18:47.317960 18228 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:47.321749 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:47.322499 18228 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:47.325714 18229 raft_consensus.cc:2410] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:47.328366 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.315840 22423 raft_consensus.cc:697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:47.330232 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.317644 22432 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:47.331586 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2359) took 1132 ms. Trace:
I20260709 13:18:47.332667 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.334062 18229 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:47.334966 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.336828 18229 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:18:47.322069 22438 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:47.336997 22321 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:47.352939 22403 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:47.354671 22403 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.355209 22403 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:47.360915 22434 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:47.361135 22423 consensus_queue.cc:237] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:47.362244 22377 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:47.362767 18311 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:18:47.364035 18311 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:18:47.364806 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 713) took 1154 ms. Trace:
I20260709 13:18:47.365702 22411 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:47.366351 22411 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:47.365254 18307 rpcz_store.cc:276] 0709 13:18:46.210244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.819515 (+609271us) service_pool.cc:224] Handling call
0709 13:18:46.829275 (+  9760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.834181 (+  4906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.834208 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:46.834620 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.226690 (+392070us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:47.226727 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.226786 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.364590 (+137804us) raft_consensus.cc:1685] finished
0709 13:18:47.364614 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.364744 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4503,"raft.queue_time_us":5500,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":391721,"threads_started":1,"wal-append.queue_time_us":480520}
I20260709 13:18:47.370919 18307 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:47.342068 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.342602 18228 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:47.321914 22563 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:47.383050 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:47.384222 18961 raft_consensus.cc:2393] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:18:47.391144 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:47.391881 18228 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:47.401100 18228 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
W20260709 13:18:47.391207 22511 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.003s
I20260709 13:18:47.405191 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.367262 22411 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.406072 18228 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:47.407322 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:47.397432 22438 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:47.409025 18383 raft_consensus.cc:2410] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:18:47.380990 22563 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.412087 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.413552 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:47.416425 22355 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:47.422371 22403 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:47.391839 22377 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:47.424696 22563 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:47.428086 22377 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.423821 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:47.424710 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.431216 18229 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:47.432248 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.432916 18229 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:47.433647 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.434553 22377 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:47.436100 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:47.438164 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:47.436866 22566 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:47.442096 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:47.483868 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.486253 18228 raft_consensus.cc:2410] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:18:47.486912 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.487965 18229 raft_consensus.cc:2410] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:18:47.442696 22573 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:47.488667 22573 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:47.490978 22573 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:47.493247 18229 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:47.483428 22561 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:47.495676 18229 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:18:47.494706 22438 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:47.501149 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 59140.9us
I20260709 13:18:47.484125 22321 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:47.501727 22572 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:47.504374 22355 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:47.510619 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:47.512491 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:47.515239 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:47.513276 18229 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:47.518275 18229 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:18:47.520704 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.522429 22566 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:47.522913 22566 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:47.523326 22566 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:47.513562 22572 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:47.514928 22321 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:47.525012 22572 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:47.526772 22321 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:47.514240 22561 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:47.528234 22561 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.530932 22563 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:47.535679 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.548981 18961 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:18:47.550508 18200 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:47.551308 22377 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:47.540202 22573 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:47.541092 22403 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.560534 22438 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:47.561915 22571 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:47.572677 22403 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.575546 22403 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:47.567548 22563 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:47.559455 22570 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:47.563360 22573 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:47.558736 22377 raft_consensus.cc:697] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:47.565165 22438 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:47.541819 22411 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:18:47.576200 22403 raft_consensus.cc:3055] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:18:47.589097 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 68492.4us
I20260709 13:18:47.592608 22438 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:47.594281 22403 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:47.595448 22403 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.597048 22438 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:47.602097 22403 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:47.597862 22563 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:47.609450 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.610227 18229 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:47.611047 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.611581 18229 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:47.612227 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:47.612303 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:47.619498 18229 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
W20260709 13:18:47.618994 22551 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.485s	user 0.000s	sys 0.002s
I20260709 13:18:47.586084 22570 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:47.615300 22553 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.597s	user 0.002s	sys 0.000s
I20260709 13:18:47.622203 22570 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:47.586306 22573 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:47.624828 18311 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:47.628669 18381 raft_consensus.cc:3055] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:47.629163 18381 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:47.629302 22377 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:47.630066 18381 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.615584 22566 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.631049 18381 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:47.622627 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:47.633301 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:47.647342 18381 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:47.648133 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2437) took 1728 ms. Trace:
I20260709 13:18:47.650980 18381 rpcz_store.cc:276] 0709 13:18:45.919445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.239968 (+320523us) service_pool.cc:224] Handling call
0709 13:18:46.240236 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.628544 (+1388308us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b54003929a0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821eadc0 00007fa1822751c0 00007fa182276231 00007fa182272d8f 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c
0709 13:18:47.647871 (+ 19327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.648079 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92810496}
I20260709 13:18:47.638285 22566 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:47.648070 22518 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:47.658910 22518 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.659305 22518 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.660555 22572 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.649067 22438 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.662554 22438 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.647984 22570 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.647708 22563 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.664909 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:47.665232 22563 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:47.654206 22411 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.766003 18234 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:47.777213 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:18:47.779901 18202 connection.cc:256] RPC call timeout handler was delayed by -1.030663524999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 13:18:47.745494 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:47.747174 18306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.588s	user 0.014s	sys 0.015s
I20260709 13:18:47.783990 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1874) took 1111 ms. Trace:
I20260709 13:18:47.785820 18381 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:47.727475 18228 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:47.788352 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:47.784487 18234 rpcz_store.cc:276] 0709 13:18:46.672846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.750907 (+1078061us) service_pool.cc:224] Handling call
0709 13:18:47.765755 (+ 14848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.783607 (+ 17852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.783881 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:47.791093 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.734529 18235 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:47.791414 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:47.792035 18377 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:47.789810 18378 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:47.794301 18955 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:47.744654 18961 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:47.791859 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1872) took 1211 ms. Trace:
I20260709 13:18:47.795042 18235 rpcz_store.cc:276] 0709 13:18:46.580001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.733539 (+1153538us) service_pool.cc:224] Handling call
0709 13:18:47.734038 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.791605 (+ 57567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.791801 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.778825 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:47.790998 18228 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:47.718586 22580 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:18:47.797878 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:47.795960 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:47.800774 18378 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
W20260709 13:18:47.798674 18306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.640s	user 0.014s	sys 0.021s
I20260709 13:18:47.798995 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:47.804101 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:47.682444 22566 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.781661 22442 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.812978 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:47.776957 22098 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.745983 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:47.781826 22420 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.664934 22570 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.728188 22438 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:47.781821 22511 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:47.816777 18381 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:47.785384 22443 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:47.785542 22432 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:47.818744 18234 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:47.805289 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:47.700650 22573 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.835834 18386 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:47.825547 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:47.829074 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:47.831270 18377 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:18:47.792557 22411 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:47.841192 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 52350.7us
I20260709 13:18:47.845068 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:47.846427 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 63476.1us
I20260709 13:18:47.813992 22377 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:18:47.862200 18234 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:47.827474 22583 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:47.816220 22566 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:47.819866 22442 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:47.824741 22098 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.842152 22321 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:47.828357 22420 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:47.868484 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 89770.1us
I20260709 13:18:47.832199 18228 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:47.866384 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:47.845371 22563 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:47.893216 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:47.837668 22511 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.840466 22443 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.842983 22432 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.905838 18234 raft_consensus.cc:1217] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Deduplicated request from leader. Original: 5.3->[6.4-10.6]   Dedup: 10.6->[]
W20260709 13:18:47.906733 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 130048us
I20260709 13:18:47.907119 18234 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: [6.4-10.6]
I20260709 13:18:47.907809 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:47.908797 18234 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:18:47.908998 18276 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:47.873737 22572 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:47.911164 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 67375.4us
I20260709 13:18:47.912298 18234 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
W20260709 13:18:47.914069 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.917078 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:47.872097 22434 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:18:47.903949 22599 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:47.901229 22321 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:18:47.938474 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.874173 22583 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.927269 22594 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:18:47.928960 22563 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.929402 22572 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:48.040489 22572 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:47.978631 22595 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:47.939450 22599 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.983353 22596 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:18:47.929251 22593 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:48.043346 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1696) took 1048 ms. Trace:
I20260709 13:18:48.049602 18229 rpcz_store.cc:276] 0709 13:18:46.994745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.645094 (+650349us) service_pool.cc:224] Handling call
0709 13:18:47.645526 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.645937 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.645963 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.646488 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.913175 (+266687us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:47.913215 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.913282 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.043099 (+129817us) raft_consensus.cc:1685] finished
0709 13:18:48.043123 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.043278 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":1865,"thread_start_us":210356,"threads_started":1,"wal-append.queue_time_us":382005}
I20260709 13:18:48.052407 18229 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:48.057485 22573 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:48.049561 22593 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.059425 22593 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:48.005980 22591 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:18:48.062279 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 116530us
I20260709 13:18:47.978884 22602 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:48.042881 22599 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:48.068331 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 151323us
I20260709 13:18:48.069247 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:48.070313 22566 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:48.070950 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:48.064935 22610 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.073586 22610 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.077514 22610 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:48.082118 22610 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:48.077674 22594 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:48.083043 22594 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:48.083913 22594 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.042821 22595 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.064556 22570 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:48.065459 22602 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.082536 22610 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:48.089088 18201 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.131:44265 timed out after 1.511s (SENT) [suppressed 29 similar messages]
I20260709 13:18:48.055780 22563 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.092023 18234 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:48.088917 22602 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:48.089747 22610 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:48.119674 22599 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.123174 22593 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.125288 22593 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:48.125826 22593 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:48.126304 22593 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:48.134902 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 71324.2us
I20260709 13:18:48.149164 22615 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.149901 22615 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:48.152853 22615 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:48.153594 22615 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:48.134403 22595 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:48.168497 22593 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:48.170353 22599 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:48.173964 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 84903.2us
W20260709 13:18:48.173686 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 101047us
I20260709 13:18:48.179185 22612 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:18:48.180100 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 43937.4us
I20260709 13:18:48.174916 22593 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.179234 18201 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:48.194540 18202 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:48.199939 22614 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:48.193289 22610 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.201764 18234 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:18:48.203142 22619 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:48.203949 22619 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:48.174263 22594 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:18:48.203213 22610 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:48.209661 22612 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:47.332144 18303 rpcz_store.cc:276] 0709 13:18:46.199563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.520317 (+320754us) service_pool.cc:224] Handling call
0709 13:18:46.520625 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.520869 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:47.142326 (+621457us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.331162 (+188836us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.331217 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:47.331266 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.331338 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.331489 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23060,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":1843,"thread_start_us":809357,"threads_started":2}
I20260709 13:18:48.199200 22593 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:48.220943 18201 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:48.221287 22619 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.221858 22610 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:48.222468 22619 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:48.216215 22612 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:48.226120 22612 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.228353 22602 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.230806 22593 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:48.232676 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 51493.4us
W20260709 13:18:48.214833 22501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.388s	user 0.004s	sys 0.008s
W20260709 13:18:48.234589 22501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.408s	user 0.004s	sys 0.009s
I20260709 13:18:48.007174 22098 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:48.236799 18228 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:18:48.251108 22619 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.251699 22619 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.254390 22619 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:48.275506 18308 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:48.278404 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2364) took 1418 ms. Trace:
I20260709 13:18:48.278859 18308 rpcz_store.cc:276] 0709 13:18:46.859495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.506742 (+647247us) service_pool.cc:224] Handling call
0709 13:18:48.275253 (+768511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.276091 (+   838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.278162 (+  2071us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b54001de550. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:48.278334 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766525184}
W20260709 13:18:48.297976 18304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1770) took 2348 ms (client timeout 1757 ms). Trace:
W20260709 13:18:48.298506 18304 rpcz_store.cc:269] 0709 13:18:45.949557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.950290 (+   733us) service_pool.cc:224] Handling call
0709 13:18:48.275083 (+2324793us) spinlock_profiling.cc:243] Waited 60.7 ms on lock 0x7b54001de554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:48.297876 (+ 22793us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139621248}
I20260709 13:18:48.259769 22411 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:48.299782 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1871) took 1720 ms. Trace:
I20260709 13:18:48.256378 22442 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:48.300199 18232 rpcz_store.cc:276] 0709 13:18:46.579679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.298843 (+1719164us) service_pool.cc:224] Handling call
0709 13:18:48.299187 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.299477 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.299507 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.299550 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:48.299580 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.299634 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.299735 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.301510 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:48.302698 22610 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:48.304908 22382 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:47.945169 22438 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:48.306293 22438 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:48.306497 22617 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:48.308176 22617 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:48.306874 22438 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:48.313982 22614 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:48.314184 22625 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:48.315276 22614 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:48.315500 22511 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:48.321261 22443 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:48.340266 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2267) took 1759 ms. Trace:
I20260709 13:18:48.341435 18383 rpcz_store.cc:276] 0709 13:18:46.581248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.811200 (+229952us) service_pool.cc:224] Handling call
0709 13:18:48.339942 (+1528742us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b540019bc54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:48.340149 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372099840}
I20260709 13:18:48.351444 22348 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:48.351989 22348 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:48.355541 18960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53364 (request call id 284) took 1794 ms. Trace:
W20260709 13:18:48.356101 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.352983 22348 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.355950 18960 rpcz_store.cc:276] 0709 13:18:46.561652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.561814 (+   162us) service_pool.cc:224] Handling call
0709 13:18:46.562189 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.691061 (+128872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.355238 (+1664177us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54006c9b54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:48.355472 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294666624}
I20260709 13:18:48.376740 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:48.377331 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:48.378207 18232 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:48.380893 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.383517 18230 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:48.388334 18124 maintenance_manager.cc:419] P dc71a90b0e6d42fc8a6b135fbfbac453: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033333
I20260709 13:18:48.378337 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:48.388764 22606 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:48.404659 22606 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:48.405385 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:48.406390 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:48.407676 22606 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:48.389591 22443 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:48.408371 22443 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:48.410188 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.410526 22443 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:48.411170 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.390365 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.414386 22443 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:48.414867 22443 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.417891 22443 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:48.419801 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:48.420266 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:48.421015 18304 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:48.421583 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:48.393911 18230 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:18:48.422205 18310 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:48.422492 18230 pending_rounds.cc:85] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 7
I20260709 13:18:48.422755 18230 pending_rounds.cc:107] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:18:48.422982 18230 raft_consensus.cc:2889] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:48.397037 22620 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:48.430053 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:48.431969 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.434047 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 496) took 4424 ms. Trace:
I20260709 13:18:48.434511 18230 rpcz_store.cc:276] 0709 13:18:43.999355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.999773 (+   418us) service_pool.cc:224] Handling call
0709 13:18:44.009096 (+  9323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.383045 (+4373949us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b58002228d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821cf0aa 00007fa182251447 00007fa182269fe7 00007fa18226b7de 00007fa182275b49 00007fa182276416 00007fa182272d8f 00007fa18227283e 00007fa187237419 00007fa1807aebd4
0709 13:18:48.423733 (+ 40688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.423913 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3384687488}
I20260709 13:18:48.398386 22438 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:48.399554 22583 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:48.424817 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.425673 18232 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:48.427443 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.427690 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.429026 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:48.429955 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:48.436103 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:48.434870 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.437999 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.439548 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:48.447602 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:48.440043 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:48.504956 18377 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:48.509943 18310 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:48.512017 18277 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:48.513041 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 199260us
I20260709 13:18:48.513767 18383 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:18:48.513378 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:48.514933 18309 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:48.505075 18385 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:18:48.515388 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.515524 22609 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:48.505252 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:48.517244 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:48.517867 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:48.518494 18309 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:48.437268 22606 consensus_queue.cc:1059] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:18:48.521448 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:48.520505 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:48.522612 18310 raft_consensus.cc:2393] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 7: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:48.522485 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:48.465165 22375 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:18:48.466068 18954 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:18:48.535354 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:48.539294 18303 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:48.544255 18303 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:18:48.517567 22098 consensus_queue.cc:1059] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:18:48.545850 22625 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:48.546433 22463 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:48.548677 22571 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.549265 22571 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.551527 22571 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:48.552697 22606 raft_consensus.cc:3055] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:48.553156 22606 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:48.553268 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:48.554404 18233 raft_consensus.cc:2393] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:48.554172 22606 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:48.554972 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1870) took 1975 ms. Trace:
I20260709 13:18:48.555446 18233 rpcz_store.cc:276] 0709 13:18:46.579272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.553012 (+1973740us) service_pool.cc:224] Handling call
0709 13:18:48.554900 (+  1888us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.557121 22627 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.557552 18277 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:48.557776 22627 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.558831 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:48.560043 22627 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:48.560009 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:48.517364 22609 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:48.440019 22443 consensus_queue.cc:1059] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:18:48.437019 22620 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.567512 18309 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:48.562824 18310 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:48.569432 18303 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:18:48.571950 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:48.575162 18310 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:48.555568 22606 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:48.561651 22593 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:48.564018 22617 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.561429 22619 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:48.562849 22438 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:48.570137 22609 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:48.560850 22622 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:48.592048 22626 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:48.592675 22626 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:48.593827 22626 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.595515 22626 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:48.597222 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:48.598125 18237 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1869) took 2019 ms (client timeout 2453 ms). Trace:
I20260709 13:18:48.598326 22620 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:48.599062 22539 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:48.600000 22539 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:48.560401 22321 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.604645 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1775) took 2644 ms. Trace:
I20260709 13:18:48.586884 22593 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:48.598501 18237 rpcz_store.cc:269] 0709 13:18:46.578984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.596935 (+2017951us) service_pool.cc:224] Handling call
0709 13:18:48.598069 (+  1134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:48.609477 22593 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:48.617079 22438 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:48.617743 22438 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:48.618136 22555 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 1.455s	user 0.004s	sys 0.000s
I20260709 13:18:48.620132 22438 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:48.623168 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2358) took 2423 ms. Trace:
I20260709 13:18:48.623689 18305 rpcz_store.cc:276] 0709 13:18:46.199286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.514012 (+314726us) service_pool.cc:224] Handling call
0709 13:18:46.524742 (+ 10730us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:46.566448 (+ 41706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.566481 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:46.567041 (+   560us) log.cc:844] Serialized 52 byte log entry
0709 13:18:46.819014 (+251973us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:46.819071 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.819171 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.617468 (+1798297us) spinlock_profiling.cc:243] Waited 4.99 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:48.622794 (+  5326us) raft_consensus.cc:1685] finished
0709 13:18:48.622822 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.623097 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41245,"raft.queue_time_us":44354,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":1361,"spinlock_wait_cycles":11482368,"thread_start_us":251445,"threads_started":1,"wal-append.queue_time_us":509266}
W20260709 13:18:48.625924 22518 consensus_meta.cc:287] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.966s	user 0.016s	sys 0.000s
I20260709 13:18:48.626725 18305 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:18:48.627200 18305 pending_rounds.cc:85] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 8
I20260709 13:18:48.627473 18305 pending_rounds.cc:107] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:18:48.627751 18305 raft_consensus.cc:2889] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:48.608791 22617 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.628708 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1715) took 1021 ms. Trace:
I20260709 13:18:48.629104 18234 rpcz_store.cc:276] 0709 13:18:47.607621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.124487 (+516866us) service_pool.cc:224] Handling call
0709 13:18:48.125614 (+  1127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.202168 (+ 76554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.628381 (+426213us) spinlock_profiling.cc:243] Waited 75.9 ms on lock 0x7b540005a354. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:48.628640 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174555904}
I20260709 13:18:48.630379 22617 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:48.626405 22518 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:48.632499 18960 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:48.634852 22518 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:18:48.605101 18306 rpcz_store.cc:276] 0709 13:18:45.960374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.961091 (+   717us) service_pool.cc:224] Handling call
0709 13:18:45.961372 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.157965 (+196593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.157996 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:46.158502 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.802060 (+1643558us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:47.802113 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.604126 (+802013us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54000cadd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:48.604193 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.604256 (+    63us) raft_consensus.cc:1685] finished
0709 13:18:48.604273 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.604544 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12676,"raft.queue_time_us":22823,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":52,"spinlock_wait_cycles":422004096,"thread_start_us":1643224,"threads_started":1,"wal-append.queue_time_us":312919,"wal-append.run_cpu_time_us":1830,"wal-append.run_wall_time_us":1001823}
I20260709 13:18:48.637148 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:48.636247 22391 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:48.653502 22518 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:18:48.655148 22434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.002s	sys 0.007s
W20260709 13:18:48.655617 22434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.003s	sys 0.008s
W20260709 13:18:48.657016 18349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.001s	sys 0.020s
W20260709 13:18:48.658948 18351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.003s	sys 0.001s
W20260709 13:18:48.659417 18351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.003s	sys 0.001s
W20260709 13:18:48.659770 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 766622us
I20260709 13:18:48.660945 22382 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:48.660470 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:48.666174 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:48.667443 22438 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:18:48.670310 22571 consensus_queue.cc:1059] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:48.677274 18231 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:48.673228 22583 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:48.673537 22510 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:48.677924 22567 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:48.700327 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 180636us
I20260709 13:18:48.687999 22510 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:48.709861 22375 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:48.710367 22510 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:48.717016 22593 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.705880 22438 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:48.708550 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:48.707041 22511 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:18:48.706516 22411 consensus_queue.cc:1059] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 13:18:48.728397 18349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.002s	sys 0.020s
W20260709 13:18:48.729267 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 157438us
I20260709 13:18:48.730002 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:48.731837 18277 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:48.732381 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:48.734112 18383 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:18:48.735462 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.737115 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:48.727841 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.722846 22438 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:48.703697 22567 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.736229 18383 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:48.742240 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:48.731143 18201 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:48.745611 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:48.740718 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.741358 18384 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:48.746315 18383 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:48.746819 18377 raft_consensus.cc:2410] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:18:48.748099 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.749850 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:48.750160 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.750505 18378 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:48.751446 18384 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:48.744092 18201 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:48.753611 18201 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:48.726272 22432 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:48.755376 18201 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:48.743158 22443 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.744930 22391 raft_consensus.cc:2764] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:18:48.752558 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.728819 22593 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:48.726879 22630 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:48.771267 18383 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:48.781374 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.745723 22321 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:48.744750 22098 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:48.788123 22518 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:48.782058 18377 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:45.242683 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:48.799860 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.800702 18386 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:48.756040 22375 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:48.749954 22619 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:48.816774 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:48.817535 18232 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:48.807227 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.819271 18234 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:18:48.819368 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:48.782526 22630 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:48.781271 22434 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:48.820830 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:48.815986 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:48.786772 22321 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.798882 22098 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:48.824743 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:48.830099 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.830741 18384 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:48.831547 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.825325 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.798596 22617 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:48.826529 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.832697 18386 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:48.834815 18232 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:48.836551 18384 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:18:48.808998 22375 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.838339 18378 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:48.841361 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.836874 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:48.844125 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:48.787056 22443 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.845314 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.828998 22098 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:48.846500 18384 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:48.828963 22321 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:48.849464 18383 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:18:48.812588 22593 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:18:48.845621 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 138787us
I20260709 13:18:48.850371 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.828101 22630 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:48.849911 18386 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:18:48.836118 22617 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:48.856863 18384 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 14: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:48.844628 22375 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:48.838882 22411 consensus_queue.cc:1243] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:48.862115 18201 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:48.863521 22643 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:48.852208 22501 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:48.867113 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1694) took 1900 ms. Trace:
I20260709 13:18:48.830269 22609 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.837788 22583 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:18:48.863157 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 76149.4us
I20260709 13:18:48.867846 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:48.848501 22634 consensus_queue.cc:1059] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:18:48.871153 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:48.807649 22438 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.876806 22641 raft_consensus.cc:3055] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:48.921079 22641 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:48.835886 22158 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:18:48.922103 22641 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.851161 22596 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:48.923362 22641 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:48.861699 22617 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:48.924468 22583 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.907335 22539 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:48.890937 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:48.867136 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.928756 18386 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:48.901367 18236 rpcz_store.cc:276] 0709 13:18:46.966494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.523875 (+557381us) service_pool.cc:224] Handling call
0709 13:18:47.524194 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.534800 (+ 10606us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:48.004605 (+469805us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b48001bc3d8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18719caa1 00007fa187193b37 00007fa1871939ca 00007fa18728b26f 00007fa18728af37 00007fa18729f55c 00007fa18729f508 00007fa18729f488 00007fa18729f443 00007fa18729e6ec 00007fa1861c8a96
0709 13:18:48.609707 (+605102us) spinlock_profiling.cc:243] Waited 7.9 ms on lock 0x7b180040dda0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181e1b4bc 00007fa17f16948b 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f183455 00007fa185c6b3c7 00007fa18227d9a7 00007fa18228d0bf
0709 13:18:48.609869 (+   162us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.739981 (+130112us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.740465 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.740650 (+   185us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:48.740685 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.740761 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.866897 (+126136us) raft_consensus.cc:1685] finished
0709 13:18:48.866920 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.867052 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4316,"prepare.queue_time_us":29981,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":421,"raft.run_cpu_time_us":2740,"raft.run_wall_time_us":480024,"spinlock_wait_cycles":50254592,"thread_start_us":168013,"threads_started":2,"wal-append.queue_time_us":212401}
I20260709 13:18:48.930207 22509 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.930756 22509 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.914393 22640 raft_consensus.cc:1064] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
W20260709 13:18:48.932878 22640 raft_consensus.cc:1068] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Unable to promote non-voter e016302b7e734d74833a2bf7bab44838: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:48.934950 22539 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:48.935346 22539 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:48.918493 22098 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:48.936167 22539 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.937415 22539 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:48.938267 22609 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:48.905974 22643 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.938263 22098 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:48.849421 22619 raft_consensus.cc:697] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:48.866817 22511 consensus_queue.cc:1059] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:18:48.942787 22511 raft_consensus.cc:3055] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:48.942584 22619 consensus_queue.cc:237] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.943310 22511 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:18:48.943562 22417 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:18:48.889302 22510 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:48.950677 18386 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:48.911605 22501 raft_consensus.cc:697] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:48.962029 22510 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:48.962486 22501 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:47.979874 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 50917.3us
I20260709 13:18:48.964385 18926 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:48.904305 22626 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:48.974296 22521 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:48.944433 22511 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.988893 22511 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:48.979943 22324 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:48.996757 22324 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:48.997364 22630 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:48.997648 22324 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:48.998445 18237 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:48.998764 22324 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:49.000766 22630 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:47.948118 22494 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 1.058s
I20260709 13:18:49.012778 22503 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:49.020850 22420 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:49.021546 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 50864.9us
W20260709 13:18:49.023082 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.023164 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.023993 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.024155 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 116176us
I20260709 13:18:49.024895 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:49.026332 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 164329us
W20260709 13:18:49.031644 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 154583us
I20260709 13:18:49.034605 18201 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:49.035336 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.036984 22420 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:49.024541 22510 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:49.042979 18277 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:49.045264 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:49.046567 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.016278 22375 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.048318 22098 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:49.049417 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:49.050745 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:49.051020 22375 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:49.051779 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:49.053710 18309 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:49.054636 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.047456 22593 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:49.056558 22593 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:49.057089 22443 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:49.057564 22593 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.043910 22640 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:18:49.059928 22640 raft_consensus.cc:3055] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:49.060268 22640 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:49.031863 22521 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:49.061079 18377 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:49.061446 22521 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:49.062304 18377 raft_consensus.cc:1240] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:49.062449 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:49.064440 18303 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:49.065826 18305 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:49.067655 22420 consensus_queue.cc:1243] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer 8b4fbc44aa2649f0bcac5cd70f71951d log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:49.047628 22510 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:49.068804 22420 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:49.069193 22420 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:49.069612 22510 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:49.070101 22420 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.071470 22420 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:49.073292 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.074240 22643 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:49.120914 18303 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: [6.4-10.6]
W20260709 13:18:49.120397 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 44366.8us
I20260709 13:18:49.124752 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:49.125416 18305 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:49.126748 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:49.134783 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:49.135653 22509 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:49.135878 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.136556 18306 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:49.137321 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:49.137840 18306 raft_consensus.cc:2376] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13. Re-sending same reply.
I20260709 13:18:49.138540 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.139024 18306 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:49.139734 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:49.139195 22454 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:49.140386 22454 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:49.142156 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.142799 22454 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:49.143245 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:49.139400 22382 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:49.146081 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.146528 22382 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:49.147140 18306 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:49.120023 22375 consensus_queue.cc:1059] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:18:49.148283 22375 raft_consensus.cc:3055] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:49.144268 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.061107 22640 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:49.155177 18381 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:49.260396 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:49.117488 18333 debug-util.cc:398] Leaking SignalData structure 0x7b08001c2e40 after lost signal to thread 17141
W20260709 13:18:49.225330 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 248570us
I20260709 13:18:49.227959 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:49.210798 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.263710 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.245846 18384 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:18:49.265789 18384 pending_rounds.cc:85] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 5
I20260709 13:18:49.266144 18384 pending_rounds.cc:107] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:18:49.226159 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:49.266501 18384 raft_consensus.cc:2889] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:49.266822 18378 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:49.267634 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:49.268875 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:49.268893 18306 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:49.270000 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:49.270285 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:49.201071 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.271915 18309 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:49.272126 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.261126 18303 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:18:49.148684 22375 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:49.273438 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.273643 22375 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.274552 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.275077 22375 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:49.275157 18303 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:18:49.090404 22630 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:49.273444 22454 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:49.277115 22630 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.277554 22454 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:49.277725 22630 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:49.278040 22454 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:49.278383 18306 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:49.278792 22438 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:49.279878 22348 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:49.280037 22610 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:49.280665 22610 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:49.282873 22610 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:49.283082 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1868) took 2704 ms. Trace:
I20260709 13:18:49.283507 18231 rpcz_store.cc:276] 0709 13:18:46.578684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.552031 (+1973347us) service_pool.cc:224] Handling call
0709 13:18:48.552431 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.677761 (+125330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.282833 (+605072us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b540026a554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:49.282986 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286118272}
I20260709 13:18:49.197379 18304 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:49.287314 18276 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:49.206703 22382 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:49.194518 22521 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:49.288215 22433 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:49.196069 22321 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.291087 22433 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:49.291030 22454 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:49.291608 22321 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:49.293345 22454 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:49.230888 18305 raft_consensus.cc:2410] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:18:49.276304 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.271112 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:49.154968 22509 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:49.292404 22646 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:49.293052 18276 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:49.263850 18202 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:49.296782 18303 raft_consensus.cc:2410] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:18:49.299268 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:49.297586 22646 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:49.300622 22619 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:49.301090 22646 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.302512 22646 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:49.303094 22625 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:49.303544 22625 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:49.306216 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:49.306475 18276 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:49.308271 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:49.309326 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.309219 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:49.311213 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:49.312404 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:49.312785 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.313625 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.311429 18276 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:49.308929 18303 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:18:49.314774 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.301116 22619 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:49.313452 18306 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:49.314251 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:49.318401 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:49.319000 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.319723 18306 raft_consensus.cc:2393] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:49.317142 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:49.316217 18303 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:49.316118 18311 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:49.315003 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:49.319594 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:49.321327 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:49.316249 22420 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:49.315505 22610 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:49.317767 22634 consensus_queue.cc:1059] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:18:49.324710 22634 raft_consensus.cc:3055] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:49.325055 22634 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:49.325611 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:49.328341 18306 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:18:49.328635 18311 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:18:49.331856 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.330021 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:49.329511 22531 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:49.325881 22634 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.297895 22509 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.343365 18309 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:49.316082 22382 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:49.317885 22443 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:49.315593 22348 raft_consensus.cc:2764] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:18:49.318028 22640 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:49.313844 22593 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:49.362633 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:49.329391 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:18:49.390625 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.392834 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 63518.1us
I20260709 13:18:49.393581 18276 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:49.370225 22382 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.346509 22391 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:49.343420 22433 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:49.395033 22348 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:49.410249 22593 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:49.411070 22567 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:49.411991 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.412556 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.317735 22617 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.344419 22521 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:49.401232 22531 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:49.401662 22630 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.327205 22619 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:49.406816 22511 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.304452 22625 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.449227 22625 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:49.449777 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:49.450400 18384 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:18:49.451166 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:49.399861 22382 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:49.447975 22511 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.396152 18276 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:49.395576 22443 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:49.420667 22509 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:49.421087 22630 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:49.397928 22408 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:49.426023 22617 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:49.428586 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.460036 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 2367) took 1041 ms. Trace:
I20260709 13:18:49.460391 18308 rpcz_store.cc:276] 0709 13:18:48.419152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.419307 (+   155us) service_pool.cc:224] Handling call
0709 13:18:49.428380 (+1009073us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b58000e1398. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa1872390a0 00007fa187238984 00007fa1807b36d4 00007fa1807b3662
0709 13:18:49.459959 (+ 31579us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3760384}
I20260709 13:18:49.429294 22420 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:49.431349 22610 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:49.432106 22660 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
W20260709 13:18:49.434846 22403 consensus_meta.cc:287] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 1.816s	user 0.014s	sys 0.002s
I20260709 13:18:49.398078 22631 consensus_queue.cc:1059] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:18:49.438759 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1716) took 1788 ms. Trace:
I20260709 13:18:49.467509 18228 rpcz_store.cc:276] 0709 13:18:47.650280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.193854 (+543574us) service_pool.cc:224] Handling call
0709 13:18:48.194218 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.238281 (+ 44063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.438531 (+1200250us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b540001b8d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:49.438702 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97349504}
I20260709 13:18:49.446789 22380 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.454380 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:49.456389 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 60314.3us
I20260709 13:18:49.456847 22433 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:49.455076 22443 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:49.466934 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.470227 18276 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:49.462536 22408 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:49.471067 22631 raft_consensus.cc:3055] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:49.471388 22380 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:49.471798 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:49.411686 22348 raft_consensus.cc:697] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:49.472262 22610 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:49.473235 18385 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:49.504338 22443 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:49.504946 22348 consensus_queue.cc:237] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.505424 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:49.453853 22521 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:49.505231 22391 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:49.507661 18202 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:49.508193 22463 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:49.518743 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 48627.6us
I20260709 13:18:49.520169 22593 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:49.520656 22593 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:49.521054 22593 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:49.514916 22494 consensus_queue.cc:1059] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:18:49.510437 22442 raft_consensus.cc:3055] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:49.523830 22494 raft_consensus.cc:3055] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:49.523940 22442 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:49.524286 22494 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:49.518344 22463 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.525089 22463 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:49.524928 22442 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.471102 22633 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.503760 22438 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.530725 18276 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:49.567559 22355 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:49.554204 18202 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:49.536098 18303 raft_consensus.cc:2410] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:18:49.539363 22633 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:49.536201 18378 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:49.571780 22391 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:49.572819 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:49.573766 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54070.6us
I20260709 13:18:49.574216 18959 raft_consensus.cc:2393] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 8: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:18:49.508256 22521 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:49.516891 22610 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.561854 22626 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:49.540211 22511 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:49.519093 22631 raft_consensus.cc:740] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:49.582245 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:49.596118 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2362) took 2737 ms. Trace:
I20260709 13:18:49.574595 18276 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:49.596627 18307 rpcz_store.cc:276] 0709 13:18:46.859013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.372860 (+513847us) service_pool.cc:224] Handling call
0709 13:18:47.373488 (+   628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.373709 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:47.377937 (+  4228us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.547202 (+2169265us) spinlock_profiling.cc:243] Waited 6.88 ms on lock 0x7b18003ac120. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e1323a 00007fa18227da2a
0709 13:18:49.595730 (+ 48528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.595796 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:49.595848 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.595937 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.596060 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":588,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"spinlock_wait_cycles":15818624,"thread_start_us":48228,"threads_started":1}
I20260709 13:18:49.518081 22408 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:49.602118 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:49.602646 18311 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:49.601861 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:49.598668 22597 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:49.605449 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:49.607674 22391 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:49.608384 22391 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.577105 22433 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:49.576110 22633 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:49.614939 18311 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:49.618445 18276 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:49.621346 22442 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:49.622417 18959 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:18:49.533367 22614 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:18:49.599675 22610 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:49.617003 22356 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:49.630393 18378 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:49.541474 22494 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:49.636677 22443 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:49.637537 22494 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:49.636689 22631 consensus_queue.cc:260] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.639839 22443 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:49.641028 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:49.643405 22614 consensus_queue.cc:1243] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer 459e82ee6b564cc19be6f73186938e79 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:49.646935 18378 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:18:49.647814 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.575979 22438 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.616181 22433 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.655515 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:49.665992 18228 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:18:49.667088 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:49.656198 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:49.656831 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:49.658244 18232 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:18:49.668493 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:49.668823 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:49.672797 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:49.669816 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:49.673604 18232 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:49.674638 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:49.664875 18230 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:18:49.677083 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:49.678447 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:49.683192 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:49.684413 18228 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:49.685176 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:49.688871 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:49.622831 22463 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.670279 22356 raft_consensus.cc:697] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:49.691956 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:49.654245 22355 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:49.697474 22667 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:18:49.697535 18232 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:18:49.705267 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:49.713742 18961 raft_consensus.cc:2393] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 6: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:18:49.705578 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:49.714056 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:49.715168 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:49.655166 22348 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.709625 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:49.670910 22433 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:49.666217 22633 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:49.702069 22614 consensus_queue.cc:1059] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:18:49.735419 18230 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 11: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:49.737735 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2291) took 1006 ms. Trace:
W20260709 13:18:49.803328 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 178825us
W20260709 13:18:49.799438 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.716012 18237 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:49.834676 18381 rpcz_store.cc:276] 0709 13:18:48.731679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.759975 (+ 28296us) service_pool.cc:224] Handling call
0709 13:18:48.797378 (+ 37403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.260744 (+463366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.737432 (+476688us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400129b54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:49.737652 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822326016}
W20260709 13:18:49.820133 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.730057 22659 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.586s	user 0.003s	sys 0.000s
I20260709 13:18:49.839234 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:49.740720 22458 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:49.717236 22391 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:49.844570 22443 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:49.839531 22615 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:18:49.779069 22572 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:49.850068 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:49.848217 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:49.780314 22563 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:49.777199 18131 catalog_manager.cc:5697] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.745919 22438 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:49.734076 22463 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:49.858433 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:49.741940 22382 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.835955 22348 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.860868 18231 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:49.860967 22382 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:49.729435 22619 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.835716 22495 consensus_queue.cc:1059] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:18:49.863374 18305 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:49.863849 22495 raft_consensus.cc:3055] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:49.865089 22619 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:49.864231 22495 raft_consensus.cc:740] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:49.866253 22495 consensus_queue.cc:260] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:49.867838 22495 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:49.850538 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:49.872607 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:49.873420 18236 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 9: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:49.874280 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:49.875248 22396 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:49.875687 22396 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:49.876924 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.877451 18333 debug-util.cc:398] Leaking SignalData structure 0x7b08001a9de0 after lost signal to thread 18169
W20260709 13:18:49.878847 18333 debug-util.cc:398] Leaking SignalData structure 0x7b08003832a0 after lost signal to thread 18261
W20260709 13:18:49.734953 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.715883 18232 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 12: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:49.851778 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:49.881150 22584 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.881652 22584 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.882020 18383 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:49.832734 22633 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:49.882606 22626 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:49.882901 22633 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:49.883802 22615 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:49.884210 22615 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:49.885052 18380 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
W20260709 13:18:49.886961 18380 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2261) took 3312 ms (client timeout 2437 ms). Trace:
W20260709 13:18:49.887427 18380 rpcz_store.cc:269] 0709 13:18:46.574533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.575778 (+  1245us) service_pool.cc:224] Handling call
0709 13:18:49.886785 (+3311007us) spinlock_profiling.cc:243] Waited 3.31 s on lock 0x7b540027f1d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:49.886890 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7604807936}
I20260709 13:18:49.888536 22380 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:49.889710 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:49.890542 18232 raft_consensus.cc:2410] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:18:49.890777 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:49.892379 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:49.862264 22348 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:49.717566 22355 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.788335 22408 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.869671 22321 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.726094 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:49.718482 22356 consensus_queue.cc:237] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.787099 22593 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:49.876793 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:49.853580 18378 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:49.744190 22597 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:49.916476 18232 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:18:49.733471 22657 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.588s	user 0.001s	sys 0.000s
I20260709 13:18:49.916801 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:49.921367 18234 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:49.931933 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:49.956135 18333 debug-util.cc:398] Leaking SignalData structure 0x7b08003cf8a0 after lost signal to thread 18336
I20260709 13:18:49.957271 18236 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:18:49.959589 18234 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:49.895957 22584 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:49.976052 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:49.987948 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.992671 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.039410 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.043009 18236 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
W20260709 13:18:50.042878 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 85173.5us
I20260709 13:18:50.043444 18236 pending_rounds.cc:85] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 7
I20260709 13:18:50.043694 18236 pending_rounds.cc:107] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:18:50.043948 18236 raft_consensus.cc:2889] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:49.929962 22597 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:50.050212 22442 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:49.913568 22396 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:50.053279 22396 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:50.055577 22433 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:50.057130 18311 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:18:49.885063 22615 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:50.058125 22615 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:50.058271 22672 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:50.061714 22408 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:49.922366 22321 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:50.077057 18308 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:18:50.077617 18308 pending_rounds.cc:85] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 6
I20260709 13:18:50.077898 18308 pending_rounds.cc:107] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:18:50.078193 18308 raft_consensus.cc:2889] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:50.085135 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:50.086062 22158 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:18:50.102869 22321 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:50.087690 18308 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:18:50.090068 22380 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:50.093497 22610 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:50.119822 22158 consensus_queue.cc:1059] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:18:50.218120 18228 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 15: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:50.207034 22619 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.233820 22633 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:50.234036 22619 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:50.236824 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.240548 22610 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:50.249620 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.293910 18233 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:50.294761 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:50.296773 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:50.298712 18233 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:50.242169 22593 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:50.315186 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:50.317170 18235 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:18:50.318470 22672 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.319092 22672 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:50.324815 18333 debug-util.cc:398] Leaking SignalData structure 0x7b080020d340 after lost signal to thread 18410
W20260709 13:18:50.325318 18333 debug-util.cc:398] Leaking SignalData structure 0x7b0800320fe0 after lost signal to thread 18411
I20260709 13:18:50.326184 22672 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:50.330147 22672 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:50.332558 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:50.340075 18959 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:18:50.252301 22433 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:50.349040 22620 raft_consensus.cc:3055] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:50.350011 22620 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:18:50.276786 22627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.017s	sys 0.017s
I20260709 13:18:50.253921 22355 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:50.293632 22610 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.309150 22382 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:18:50.362643 18312 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.052s	sys 0.051s
W20260709 13:18:50.363018 18312 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.052s	sys 0.051s
I20260709 13:18:50.302796 22633 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:50.366539 18277 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:50.357424 22626 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:50.359700 22391 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:50.385092 18275 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.008s	sys 0.012s
W20260709 13:18:50.388365 18275 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.008s	sys 0.012s
W20260709 13:18:50.386265 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.376266 22382 raft_consensus.cc:697] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:50.383983 22593 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:50.385449 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:50.389614 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 509237us
I20260709 13:18:50.354480 22672 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:50.402109 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:50.394652 22391 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:50.405301 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:18:50.416376 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.385748 22619 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:50.365109 22610 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:50.406575 18233 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:18:50.419479 18233 pending_rounds.cc:85] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 7
I20260709 13:18:50.419751 18233 pending_rounds.cc:107] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:18:50.420011 18233 raft_consensus.cc:2889] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:50.421015 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:50.425971 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:50.428848 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:50.429719 18378 raft_consensus.cc:2410] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:18:50.430596 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:50.430063 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.417039 22672 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:50.408993 22433 consensus_queue.cc:1059] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:50.409386 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:50.435848 18309 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:50.409973 18275 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:50.437584 18275 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:18:50.357918 22627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.018s	sys 0.018s
I20260709 13:18:50.396660 22633 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:50.441282 22614 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.441872 22614 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:50.397249 22620 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:50.445513 18275 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:50.446671 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:50.448226 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:50.448971 18383 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:50.450012 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:50.454371 18275 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:50.446600 22676 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:50.460692 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.423271 22563 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.461679 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.423026 22584 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:50.458667 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:50.440738 22672 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:50.458177 18275 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:50.450137 22433 consensus_queue.cc:1243] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer e016302b7e734d74833a2bf7bab44838 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:50.439162 22355 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:50.445047 22593 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:50.457387 22321 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:50.451972 22571 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:50.464884 22619 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:50.493682 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.475310 22442 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:50.535594 22442 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.540041 22442 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:50.482124 22382 consensus_queue.cc:237] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:50.502611 22571 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:50.546784 22571 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:50.548856 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:50.456954 22408 consensus_queue.cc:1059] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:18:50.549487 18303 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:50.550426 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:50.551131 18303 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:50.552090 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:50.555888 18303 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:50.471331 22563 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:50.587327 18309 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:50.490227 22433 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:50.596408 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:50.476503 22584 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:50.615504 18333 debug-util.cc:398] Leaking SignalData structure 0x7b0800345760 after lost signal to thread 18986
W20260709 13:18:50.615971 18333 debug-util.cc:398] Leaking SignalData structure 0x7b080033ffa0 after lost signal to thread 18987
I20260709 13:18:50.625240 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:50.626116 18309 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:50.490033 22355 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:50.596019 22348 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.635648 22391 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:50.636256 18953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54020 (request call id 344) took 2132 ms (client timeout 1935 ms). Trace:
I20260709 13:18:50.642654 22563 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:50.643689 18953 rpcz_store.cc:269] 0709 13:18:48.504240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.635971 (+2131731us) service_pool.cc:211] Skipping call since client already timed out
0709 13:18:50.636138 (+   167us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:18:50.649098 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.649897 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.651150 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:50.654834 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:50.665241 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:50.652639 22614 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:50.653043 22348 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:50.660166 22563 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:18:50.663141 22411 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:18:50.661625 22442 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:50.683530 22610 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:50.725733 22495 consensus_meta.cc:287] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.811s	user 0.008s	sys 0.005s
I20260709 13:18:50.727764 22442 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:50.738476 22571 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.751762 22658 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 1.607s	user 0.014s	sys 0.011s
I20260709 13:18:50.753371 22355 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:50.755021 22597 consensus_meta.cc:287] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.002s
I20260709 13:18:50.755720 22602 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:50.755970 18960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53364 (request call id 298) took 1317 ms. Trace:
I20260709 13:18:50.756372 22584 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:50.756711 22681 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.125s	user 0.001s	sys 0.001s
I20260709 13:18:50.756426 18960 rpcz_store.cc:276] 0709 13:18:49.438605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.439045 (+   440us) service_pool.cc:224] Handling call
0709 13:18:49.439348 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.516380 (+ 77032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.516422 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.516478 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:49.516537 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.755732 (+1239195us) spinlock_profiling.cc:243] Waited 76.8 ms on lock 0x7b5400840154. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:50.755777 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.755907 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176586112}
I20260709 13:18:50.759827 22348 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:50.755472 22597 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:50.813308 22321 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:50.776575 22672 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:50.830010 22672 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:50.760004 22571 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:50.833460 22571 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:50.826062 22597 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:50.838030 22596 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.842263 22596 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:50.850409 22596 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:50.851423 22708 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:18:50.853535 22615 consensus_meta.cc:287] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.795s	user 0.009s	sys 0.014s
I20260709 13:18:50.867936 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1918) took 1206 ms. Trace:
I20260709 13:18:50.868685 18230 rpcz_store.cc:276] 0709 13:18:49.661402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.678175 (+ 16773us) service_pool.cc:224] Handling call
0709 13:18:50.867194 (+1189019us) spinlock_profiling.cc:243] Waited 56 ms on lock 0x7b54001897d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:50.867587 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128861056}
I20260709 13:18:50.873775 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:50.876475 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:50.878417 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:50.879876 18230 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:50.881469 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:50.882647 18230 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:50.884101 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:50.885581 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:50.886967 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:50.889379 18230 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:18:50.906702 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.971431 22596 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.972543 22596 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:50.976912 22596 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:51.021239 22348 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.022086 22348 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.028360 18123 maintenance_manager.cc:643] P dc71a90b0e6d42fc8a6b135fbfbac453: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 2.621s	user 0.163s	sys 0.057s Metrics: {"bytes_written":29491,"cfile_init":1,"dirs.queue_time_us":21076,"dirs.run_cpu_time_us":628,"dirs.run_wall_time_us":2145,"drs_written":1,"lbm_read_time_us":542,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4686,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"rows_written":63,"thread_start_us":18102,"threads_started":2,"wal-append.queue_time_us":11757}
W20260709 13:18:51.030664 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.034566 22470 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:51.035486 22470 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:51.038661 22702 raft_consensus.cc:1064] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:18:51.042241 22702 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:51.059841 18953 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 14 LEARNER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:51.004392 18131 catalog_manager.cc:5697] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:51.063259 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1727) took 1380 ms. Trace:
I20260709 13:18:51.063050 18131 catalog_manager.cc:5697] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index -1 to 7, term changed from 11 to 13, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added, now has a pending config: VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129), VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130), VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131), VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 13 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:18:51.063803 18234 rpcz_store.cc:276] 0709 13:18:49.682330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.922233 (+239903us) service_pool.cc:224] Handling call
0709 13:18:49.922498 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.960077 (+ 37579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.062609 (+1102532us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b5400269b54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:51.063046 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84424064}
I20260709 13:18:51.065280 22348 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:51.068398 18236 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:18:51.065558 18131 catalog_manager.cc:5697] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:51.069437 22470 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:51.076786 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:51.078720 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1915) took 1418 ms. Trace:
I20260709 13:18:51.079101 18237 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:51.079301 18235 rpcz_store.cc:276] 0709 13:18:49.660455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.660596 (+   141us) service_pool.cc:224] Handling call
0709 13:18:51.078272 (+1417676us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b540037d2d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:51.078498 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503053696}
W20260709 13:18:51.087904 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.091454 22539 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:51.092702 22539 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.093879 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:51.101413 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.104018 22348 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.105157 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 718) took 2078 ms. Trace:
I20260709 13:18:51.104828 22348 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.105537 18377 rpcz_store.cc:276] 0709 13:18:49.026789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.063089 (+ 36300us) service_pool.cc:224] Handling call
0709 13:18:49.063361 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.068556 (+  5195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.068591 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.068639 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:49.068668 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.104569 (+2035901us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b54000cd0d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:51.104645 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.104909 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11438848}
I20260709 13:18:51.111855 22348 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:51.109238 18237 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:51.116215 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2405) took 1514 ms. Trace:
I20260709 13:18:51.117259 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:51.119576 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:51.117126 18312 rpcz_store.cc:276] 0709 13:18:49.601785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.606224 (+  4439us) service_pool.cc:224] Handling call
0709 13:18:49.606567 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:49.704172 (+ 97605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.704220 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:49.707341 (+  3121us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.363392 (+656051us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:50.363435 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.363508 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.115423 (+751915us) raft_consensus.cc:1685] finished
0709 13:18:51.115471 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.115839 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10099,"raft.queue_time_us":45574,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":12661,"thread_start_us":661487,"threads_started":2,"wal-append.queue_time_us":747765}
I20260709 13:18:51.120541 18377 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:51.123195 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:51.107632 22539 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:51.130682 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:51.130904 22620 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:51.131901 22596 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:51.131132 18377 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:18:51.135972 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.137532 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.138718 18377 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:51.139779 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:51.139997 22596 consensus_queue.cc:1059] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:51.140565 18377 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:51.141918 22596 raft_consensus.cc:3055] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:51.142355 22596 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:51.143707 22596 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:51.145133 18960 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:51.145237 22596 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:51.149530 18377 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:51.154982 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:51.156073 18234 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:18:51.159235 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:18:51.159649 22656 log.cc:927] Time spent T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 2.014s	user 0.004s	sys 0.014s
I20260709 13:18:51.162364 22594 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:51.163640 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:51.163516 22594 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:51.165053 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:51.165966 22432 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.166595 22432 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.171464 22594 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:51.172194 22594 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:51.172914 22594 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:51.171769 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.178556 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:51.179085 22602 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:51.179672 18960 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:51.180124 22602 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.188110 22602 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:51.192447 22432 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:51.203956 22415 raft_consensus.cc:3055] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:51.204775 22415 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:51.208475 22415 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:51.206039 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:51.215246 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.216140 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.216378 22415 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:51.217163 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.217736 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.228829 22432 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.229651 22432 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.232074 22432 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:51.233247 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:51.234368 22610 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:51.234789 22610 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.235205 22610 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:51.235930 18926 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:51.242594 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.243439 18959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54004 (request call id 376) took 1589 ms. Trace:
I20260709 13:18:51.243664 18377 raft_consensus.cc:2410] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:18:51.244050 18959 rpcz_store.cc:276] 0709 13:18:49.653687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.653906 (+   219us) service_pool.cc:224] Handling call
0709 13:18:51.242907 (+1589001us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b5400508a54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:51.243155 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477769984}
I20260709 13:18:51.259048 18200 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:51.249081 22423 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:18:51.264437 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.260389 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:51.258987 22494 raft_consensus.cc:3055] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:51.270830 18926 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:51.272085 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.272820 22494 raft_consensus.cc:740] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:51.276283 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2477) took 2087 ms. Trace:
I20260709 13:18:51.274412 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.278365 22494 consensus_queue.cc:260] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:51.279486 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.280057 22494 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:51.281297 18377 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:51.266603 22602 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:51.282357 22539 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:51.284109 22539 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:51.286363 18385 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2282) took 2557 ms (client timeout 2132 ms). Trace:
W20260709 13:18:51.286820 18385 rpcz_store.cc:269] 0709 13:18:48.729112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.732137 (+  3025us) service_pool.cc:224] Handling call
0709 13:18:51.285957 (+2553820us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b540033e354. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:51.286136 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682727680}
I20260709 13:18:51.288589 22539 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:51.289450 18382 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:51.281842 18200 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:51.292042 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2322) took 1436 ms. Trace:
W20260709 13:18:51.292696 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 45528.4us
I20260709 13:18:51.293694 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:51.295117 18275 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.002s	sys 0.002s
W20260709 13:18:51.295480 18275 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.004s	sys 0.003s
I20260709 13:18:51.282974 22602 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:51.296309 22602 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:51.296715 22348 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:51.277624 18379 rpcz_store.cc:276] 0709 13:18:49.186287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.643029 (+456742us) service_pool.cc:224] Handling call
0709 13:18:51.235175 (+1592146us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b5800050198. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:18:51.235474 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.235919 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:51.236338 (+   419us) log.cc:844] Serialized 14 byte log entry
0709 13:18:51.267111 (+ 30773us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:51.267176 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:51.268342 (+  1166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.268428 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.273131 (+  4703us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1113,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":2459,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":5100,"spinlock_wait_cycles":9319808,"thread_start_us":17270,"threads_started":1}
I20260709 13:18:51.299126 22610 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.299957 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.303517 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.304462 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:51.304771 22636 raft_consensus.cc:3055] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:51.305262 22636 raft_consensus.cc:740] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:51.305975 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:51.306792 18379 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:51.306535 22636 consensus_queue.cc:260] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:51.308207 22636 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:51.294899 22617 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:51.311759 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 734) took 1197 ms. Trace:
I20260709 13:18:51.313491 22617 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.292448 18382 rpcz_store.cc:276] 0709 13:18:49.855916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.869553 (+ 13637us) service_pool.cc:224] Handling call
0709 13:18:51.288893 (+1419340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.290316 (+  1423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.291808 (+  1492us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b540033e350. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:51.291978 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3263320320}
I20260709 13:18:51.314069 22617 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:51.314220 22594 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:51.313560 18308 rpcz_store.cc:276] 0709 13:18:50.114249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.116501 (+  2252us) service_pool.cc:224] Handling call
0709 13:18:50.118073 (+  1572us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.270675 (+152602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.270725 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.271329 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.556775 (+285446us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:50.556814 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.556890 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.311250 (+754360us) raft_consensus.cc:1685] finished
0709 13:18:51.311299 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.311510 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1286,"raft.queue_time_us":1490,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":80905,"thread_start_us":285077,"threads_started":1,"wal-append.queue_time_us":400698}
I20260709 13:18:51.318197 18308 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:51.288277 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.319526 18385 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:51.318236 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:51.321100 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.322216 22415 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:18:51.317505 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 859396us
I20260709 13:18:51.320178 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 727) took 1402 ms. Trace:
I20260709 13:18:51.282896 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:51.329998 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 83477.2us
I20260709 13:18:51.331445 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:51.326973 18311 rpcz_store.cc:276] 0709 13:18:49.917866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.918085 (+   219us) service_pool.cc:224] Handling call
0709 13:18:49.918391 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.057528 (+139137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.319610 (+1262082us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540013f954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:51.319947 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318259584}
I20260709 13:18:51.342167 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.343511 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.344231 18385 raft_consensus.cc:2410] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:18:51.344414 18311 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:51.350369 18380 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:51.356244 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 99823.7us
I20260709 13:18:51.363092 18379 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:51.362821 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.362864 18377 raft_consensus.cc:2393] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:51.340204 22415 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:51.356333 22348 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:51.371767 18312 raft_consensus.cc:2410] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:18:51.374281 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 107523us
I20260709 13:18:51.374539 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.378156 18385 raft_consensus.cc:2410] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:18:51.384811 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 103187us
I20260709 13:18:51.390724 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:51.397117 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 65765.2us
I20260709 13:18:51.397580 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:51.398838 18959 raft_consensus.cc:2393] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 6: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:18:51.404647 18382 raft_consensus.cc:2410] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 13:18:51.405498 18303 consensus_meta.cc:287] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.794s	user 0.018s	sys 0.001s
I20260709 13:18:51.407719 18303 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:18:51.395689 22594 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:51.406874 18311 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:51.405066 22723 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.398339 22719 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:51.409759 22539 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:51.412885 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.417059 22539 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.419436 22539 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:51.425185 22415 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:51.425947 22631 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:51.427915 18385 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:18:51.428326 18385 pending_rounds.cc:85] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 7
I20260709 13:18:51.429441 18380 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:18:51.412338 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2413) took 1006 ms. Trace:
I20260709 13:18:51.429363 22594 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.431659 22725 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:51.432232 22725 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.432660 22725 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.431916 22594 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.440122 22594 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:51.429919 18385 pending_rounds.cc:107] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:18:51.428926 22722 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:51.441138 18385 raft_consensus.cc:2889] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:51.430691 18311 rpcz_store.cc:276] 0709 13:18:50.403280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.362370 (+959090us) service_pool.cc:224] Handling call
0709 13:18:51.386669 (+ 24299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.409662 (+ 22993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.409874 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:51.445886 22594 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.446810 18311 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:51.447391 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2418) took 1036 ms. Trace:
I20260709 13:18:51.447695 18311 rpcz_store.cc:276] 0709 13:18:50.410644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.446038 (+1035394us) service_pool.cc:224] Handling call
0709 13:18:51.446445 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.447206 (+   761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.447349 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:51.448164 18385 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:18:51.409154 22610 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:51.446844 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.449139 22594 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.452672 22723 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.406278 22348 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.451218 18311 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:51.449414 22602 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:51.455762 18380 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:51.458443 18303 raft_consensus.cc:1217] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Deduplicated request from leader. Original: 6.5->[7.6-10.8]   Dedup: 9.7->[10.8-10.8]
I20260709 13:18:51.459038 18303 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: [7.6-10.8]
I20260709 13:18:51.459649 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2415) took 1055 ms. Trace:
I20260709 13:18:51.459965 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:51.460635 22722 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.463020 22722 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:51.465334 18381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.013s	sys 0.006s
W20260709 13:18:51.465662 18381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.013s	sys 0.006s
I20260709 13:18:51.466393 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2326) took 1048 ms. Trace:
I20260709 13:18:51.466709 18381 rpcz_store.cc:276] 0709 13:18:50.417585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.420699 (+  3114us) service_pool.cc:224] Handling call
0709 13:18:50.443997 (+ 23298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.660494 (+216497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.660545 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.661008 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:18:51.466031 (+805023us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:51.466082 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.466174 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.466212 (+    38us) raft_consensus.cc:1685] finished
0709 13:18:51.466222 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.466337 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102935,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":1020623,"threads_started":2,"wal-append.queue_time_us":117931}
I20260709 13:18:51.468294 18959 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
W20260709 13:18:51.469408 18350 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.002s	sys 0.010s
I20260709 13:18:51.470271 18200 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:51.471154 22722 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:51.471833 22722 raft_consensus.cc:697] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:51.472553 18383 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.004s	sys 0.004s
I20260709 13:18:51.472882 22722 consensus_queue.cc:237] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:51.474856 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.470279 18350 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.003s	sys 0.010s
W20260709 13:18:51.475893 18276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.007s	user 0.026s	sys 0.054s
W20260709 13:18:51.472903 18383 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.004s	sys 0.006s
I20260709 13:18:51.487618 22723 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:51.492592 18276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.024s	user 0.027s	sys 0.055s
I20260709 13:18:51.490058 22690 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:51.488780 22610 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:51.495090 22610 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.496304 22648 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.496876 22648 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:51.497298 22610 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:51.497843 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 1.0295e+06us
I20260709 13:18:51.499321 22648 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:51.501565 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:51.502259 18960 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:51.502440 18309 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:18:51.459951 18303 rpcz_store.cc:276] 0709 13:18:50.403894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.454980 (+1051086us) service_pool.cc:224] Handling call
0709 13:18:51.458040 (+  3060us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:51.459375 (+  1335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.459596 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:51.502514 22602 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:51.503618 18349 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:51.505265 22648 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:51.505645 22648 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.505995 22648 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:51.457203 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2421) took 1013 ms. Trace:
I20260709 13:18:51.455173 18385 pending_rounds.cc:85] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 6
I20260709 13:18:51.510422 18385 pending_rounds.cc:107] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:18:51.510241 18311 rpcz_store.cc:276] 0709 13:18:50.444019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.448418 (+1004399us) service_pool.cc:224] Handling call
0709 13:18:51.450933 (+  2515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.456892 (+  5959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.457134 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:51.512480 18310 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:18:51.512933 18310 pending_rounds.cc:85] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 8
I20260709 13:18:51.513499 18310 pending_rounds.cc:107] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:18:51.513772 18310 raft_consensus.cc:2889] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:51.512768 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 516) took 1072 ms. Trace:
I20260709 13:18:51.508461 22634 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:51.515115 18230 rpcz_store.cc:276] 0709 13:18:50.440488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.960480 (+519992us) service_pool.cc:224] Handling call
0709 13:18:50.961211 (+   731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.962694 (+  1483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.962733 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.963514 (+   781us) log.cc:844] Serialized 26 byte log entry
0709 13:18:51.511344 (+547830us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b1800280420. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181e1b4bc 00007fa17f16948b 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1
0709 13:18:51.511527 (+   183us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:51.511918 (+   391us) log.cc:844] Serialized 14 byte log entry
0709 13:18:51.512197 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.512283 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.512342 (+    59us) raft_consensus.cc:1685] finished
0709 13:18:51.512452 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.512663 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2045,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":539,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":198,"spinlock_wait_cycles":14245760,"thread_start_us":6585,"threads_started":1,"wal-append.queue_time_us":6550}
I20260709 13:18:51.510730 18385 raft_consensus.cc:2889] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:51.528435 22594 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:51.529714 22617 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:51.538329 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 140256us
I20260709 13:18:51.551478 18386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 715) took 2525 ms. Trace:
I20260709 13:18:51.555131 22632 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:51.558148 18131 catalog_manager.cc:5697] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:51.562623 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 155942us
W20260709 13:18:51.563164 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 163482us
W20260709 13:18:51.570184 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 141545us
I20260709 13:18:51.569832 22617 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:51.580000 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:51.551916 18386 rpcz_store.cc:276] 0709 13:18:49.025957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.029458 (+  3501us) service_pool.cc:224] Handling call
0709 13:18:49.043519 (+ 14061us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:49.058334 (+ 14815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:49.058381 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.347021 (+1288640us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b2c0010dcf8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:18:50.347502 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.672641 (+325139us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:50.672676 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.672745 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.551045 (+878300us) raft_consensus.cc:1685] finished
0709 13:18:51.551082 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.551289 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12370,"raft.queue_time_us":12554,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"spinlock_wait_cycles":48482176,"thread_start_us":324564,"threads_started":1,"wal-append.queue_time_us":393092}
I20260709 13:18:51.587644 22736 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.588469 22736 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:51.593564 22736 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:51.571547 22432 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.600845 22432 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.585973 22415 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:51.630344 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 61822.7us
I20260709 13:18:51.703999 22738 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.705268 22738 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:51.708353 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.708956 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.709751 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.712715 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 150941us
W20260709 13:18:51.721966 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 123092us
I20260709 13:18:51.727660 22719 consensus_queue.cc:1059] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:51.727905 18201 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:51.729058 22631 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.737228 22631 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:51.738569 18386 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
W20260709 13:18:51.729434 22727 log.cc:927] Time spent T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.144s	user 0.003s	sys 0.003s
W20260709 13:18:51.737260 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.737244 22738 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:51.743429 18124 maintenance_manager.cc:419] P dc71a90b0e6d42fc8a6b135fbfbac453: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7965 bytes on disk
I20260709 13:18:51.746663 18123 maintenance_manager.cc:643] P dc71a90b0e6d42fc8a6b135fbfbac453: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":404,"lbm_reads_lt_1ms":4}
I20260709 13:18:51.747417 22631 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:51.734808 22415 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:51.747869 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1737) took 2051 ms. Trace:
I20260709 13:18:51.748080 22415 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.748797 22415 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:51.749899 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:51.750599 18959 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
W20260709 13:18:51.753931 18231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1922) took 2091 ms (client timeout 2385 ms). Trace:
I20260709 13:18:51.741887 18201 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:51.755465 18200 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:18:51.754318 18231 rpcz_store.cc:269] 0709 13:18:49.662536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.669550 (+  7014us) service_pool.cc:224] Handling call
0709 13:18:51.753527 (+2083977us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b540001bdd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:51.753746 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429239168}
I20260709 13:18:51.748371 18236 rpcz_store.cc:276] 0709 13:18:49.696922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.071219 (+374297us) service_pool.cc:224] Handling call
0709 13:18:51.052133 (+980914us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.068979 (+ 16846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.747653 (+678674us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b54001897d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:51.747810 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2223029120}
W20260709 13:18:51.759598 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.754738 22620 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.761066 22620 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.748180 22725 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:51.766460 22735 raft_consensus.cc:3055] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:51.767051 22735 raft_consensus.cc:740] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:51.767977 22725 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:51.769307 22740 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:51.772101 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.773504 22634 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:51.784363 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1927) took 1492 ms. Trace:
I20260709 13:18:51.784600 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:51.784102 22634 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.785205 18386 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:51.785552 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:51.786310 18385 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 14: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:51.787290 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.787793 22634 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:51.779300 22348 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:51.789602 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.790866 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:51.791107 22731 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:51.784825 18233 rpcz_store.cc:276] 0709 13:18:50.291975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.299894 (+  7919us) service_pool.cc:224] Handling call
0709 13:18:50.300211 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.420453 (+120242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.783951 (+1363498us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400188dd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:51.784178 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243731712}
W20260709 13:18:51.793877 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.800815 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2334) took 1374 ms. Trace:
I20260709 13:18:51.801257 18378 rpcz_store.cc:276] 0709 13:18:50.426703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.456660 (+ 29957us) service_pool.cc:224] Handling call
0709 13:18:50.522862 (+ 66202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.638266 (+115404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.638315 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:50.638372 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:50.638417 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.800346 (+1161929us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54000ba9d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:51.800444 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.800656 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264735104}
I20260709 13:18:51.769867 22740 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:51.812709 18229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.313s	user 0.012s	sys 0.006s
W20260709 13:18:51.813320 18229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.314s	user 0.012s	sys 0.007s
I20260709 13:18:51.813938 22740 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:51.814378 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.817595 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.817817 22735 consensus_queue.cc:260] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:51.820729 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:51.825580 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1893) took 4474 ms. Trace:
I20260709 13:18:51.825982 18229 rpcz_store.cc:276] 0709 13:18:47.345454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.054629 (+709175us) service_pool.cc:224] Handling call
0709 13:18:48.054993 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.055272 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:48.067693 (+ 12421us) log.cc:844] Serialized 14 byte log entry
0709 13:18:50.499209 (+2431516us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b18001c6b40. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e1323a 00007fa18227da2a
0709 13:18:51.813982 (+1314773us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:51.814113 (+   131us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:51.814229 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.814360 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.819509 (+  5149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10952,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"spinlock_wait_cycles":3223808,"thread_start_us":1314362,"threads_started":1,"wal-append.queue_time_us":2661685,"wal-append.run_cpu_time_us":1568,"wal-append.run_wall_time_us":1036221}
I20260709 13:18:51.829802 22726 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.830626 22726 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:51.832927 22722 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:51.833649 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:51.836426 22726 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:51.838416 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 96569.4us
I20260709 13:18:51.839753 18304 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:51.840715 22723 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:18:51.857251 22722 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:51.857667 22722 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:51.858430 22722 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.864804 18386 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:18:51.854586 22723 consensus_queue.cc:1059] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:18:51.873677 22723 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:51.875552 22723 raft_consensus.cc:3055] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:51.876011 22723 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:51.872366 18201 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:51.880821 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:51.881610 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2406) took 2279 ms. Trace:
I20260709 13:18:51.884780 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.853215 22726 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:51.892401 22726 raft_consensus.cc:697] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:51.893772 22726 consensus_queue.cc:237] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:51.888224 22732 log.cc:927] Time spent T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:18:51.905706 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2485) took 1248 ms. Trace:
I20260709 13:18:51.906034 22454 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:51.916991 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.891588 22735 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:51.906251 18379 rpcz_store.cc:276] 0709 13:18:50.657693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.370735 (+713042us) service_pool.cc:224] Handling call
0709 13:18:51.399918 (+ 29183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.427347 (+ 27429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.427379 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:51.427994 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 13:18:51.545105 (+117111us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:51.545151 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.545234 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:51.887307 (+342073us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:51.905317 (+ 18010us) raft_consensus.cc:1685] finished
0709 13:18:51.905344 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.905628 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4574,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":7219584,"thread_start_us":116436,"threads_started":1,"wal-append.queue_time_us":210692}
I20260709 13:18:51.882071 18305 rpcz_store.cc:276] 0709 13:18:49.602046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.614461 (+ 12415us) service_pool.cc:224] Handling call
0709 13:18:49.642276 (+ 27815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.863716 (+221440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.881005 (+2017289us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54001bbf54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:51.881364 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508075776}
I20260709 13:18:51.909560 22723 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.912353 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.913391 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:51.920807 22723 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:51.921521 18386 raft_consensus.cc:2393] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:51.925202 22690 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:51.925817 22690 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.927469 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.927840 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.927923 22690 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:51.928728 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.929672 18377 raft_consensus.cc:2410] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:18:51.929910 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.937067 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:51.943133 18379 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:51.945015 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:51.945590 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:51.945948 18386 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:51.946475 18377 raft_consensus.cc:2376] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15. Re-sending same reply.
I20260709 13:18:51.967499 22726 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:51.972878 22726 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:51.974396 22726 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:51.976141 22722 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:51.994149 22751 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.983264 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:51.996974 18958 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:51.986972 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:51.998778 18959 raft_consensus.cc:2410] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:18:51.998905 18275 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:18:51.980218 18228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1725) took 2298 ms (client timeout 1555 ms). Trace:
I20260709 13:18:51.992611 22690 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:18:51.999786 18228 rpcz_store.cc:269] 0709 13:18:49.681756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.684984 (+  3228us) service_pool.cc:224] Handling call
0709 13:18:51.979708 (+2294724us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b5400104ad4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:51.979977 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223673600}
I20260709 13:18:52.000030 22690 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.002961 22617 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:52.003672 22690 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:52.011814 22617 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:51.995072 22751 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.018755 22751 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.015079 22348 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:52.031011 22348 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:52.043047 18386 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:18:52.012387 22617 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.048573 22617 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.039901 22348 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.050352 22348 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:52.063992 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.070672 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:52.071530 18960 raft_consensus.cc:2393] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
W20260709 13:18:52.077698 18351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.405s	user 0.002s	sys 0.011s
W20260709 13:18:52.078161 18351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.405s	user 0.003s	sys 0.011s
W20260709 13:18:52.081136 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 1.41589e+06us
I20260709 13:18:52.084270 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:52.085005 18229 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:52.085675 22690 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:52.087152 18386 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:52.089769 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:52.090596 18386 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:18:52.088438 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:52.084493 18953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53364 (request call id 301) took 1029 ms. Trace:
I20260709 13:18:52.092798 18953 rpcz_store.cc:276] 0709 13:18:51.054609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.054844 (+   235us) service_pool.cc:224] Handling call
0709 13:18:51.058948 (+  4104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.060286 (+  1338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.084261 (+1023975us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b54006f72d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:52.084408 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8430336}
I20260709 13:18:52.091915 22690 raft_consensus.cc:2764] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:18:52.094990 18232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1932) took 1681 ms (client timeout 1649 ms). Trace:
I20260709 13:18:52.096374 22620 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:52.096292 18232 rpcz_store.cc:269] 0709 13:18:50.413882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.596074 (+182192us) service_pool.cc:224] Handling call
0709 13:18:52.094382 (+1498308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.097191 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:52.097450 22690 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 13:18:52.102276 18956 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.960s	user 0.042s	sys 0.030s
W20260709 13:18:52.102994 18956 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.961s	user 0.042s	sys 0.031s
I20260709 13:18:52.094485 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:52.105785 18386 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:52.108062 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:52.110491 22610 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:52.110101 22415 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.114187 22415 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:52.115533 18304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 2408) took 1714 ms (client timeout 1910 ms). Trace:
I20260709 13:18:52.117839 22690 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:52.119958 22690 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:52.119351 18926 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:52.124327 22735 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:52.116108 18304 rpcz_store.cc:269] 0709 13:18:50.401532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.401752 (+   220us) service_pool.cc:224] Handling call
0709 13:18:52.115259 (+1713507us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400222ed4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:52.115438 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3272491904}
W20260709 13:18:52.127209 22730 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.533s	user 0.004s	sys 0.000s
I20260709 13:18:52.126879 22690 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.098757 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:52.134042 22602 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:52.136093 22602 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:52.142881 18229 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:18:52.137054 22756 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:18:52.163796 22762 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:52.164286 22762 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:52.164639 22762 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:52.168881 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 70244.1us
I20260709 13:18:52.168891 22596 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:52.171028 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:52.175725 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:52.171432 18956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53364 (request call id 297) took 3039 ms. Trace:
I20260709 13:18:52.169519 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:52.182324 18201 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:52.184432 22380 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:52.184697 22348 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:52.185205 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 723) took 3679 ms. Trace:
I20260709 13:18:52.185276 22348 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:52.185861 18310 rpcz_store.cc:276] 0709 13:18:48.505765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.576140 (+ 70375us) service_pool.cc:224] Handling call
0709 13:18:48.578415 (+  2275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.514325 (+2935910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.169321 (+654996us) spinlock_profiling.cc:243] Waited 2.93 s on lock 0x7b540011c454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:52.185145 (+ 15824us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6746220928}
I20260709 13:18:52.184432 18201 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:52.191589 22755 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:52.195259 18201 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:52.196957 18201 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:52.189832 22380 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:52.186926 22348 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.214510 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:52.199779 22755 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:52.217133 22423 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:52.210347 22756 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:52.216609 22380 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:52.222064 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:52.222255 22755 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.222754 22756 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:52.237149 22380 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.231405 22755 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:52.239323 22718 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.822s	user 0.003s	sys 0.000s
I20260709 13:18:52.231221 22756 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:52.225456 22423 raft_consensus.cc:697] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:52.241341 22423 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:52.187687 18956 rpcz_store.cc:276] 0709 13:18:49.131886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.140859 (+  8973us) service_pool.cc:224] Handling call
0709 13:18:49.141195 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.141412 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:51.634269 (+2492857us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa17f1690ac 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f183455 00007fa185c6b3c7
0709 13:18:52.104163 (+469894us) log.cc:844] Serialized 14 byte log entry
0709 13:18:52.153188 (+ 49025us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:52.162773 (+  9585us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:52.168677 (+  5904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.171203 (+  2526us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.171348 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1611213,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":2434,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":841,"spinlock_wait_cycles":102529920,"thread_start_us":3005850,"threads_started":2,"wal-append.queue_time_us":49819}
W20260709 13:18:52.251653 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 76116.9us
W20260709 13:18:52.265460 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.245486 22690 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:52.284711 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:18:52.311525 22759 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:18:52.314862 18960 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:52.315474 22766 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:52.315961 22766 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:52.346187 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:52.346477 22765 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:52.339143 22766 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:52.353775 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.355257 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:52.356446 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.356942 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.357391 18230 raft_consensus.cc:2393] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 10: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:18:52.356446 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.356818 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.359488 18231 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:52.359247 22762 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:52.360677 22602 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:52.361583 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:52.362169 18228 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:52.341339 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:52.344169 22380 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.380493 18959 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:52.361595 22762 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:52.381892 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:18:52.402736 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 124547us
I20260709 13:18:52.406840 18229 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:52.371387 22755 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.400045 22722 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:18:52.382741 22380 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:52.414683 18232 raft_consensus.cc:2368] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15.
I20260709 13:18:52.423693 22766 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.425323 22380 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.430254 22755 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.432262 22766 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:52.440208 18228 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:18:52.445827 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:52.453999 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2321) took 2596 ms. Trace:
I20260709 13:18:52.454546 18382 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:52.454490 18384 rpcz_store.cc:276] 0709 13:18:49.855620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:49.863825 (+  8205us) service_pool.cc:224] Handling call
0709 13:18:52.450945 (+2587120us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b5800050198. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:18:52.451196 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.451607 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.451630 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:52.451664 (+    34us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:52.451690 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.451739 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.451827 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30906240}
I20260709 13:18:52.453999 22470 raft_consensus.cc:2764] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:18:52.455874 18380 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:52.456359 18380 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:52.458994 18960 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:52.461462 18349 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:52.463809 22470 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:52.463742 18380 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.465384 18380 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:52.464478 22470 raft_consensus.cc:697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:18:52.467139 22648 consensus_meta.cc:287] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.961s	user 0.018s	sys 0.000s
I20260709 13:18:52.467257 22470 consensus_queue.cc:237] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:52.467656 22648 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:52.468930 22756 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.471832 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:52.472579 18383 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:52.472645 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:52.471341 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:52.481848 18953 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.487828 18380 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:18:52.488302 18380 pending_rounds.cc:85] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 7
I20260709 13:18:52.488517 18380 pending_rounds.cc:107] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:18:52.472460 22648 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:52.489230 18380 raft_consensus.cc:2889] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:52.492766 22756 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.498838 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:52.486946 22602 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:18:52.499768 18953 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:52.501312 18349 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:52.502952 18383 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:18:52.504079 22634 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.504501 22234 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:52.505020 22234 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:52.504815 22634 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.505489 22234 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:52.506789 22772 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:52.505524 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:52.508669 22740 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.508919 22648 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:52.509464 22648 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:52.509227 22740 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.509907 22648 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:52.510550 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.512073 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:52.512663 18307 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:52.513087 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:52.507055 22634 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.518903 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:52.519763 18383 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:52.511507 22740 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.513005 22622 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.524685 22636 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.525199 22636 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.505555 22766 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:52.526208 22766 raft_consensus.cc:697] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:52.527267 22636 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.528741 22634 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:52.529284 22634 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:52.529621 22634 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:52.541962 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 543157us
W20260709 13:18:52.543567 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.528616 22772 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:52.527572 22766 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:52.545586 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2410) took 2143 ms. Trace:
I20260709 13:18:52.555919 18383 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:52.565099 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 739) took 1465 ms. Trace:
I20260709 13:18:52.537734 22735 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.560165 18308 rpcz_store.cc:276] 0709 13:18:50.402311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.319368 (+917057us) service_pool.cc:224] Handling call
0709 13:18:51.319866 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.320270 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:51.361170 (+ 40900us) log.cc:844] Serialized 14 byte log entry
0709 13:18:51.390038 (+ 28868us) log.cc:844] Serialized 14 byte log entry
0709 13:18:52.129823 (+739785us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b18004487e0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa185c6b3c7 00007fa18227d9a7 00007fa18228d0bf 00007fa18228d038
0709 13:18:52.130026 (+   203us) log.cc:844] Serialized 14 byte log entry
0709 13:18:52.523115 (+393089us) log.cc:844] Serialized 14 byte log entry
0709 13:18:52.523272 (+   157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:52.523313 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:52.523351 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.545416 (+ 22065us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.545533 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1081253,"prepare.queue_time_us":1558866,"prepare.run_cpu_time_us":143,"prepare.run_wall_time_us":629,"raft.queue_time_us":399344,"raft.run_cpu_time_us":434,"raft.run_wall_time_us":6037,"spinlock_wait_cycles":3940736,"thread_start_us":52042,"threads_started":2,"wal-append.queue_time_us":156929}
W20260709 13:18:52.574828 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 60055.8us
I20260709 13:18:52.582543 18307 raft_consensus.cc:2410] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:18:52.566102 18309 rpcz_store.cc:276] 0709 13:18:51.100980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.503784 (+402804us) service_pool.cc:224] Handling call
0709 13:18:51.504171 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.504442 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:52.131902 (+627460us) log.cc:844] Serialized 14 byte log entry
0709 13:18:52.564572 (+432670us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:52.564666 (+    94us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:52.564739 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.564855 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.565015 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1009548,"prepare.queue_time_us":797177,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":381987,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":13312,"thread_start_us":52665,"threads_started":2,"wal-append.queue_time_us":13252}
I20260709 13:18:52.557446 22423 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:18:52.569444 22622 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.572252 22735 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:52.596491 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.599644 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:52.601732 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.591812 22443 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.604863 22443 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.594426 22740 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.605937 22740 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.606951 22443 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.607673 22234 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.594141 22636 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.607988 22740 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.612670 18307 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:52.593885 22673 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.618016 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:52.619021 18383 raft_consensus.cc:2410] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:52.618104 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:52.618933 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:52.621240 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:52.623886 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:52.625216 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:52.625856 18381 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:51.762248 22631 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:52.627812 22631 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.633572 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.637282 18231 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:52.637209 18386 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:52.628269 22631 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:52.639817 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.641453 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:52.642112 18309 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:52.649369 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:52.611562 22786 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.652243 22786 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.654305 22786 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.661492 22234 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:52.663120 22622 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.617209 22636 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.666093 22636 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.666957 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:52.667516 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:52.667905 22735 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.668484 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:52.668841 18383 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:52.669106 18307 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
I20260709 13:18:52.670204 18927 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:52.670612 22648 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.671017 22735 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:52.671013 22634 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:52.671618 22735 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.672013 22735 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:52.672588 22785 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:18:52.673724 22785 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:52.674036 22785 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:52.674949 22785 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.676095 22785 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:52.681413 22634 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:52.682331 18380 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:52.683903 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:52.686180 18386 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:52.687523 18386 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:52.689666 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.690331 18236 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:52.695643 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.702283 18236 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:52.701704 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.703071 18201 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:52.719774 18234 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:52.721026 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.722234 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.728183 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:52.729321 18201 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:52.732043 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.735529 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.727274 22723 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:52.730762 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:52.738101 18235 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:52.739027 18379 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:52.623438 22673 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.742654 18305 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:52.743709 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:52.746168 18309 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:52.724196 22728 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.725625 22636 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:52.679800 22735 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:52.747282 22610 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:52.745678 22740 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.736799 22415 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:18:52.761394 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 120293us
I20260709 13:18:52.763895 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:52.765065 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.767853 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:52.766582 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:52.765795 18237 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:52.768503 18309 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:52.770192 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:52.757449 22636 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:52.774255 22622 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:52.775605 18305 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:52.774361 18131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 86) took 10289 ms. Trace:
I20260709 13:18:52.789034 22098 consensus_queue.cc:1059] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:52.790191 22098 raft_consensus.cc:3055] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:52.790576 22098 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:52.773159 22787 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:52.774765 22622 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.792770 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:52.753859 22728 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:52.791430 22098 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.765368 22740 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:52.805259 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:52.812923 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.774266 22752 consensus_queue.cc:1059] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:18:52.818511 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:52.818722 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:52.797405 22787 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:52.813815 18407 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad1c0 after lost signal to thread 17141
I20260709 13:18:52.814554 18237 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:52.801432 22622 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:52.822507 18407 debug-util.cc:398] Leaking SignalData structure 0x7b08000bb280 after lost signal to thread 18169
I20260709 13:18:52.823477 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:52.827695 22791 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:52.802300 22610 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:52.834379 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:52.835225 18309 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:52.837895 22740 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:52.840631 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:52.841408 18380 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:52.804913 22634 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:18:52.843644 18407 debug-util.cc:398] Leaking SignalData structure 0x7b08000e96e0 after lost signal to thread 18261
W20260709 13:18:52.844404 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.862401 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:52.864297 18386 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 14: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:52.866011 22673 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.824879 22648 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:52.825037 22787 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:52.861055 22098 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:52.873026 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:52.873700 18308 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:52.868628 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.877585 18407 debug-util.cc:398] Leaking SignalData structure 0x7b08001b4060 after lost signal to thread 18336
W20260709 13:18:52.878561 18407 debug-util.cc:398] Leaking SignalData structure 0x7b0800371cc0 after lost signal to thread 18410
W20260709 13:18:52.879868 18407 debug-util.cc:398] Leaking SignalData structure 0x7b080034c4e0 after lost signal to thread 18411
I20260709 13:18:52.776055 18131 rpcz_store.cc:276] 0709 13:18:42.482523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.482759 (+   236us) service_pool.cc:224] Handling call
0709 13:18:52.772000 (+10289241us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:51.873102 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:51.873902 (+   800us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:51.873979 (+    77us) write_op.cc:435] Acquired schema lock
0709 13:18:51.874046 (+    67us) tablet.cc:662] Decoding operations
0709 13:18:51.874974 (+   928us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:51.875117 (+   143us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:51.875160 (+    43us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:18:51.875917 (+   757us) tablet.cc:701] Row locks acquired
0709 13:18:51.875981 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:18:51.876250 (+   269us) write_op.cc:270] Start()
0709 13:18:51.876424 (+   174us) write_op.cc:276] Timestamp: P: 1783603131876121 usec, L: 0
0709 13:18:51.876478 (+    54us) op_driver.cc:348] REPLICATION: starting
0709 13:18:51.884733 (+  8255us) log.cc:844] Serialized 2395 byte log entry
0709 13:18:51.958211 (+ 73478us) op_driver.cc:464] REPLICATION: finished
0709 13:18:52.031731 (+ 73520us) write_op.cc:301] APPLY: starting
0709 13:18:52.031835 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:52.049936 (+ 18101us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:52.050067 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:52.082281 (+ 32214us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:52.082563 (+   282us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 13:18:52.082621 (+    58us) write_op.cc:312] APPLY: finished
0709 13:18:52.082953 (+   332us) log.cc:844] Serialized 57 byte log entry
0709 13:18:52.084852 (+  1899us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:52.084971 (+   119us) write_op.cc:454] Released schema lock
0709 13:18:52.085043 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:52.085481 (+   438us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:52.085514 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1997837,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":71771,"apply.run_cpu_time_us":12289,"apply.run_wall_time_us":53676,"cfile_cache_hit":18,"cfile_cache_hit_bytes":18774,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6213,"cfile_init":1,"lbm_read_time_us":1845,"lbm_reads_lt_1ms":8,"num_ops":5,"prepare.queue_time_us":106169,"prepare.run_cpu_time_us":4856,"prepare.run_wall_time_us":23828,"replication_time_us":79836,"thread_start_us":97714,"threads_started":2}]]}
W20260709 13:18:52.883230 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.886931 22636 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.907516 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:52.864982 22723 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:52.917681 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:52.924216 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.925612 18232 raft_consensus.cc:2410] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:52.935932 18308 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
W20260709 13:18:52.939062 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 171626us
I20260709 13:18:52.939895 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.940582 18232 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 6.
I20260709 13:18:52.941567 18237 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:52.942902 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:52.944331 18308 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:52.945359 22463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.137s	user 0.018s	sys 0.004s
W20260709 13:18:52.945544 22782 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.327s	user 0.004s	sys 0.000s
W20260709 13:18:52.945787 22463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.018s	sys 0.005s
I20260709 13:18:52.922260 22799 raft_consensus.cc:3055] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:52.927711 22735 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.950749 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:52.943077 18351 connection.cc:256] RPC call timeout handler was delayed by -2.3447238300000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
I20260709 13:18:52.952359 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:52.956490 18351 connection.cc:256] RPC call timeout handler was delayed by -2.3303238299999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260709 13:18:52.957525 18351 connection.cc:256] RPC call timeout handler was delayed by -2.3168238299999757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 13:18:52.957867 18351 connection.cc:256] RPC call timeout handler was delayed by -2.2835238299999219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
I20260709 13:18:52.956539 18305 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:18:52.959282 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:18:52.958240 18351 connection.cc:256] RPC call timeout handler was delayed by -2.2556238300001041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:18:52.960805 18351 connection.cc:256] RPC call timeout handler was delayed by -2.2214238300000488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 13:18:52.961047 18351 connection.cc:256] RPC call timeout handler was delayed by -2.1791238299999804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 13:18:52.961241 18351 connection.cc:256] RPC call timeout handler was delayed by -2.0288238299999648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 13:18:52.961455 18351 connection.cc:256] RPC call timeout handler was delayed by -1.9874238299998979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
W20260709 13:18:52.961710 18351 connection.cc:256] RPC call timeout handler was delayed by -1.8326238300001023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
W20260709 13:18:52.961938 18351 connection.cc:256] RPC call timeout handler was delayed by -1.8020238300000528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260709 13:18:52.962154 18351 connection.cc:256] RPC call timeout handler was delayed by -1.2341238300000441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27890000000000004s for a response
I20260709 13:18:52.941272 18956 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:52.970907 22723 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.975500 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:52.976747 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:52.977272 18235 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:52.978451 22787 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:52.980929 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:52.981438 18228 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:18:52.982200 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:52.951814 22799 raft_consensus.cc:740] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:52.977173 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:53.000592 18307 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:52.981494 22787 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.982846 18309 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:18:52.971374 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:52.974264 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:52.973335 22631 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:52.990305 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.002123 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:53.008234 18275 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:53.010171 18308 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:18:53.011525 18237 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:53.011938 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:53.014281 18309 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:53.014374 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:53.006894 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:53.015417 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 262142us
I20260709 13:18:53.026791 18307 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:18:53.028282 18312 raft_consensus.cc:2368] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14.
I20260709 13:18:53.018950 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:53.029722 18378 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:53.030262 18927 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:53.028851 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:53.037245 18310 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:53.037655 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:53.015020 22380 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.033175 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:53.042548 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:53.040827 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:53.038600 18308 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:53.019431 22740 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:53.044562 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:53.031682 22786 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:53.043977 18311 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:18:53.048214 18235 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:53.029773 18956 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
W20260709 13:18:53.069175 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.049355 18312 raft_consensus.cc:2410] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:18:53.054946 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.060721 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:53.061883 22631 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:53.062295 22470 consensus_queue.cc:1059] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:53.063058 22432 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:52.960577 22610 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:53.073912 18378 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:18:53.077310 18308 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:18:53.078642 18309 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:18:53.083673 18311 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:53.039196 22800 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:53.085880 18309 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:53.040077 22463 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:18:53.091809 18305 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:18:53.092460 18305 pending_rounds.cc:85] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 8
I20260709 13:18:53.096406 22800 raft_consensus.cc:697] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 9 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:53.101533 22800 consensus_queue.cc:237] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:53.069280 22723 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:53.098012 18304 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:53.045686 22380 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:53.075572 22740 raft_consensus.cc:697] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:53.115178 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:53.098351 18305 pending_rounds.cc:107] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:18:53.116539 18305 raft_consensus.cc:2889] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:53.099172 22807 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:18:53.119933 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 87879.8us
I20260709 13:18:53.075907 22786 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:53.122205 22631 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:18:53.124188 22234 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:53.068681 22799 consensus_queue.cc:260] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:53.141240 18202 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.592s (SENT) [suppressed 11 similar messages]
I20260709 13:18:53.136742 22799 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:53.150074 18407 debug-util.cc:398] Leaking SignalData structure 0x7b080039be20 after lost signal to thread 18986
W20260709 13:18:53.150552 18407 debug-util.cc:398] Leaking SignalData structure 0x7b08002bac40 after lost signal to thread 18987
I20260709 13:18:53.118647 22723 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:53.153324 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:53.142904 22786 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:53.166088 22813 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.166703 22813 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:53.168201 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:53.169426 22813 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:53.171241 22786 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:53.171375 22636 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:53.174306 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:53.175379 22636 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:53.176564 22380 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:53.176923 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:53.178153 22785 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:53.180480 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:53.181674 22785 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:53.182322 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:53.183287 22470 raft_consensus.cc:2764] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:18:53.183840 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:53.185564 22631 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.186101 22631 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:53.186194 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:53.188025 22785 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:53.188387 22785 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.188393 22631 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:53.188774 22785 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:53.177093 22234 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:53.188818 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:53.148367 22463 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.195922 18276 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:53.220142 22463 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:53.196485 22470 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:53.250923 22463 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:53.252332 22622 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:53.254810 22622 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:53.256076 22766 raft_consensus.cc:3055] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:53.256634 22766 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:53.257786 22766 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:53.218926 22636 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:53.259572 22636 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.260067 22636 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:53.264978 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 123781us
W20260709 13:18:53.272631 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 56134.9us
W20260709 13:18:53.273676 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.265487 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:18:53.275876 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 92109.1us
I20260709 13:18:53.278903 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:53.283214 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:53.302459 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:53.303349 18378 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
W20260709 13:18:53.306013 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 120363us
W20260709 13:18:53.309330 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.315858 18381 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:18:53.317433 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.321957 22728 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:18:53.326534 18275 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:53.329941 22620 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:53.330363 22620 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.330696 22620 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:53.332259 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:53.334234 22596 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:53.337302 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:53.338169 18235 raft_consensus.cc:2410] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:18:53.341632 22596 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:53.362093 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:53.393133 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:53.288470 22786 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:18:53.401440 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 61478.4us
I20260709 13:18:53.396037 22470 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:53.396950 22728 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:53.215319 22740 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:53.408540 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:53.410054 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:53.314762 22766 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:53.313921 22234 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:53.281224 22785 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:53.401448 22775 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:18:53.453559 18277 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:53.455472 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 148149us
I20260709 13:18:53.429749 22801 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.429440 22722 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.441403 22786 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:53.485534 18275 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:53.481860 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:53.478886 18201 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:53.461298 22811 log.cc:927] Time spent T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 13:18:53.486037 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.449040 22634 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:18:53.493449 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.505239 18202 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.910s (SENT)
I20260709 13:18:53.505863 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:53.473788 22234 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:53.524255 22785 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:53.524914 22785 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:53.526559 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 85902.8us
I20260709 13:18:53.527889 18277 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:53.529166 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:53.529036 22622 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:18:53.509747 22815 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:18:53.515792 22786 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:53.537030 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 65207.6us
I20260709 13:18:53.532857 22432 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:18:53.508863 22098 consensus_meta.cc:287] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.000s
I20260709 13:18:53.504386 22826 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:53.493916 22722 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:53.544688 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:53.530756 22648 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:53.557375 18307 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:53.541582 22432 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.498694 22801 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:53.565596 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.506099 22634 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:53.570683 22826 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:53.570788 22432 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:53.570427 22825 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:53.574339 22634 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:53.558897 22602 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:18:53.593129 22620 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:53.595818 22620 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:53.562604 22617 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:53.603880 22756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.009s	sys 0.012s
W20260709 13:18:53.604393 22756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.009s	sys 0.012s
I20260709 13:18:53.607409 22636 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:53.643663 18381 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:53.644656 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:53.659878 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 115323us
W20260709 13:18:53.659683 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 99585.2us
I20260709 13:18:53.670931 18379 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:53.669247 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:53.677940 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:53.679952 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:53.658558 22432 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:53.690841 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:53.691533 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:53.674566 22826 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:53.701462 22826 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:53.703670 22632 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:53.705252 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:53.705943 18956 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:53.707211 22801 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:53.676040 22631 consensus_queue.cc:1059] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:18:53.697029 18304 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:53.670082 22098 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:18:53.715898 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 46762.4us
I20260709 13:18:53.718590 18277 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:53.688660 22463 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:18:53.722746 22631 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:53.723296 22631 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:53.724552 22827 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:53.725644 22636 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:53.733856 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:53.735960 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:53.752303 18277 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:53.753834 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.757215 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 65765.2us
I20260709 13:18:53.773877 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:53.753090 22620 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:53.757498 22722 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:53.800239 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:53.853003 18379 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:53.838156 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:53.853893 18386 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:53.756712 22673 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:53.856317 22803 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.787s	user 0.000s	sys 0.004s
W20260709 13:18:53.858595 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 84807.5us
I20260709 13:18:53.859556 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:53.865764 22786 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:53.866215 22786 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.866572 22786 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:53.869001 22831 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:53.869638 22831 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:53.870508 22831 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:53.724304 22631 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:53.905577 18277 leader_election.cc:400] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15.
I20260709 13:18:53.906163 18277 leader_election.cc:403] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:18:53.909363 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 134415us
I20260709 13:18:53.779320 22804 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.135s
I20260709 13:18:53.912710 18382 raft_consensus.cc:2410] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:18:53.923331 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.938418 22845 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:53.946272 22723 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:53.952193 22806 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.952956 22806 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:53.955139 22806 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:53.965742 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 187377us
I20260709 13:18:53.936168 22631 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:53.977910 18953 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:53.979949 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:53.981525 18383 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:53.996062 18379 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:18:53.957226 22617 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:54.001859 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:54.004268 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:54.005838 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:54.008229 18228 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:18:54.008844 18228 pending_rounds.cc:85] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 5
I20260709 13:18:54.008847 18237 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 14: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:54.009378 18228 pending_rounds.cc:107] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:18:54.009814 18228 raft_consensus.cc:2889] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:54.010462 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:53.948231 22766 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:18:54.007934 18234 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:54.019654 18230 raft_consensus.cc:2410] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:54.020639 18201 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:54.022413 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:54.021799 18201 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:54.023138 18231 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:54.025995 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:54.026701 18234 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:54.027206 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:54.028067 18230 raft_consensus.cc:2410] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 16 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:18:54.029340 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:54.035683 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:54.036327 22802 log.cc:927] Time spent T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 1.066s	user 0.000s	sys 0.008s
I20260709 13:18:54.036629 22814 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:54.037242 22814 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:54.038503 22839 log.cc:927] Time spent T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.338s	user 0.002s	sys 0.000s
I20260709 13:18:54.040318 22842 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:54.041301 22836 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15.
W20260709 13:18:54.042651 22837 log.cc:927] Time spent T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:18:54.044472 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:54.045234 18233 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:53.989254 22825 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:54.066829 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.067832 18306 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
W20260709 13:18:54.066836 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 81218.9us
I20260709 13:18:54.033846 22622 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.072700 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:54.073489 18229 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:54.075677 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.077045 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.077894 18309 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:18:54.079138 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 46243.7us
I20260709 13:18:54.079928 18201 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:54.072638 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:54.095156 22846 log.cc:927] Time spent T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:18:54.110517 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:54.112023 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.113131 18311 raft_consensus.cc:2410] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:18:54.115156 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:54.115839 22844 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:18:54.120868 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.121717 18303 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 15: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:54.122596 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:54.124001 22825 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:54.124909 22636 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:54.125622 22825 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:54.126026 22825 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:54.126374 22825 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:54.112797 18310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "b52e2477fc524694967c4a16afa983e3"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:18:54.128858 18310 raft_consensus.cc:606] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Received request to transfer leadership to TS b52e2477fc524694967c4a16afa983e3
I20260709 13:18:54.129283 18310 raft_consensus.cc:614] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:54.129738 18312 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:54.025193 22766 consensus_queue.cc:1243] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:54.132367 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.133308 18305 raft_consensus.cc:2410] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:18:54.034911 22851 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:54.134248 22851 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.134624 22851 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:54.062271 22617 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:54.137146 22617 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.137468 22617 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:54.039510 22814 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:54.154060 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:54.162077 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 82246.7us
I20260709 13:18:54.164876 18379 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:54.002658 22829 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.140s
I20260709 13:18:54.175964 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:54.176994 18229 raft_consensus.cc:2368] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14.
I20260709 13:18:54.172219 22602 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:54.142653 22622 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:54.192411 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:54.194458 18229 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
W20260709 13:18:54.193634 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 237565us
I20260709 13:18:54.198288 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:54.199040 18233 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:54.194864 22602 raft_consensus.cc:697] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:54.203867 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:54.204495 18233 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:54.210393 18305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87ce294aa3d9426291ec809884e80749"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "b52e2477fc524694967c4a16afa983e3"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:18:54.211112 18305 raft_consensus.cc:606] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Received request to transfer leadership to TS b52e2477fc524694967c4a16afa983e3
I20260709 13:18:54.211481 18305 raft_consensus.cc:614] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:54.209440 18956 consensus_meta.cc:287] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.005s
I20260709 13:18:54.227766 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.229099 18310 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:54.230679 18309 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:54.232128 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.232805 18308 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:54.236184 18306 raft_consensus.cc:2368] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9.
I20260709 13:18:54.234563 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.238720 18311 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:18:54.238720 18303 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:18:54.235597 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 125187us
I20260709 13:18:54.237735 18312 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:18:54.241892 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:54.242700 18953 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:54.243685 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.244423 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.230566 18956 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:54.246367 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:54.246997 18228 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:54.248121 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:54.248710 18235 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:54.250046 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.250437 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:54.244169 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 127992us
I20260709 13:18:54.250047 18304 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:54.254734 18381 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:54.258658 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:54.259848 18304 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 13:18:54.260887 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:54.263546 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.263912 18312 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:54.264202 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:54.264807 18386 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:54.269258 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:54.280042 18228 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:54.285604 18237 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:54.302426 18953 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:18:54.340852 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:54.341518 18236 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:54.343838 18233 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:18:54.348011 18235 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:18:54.350060 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.351456 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:18:54.352869 22855 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:18:54.354314 22858 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:18:54.354421 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.355172 18306 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:54.251904 22602 consensus_queue.cc:237] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:54.355924 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.356215 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.356590 18305 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:18:54.355330 18311 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 14: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:54.350203 22622 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:54.362206 18308 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:54.366232 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:54.368172 18953 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 5.
I20260709 13:18:54.377667 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.356300 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.379254 18304 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:54.298460 22723 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.392274 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.311455 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:54.397471 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.400285 18312 raft_consensus.cc:2393] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:54.401274 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.405409 18310 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:54.406983 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:54.378150 22860 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:54.418793 18386 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:54.426007 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.427171 18312 raft_consensus.cc:2410] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:18:54.402787 22723 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:54.426585 18956 raft_consensus.cc:2393] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:18:54.439469 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.449610 22842 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:54.455529 22861 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:54.456677 18276 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:54.457492 22826 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:54.457979 22826 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:54.458832 22826 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:54.459583 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:54.460911 22610 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:54.462620 22415 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:54.463236 22415 raft_consensus.cc:3055] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:54.463543 22415 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:54.466204 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.466749 18312 raft_consensus.cc:2376] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14. Re-sending same reply.
I20260709 13:18:54.464286 22415 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:54.475689 22862 log.cc:927] Time spent T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:18:54.480226 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:54.482017 22859 log.cc:927] Time spent T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:18:54.482959 22863 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:54.483726 18381 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:54.483771 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:54.487895 18380 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:54.488268 18380 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:54.489049 18380 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:54.490204 18380 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:54.495522 18202 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:54.500995 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 260666us
I20260709 13:18:54.505339 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:54.506086 18312 raft_consensus.cc:2376] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14. Re-sending same reply.
I20260709 13:18:54.509338 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:54.511548 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:54.512188 18312 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:54.518290 18379 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:18:54.523620 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:54.531561 18351 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:54.530134 18275 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:54.534586 18236 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:18:54.514398 22806 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:54.542147 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:54.542276 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.511740 22432 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:54.548213 18309 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:54.503139 22755 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:18:54.555141 18380 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:18:54.555768 18953 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:54.557606 18380 pending_rounds.cc:85] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 9
I20260709 13:18:54.559327 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:54.560241 18958 raft_consensus.cc:2410] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:18:54.558611 18380 pending_rounds.cc:107] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 14.10
I20260709 13:18:54.562450 18380 raft_consensus.cc:2917] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Aborting config change with OpId 14.10: Aborted: Op aborted by new leader
I20260709 13:18:54.562505 18956 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:54.565280 22865 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:18:54.533509 22799 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:54.571748 22799 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:54.511296 22740 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:18:54.572739 22799 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:54.572845 18380 raft_consensus.cc:2889] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:54.587654 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:54.572481 18956 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:18:54.554563 22861 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:54.518527 22756 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:18:54.544585 22622 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:54.550498 22806 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.590895 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:54.580155 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 56602us
I20260709 13:18:54.603168 22617 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:54.590720 22852 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:54.606782 18275 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:54.620671 18310 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:54.615657 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:54.614876 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 113063us
I20260709 13:18:54.600096 18379 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:54.599720 18956 pending_rounds.cc:85] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Aborting all ops after (but not including) 9
I20260709 13:18:54.628017 18202 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:54.631115 22860 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:18:54.634334 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.634922 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.635530 18309 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:54.545627 18200 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:18:54.638252 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 197805us
I20260709 13:18:54.639199 18200 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:54.641567 18237 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:54.643604 22454 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:54.617900 22806 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:54.647414 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:54.657128 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:54.633690 18956 pending_rounds.cc:107] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 14.10
I20260709 13:18:54.627013 22622 raft_consensus.cc:697] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:54.627992 22857 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.614907 22836 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:18:54.670147 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:54.673377 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.636164 22380 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:54.668588 18309 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:54.644814 22813 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:54.617213 22740 consensus_queue.cc:1059] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:18:54.658308 22852 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:54.645958 22842 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:54.658833 22454 raft_consensus.cc:697] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:54.687988 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:54.670851 18956 raft_consensus.cc:2917] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Aborting config change with OpId 14.10: Aborted: Op aborted by new leader
I20260709 13:18:54.692343 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:54.699458 18386 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:54.679735 22755 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:54.680945 22813 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:54.719660 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 84584.3us
I20260709 13:18:54.685738 22852 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:54.730412 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:54.696632 22829 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:54.722666 18956 raft_consensus.cc:2889] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 15 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:54.681105 22857 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:54.728902 22813 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:54.696470 22432 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:18:54.728204 22740 raft_consensus.cc:3055] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:54.733881 22852 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:54.740432 22829 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.743214 22861 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:54.708287 22380 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 13:18:54.772969 22786 consensus_meta.cc:287] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.906s	user 0.011s	sys 0.004s
I20260709 13:18:54.805131 18926 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:54.798496 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 84684.6us
W20260709 13:18:54.826138 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 187075us
I20260709 13:18:54.786214 22740 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:54.792973 22829 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:54.832113 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:54.834008 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.796329 22454 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:54.773862 22622 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:54.792132 22861 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:54.848292 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:54.857357 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:54.842677 22348 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.859364 18381 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:54.859323 18386 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:54.839214 22744 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:54.900372 18312 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:18:54.852476 22766 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:54.809170 22786 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:54.857589 22887 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.895915 22636 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:54.846436 22617 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:54.863489 22861 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:54.898277 22348 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:54.912732 18307 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:54.957993 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:54.952585 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:54.902459 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 61650.9us
I20260709 13:18:54.966755 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:54.966137 18381 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
W20260709 13:18:54.969657 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 239313us
I20260709 13:18:54.977520 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:54.979341 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:54.916260 22836 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:54.925439 22851 consensus_meta.cc:287] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.790s	user 0.010s	sys 0.003s
W20260709 13:18:54.909428 22878 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:18:54.982582 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:54.970916 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:54.927960 22871 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:18:54.939546 22755 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:18:54.915308 22874 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
W20260709 13:18:54.931720 22825 consensus_meta.cc:287] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.805s	user 0.006s	sys 0.006s
I20260709 13:18:54.911044 22786 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:54.928802 22867 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:18:54.922467 22829 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:54.938868 22348 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:55.014772 22829 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:54.916400 22800 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:55.015677 22800 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:55.018112 22800 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:54.932374 22617 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:55.019035 22617 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.020465 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:55.021257 18312 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
I20260709 13:18:55.021310 22617 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:55.024083 22744 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:55.024833 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:55.026011 22801 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:55.026407 22801 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.026757 22801 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:54.909205 22766 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:54.927155 22857 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:54.981017 22673 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:54.985543 22826 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:55.001956 22636 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:55.002488 18229 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:54.927361 18130 catalog_manager.cc:5697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 4 to 10, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 10 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:54.983831 22880 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:54.938243 22852 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:55.032191 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:54.911191 22887 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:54.998854 22888 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:18:55.066412 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 388492us
I20260709 13:18:55.032639 22766 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:55.054314 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.036556 18277 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:55.043823 18201 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:55.045986 18927 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:55.074847 18277 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:54.990676 22851 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.049374 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:54.908902 22740 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:55.047781 22880 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.083936 22880 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:55.087298 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 43541.8us
W20260709 13:18:55.096552 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.098668 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:55.028381 22825 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.101382 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:55.050343 22888 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:55.071146 22829 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.054930 22842 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.104009 18277 leader_election.cc:400] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14.
W20260709 13:18:55.226364 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 122516us
I20260709 13:18:55.227847 18277 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:55.147033 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 49565.8us
I20260709 13:18:55.129281 22888 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:55.163926 18959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82"
dest_uuid: "e016302b7e734d74833a2bf7bab44838"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:39982
I20260709 13:18:55.230268 18959 raft_consensus.cc:606] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:55.093215 22799 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:18:55.152160 22887 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:55.148116 22878 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:55.093509 22800 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:55.087649 22826 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:55.153116 22755 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.160250 22825 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:55.165567 22806 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.096994 22617 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:55.044291 22861 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.066957 22836 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
W20260709 13:18:55.148698 18134 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39284 (request call id 174) took 45109 ms (client timeout 15000 ms). Trace:
I20260709 13:18:55.146242 22636 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.160938 18383 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:55.040022 22348 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:18:55.070614 22898 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:18:55.128048 22673 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:55.146485 22740 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:55.105935 22786 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:55.284407 22852 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:55.284811 22786 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.285493 22786 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.285775 22851 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:55.161581 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 81307.4us
I20260709 13:18:55.230816 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:55.239555 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1818) took 1216 ms. Trace:
I20260709 13:18:55.240113 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:55.291594 18307 rpcz_store.cc:276] 0709 13:18:54.035195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.063885 (+ 28690us) service_pool.cc:224] Handling call
0709 13:18:54.064226 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.960249 (+896023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.239287 (+279038us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b5400350f54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:55.239472 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1950864256}
I20260709 13:18:55.292929 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:55.234476 22415 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.293773 18959 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:55.231817 22904 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:55.295444 22888 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.295960 22904 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.296347 22904 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.146432 22829 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.249903 22723 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:55.252842 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.239921 22813 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:55.262410 18303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef83aa6f9534403ebe38156348430345"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:18:55.303912 18303 raft_consensus.cc:606] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:55.254002 22800 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:55.291958 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 61235.5us
I20260709 13:18:55.229705 18130 catalog_manager.cc:5697] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 4 to 8, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 8 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.309864 22800 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:55.315253 22829 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:55.292312 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 52321.9us
I20260709 13:18:55.319962 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:55.320760 22797 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:55.305625 18277 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:55.322862 22673 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:55.323031 22826 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:55.323720 22673 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:55.328678 22831 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.329217 22831 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.330790 18386 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:55.331305 22831 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:55.332037 18386 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:55.332854 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:55.334132 18378 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.339499 22423 raft_consensus.cc:993] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:18:55.340322 22423 raft_consensus.cc:1081] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:18:55.342146 18234 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:18:55.312134 18130 catalog_manager.cc:5697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 6 to 9, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 9 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:55.343115 18233 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:55.343447 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:55.344092 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:55.344811 18309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "b52e2477fc524694967c4a16afa983e3"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:18:55.345353 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:55.346078 18233 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:55.344913 18130 catalog_manager.cc:5697] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 6 to 9, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 9 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.347211 18237 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:18:55.348271 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:55.349848 18231 pending_rounds.cc:85] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 7
I20260709 13:18:55.350172 18231 pending_rounds.cc:107] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:18:55.350420 18231 raft_consensus.cc:2889] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:55.352128 18230 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:55.355468 18385 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:55.356732 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:55.357163 22673 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.308259 22813 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:55.308924 18236 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:55.309326 22898 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:55.359295 22898 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:55.321273 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:55.300233 22636 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.345376 18309 raft_consensus.cc:606] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Received request to transfer leadership to TS b52e2477fc524694967c4a16afa983e3
W20260709 13:18:55.356750 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 50142.9us
I20260709 13:18:55.366694 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:55.344110 18234 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:18:55.368637 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:55.360680 22898 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.268564 22617 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:55.383745 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 56872.3us
I20260709 13:18:55.374593 18959 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 6.
I20260709 13:18:55.381141 18378 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:55.389266 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:55.385986 18200 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:55.392573 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:55.231413 22842 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.398882 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:55.402077 18309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:18:55.402750 18309 raft_consensus.cc:606] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:55.405895 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:55.391220 22881 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:55.305584 22852 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:55.391336 22617 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.391739 18383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:43098
I20260709 13:18:55.409806 18383 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:55.410218 18383 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:55.273090 18134 rpcz_store.cc:269] 0709 13:18:09.928994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.929256 (+   262us) service_pool.cc:224] Handling call
0709 13:18:55.030143 (+45100887us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:43.187399 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:43.187951 (+   552us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:43.187983 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:18:43.188002 (+    19us) tablet.cc:662] Decoding operations
0709 13:18:43.188823 (+   821us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:43.188905 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:43.188933 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:18:43.189438 (+   505us) tablet.cc:701] Row locks acquired
0709 13:18:43.189456 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:18:43.189590 (+   134us) write_op.cc:270] Start()
0709 13:18:43.189714 (+   124us) write_op.cc:276] Timestamp: P: 1783603123189541 usec, L: 0
0709 13:18:43.189737 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:18:43.268980 (+ 79243us) log.cc:844] Serialized 2500 byte log entry
0709 13:18:43.679181 (+410201us) op_driver.cc:464] REPLICATION: finished
0709 13:18:43.997393 (+318212us) write_op.cc:301] APPLY: starting
0709 13:18:43.997533 (+   140us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:44.025368 (+ 27835us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:44.051426 (+ 26058us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:44.783038 (+731612us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:44.807344 (+ 24306us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:18:44.807400 (+    56us) write_op.cc:312] APPLY: finished
0709 13:18:44.807676 (+   276us) log.cc:844] Serialized 53 byte log entry
0709 13:18:44.842308 (+ 34632us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:44.857548 (+ 15240us) write_op.cc:454] Released schema lock
0709 13:18:44.860712 (+  3164us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:44.932225 (+ 71513us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:44.932265 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":994380,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":298582,"apply.run_cpu_time_us":19820,"apply.run_wall_time_us":915601,"num_ops":6,"prepare.queue_time_us":150355,"prepare.run_cpu_time_us":60454,"prepare.run_wall_time_us":232532,"raft.queue_time_us":99013,"raft.run_cpu_time_us":11756,"raft.run_wall_time_us":245515,"replication_time_us":465994,"thread_start_us":528795,"threads_started":5,"wal-append.queue_time_us":245208,"wal-append.run_cpu_time_us":33683,"wal-append.run_wall_time_us":2156545}]]}
I20260709 13:18:55.416803 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:55.364841 22636 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:55.417908 18383 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:55.419183 18386 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:18:55.420343 18230 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:55.421329 18232 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:55.425006 22602 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:55.425097 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:55.426816 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:55.429652 22891 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.430292 22891 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.431550 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:55.432816 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:55.433436 22723 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:55.433638 22894 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:55.434530 22463 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:55.430159 22852 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:18:55.436488 22891 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:55.440415 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:55.442606 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.443631 18378 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:55.382656 22826 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.452075 18378 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:55.454774 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:55.462440 18384 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:55.463860 18383 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:55.465236 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:55.466058 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:55.467000 18303 raft_consensus.cc:2368] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14.
I20260709 13:18:55.466025 18312 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:55.402601 22631 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:55.469029 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:55.475404 18201 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:55.417912 22905 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:55.468474 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:55.469323 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:55.469691 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:55.475855 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 1970) took 1051 ms. Trace:
I20260709 13:18:55.483314 22894 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:55.483623 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:55.413475 22797 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:55.483771 22894 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.484440 18309 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:55.449357 22799 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:55.482877 18235 rpcz_store.cc:276] 0709 13:18:54.424337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.424489 (+   152us) service_pool.cc:224] Handling call
0709 13:18:54.435195 (+ 10706us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.435542 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:54.535898 (+100356us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.716913 (+181015us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.911963 (+195050us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b18000187c0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181e1b4bc 00007fa17f16948b 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f183455 00007fa18226b060 00007fa18227d716 00007fa18228e287
0709 13:18:54.912069 (+   106us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.932647 (+ 20578us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.932810 (+   163us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:54.933311 (+   501us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.933686 (+   375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.933842 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.475655 (+541813us) raft_consensus.cc:1685] finished
0709 13:18:55.475677 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.475798 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155805,"prepare.queue_time_us":96878,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":120,"raft.queue_time_us":212654,"raft.run_cpu_time_us":539,"raft.run_wall_time_us":75082,"spinlock_wait_cycles":9004800,"thread_start_us":224855,"threads_started":3,"wal-append.queue_time_us":189680}
I20260709 13:18:55.406600 22831 consensus_queue.cc:1059] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:18:55.413010 22348 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:18:55.468719 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:55.515065 18307 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:55.347815 18130 catalog_manager.cc:5697] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 4 to 8, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 8 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.494336 18378 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.513389 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:55.476550 22636 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:55.531741 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:55.495517 22894 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:55.535912 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.475026 22380 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:18:55.541669 18378 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:55.534060 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:55.470659 22826 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.548188 18235 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:55.549139 18307 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:18:55.564193 18378 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:18:55.564792 18378 pending_rounds.cc:85] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 7
I20260709 13:18:55.565142 18378 pending_rounds.cc:107] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:18:55.565486 18378 raft_consensus.cc:2889] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:55.569835 18306 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:18:55.555733 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:55.539593 22636 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.601253 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:55.602569 18378 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:55.619441 18956 raft_consensus.cc:3055] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:55.581149 22907 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:18:55.570542 22836 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:55.574870 22806 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:55.582878 22888 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:55.646778 18956 raft_consensus.cc:740] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:18:55.582144 22454 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
W20260709 13:18:55.709149 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 231298us
I20260709 13:18:55.662528 22836 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:55.667862 22861 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:55.710711 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 242318us
I20260709 13:18:55.739845 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:55.707599 22891 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:55.750372 18386 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
W20260709 13:18:55.757009 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.755050 18201 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:55.762619 18960 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:18:55.743754 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 161984us
I20260709 13:18:55.740906 22797 raft_consensus.cc:697] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:55.755350 22415 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:18:55.761611 22801 consensus_meta.cc:287] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.734s	user 0.006s	sys 0.006s
I20260709 13:18:55.753371 22842 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:55.751670 22786 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:55.817123 22914 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
W20260709 13:18:55.825348 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 56896.8us
I20260709 13:18:55.810379 22415 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.841989 18310 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:18:55.841876 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63711.9us
I20260709 13:18:55.799403 22890 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:18:55.809320 22813 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:55.838721 22800 consensus_meta.cc:287] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.525s	user 0.004s	sys 0.007s
I20260709 13:18:55.850867 18276 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:55.798424 22926 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:18:55.847029 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.855358 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:55.818352 22801 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.838356 22826 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:55.807926 22836 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:55.891201 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:55.891656 22836 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:55.893729 22786 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:55.894872 22880 consensus_meta.cc:287] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.810s	user 0.006s	sys 0.003s
I20260709 13:18:55.843780 22415 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:55.895350 22880 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:55.915864 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:55.765727 18130 catalog_manager.cc:5697] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:55.901305 22914 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:55.918435 18234 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:55.940503 22905 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.912135 22930 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
W20260709 13:18:56.002830 22740 consensus_meta.cc:287] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.722s	user 0.009s	sys 0.003s
I20260709 13:18:56.041158 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:55.961766 22766 consensus_meta.cc:287] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.862s	user 0.011s	sys 0.003s
I20260709 13:18:55.889989 22636 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:55.875607 22800 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:55.966228 22919 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.302s	user 0.002s	sys 0.000s
I20260709 13:18:55.900429 22799 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:55.979754 22929 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:18:55.916316 22826 consensus_queue.cc:1059] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:18:55.980598 22917 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:18:55.982074 22880 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:55.994445 22933 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.001215 22915 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:55.911741 22926 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:55.953429 22924 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.169s
W20260709 13:18:55.982810 22913 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 13:18:56.077159 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:56.078903 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:55.955681 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 125711us
W20260709 13:18:56.079216 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.978124 22673 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:18:55.990589 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.038651 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:56.037667 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:55.994237 22934 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:18:56.039449 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:56.086691 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:56.089120 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:56.089702 18383 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:56.043794 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:56.043992 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:56.047931 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:56.055437 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:56.059391 18959 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:56.043529 22905 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:56.061441 22933 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:56.063807 22921 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:18:55.873637 22797 consensus_queue.cc:237] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:55.951733 18235 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:56.083503 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:56.121078 18307 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:56.069036 18130 catalog_manager.cc:5697] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 8 to 10, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 10 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:56.132424 18130 catalog_manager.cc:5697] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 8 to 9, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 9 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:56.134385 18130 catalog_manager.cc:5697] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 8 to 10, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 10 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:56.070060 22918 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.250s	user 0.000s	sys 0.003s
I20260709 13:18:56.141677 18307 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:18:56.146106 18383 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:56.048851 22766 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:55.954262 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 103501us
I20260709 13:18:56.092418 18386 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:56.149052 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:56.092370 18303 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:18:56.149734 18307 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:56.060707 22801 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:56.081840 18310 raft_consensus.cc:2376] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15. Re-sending same reply.
I20260709 13:18:56.100780 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:56.073071 22740 raft_consensus.cc:3055] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:18:56.128721 22928 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:18:56.072582 22915 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.121505 22888 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:56.169191 22888 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.169843 22933 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:56.129674 22926 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.171466 22888 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:56.172727 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:56.130213 18351 connection.cc:256] RPC call timeout handler was delayed by -1.0002004499999657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
I20260709 13:18:56.173993 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:56.175235 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:56.175621 22800 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:56.176355 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:56.130627 22903 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:56.177397 22415 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.177481 22903 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.178220 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:56.149165 22861 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:56.179029 18235 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 12: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:18:56.180732 18379 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:56.181955 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:56.183193 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:56.184092 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:56.162667 18307 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:56.163607 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:56.187577 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:56.190851 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:56.193758 18310 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:56.195804 18202 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:56.196980 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:56.242614 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:56.269375 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:56.163575 22740 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:18:56.276468 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 79547.5us
W20260709 13:18:56.276036 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 62388us
W20260709 13:18:56.281226 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 96480.1us
I20260709 13:18:56.283257 18202 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:56.194808 22904 consensus_meta.cc:287] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.898s	user 0.006s	sys 0.006s
I20260709 13:18:56.291826 18202 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:56.292869 22890 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:56.293188 18960 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:56.188948 22888 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:56.307895 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.165402 22673 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:18:56.179045 22861 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.186275 22801 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:56.167176 22899 consensus_queue.cc:1059] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 13:18:56.252091 22755 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:56.252831 22799 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:56.278684 22935 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:56.188779 22806 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:56.280088 22800 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:18:56.327376 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 207117us
I20260709 13:18:56.270517 22636 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:18:56.248832 22941 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 13:18:56.318881 22926 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:56.313067 22888 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:18:56.344623 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 168331us
I20260709 13:18:56.287029 22610 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 13:18:56.329128 22617 consensus_meta.cc:287] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.920s	user 0.010s	sys 0.002s
I20260709 13:18:56.299377 22904 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.377333 18231 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:56.340956 22415 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:56.308879 22813 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:18:56.340292 22903 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:56.341085 22940 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:56.374138 22888 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:56.377976 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:56.399163 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 191143us
I20260709 13:18:56.363246 22905 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:56.406005 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:56.408885 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:56.409664 18386 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:56.363325 22766 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:56.375262 22898 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.412988 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:56.375844 22948 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:56.388006 22826 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.418692 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:56.432839 22951 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:56.433662 22951 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:56.435824 22861 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:56.426728 18381 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:56.278615 18130 catalog_manager.cc:5697] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 3 to 7, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 7 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:56.374068 22800 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:56.423188 18956 consensus_queue.cc:260] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:56.379567 22617 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.443146 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:18:56.453449 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 146954us
I20260709 13:18:56.459126 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:56.460489 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:56.461347 18234 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:18:56.461655 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:56.377079 22740 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.463778 22740 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:56.464481 22904 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:56.467288 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:56.467898 18384 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:56.405984 22903 consensus_queue.cc:1059] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:18:56.484805 18229 raft_consensus.cc:2368] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11.
I20260709 13:18:56.487857 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:56.492782 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:56.493373 18237 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:56.490517 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 47472.8us
I20260709 13:18:56.501636 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:56.437929 22898 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:56.444602 22826 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.473349 22948 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:56.508961 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.482858 18956 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:56.446100 22940 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:18:56.517930 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:56.491757 22915 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:56.522533 18305 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:56.504109 22813 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:56.528458 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:56.535522 22766 consensus_queue.cc:1059] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:18:56.537290 22947 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:18:56.540122 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.545125 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:56.548939 22948 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:56.541700 22915 raft_consensus.cc:2764] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:18:56.546521 22766 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:56.520983 22960 raft_consensus.cc:3055] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:56.550108 22766 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:56.550244 22960 raft_consensus.cc:740] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:56.551833 18351 leader_election.cc:400] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9.
I20260709 13:18:56.551311 22766 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.552295 18351 leader_election.cc:403] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:56.554877 22915 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9.
I20260709 13:18:56.557093 22766 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:56.551348 22960 consensus_queue.cc:260] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:56.561299 22960 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:56.568409 22800 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:56.560400 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.569432 22831 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:56.578770 22831 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:56.574433 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:56.574767 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:56.584129 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:56.589675 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 1759) took 1270 ms. Trace:
I20260709 13:18:56.590205 18229 rpcz_store.cc:276] 0709 13:18:55.319516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.319679 (+   163us) service_pool.cc:224] Handling call
0709 13:18:56.580458 (+1260779us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540001ccd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:56.589614 (+  9156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2676648192}
I20260709 13:18:56.597425 18231 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:56.604352 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:56.605046 18377 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:56.605542 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.613009 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:56.563854 22894 consensus_meta.cc:287] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.017s	user 0.010s	sys 0.003s
I20260709 13:18:56.624576 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:56.574847 22617 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:56.582259 22813 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:56.631366 18377 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:56.568488 22888 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.635336 18351 leader_election.cc:400] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14.
I20260709 13:18:56.638083 18351 leader_election.cc:403] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:18:56.644963 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:56.648384 18201 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:56.659899 18384 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:56.569442 18130 catalog_manager.cc:5697] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 10 to 12, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 12 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:56.629110 22825 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:18:56.647814 22836 consensus_meta.cc:287] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.756s	user 0.006s	sys 0.007s
I20260709 13:18:56.618288 22894 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.643442 22861 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14.
W20260709 13:18:56.694072 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 45746.6us
I20260709 13:18:56.685281 18309 raft_consensus.cc:2410] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:18:56.682153 22813 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:56.700949 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.642645 22940 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:18:56.711338 22940 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:56.711902 22940 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:56.693711 22951 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:56.713400 22951 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:56.714625 22951 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:56.716408 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 71577.8us
W20260709 13:18:56.722016 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.723016 18229 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:56.636808 22948 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:18:56.724304 18228 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:56.727087 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:56.730049 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:56.740697 22940 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.742355 22940 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:56.717689 22853 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:56.758587 18229 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:56.759900 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:56.765340 22936 raft_consensus.cc:3055] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:56.765724 22936 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:56.766363 22936 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.767302 22936 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:56.770738 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:56.775825 18377 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:56.776320 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:56.777205 18384 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:56.775767 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:56.778373 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:56.787667 22800 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:56.787997 22950 log.cc:927] Time spent T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.366s	user 0.004s	sys 0.000s
I20260709 13:18:56.788316 22800 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:56.797001 22800 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:56.797935 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.803058 18384 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:56.804720 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:56.808355 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:56.808981 18229 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:18:56.810956 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:56.811040 18201 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:56.820711 22888 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:56.821532 22930 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:56.822252 18956 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:56.822091 22930 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:56.822844 18956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53364 (request call id 319) took 1343 ms (client timeout 1515 ms). Trace:
W20260709 13:18:56.823231 18956 rpcz_store.cc:269] 0709 13:18:55.478991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.494231 (+ 15240us) service_pool.cc:224] Handling call
0709 13:18:56.422790 (+928559us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b540047d220. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821f106f 00007fa182269f60 00007fa18226b7de 00007fa18227727c 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2
0709 13:18:56.822773 (+399983us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12999424}
I20260709 13:18:56.772220 22853 raft_consensus.cc:697] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:56.825637 22836 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:56.825461 22853 consensus_queue.cc:237] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.826184 22836 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:56.828200 22836 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:56.820832 22962 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:56.828668 22740 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:56.828876 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:56.830410 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.807168 22602 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:18:56.841320 22932 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:56.848321 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:56.777534 22976 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:56.824278 22930 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:56.845489 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:56.849359 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:56.846051 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:56.848613 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:56.850322 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:56.850862 18237 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:56.851078 18304 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:56.816727 22926 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:56.853365 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:56.858294 18310 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:18:56.858985 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:56.859579 18303 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:56.855978 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:56.857082 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:56.860729 18228 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:18:56.873287 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:56.928063 22894 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:56.818154 18130 catalog_manager.cc:5697] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:56.843549 22740 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:56.828886 22962 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.858006 22932 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:56.943593 22975 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:18:56.916043 22923 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:56.956954 22888 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.961460 18304 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:56.963272 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1850) took 1494 ms. Trace:
I20260709 13:18:56.960342 22852 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:56.957801 22415 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:56.965238 22831 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:56.860116 22976 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:56.966163 18383 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:56.966893 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:56.968284 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2406) took 1639 ms. Trace:
W20260709 13:18:56.971688 22945 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.594s	user 0.002s	sys 0.000s
I20260709 13:18:57.049351 22888 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:57.057490 22881 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.975226 22898 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:57.057999 22881 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:57.051244 18379 rpcz_store.cc:276] 0709 13:18:55.329132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.334414 (+  5282us) service_pool.cc:224] Handling call
0709 13:18:55.334695 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.181138 (+846443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.968055 (+786917us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b5400074c54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:18:56.968227 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1945258880}
I20260709 13:18:56.979314 22826 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:57.050529 22793 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.060112 22881 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:57.001655 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 119676us
I20260709 13:18:57.007683 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:18:57.033457 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63691.7us
I20260709 13:18:57.034008 18306 rpcz_store.cc:276] 0709 13:18:55.469220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.469466 (+   246us) service_pool.cc:224] Handling call
0709 13:18:56.963072 (+1493606us) spinlock_profiling.cc:243] Waited 86.8 ms on lock 0x7b54002238d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:56.963214 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199629568}
I20260709 13:18:57.059404 22888 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:57.060330 22793 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:57.050685 18383 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:57.053614 22948 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:18:57.055961 22415 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:57.086663 22861 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:57.087152 22861 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:57.058001 22825 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:18:57.092293 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:57.093253 18229 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
W20260709 13:18:57.093914 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.062244 22740 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:57.096388 22415 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:57.063936 22923 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:18:57.105383 22923 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.040472 18312 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:57.073180 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:57.107506 18306 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:56.833981 22673 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:57.075618 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2487) took 1033 ms. Trace:
I20260709 13:18:57.071975 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:57.054265 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:57.110503 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 56322.6us
I20260709 13:18:57.081218 18304 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:18:57.111297 18304 pending_rounds.cc:85] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 10
I20260709 13:18:57.111632 18304 pending_rounds.cc:107] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:18:57.111907 18304 raft_consensus.cc:2889] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:57.083101 18309 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:57.084213 22793 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:57.116364 22888 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:18:57.116691 22980 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:18:57.068832 22852 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.114981 22880 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:57.063611 22962 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:57.125638 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:57.155661 18351 leader_election.cc:400] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11.
I20260709 13:18:57.155978 18351 leader_election.cc:403] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:18:57.108387 18311 rpcz_store.cc:276] 0709 13:18:56.046998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.047112 (+   114us) service_pool.cc:224] Handling call
0709 13:18:56.056706 (+  9594us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:56.061082 (+  4376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.061118 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:56.109860 (+ 48742us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.210182 (+100322us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:56.388203 (+178021us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.388446 (+   243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.388545 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.536117 (+147572us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b18003da500. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:18:56.970940 (+434823us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:18:57.075433 (+104493us) raft_consensus.cc:1685] finished
0709 13:18:57.075452 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.075562 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7952,"prepare.queue_time_us":193773,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":34392,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":13221,"spinlock_wait_cycles":162933376,"thread_start_us":162179,"threads_started":2,"wal-append.queue_time_us":172622}
I20260709 13:18:57.157473 18311 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:57.133649 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:57.066311 18130 catalog_manager.cc:5697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:57.122318 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:57.169931 18229 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:57.191768 18304 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
W20260709 13:18:57.180826 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 108969us
I20260709 13:18:57.180397 18953 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:57.201484 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:57.088115 22861 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.211869 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:57.213027 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 1989) took 1036 ms. Trace:
I20260709 13:18:57.213404 18231 rpcz_store.cc:276] 0709 13:18:56.177035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.179972 (+  2937us) service_pool.cc:224] Handling call
0709 13:18:57.212825 (+1032853us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b540001b8d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:57.212962 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434951936}
I20260709 13:18:57.207103 18276 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:57.168748 22948 raft_consensus.cc:2764] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:18:57.180553 22786 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:57.150408 22880 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:57.181097 22836 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:57.149688 22888 consensus_queue.cc:1059] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:18:57.182577 22887 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11.
W20260709 13:18:57.217228 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 79401.9us
I20260709 13:18:57.198601 22740 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:57.184197 22932 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:57.216338 22826 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:57.231586 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:57.226804 18383 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.182391 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:57.215863 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:57.253705 22983 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:18:57.256901 22880 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.271862 22880 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:57.272631 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:57.275767 22888 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:57.279057 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:57.236421 22836 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:57.238550 22766 consensus_meta.cc:287] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.005s
I20260709 13:18:57.240486 18231 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:57.289901 22602 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.290372 22602 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.228052 18276 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:57.286618 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:57.263247 22976 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:57.219296 22934 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:18:57.296866 22976 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:57.260428 22415 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
W20260709 13:18:57.265055 22940 consensus_meta.cc:287] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.003s
I20260709 13:18:57.303906 18310 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:57.306181 22826 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:57.261284 18130 catalog_manager.cc:5697] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 5 to 10, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 10 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:57.219846 18303 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:57.221542 22979 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:18:57.270660 18229 raft_consensus.cc:2368] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11.
I20260709 13:18:57.237103 22786 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:57.323413 18380 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:18:57.323797 18380 pending_rounds.cc:85] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 8
I20260709 13:18:57.324007 18380 pending_rounds.cc:107] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:18:57.324239 18380 raft_consensus.cc:2889] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:57.326144 18306 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:18:57.327014 18307 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:57.288111 22836 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:57.330154 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.226356 22799 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:57.282171 18308 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:57.221585 22915 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:57.293853 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 65874.9us
I20260709 13:18:57.250306 22740 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:57.270159 22948 raft_consensus.cc:3055] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:57.313426 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:57.129179 22673 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.315276 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:57.313508 22842 raft_consensus.cc:2764] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:18:57.349403 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:57.352033 18276 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:57.329785 22786 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:57.286899 22951 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:57.286806 22852 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:57.358685 18233 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:57.353394 22976 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:57.293577 22602 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:57.347335 18351 leader_election.cc:400] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11.
I20260709 13:18:57.331712 22380 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:57.365708 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 383397us
I20260709 13:18:57.367314 18276 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:57.350980 22915 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:57.375962 18351 leader_election.cc:403] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:18:57.323179 22940 consensus_queue.cc:1059] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:18:57.381582 18276 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:57.358108 22948 raft_consensus.cc:740] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:57.357417 22766 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:57.385977 18276 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:57.441130 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 55240.7us
I20260709 13:18:57.366117 22826 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:57.383649 22915 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:57.379675 22976 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:57.443002 18276 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:57.358263 22799 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:57.390548 22880 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:57.466250 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 119414us
W20260709 13:18:57.460173 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 236626us
W20260709 13:18:57.439774 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 50852.5us
I20260709 13:18:57.461534 22852 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:57.468400 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:57.474299 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:57.475183 18953 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:57.445948 22912 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:57.516116 22799 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:57.516821 22673 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:57.512996 22936 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:57.452654 22786 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:57.384300 22380 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.469910 22951 raft_consensus.cc:3055] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:57.531962 22930 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:18:57.535310 22912 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.535874 22912 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:57.538220 22861 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:57.517391 22852 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.540163 22912 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:57.540932 22912 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.541498 22912 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.544592 22962 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:57.545487 22962 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:57.545822 22962 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:57.546625 22962 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.547755 22962 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:57.549003 22930 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:57.549587 22930 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:57.526309 22887 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:57.550663 22930 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.551749 22887 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.516681 18130 catalog_manager.cc:5697] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 5 to 12, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 12 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:57.554313 18130 catalog_manager.cc:5697] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:57.552251 22930 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:57.560262 22880 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:57.544157 22912 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:57.477569 22979 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.525182 18233 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:18:57.522742 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54586.4us
I20260709 13:18:57.560917 22880 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.432945 22636 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:57.583597 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:57.555655 18130 catalog_manager.cc:5697] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 7 to 8, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 8 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:57.529449 22940 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:57.563184 22951 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:57.563422 22936 raft_consensus.cc:697] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:57.602391 18277 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:57.528710 22888 consensus_queue.cc:1059] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:18:57.459424 22766 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:57.590720 22940 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:57.641650 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:57.588012 22960 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:18:57.657027 22740 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:57.656937 22951 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.658704 22951 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:57.623224 22852 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:57.649344 22988 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:18:57.594530 22934 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 13:18:57.685086 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 43567.4us
I20260709 13:18:57.687450 18200 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:57.649590 22826 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:57.654841 22940 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.655253 22960 consensus_queue.cc:1243] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:57.683737 22831 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:57.707136 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:18:57.761209 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54142.3us
I20260709 13:18:57.624570 22976 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.693614 22995 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:57.778558 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:57.779393 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:57.785826 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:57.775852 22936 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.786402 18232 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:18:57.787209 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:57.787904 18232 raft_consensus.cc:2410] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:18:57.760529 22673 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:57.791611 18230 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:57.703712 22826 raft_consensus.cc:697] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:18:57.795001 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 321480us
I20260709 13:18:57.795861 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:57.801688 18236 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:57.797284 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:57.805168 18234 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.007s	sys 0.031s
I20260709 13:18:57.789186 22673 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:57.806348 18234 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.007s	sys 0.031s
I20260709 13:18:57.793910 22995 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:18:57.861784 22992 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:18:57.862879 22976 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:57.866207 22957 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:58.004951 22957 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:57.868594 18130 catalog_manager.cc:5697] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 7 to 9, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 9 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:57.781234 22636 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:58.008742 22636 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:58.009229 22636 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.873088 22380 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:57.879525 22887 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:57.782102 22991 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:18:57.800128 18927 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:18:58.015245 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 215308us
I20260709 13:18:58.016091 22989 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:58.016834 22989 raft_consensus.cc:697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:18:57.882408 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 359195us
I20260709 13:18:58.017616 18953 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:58.017619 22989 consensus_queue.cc:237] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:58.020781 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2510) took 1529 ms. Trace:
W20260709 13:18:57.904973 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.021240 18312 rpcz_store.cc:276] 0709 13:18:56.491643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.130973 (+639330us) service_pool.cc:224] Handling call
0709 13:18:57.131464 (+   491us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:57.217127 (+ 85663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.217160 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:57.225830 (+  8670us) log.cc:844] Serialized 52 byte log entry
0709 13:18:57.669538 (+443708us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:57.669586 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.680559 (+ 10973us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.020527 (+339968us) raft_consensus.cc:1685] finished
0709 13:18:58.020554 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.020715 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87438,"raft.queue_time_us":85759,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":5375,"thread_start_us":392497,"threads_started":1,"wal-append.queue_time_us":769671}
I20260709 13:18:58.024950 18379 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:57.997382 22766 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:57.998288 22880 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.034255 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:58.162989 18228 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.028s	sys 0.072s
I20260709 13:18:58.170805 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:58.169258 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.170150 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:58.170845 18228 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.028s	sys 0.072s
I20260709 13:18:58.187572 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2004) took 1265 ms. Trace:
W20260709 13:18:58.188234 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.192462 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:58.193815 18237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.031s	sys 0.077s
W20260709 13:18:58.194360 18237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.031s	sys 0.077s
I20260709 13:18:58.171927 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:58.196821 18378 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:58.187929 18228 rpcz_store.cc:276] 0709 13:18:56.922621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.961455 (+ 38834us) service_pool.cc:224] Handling call
0709 13:18:56.961950 (+   495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:56.999203 (+ 37253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.999256 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.007838 (+  8582us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.331149 (+323311us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:58.187008 (+855859us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.187260 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.187339 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.187381 (+    42us) raft_consensus.cc:1685] finished
0709 13:18:58.187392 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.187516 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56931,"prepare.queue_time_us":412816,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":10490,"raft.queue_time_us":42792,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":14729,"thread_start_us":1098455,"threads_started":2,"wal-append.queue_time_us":591468}
I20260709 13:18:58.199348 18380 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:18:58.200178 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:58.201776 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:58.204595 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:57.885743 22934 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.171986 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:58.207612 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:58.217152 18960 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 7: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:58.215835 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:58.208902 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:58.219944 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:58.221463 22958 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.221944 22958 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.215585 22960 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:58.223279 22960 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.225217 22960 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:58.225845 22960 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.226248 22960 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:58.227764 22979 consensus_meta.cc:287] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.000s
I20260709 13:18:58.228048 22960 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:58.228188 22979 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11.
W20260709 13:18:58.170923 18954 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.018s	sys 0.055s
I20260709 13:18:57.887259 22995 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.234850 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:58.241070 18379 raft_consensus.cc:2410] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:18:58.237022 22960 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:58.007916 18130 catalog_manager.cc:5697] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:18:58.238003 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:58.207777 22887 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.245129 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:58.242154 18349 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:58.247951 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:58.252614 18385 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:18:58.247184 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:58.253530 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:58.248065 18959 raft_consensus.cc:2376] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7. Re-sending same reply.
I20260709 13:18:58.256449 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:18:58.215607 22617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.035s	sys 0.083s
W20260709 13:18:58.238878 18954 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.019s	sys 0.056s
I20260709 13:18:58.257146 18927 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:58.235534 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:58.240296 22923 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.262741 18349 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:18:58.260185 22617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.036s	sys 0.083s
I20260709 13:18:58.278699 18927 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:58.250111 22852 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:58.279707 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:58.281388 22800 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:58.285529 22800 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:58.285960 22800 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:58.286404 22800 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.241766 22934 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.312008 18383 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.313139 22948 consensus_queue.cc:260] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:58.314495 22948 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:58.315744 22934 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.250486 22960 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.316754 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2502) took 2147 ms. Trace:
I20260709 13:18:58.317219 18305 rpcz_store.cc:276] 0709 13:18:56.169352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.589781 (+420429us) service_pool.cc:224] Handling call
0709 13:18:56.964398 (+374617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.066127 (+101729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.066163 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.066662 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.444372 (+377710us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:57.444435 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.455233 (+ 10798us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.219079 (+763846us) raft_consensus.cc:1685] finished
0709 13:18:58.219109 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.316429 (+ 97320us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54002238d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:58.316688 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":198058,"raft.queue_time_us":102237,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":9049,"spinlock_wait_cycles":796829952,"thread_start_us":377226,"threads_started":1,"wal-append.queue_time_us":551024}
I20260709 13:18:58.318590 18384 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:58.261955 22673 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.346318 22960 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:58.245311 22826 consensus_queue.cc:237] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.355111 22958 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:58.356340 22610 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:58.356931 22806 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:58.357422 22806 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.358486 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:58.359344 22806 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.360088 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:58.356954 22610 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:58.361965 22894 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:58.361510 18233 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:18:58.363518 18386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2655) took 1090 ms. Trace:
I20260709 13:18:58.364741 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:58.364617 18927 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:58.363940 18386 rpcz_store.cc:276] 0709 13:18:57.272751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.273724 (+   973us) service_pool.cc:224] Handling call
0709 13:18:57.274020 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.276640 (+  2620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.276671 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.277140 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.694804 (+417664us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:57.694869 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.696484 (+  1615us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.363289 (+666805us) raft_consensus.cc:1685] finished
0709 13:18:58.363313 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.363456 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2249,"raft.queue_time_us":3434,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":417202,"threads_started":1,"wal-append.queue_time_us":978367}
I20260709 13:18:58.366117 18228 pending_rounds.cc:85] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 5
I20260709 13:18:58.383389 18228 pending_rounds.cc:107] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:18:58.383697 18228 raft_consensus.cc:2889] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:58.384207 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.282375 22937 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.399097 22937 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.402434 22937 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.405229 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:58.392350 18383 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:18:58.260461 22887 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:58.396893 22930 consensus_meta.cc:287] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.839s	user 0.004s	sys 0.008s
I20260709 13:18:58.398083 23004 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.360373 22806 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:58.410063 18383 pending_rounds.cc:85] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 5
I20260709 13:18:58.413712 18383 pending_rounds.cc:107] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:18:58.320955 23005 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:58.414106 18383 raft_consensus.cc:2889] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:58.360150 22962 consensus_meta.cc:287] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.812s	user 0.009s	sys 0.000s
I20260709 13:18:58.415410 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2422) took 1921 ms. Trace:
W20260709 13:18:58.391444 22836 consensus_meta.cc:287] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 1.061s	user 0.004s	sys 0.009s
I20260709 13:18:58.416989 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:58.417761 18305 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:18:58.270149 22923 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.416087 18383 rpcz_store.cc:276] 0709 13:18:56.493779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.496783 (+  3004us) service_pool.cc:224] Handling call
0709 13:18:56.497132 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.966051 (+468919us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b540026faa0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821eadc0 00007fa1822751c0 00007fa182276231 00007fa182272d8f 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c
0709 13:18:57.214829 (+248778us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b540026faa0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821f106f 00007fa182269f60 00007fa18226b7de 00007fa182275b49 00007fa182276416 00007fa182272d8f 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62
0709 13:18:58.308737 (+1093908us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b58004c49d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821cf0aa 00007fa182251447 00007fa182269fe7 00007fa18226b7de 00007fa182275b49 00007fa182276416 00007fa182272d8f 00007fa18227283e 00007fa187237419 00007fa1807aebd4
0709 13:18:58.414769 (+106032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.415326 (+   557us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2216818304}
I20260709 13:18:58.391347 22880 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:58.391619 22831 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:58.408079 22673 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:58.360497 22636 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:58.419536 23005 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:58.424047 22903 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:18:58.422583 23004 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:58.415319 22800 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:58.440586 22957 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.457605 18308 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:58.425446 22836 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.423851 22806 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.442054 23005 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:58.439814 22831 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.436546 22880 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.441689 22673 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.471692 22610 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:58.477480 22636 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:58.479130 22836 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.480476 22923 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.483181 22880 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.489452 22673 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.492805 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1783) took 1261 ms. Trace:
I20260709 13:18:58.493188 18237 rpcz_store.cc:276] 0709 13:18:57.231595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.232420 (+   825us) service_pool.cc:224] Handling call
0709 13:18:57.232933 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.246891 (+ 13958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.246928 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:57.247577 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.541626 (+294049us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b48001bc3d8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18719caa1 00007fa187193b37 00007fa1871939ca 00007fa18728b26f 00007fa18728af37 00007fa18729f55c 00007fa18729f508 00007fa18729f488 00007fa18729f443 00007fa18729e6ec 00007fa1861c8a96
0709 13:18:58.194879 (+653253us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:58.248900 (+ 54021us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.249190 (+   290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.249527 (+   337us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.302879 (+ 53352us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b18000361c0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:18:58.492594 (+189715us) raft_consensus.cc:1685] finished
0709 13:18:58.492615 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.492748 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57500,"prepare.queue_time_us":52349,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":44,"raft.queue_time_us":15216,"raft.run_cpu_time_us":1938,"raft.run_wall_time_us":290018,"spinlock_wait_cycles":54153856,"thread_start_us":932409,"threads_started":1,"wal-append.queue_time_us":1121298}
W20260709 13:18:58.496212 22951 consensus_meta.cc:287] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.837s	user 0.007s	sys 0.002s
I20260709 13:18:58.559477 23004 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:18:58.563766 18382 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:18:58.564319 18382 pending_rounds.cc:85] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 7
I20260709 13:18:58.564627 18382 pending_rounds.cc:107] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:18:58.564936 18382 raft_consensus.cc:2889] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:58.566334 22940 consensus_meta.cc:287] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.860s	user 0.010s	sys 0.002s
W20260709 13:18:58.583029 18958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.008s	sys 0.021s
I20260709 13:18:58.563462 22995 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:58.583699 18958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.008s	sys 0.022s
W20260709 13:18:58.591506 18232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.013s	sys 0.033s
W20260709 13:18:58.598587 18232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.013s	sys 0.033s
W20260709 13:18:58.589625 18276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.014s	sys 0.017s
W20260709 13:18:58.599128 18276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.014s	sys 0.017s
W20260709 13:18:58.605298 18277 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.007s	sys 0.022s
I20260709 13:18:58.606367 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:58.606899 18277 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.008s	sys 0.022s
I20260709 13:18:58.576436 22940 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.614971 18312 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:58.616259 18229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.029s	sys 0.043s
W20260709 13:18:58.618350 18229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.030s	sys 0.043s
I20260709 13:18:58.600612 22800 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.633723 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:58.634497 18310 raft_consensus.cc:2368] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12.
I20260709 13:18:58.632462 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:58.614964 22673 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:58.635087 18308 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:58.651960 18306 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 7.
I20260709 13:18:58.650715 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:18:58.663712 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:58.664688 18276 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:58.650480 22931 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.018s	sys 0.021s
I20260709 13:18:58.666725 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:58.618259 22887 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:58.675974 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:58.630360 22880 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.686444 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:58.651064 22836 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:58.686740 18386 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:18:58.670944 22931 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.018s	sys 0.021s
I20260709 13:18:58.658509 22962 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.705054 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:58.707512 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:58.716895 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:58.717505 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:58.717685 18386 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:18:58.718312 18312 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:18:58.711709 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:58.718677 18378 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:58.712421 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:58.689805 18275 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:58.713822 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:58.711423 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:58.720494 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:58.723624 18383 raft_consensus.cc:2410] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:18:58.718776 18379 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.726045 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1784) took 1494 ms. Trace:
I20260709 13:18:58.729172 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:58.730072 18304 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:18:58.669798 22842 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:58.685948 22976 consensus_meta.cc:287] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.646s	user 0.007s	sys 0.004s
I20260709 13:18:58.731923 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:58.681269 22806 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.738629 22842 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:58.739089 22842 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.737339 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:58.739406 22842 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:58.739648 22931 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:58.741415 22931 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:58.743857 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:58.744329 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:58.744918 18310 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:58.745684 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:58.746488 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:58.747040 18308 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:58.747943 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:58.679721 22948 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:58.748525 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:58.749369 18235 raft_consensus.cc:2410] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:18:58.750356 22940 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:58.748914 22948 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:58.689241 22887 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.752228 22887 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.753135 22948 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:58.756933 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:58.758464 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:58.759047 18229 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:58.759243 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:58.748554 18312 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:18:58.767127 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:58.770851 18350 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.024s	sys 0.040s
W20260709 13:18:58.772594 18350 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.024s	sys 0.040s
I20260709 13:18:58.687077 23017 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:58.662223 22673 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.696142 22831 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.798693 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:58.801050 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:58.726538 18234 rpcz_store.cc:276] 0709 13:18:57.231939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.233322 (+  1383us) service_pool.cc:224] Handling call
0709 13:18:57.233683 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.233982 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:57.881252 (+647270us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.386338 (+505086us) log.cc:844] Serialized 14 byte log entry
0709 13:18:58.495880 (+109542us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b1800263440. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:18:58.725369 (+229489us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b1800263440. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa18226b060 00007fa18227d716 00007fa18228e287 00007fa18228e208
0709 13:18:58.725621 (+   252us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:58.725683 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:58.725746 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.725836 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.725973 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15835,"prepare.queue_time_us":478905,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":69,"raft.queue_time_us":15514,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":8068,"spinlock_wait_cycles":64909056,"thread_start_us":1138084,"threads_started":2,"wal-append.queue_time_us":768605}
I20260709 13:18:58.802587 18307 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:18:58.802019 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:58.802969 18307 pending_rounds.cc:85] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 5
I20260709 13:18:58.803002 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:58.803345 18235 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.803411 18307 pending_rounds.cc:107] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:18:58.804982 18307 raft_consensus.cc:2889] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:58.771631 22915 consensus_meta.cc:287] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 1.291s	user 0.003s	sys 0.011s
W20260709 13:18:58.778283 22936 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.012s	sys 0.020s
I20260709 13:18:58.811306 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:58.741972 22931 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.819130 18229 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:18:58.831290 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:58.832144 18383 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:18:58.808480 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:58.715004 22880 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.798663 22948 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.819810 18202 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:58.825587 18379 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:58.737876 22962 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.830485 22610 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.806469 23017 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:58.840327 23002 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.500s	user 0.002s	sys 0.003s
I20260709 13:18:58.806977 22861 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:58.811802 22797 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:18:58.800810 22976 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:58.781080 22887 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:58.840022 22610 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.807461 22806 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:58.811673 22831 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:58.801867 22617 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:58.843073 18309 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:58.830224 22923 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:58.844388 22957 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:58.818840 22905 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:58.871116 18306 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:58.818421 22915 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.826722 22793 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:58.801090 22934 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:18:58.826047 22415 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:58.724689 22836 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:58.885043 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 479631us
I20260709 13:18:58.947811 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:58.903154 22995 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:58.907199 22989 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.016s	sys 0.008s
I20260709 13:18:58.841667 23017 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:58.893836 18235 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
W20260709 13:18:58.861438 22826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.011s	sys 0.012s
I20260709 13:18:58.779075 22636 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 13:18:58.912806 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 212370us
W20260709 13:18:58.991590 18276 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.131:44265 timed out after 1.682s (SENT) [suppressed 14 similar messages]
W20260709 13:18:58.874984 18351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.015s	sys 0.024s
I20260709 13:18:58.877178 23007 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.876765 22951 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:58.843485 22948 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.903192 22786 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:58.945495 18925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.004s	sys 0.018s
W20260709 13:18:58.945784 23010 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:18:58.946559 23012 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:18:58.887290 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 78951.8us
I20260709 13:18:59.023851 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:58.869412 22861 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.962072 22836 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.927007 22617 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.965579 22673 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.966890 22880 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.968349 22915 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:58.972481 22962 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.973587 22931 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:58.975782 18954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54004 (request call id 406) took 1662 ms. Trace:
I20260709 13:18:58.976205 18956 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:58.934206 23014 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:18:58.885842 22976 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:58.950491 22415 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:58.878405 22797 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:58.992627 18351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.016s	sys 0.024s
W20260709 13:18:59.050148 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.050609 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.998958 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.001123 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:58.942124 22964 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.000s	sys 0.029s
I20260709 13:18:59.008045 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:58.928653 22852 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:18:59.011544 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:58.906806 22806 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:58.987417 22826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.012s	sys 0.013s
I20260709 13:18:58.978130 22881 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:58.982638 22989 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.017s	sys 0.008s
I20260709 13:18:59.082129 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:59.019097 18925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.005s	sys 0.018s
I20260709 13:18:59.021766 18380 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:58.929461 22923 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:59.027377 18277 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:59.028614 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 338971us
I20260709 13:18:59.090535 18275 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:58.933908 22905 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.030143 18385 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:59.018942 22995 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.057962 18382 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:18:59.058738 18379 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:18:59.052038 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:59.092639 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:59.096585 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 69327.1us
I20260709 13:18:59.103808 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:59.092283 18275 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:59.098690 18958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54020 (request call id 362) took 1082 ms. Trace:
W20260709 13:18:59.105213 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 260564us
I20260709 13:18:59.019506 22951 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:59.086249 22964 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.001s	sys 0.031s
W20260709 13:18:59.107028 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 159291us
I20260709 13:18:59.047804 23016 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:59.118566 18275 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:59.015795 23007 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:59.097819 23010 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:59.019289 22842 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:59.122599 18959 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.100265 22931 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:59.081032 22881 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:18:59.125347 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 133797us
I20260709 13:18:59.129220 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:59.130527 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:59.104913 18958 rpcz_store.cc:276] 0709 13:18:58.016406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.020908 (+  4502us) service_pool.cc:224] Handling call
0709 13:18:58.021327 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:58.021723 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.021758 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:58.022278 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.591396 (+569118us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:58.592189 (+   793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.592290 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.098388 (+506098us) raft_consensus.cc:1685] finished
0709 13:18:59.098424 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.098604 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3248,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":24954,"thread_start_us":568739,"threads_started":1,"wal-append.queue_time_us":808468}
I20260709 13:18:59.134322 18275 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:59.097306 22786 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:59.136003 18309 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:18:59.136585 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:59.124064 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:18:59.198417 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.189953 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 137979us
I20260709 13:18:59.162758 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:59.180683 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:59.165725 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2436) took 1133 ms. Trace:
I20260709 13:18:59.199707 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:59.201617 18229 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:59.201864 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 77934.4us
I20260709 13:18:59.114707 22673 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:59.115260 22880 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:59.205822 18277 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:59.207708 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.214833 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.203569 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:59.200562 18377 rpcz_store.cc:276] 0709 13:18:58.032743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.192571 (+159828us) service_pool.cc:224] Handling call
0709 13:18:58.192945 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:58.618458 (+425513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.618494 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:58.633394 (+ 14900us) log.cc:844] Serialized 52 byte log entry
0709 13:18:59.039690 (+406296us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:59.039741 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.039821 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.165469 (+125648us) raft_consensus.cc:1685] finished
0709 13:18:59.165489 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.165665 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22657,"raft.queue_time_us":32424,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":761920,"threads_started":2,"wal-append.queue_time_us":504677}
I20260709 13:18:59.231694 18386 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:18:59.119290 23016 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:59.232213 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:59.145859 23011 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.426s	user 0.004s	sys 0.000s
I20260709 13:18:59.241305 18377 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 14: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:59.238086 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:59.112574 22962 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:18:59.242656 18384 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:59.230775 18382 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:18:59.235652 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.145462 23009 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:59.107942 22995 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.253191 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:18:59.183627 22905 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.235453 23015 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:59.237007 18276 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:59.218186 22912 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:59.282465 22826 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:59.137040 22793 consensus_queue.cc:1059] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.143s
I20260709 13:18:59.248647 22610 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.253901 23017 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:59.245653 23016 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:59.247794 23027 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:18:59.238626 23003 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:59.241600 22831 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:59.200883 22915 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.198158 22881 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:59.299299 18384 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:18:59.300797 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47677.4us
I20260709 13:18:59.143448 22800 consensus_queue.cc:1059] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 13:18:59.280340 22740 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:59.302102 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.302553 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 65605.8us
W20260709 13:18:59.300329 23005 consensus_meta.cc:287] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.005s
I20260709 13:18:59.310065 22887 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.304489 22617 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.305354 22976 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:59.305465 22951 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:59.307325 22989 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.309309 22923 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:18:59.310905 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 204614us
W20260709 13:18:59.311497 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 131751us
I20260709 13:18:59.257318 23013 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:59.418397 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.418663 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:18:59.418354 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 104200us
W20260709 13:18:59.313683 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 179462us
I20260709 13:18:59.301501 18229 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
I20260709 13:18:59.421631 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.320148 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:59.376407 18351 leader_election.cc:400] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12.
W20260709 13:18:59.422835 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 46644.6us
I20260709 13:18:59.377348 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:59.424584 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:59.425009 18382 raft_consensus.cc:2410] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:18:59.381729 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:59.047014 18954 rpcz_store.cc:276] 0709 13:18:57.312876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.331712 (+ 18836us) service_pool.cc:224] Handling call
0709 13:18:57.388369 (+ 56657us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:58.266146 (+877777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.268903 (+  2757us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:58.289018 (+ 20115us) log.cc:844] Serialized 26 byte log entry
0709 13:18:58.812752 (+523734us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:58.818282 (+  5530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.826040 (+  7758us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.975479 (+149439us) raft_consensus.cc:1685] finished
0709 13:18:58.975501 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.975677 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98164,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":7337,"thread_start_us":1251054,"threads_started":2,"wal-append.queue_time_us":658260}
I20260709 13:18:59.333545 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:59.318516 22930 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:59.437767 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:59.399138 18231 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:59.438589 18233 raft_consensus.cc:2368] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12.
I20260709 13:18:59.320999 22940 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:59.416200 18276 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:59.315814 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:59.442698 18276 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:59.428433 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:59.444320 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 110923us
I20260709 13:18:59.445212 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:59.372663 22831 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:59.430814 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.432922 18229 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:59.434489 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:59.457209 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.426726 22861 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:59.401899 22797 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.397213 23025 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.384471 23017 raft_consensus.cc:697] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:59.447659 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.486632 18235 raft_consensus.cc:2410] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:18:59.326557 23015 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 13:18:59.442183 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:18:59.491642 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 53942.5us
I20260709 13:18:59.448810 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.446496 18234 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:18:59.414809 22617 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:59.451279 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.493273 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.451522 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:59.494352 18236 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:59.315779 22934 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:18:59.435621 23021 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.330s	user 0.001s	sys 0.001s
I20260709 13:18:59.415465 22415 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.439319 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.396898 23005 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:59.393241 22915 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.476154 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.482679 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.433768 22976 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:59.438284 22610 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:59.401300 22887 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.440760 22806 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.461885 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.499660 22842 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.450429 22831 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:59.490404 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:59.425822 22826 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:18:59.413811 22989 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:59.481177 23023 log.cc:927] Time spent T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:18:59.508695 18386 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:59.476778 23040 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:59.475418 22940 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:59.475620 22964 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:59.466113 23031 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:59.516306 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:59.553661 18380 raft_consensus.cc:2376] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11. Re-sending same reply.
I20260709 13:18:59.510538 23050 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.492017 22930 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:59.492024 22673 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:59.486655 23009 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:59.517082 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:59.485765 22936 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.522115 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:59.455780 22636 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:59.583789 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.530609 18236 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:18:59.531811 18232 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:59.556754 22964 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:59.587283 22964 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:59.571897 22673 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.591351 22673 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.581178 23009 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:59.538581 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.593755 18351 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:59.594133 23009 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.594844 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:59.596552 23015 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.597185 22976 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:59.596983 22940 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.539656 22934 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:59.599381 22934 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.510802 22951 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.600778 22951 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:59.554961 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 109840us
W20260709 13:18:59.545814 23047 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:18:59.392472 23003 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:59.549211 23035 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:18:59.567438 18380 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:59.541476 23018 raft_consensus.cc:3055] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:59.542718 22979 raft_consensus.cc:2764] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:18:59.506110 22617 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.544221 22836 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.572870 18377 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:59.553972 22842 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.597005 22861 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:59.555928 22943 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:59.565567 23050 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.581051 23017 consensus_queue.cc:237] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.645167 22915 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:59.646184 18385 pending_rounds.cc:85] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 9
I20260709 13:18:59.646611 18385 pending_rounds.cc:107] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:18:59.646963 18385 raft_consensus.cc:2889] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:59.647535 22989 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.531206 22610 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.650277 22610 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.602806 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:18:59.650450 23042 raft_consensus.cc:3055] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:59.651000 23042 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:18:59.651360 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 48614.8us
I20260709 13:18:59.652204 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:59.612392 18957 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.615646 23059 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:59.653311 23059 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:18:59.654739 23037 log.cc:927] Time spent T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.348s	user 0.002s	sys 0.001s
I20260709 13:18:59.607707 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.655398 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1788) took 1294 ms. Trace:
I20260709 13:18:59.495625 23025 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:59.570595 22995 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:18:59.581861 23038 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.266s	user 0.001s	sys 0.001s
I20260709 13:18:59.638377 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.639063 23005 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:59.639705 22617 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.613018 23018 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:59.641227 22887 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:59.641297 22951 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:59.597020 23015 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.682080 23015 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:59.646047 23050 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:18:59.652423 23045 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:18:59.654177 23059 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.655808 18228 rpcz_store.cc:276] 0709 13:18:58.361156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.365623 (+  4467us) service_pool.cc:224] Handling call
0709 13:18:58.365894 (+   271us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:58.746952 (+381058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:58.746986 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:58.747565 (+   579us) log.cc:844] Serialized 52 byte log entry
0709 13:18:59.029067 (+281502us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:59.029129 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.029223 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.655138 (+625915us) raft_consensus.cc:1685] finished
0709 13:18:59.655173 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.655332 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":337318,"raft.queue_time_us":339193,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"thread_start_us":281099,"threads_started":1,"wal-append.queue_time_us":377257}
W20260709 13:18:59.535116 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 44841.7us
I20260709 13:18:59.586220 22636 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:59.585798 22936 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:18:59.658068 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 61984.7us
I20260709 13:18:59.662030 23055 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:59.662351 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:59.662542 22880 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:59.667147 22831 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.657745 22673 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:18:59.672811 22861 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:59.677054 18956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53364 (request call id 326) took 1354 ms. Trace:
I20260709 13:18:59.658326 22842 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.632565 22836 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.697911 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:18:59.708627 18377 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:18:59.712152 23059 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:59.709841 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.709748 18351 leader_election.cc:400] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12.
I20260709 13:18:59.713332 18957 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.739668 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:18:59.740470 18382 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:18:59.651907 23042 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:18:59.743523 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 46280.8us
I20260709 13:18:59.744815 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:59.745425 18228 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.745611 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:59.746215 18305 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:18:59.728833 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.707053 22636 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:59.719128 18311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "b52e2477fc524694967c4a16afa983e3"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:18:59.741834 18351 leader_election.cc:403] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:18:59.749200 18311 raft_consensus.cc:606] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Received request to transfer leadership to TS b52e2477fc524694967c4a16afa983e3
I20260709 13:18:59.743330 18309 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:59.749226 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.746975 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.747612 18380 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 8: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:18:59.712301 23007 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.748334 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.751752 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.752712 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:59.753485 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.755041 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.750550 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:59.684149 22964 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.758015 18231 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:18:59.762128 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:59.727257 22880 raft_consensus.cc:697] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:59.765607 18927 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:59.761410 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:18:59.767050 18232 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:59.767128 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.754216 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:59.767316 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:59.731554 23003 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.767776 18231 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:18:59.769718 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:59.770428 18228 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:18:59.768543 23062 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:59.754840 22617 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:59.759325 22861 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12.
I20260709 13:18:59.771200 23050 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:59.794895 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.760531 22943 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:59.749009 23025 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:59.801700 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.773185 23015 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:59.773185 23040 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:59.771474 22454 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:59.794099 23062 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.796324 23005 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.801928 23016 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:59.810103 22964 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.796453 22852 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:18:59.840310 23016 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:59.812860 22880 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:59.841095 18303 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:59.813860 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.814592 22842 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.815045 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.815131 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.816089 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.816705 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.850170 18229 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:18:59.816841 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.817389 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:18:59.806033 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:59.818856 22989 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:18:59.819658 18232 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:18:59.821777 22836 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.798943 23014 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
W20260709 13:18:59.824043 23039 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.520s	user 0.002s	sys 0.000s
W20260709 13:18:59.825611 23048 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.268s	user 0.000s	sys 0.000s
I20260709 13:18:59.826027 23050 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:59.826447 22881 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:59.827510 23040 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:59.771270 22905 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:18:59.830808 22797 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:59.732589 18956 rpcz_store.cc:276] 0709 13:18:58.322582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.340006 (+ 17424us) service_pool.cc:224] Handling call
0709 13:18:58.975927 (+635921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.048833 (+ 72906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.676812 (+627979us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b5400862750. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:18:59.676978 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1448166656}
I20260709 13:18:59.806936 23060 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:59.796402 22617 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:18:59.875272 22617 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:59.877341 18349 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:18:59.832613 22454 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.878324 22454 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:59.881248 18955 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:59.882056 22881 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:59.868398 23040 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:59.883198 22948 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:59.885069 22943 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:59.885397 23018 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:59.886864 23018 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:59.849761 23005 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.890679 23005 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:18:59.864957 22989 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:59.892572 23025 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:59.893843 22989 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.846980 18957 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:18:59.849977 18233 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:18:59.897557 18349 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:18:59.853029 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.900933 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:18:59.817752 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:18:59.854579 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:18:59.807358 23015 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.793689 23054 consensus_queue.cc:1059] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:18:59.836771 23062 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:59.831521 22915 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:18:59.904724 18383 raft_consensus.cc:2410] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:18:59.906198 23015 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:59.920305 18201 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:18:59.905431 22797 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:59.924710 22943 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:59.926332 22943 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:18:59.926776 22943 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:59.927745 22797 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:18:59.926055 22894 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:59.904547 22800 raft_consensus.cc:2764] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:18:59.932739 22831 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:18:59.935622 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:59.936760 22948 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:59.937151 22948 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.937484 22948 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:59.908814 23060 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:18:59.941694 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:18:59.961131 18201 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:59.963100 18311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4300927be0384401aa46050bd5996d2f"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:18:59.963963 18311 raft_consensus.cc:606] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:18:59.907389 23005 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:59.942652 23025 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:59.969440 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:18:59.942015 23060 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:18:59.969894 23025 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.976836 23005 raft_consensus.cc:697] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:18:59.994801 23062 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:18:59.998833 22636 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.003629 23026 raft_consensus.cc:3055] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:00.013551 23026 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:00.016402 22943 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.019462 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:59.986344 23025 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:00.020648 22943 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:00.022904 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:00.023219 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 129540us
I20260709 13:19:00.000476 23071 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:00.000267 22454 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.026005 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.026793 18960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "715a2657f09449038e569acddbab1aea"
dest_uuid: "e016302b7e734d74833a2bf7bab44838"
mode: GRACEFUL
new_leader_uuid: "b52e2477fc524694967c4a16afa983e3"
 from {username='slave'} at 127.0.0.1:39982
I20260709 13:19:00.027304 22454 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:00.027753 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.028834 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:00.009217 23005 consensus_queue.cc:237] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:00.030019 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:19:00.031252 23064 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:19:00.031834 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:18:59.979521 23050 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.035454 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:00.036042 18304 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:00.028359 18305 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:00.037488 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.045688 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.047140 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.048940 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.065132 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.065728 18312 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:19:00.070298 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.070986 18312 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:00.071544 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:00.072710 18311 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.078068 18304 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
I20260709 13:19:00.078616 18309 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 15: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:00.079214 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.080936 18304 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
W20260709 13:19:00.079344 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 103800us
I20260709 13:19:00.082603 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:00.083001 18201 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:00.084175 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.085793 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.081838 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:00.086287 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.086441 18312 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:00.087045 18307 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:19:00.088210 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:00.088744 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.089473 18307 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:00.093485 18231 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 14: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:00.009876 23015 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.096894 23015 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:00.097878 23026 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:18:59.999887 23040 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.118929 23040 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:00.119962 18237 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:00.121341 23026 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:00.124135 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.124756 18307 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:00.125722 18311 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:19:00.122659 22636 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:00.129609 23062 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:00.130512 23079 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:00.137296 22948 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.139361 22948 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:00.141155 22617 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:00.148685 18305 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:00.131757 23079 raft_consensus.cc:697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 15 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:00.151058 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.151224 23076 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:00.154438 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:00.155854 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:00.160269 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.161964 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:00.163807 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.164871 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.163718 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.149879 22617 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:00.170711 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:00.153352 23076 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:00.163161 23005 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:00.187889 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.157960 23056 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:00.184039 23076 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:00.158571 22948 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:00.167294 23017 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:00.190940 23025 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.194330 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.166007 23015 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:00.165949 23062 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:00.195752 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.196997 18305 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:00.173983 18277 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.168006 22880 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:00.173076 22951 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:00.199452 22951 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:00.199633 23017 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:00.199959 22951 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:00.205029 23056 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:00.205654 23056 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.189064 23050 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:00.208777 23079 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:00.209717 23050 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.212939 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.213670 22880 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:00.213724 23062 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:00.240799 22880 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:00.218400 23025 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:00.224946 22936 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:00.228837 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.234200 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:00.234836 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:00.236665 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:00.247141 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.247321 18380 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:19:00.245833 22912 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:19:00.235970 23076 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.254396 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:00.255208 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:00.255748 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:00.256074 18232 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 12: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:00.256803 22415 consensus_queue.cc:1059] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:00.257153 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:00.257840 18233 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:19:00.238989 22636 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:00.239617 22831 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:00.238376 22937 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:00.240715 23062 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.194983 18310 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:00.237970 22951 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.241948 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:19:00.245031 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 119129us
I20260709 13:19:00.266299 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:00.254051 18229 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:00.210304 23050 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:00.255605 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:00.255319 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.254518 22979 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:00.255125 18228 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
W20260709 13:19:00.257697 23077 log.cc:927] Time spent T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
I20260709 13:19:00.261466 18231 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:00.257696 22415 raft_consensus.cc:3055] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:00.263619 22915 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:00.269620 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:00.270416 18230 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:19:00.272130 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:00.301592 18231 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:00.264945 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:00.278301 23061 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:00.275550 22415 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:00.279217 22894 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:00.279817 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:00.265499 23062 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:00.268782 22937 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.266919 22636 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.253399 22880 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.284883 23050 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.289757 23009 raft_consensus.cc:993] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:19:00.291676 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 794) took 1162 ms. Trace:
I20260709 13:19:00.343562 18303 rpcz_store.cc:276] 0709 13:18:59.129155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.129662 (+   507us) service_pool.cc:224] Handling call
0709 13:18:59.129912 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.841564 (+711652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.291375 (+449811us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b540011c454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:00.291598 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1635131776}
I20260709 13:19:00.293982 18201 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:00.294257 22463 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:00.295607 18276 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:00.295454 18237 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:00.242054 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:00.255543 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:19:00.347316 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 91825.1us
I20260709 13:19:00.301688 18229 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:00.265064 23025 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:00.335265 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:00.350775 18232 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:19:00.351897 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 57999.9us
I20260709 13:19:00.340910 18231 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:00.356272 18927 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:00.359951 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:00.361711 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:00.307036 23061 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.368894 23061 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:00.369982 22937 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:00.315265 22894 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:00.370931 22894 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.371429 23042 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:00.372623 23025 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.373260 23056 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:00.374030 22636 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:00.300827 22915 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.389014 18232 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:00.390600 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:00.391237 18233 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:00.381616 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:00.382958 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:00.393329 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:00.383239 18237 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:00.375151 22793 consensus_queue.cc:1059] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:19:00.395277 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:00.396062 18380 raft_consensus.cc:2368] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13.
I20260709 13:19:00.396822 23009 raft_consensus.cc:1081] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
W20260709 13:19:00.397480 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 101962us
I20260709 13:19:00.398597 18381 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 14: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:00.386772 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:00.397841 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 155871us
I20260709 13:19:00.401587 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:00.403769 18384 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:00.405483 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:00.398402 22915 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:00.410898 18232 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:00.411217 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:00.412540 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:00.414319 18228 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:00.417348 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:00.419049 18229 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:00.421986 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:00.422334 18383 raft_consensus.cc:2368] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15.
I20260709 13:19:00.335806 22979 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:00.420372 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:00.432946 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:00.440575 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.442168 18927 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.442601 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:00.389794 22905 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:00.374930 23025 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:00.388695 23056 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:00.380466 22948 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:00.391980 23018 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:00.389691 23027 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:00.446165 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:00.425648 22912 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:00.410667 23005 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:00.421324 22801 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.436697 22940 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:00.432562 23026 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:00.401485 22852 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:19:00.440122 22797 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:00.432102 22836 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:00.455027 23041 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:00.457804 23018 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.449211 23003 consensus_queue.cc:1059] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:19:00.460501 22636 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:19:00.509934 22989 raft_consensus.cc:3055] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:00.510362 22989 raft_consensus.cc:740] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:00.467258 22912 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.482064 18201 leader_election.cc:400] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13.
I20260709 13:19:00.517589 18201 leader_election.cc:403] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:00.441632 22861 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:19:00.460620 22948 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.450321 23022 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:00.487738 18233 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:00.490883 22836 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.467995 23025 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:00.492458 22940 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:00.504200 18960 raft_consensus.cc:606] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Received request to transfer leadership to TS b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.540345 18960 raft_consensus.cc:614] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:00.442965 22979 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:00.474632 23027 raft_consensus.cc:697] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:00.451745 22831 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:00.462527 23056 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.477185 23005 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.438782 22415 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:00.513321 23018 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:00.518662 22912 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:00.577782 22979 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:00.580104 22948 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:00.531198 23060 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.022s	sys 0.052s
W20260709 13:19:00.580760 23060 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.023s	sys 0.052s
I20260709 13:19:00.581862 22880 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:00.543236 23017 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:00.582751 23017 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.584487 23062 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.585049 23017 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:00.541288 22852 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13.
W20260709 13:19:00.532894 23078 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.520s	user 0.004s	sys 0.001s
I20260709 13:19:00.587190 23056 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:00.535921 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54050.3us
I20260709 13:19:00.564750 23050 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:00.518740 22951 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:00.538522 22836 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:00.497046 22797 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.476475 22801 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.568833 23025 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:00.565958 23076 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:00.575513 22831 raft_consensus.cc:697] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:00.641471 23025 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.567842 22989 consensus_queue.cc:260] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:00.699445 18384 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:19:00.668319 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 209147us
I20260709 13:19:00.674024 23061 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.674597 22801 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:00.675734 22831 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:00.676663 23062 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:00.681854 18306 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:00.734658 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:00.662990 23076 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.685179 22915 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.663159 23027 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:00.688217 22940 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.693737 23005 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:00.704756 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:00.708702 18380 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:00.707345 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:00.718163 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 273361us
I20260709 13:19:00.739133 18306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef83aa6f9534403ebe38156348430345"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:19:00.748850 18306 raft_consensus.cc:606] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:00.749245 18306 raft_consensus.cc:614] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:00.754889 22797 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:00.709501 23056 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:00.756644 23056 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:00.759575 23056 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:00.773952 18377 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:19:00.775520 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 70683.9us
I20260709 13:19:00.741699 23079 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:19:00.776486 18201 leader_election.cc:400] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15.
I20260709 13:19:00.786926 18201 leader_election.cc:403] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:19:00.790488 23054 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:00.792109 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 84873.4us
I20260709 13:19:00.791121 23054 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:00.745839 23076 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.795805 18277 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.790707 22912 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.801069 23076 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:00.747586 22894 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:00.814680 22894 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:00.815366 18229 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:00.816229 22915 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:00.822546 18385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4300927be0384401aa46050bd5996d2f"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:19:00.823230 18385 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:00.823714 18385 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:00.791875 22943 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:00.827116 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:00.834352 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:00.836761 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:00.839354 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:00.837082 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:00.842299 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:00.846527 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 426198us
I20260709 13:19:00.848739 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:00.852746 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:00.852869 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:00.853919 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:00.855175 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:00.856987 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:00.796820 23097 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:00.857880 18232 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:00.861776 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:00.862076 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:00.863209 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:00.863440 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:00.864401 18235 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
W20260709 13:19:00.886404 23100 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:19:00.906769 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:00.886296 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:00.883829 23052 consensus_queue.cc:1059] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:19:00.885280 23050 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:00.889465 23091 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.222s	user 0.005s	sys 0.000s
I20260709 13:19:00.889969 23054 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:00.891605 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:00.891980 22912 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:00.857221 22936 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:19:00.899097 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.900382 18229 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:00.832545 22930 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:00.908867 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:00.867499 22636 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:00.924301 18228 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
W20260709 13:19:00.924626 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 82444.9us
I20260709 13:19:00.926630 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:00.925513 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:00.836623 23076 consensus_queue.cc:1059] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:19:00.932125 22793 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:00.917846 23050 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.939064 22800 raft_consensus.cc:3055] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:00.941391 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:00.942131 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:00.944854 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:00.947285 23061 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:00.947149 23014 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:00.948134 23086 consensus_queue.cc:1059] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:00.906103 22951 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:19:00.984424 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 48838.5us
W20260709 13:19:01.007932 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 57857.6us
I20260709 13:19:00.868476 22836 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:00.884059 23056 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:19:00.989594 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:19:00.990069 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 64665.2us
I20260709 13:19:01.010556 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:00.991901 22915 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:01.012106 18955 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:00.951643 22793 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.017089 18306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "b52e2477fc524694967c4a16afa983e3"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:19:00.993760 22831 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:01.025318 18306 raft_consensus.cc:606] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Received request to transfer leadership to TS b52e2477fc524694967c4a16afa983e3
I20260709 13:19:00.988608 22800 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:01.021273 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:01.034345 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:00.951319 23018 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.023612 22463 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:01.026122 22793 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:01.027817 22831 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.026314 22915 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.052744 22831 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:01.053771 22836 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:01.054584 22915 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:01.025848 23025 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:01.036550 22951 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:01.040155 23093 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:01.049511 22463 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:01.062479 23093 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:01.071755 23093 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:01.148808 18386 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:19:01.067834 22800 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:01.070822 22951 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.192353 23025 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:01.245625 22915 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.199271 22454 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.201398 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:01.203310 22415 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:01.210172 22852 raft_consensus.cc:3055] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:19:01.251533 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 82771.1us
I20260709 13:19:01.186108 23061 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:19:01.251899 22852 raft_consensus.cc:740] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:01.253520 23061 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:01.254432 23061 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:01.210201 23097 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:19:01.254858 23061 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:01.194371 23050 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:01.236847 23056 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:01.250721 22454 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:01.251965 23102 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.344s	user 0.000s	sys 0.003s
I20260709 13:19:01.258170 23071 raft_consensus.cc:3055] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:01.258872 23071 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:01.259104 22454 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:01.253983 22852 consensus_queue.cc:260] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.232753 22930 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:01.248692 22915 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:01.260524 22930 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.263451 22930 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:01.157049 22463 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.239886 18385 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.269984 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:01.264568 23061 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.275332 23013 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:01.287667 23013 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.288280 23013 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:01.291743 22989 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:01.278385 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 101192us
I20260709 13:19:01.279762 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:01.281570 23018 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:01.283946 23041 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:01.285667 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 251251us
W20260709 13:19:01.265588 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 175990us
I20260709 13:19:01.297786 23041 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:01.265411 22915 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:01.305505 22930 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:01.272956 23071 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.307260 18385 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:01.313436 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.317075 22793 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:01.320019 22793 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:01.320679 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.314934 22930 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:01.343529 22930 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.326529 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:01.330057 23041 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:01.346138 23027 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.331244 22852 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:01.348984 22463 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:01.351428 23071 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:01.355369 23014 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:01.359691 22800 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:01.323783 22923 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:01.362686 18377 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:01.362597 22923 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.365564 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:19:01.360174 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.331275 22943 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15.
W20260709 13:19:01.382095 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 55802.4us
I20260709 13:19:01.346938 23027 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:01.390391 22923 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:01.403674 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:01.405094 22915 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:01.405452 22915 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:01.405849 22915 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:01.415158 18131 catalog_manager.cc:5697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.417459 18131 catalog_manager.cc:5697] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.418900 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:19:01.420495 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.423197 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 143702us
I20260709 13:19:01.427707 18309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd151355294e450f85a51ac658d4a465"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "b52e2477fc524694967c4a16afa983e3"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:19:01.429117 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:01.419456 18131 catalog_manager.cc:5697] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 4 to 5, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 5 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:01.435899 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:01.443642 23061 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:01.446970 22915 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.484797 22636 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:01.485564 22636 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.487988 22636 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:01.488619 23018 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:01.494256 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:01.496843 18232 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:01.502552 18131 catalog_manager.cc:5697] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.504650 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:01.512681 23027 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:01.514269 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.517388 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:01.520180 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:01.521216 18235 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:01.526830 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 72951.1us
W20260709 13:19:01.527410 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.532491 22831 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.533352 22930 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:01.535468 18305 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:19:01.538127 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.548928 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.549927 18307 raft_consensus.cc:2368] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12.
I20260709 13:19:01.532549 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:01.547487 18305 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:01.556743 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:01.538441 23013 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.560861 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:01.583155 18304 raft_consensus.cc:1217] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 12.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 13:19:01.581666 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.586189 18304 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:19:01.590510 18309 raft_consensus.cc:606] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Received request to transfer leadership to TS b52e2477fc524694967c4a16afa983e3
I20260709 13:19:01.556802 18131 catalog_manager.cc:5697] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.590996 18309 raft_consensus.cc:614] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:01.606325 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.609800 18307 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:01.625676 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.627477 23013 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:01.658010 22915 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:01.659956 22930 consensus_queue.cc:1059] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:01.664252 23086 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:01.665611 22943 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:01.666011 22943 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:01.667019 22943 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.668927 22930 raft_consensus.cc:3055] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:01.669407 22930 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:01.670439 22930 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.671231 22943 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:01.671813 22930 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:01.673980 22836 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:01.675081 22836 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.676834 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.678381 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.679529 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:01.680778 22636 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:01.681511 22636 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.682160 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:01.683831 22636 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:01.631922 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:01.633754 18383 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:01.634931 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:01.636823 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:01.637173 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:01.640051 18306 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:01.646442 18231 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:01.647454 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.649559 18236 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:01.647656 23093 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.650625 22831 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:01.652640 18232 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:19:01.690503 18308 raft_consensus.cc:2368] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13.
I20260709 13:19:01.699908 18311 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:01.713568 18230 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:19:01.713737 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:01.714596 18926 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:01.715529 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:01.716869 23027 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:01.717792 22962 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:01.716912 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:01.714673 18229 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
I20260709 13:19:01.723671 18385 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:01.723932 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.724566 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.728345 18305 raft_consensus.cc:2368] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13.
I20260709 13:19:01.730204 18955 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:01.730873 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:01.731343 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:01.727377 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.735471 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.742120 23093 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:01.744771 18234 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:01.746157 18383 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:19:01.748596 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.749852 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:01.750414 18303 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:01.759578 23060 consensus_queue.cc:1059] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:01.689896 18131 catalog_manager.cc:5697] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 13 to 14, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131), pending config changed. New cstate: current_term: 14 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:01.765094 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:01.769976 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:01.778129 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.779098 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:01.780958 18309 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:01.781556 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.778916 18305 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:01.784528 18306 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:01.785396 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:01.786118 18306 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:01.786837 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.787793 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:01.793869 22800 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:01.795053 22836 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:01.795513 22831 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:01.806191 18303 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:01.807085 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:01.807775 18303 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:01.804025 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:01.809080 18310 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:01.804837 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.810307 18305 raft_consensus.cc:2368] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12.
W20260709 13:19:01.817502 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 263227us
I20260709 13:19:01.828691 18309 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:01.831913 18234 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:01.730229 22962 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:01.835188 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.836565 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.836721 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.851264 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.863395 18303 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:01.871011 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.876685 18235 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
I20260709 13:19:01.878435 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.864699 22923 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:01.887252 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:01.888530 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:01.892923 22936 raft_consensus.cc:3055] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:01.893435 22936 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:01.894363 22936 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.898021 22962 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:01.900665 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 104628us
I20260709 13:19:01.907629 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:01.908903 23018 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:01.915238 22962 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.915091 23018 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.915899 22962 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.917837 23018 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:01.919348 22962 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:01.921435 18308 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:01.921788 18311 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:01.922327 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:01.923175 18306 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:01.875841 22915 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:01.931457 18303 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:01.932034 18310 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:19:01.949688 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:01.946343 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:01.952610 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.957679 18230 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:01.960336 18237 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
W20260709 13:19:01.961047 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 193951us
I20260709 13:19:01.964839 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:01.966147 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:01.967403 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:01.968276 18379 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 12: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:19:01.969606 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.971535 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.972294 18312 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:01.973165 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:01.973685 18312 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:01.947170 22915 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.976334 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:01.977010 18307 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:01.977324 22915 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:01.977897 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:01.978833 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.979440 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.980733 22831 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:01.981379 22831 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:01.983516 22831 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:01.987219 18303 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:01.992182 18230 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:01.994436 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:01.993651 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 115511us
I20260709 13:19:01.997666 18312 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:01.998831 18236 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:01.995114 18306 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:02.003396 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:02.008919 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:02.008417 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:02.014216 18312 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:02.016311 18303 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 15: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:02.022015 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:01.955883 22923 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.024284 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:01.997519 22915 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:19:02.027614 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.027604 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:02.028630 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:02.029381 18303 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:02.030835 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:02.010905 22962 consensus_queue.cc:1059] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:19:02.038054 22951 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:02.039227 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:02.045238 18234 raft_consensus.cc:2410] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:19:02.041847 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:02.042371 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:02.047369 18305 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:02.046748 23018 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:02.053411 18306 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:02.054549 18312 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:02.057238 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:02.064967 22793 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:02.065742 22989 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:02.066385 22989 raft_consensus.cc:697] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:02.067788 18310 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:02.067606 22989 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:02.069940 18230 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:02.071710 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46128 (request call id 560) took 1661 ms. Trace:
I20260709 13:19:02.072450 18233 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:02.062881 23093 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:02.075454 22936 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:02.083536 18309 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:02.044652 22951 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:02.094434 18309 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:02.101054 18230 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 13:19:02.113849 22923 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:02.117694 23026 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.118206 18312 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:02.118289 23026 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:02.122656 18305 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:02.120350 18304 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:02.136134 18312 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:02.137919 18236 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:02.115290 22951 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:02.084690 18237 rpcz_store.cc:276] 0709 13:19:00.410128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.410970 (+   842us) service_pool.cc:224] Handling call
0709 13:19:02.071521 (+1660551us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540037dcd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:02.071638 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2972299520}
I20260709 13:19:02.176792 23026 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:02.177467 18228 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:02.258744 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 226375us
W20260709 13:19:02.264093 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 202290us
W20260709 13:19:02.270509 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 210005us
I20260709 13:19:02.276378 18311 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:19:02.261185 23131 log.cc:927] Time spent T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.287s	user 0.015s	sys 0.017s
I20260709 13:19:02.278738 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:19:02.280488 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 121500us
W20260709 13:19:02.283038 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.282612 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:02.286695 18378 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:02.294787 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:02.266439 23093 raft_consensus.cc:697] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:19:02.288574 23138 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.176s	user 0.002s	sys 0.002s
I20260709 13:19:02.300092 23040 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:02.405443 23040 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.408670 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:02.302021 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.409869 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:02.410404 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:19:02.410586 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.410928 18234 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:02.411319 18230 raft_consensus.cc:2410] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:19:02.413483 18235 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:02.413825 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:02.302201 23137 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:02.313171 23013 raft_consensus.cc:3055] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:02.416224 23013 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:02.416363 23137 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.417217 23013 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.418473 23013 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:02.418710 23137 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:02.317243 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:19:02.420928 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.421309 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 104204us
I20260709 13:19:02.325243 18131 catalog_manager.cc:5697] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 10 to 11, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 11 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:02.379966 22915 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:02.427289 22915 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:02.424042 18131 catalog_manager.cc:5697] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:02.431054 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 373888us
I20260709 13:19:02.438455 18201 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:02.455302 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:02.455521 18303 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:02.428583 22915 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.460053 18235 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:02.452648 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:02.466789 18306 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:19:02.453507 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:02.472604 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:02.473297 18308 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
I20260709 13:19:02.431478 23018 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:02.452529 23137 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:02.480465 23134 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:02.481001 23137 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:02.481492 23137 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:02.482625 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:02.482380 23093 consensus_queue.cc:237] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.483408 18236 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
I20260709 13:19:02.485636 23040 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:02.479933 23052 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:02.486575 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:02.487887 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.463054 23027 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:02.509083 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:02.510622 22454 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.515995 22454 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.518468 22454 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:02.521423 23134 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.522256 23134 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.528029 23134 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:02.530726 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:02.548897 23145 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:02.549420 23145 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.549733 23145 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:02.551313 18307 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:02.564831 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:02.565738 18309 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:02.578166 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:02.579835 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:02.583245 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:02.569388 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:02.585062 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 302907us
I20260709 13:19:02.587189 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:02.588492 18310 raft_consensus.cc:2368] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14.
I20260709 13:19:02.590269 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:02.481508 23018 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.597524 18304 raft_consensus.cc:2368] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13.
I20260709 13:19:02.597368 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:02.597795 18310 raft_consensus.cc:2368] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13.
I20260709 13:19:02.598687 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:02.598934 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:02.601497 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:02.602669 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:02.600991 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:02.603473 18312 raft_consensus.cc:2368] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15.
I20260709 13:19:02.599351 18309 raft_consensus.cc:2376] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13. Re-sending same reply.
I20260709 13:19:02.600967 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:02.612164 18305 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:02.558444 22852 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:19:02.639511 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:02.643628 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:02.646093 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:02.651084 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:02.655404 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:02.656150 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:02.661032 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:02.670099 18229 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:02.683404 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:02.684329 18233 raft_consensus.cc:2410] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:19:02.701536 18131 catalog_manager.cc:5697] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 7 to 8, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 8 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:02.704044 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:02.701848 22989 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.708245 22989 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:02.713663 18233 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:19:02.715266 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.715111 22951 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:02.725409 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:02.726761 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:02.730360 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 66608.3us
I20260709 13:19:02.667701 23027 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:19:02.736625 23120 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:19:02.736979 22943 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:19:02.737013 23151 log.cc:927] Time spent T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:19:02.725103 23148 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:02.683581 22454 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:02.746572 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 205953us
I20260709 13:19:02.750918 18377 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:19:02.759250 18377 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:02.750870 18131 catalog_manager.cc:5697] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 5 to 9, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 9 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:02.760479 18955 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:02.764051 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:02.764959 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 114096us
I20260709 13:19:02.765718 18233 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:02.766193 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:02.747749 22943 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:02.773366 22943 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.774115 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:02.774974 22943 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:02.782475 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:02.747903 23027 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:02.791428 18237 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:02.791628 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:02.798367 18231 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:02.804996 23156 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:19:02.806332 23156 raft_consensus.cc:3055] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:02.806772 23156 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:02.808717 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:02.810315 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:02.782370 22463 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.811515 22463 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.812327 23061 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:02.813086 23061 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:02.813786 22463 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:02.814921 23159 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:02.818149 23137 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.819295 18234 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:02.821314 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:02.776206 23148 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:02.823939 23148 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.759765 22454 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:02.828341 18131 catalog_manager.cc:5697] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.785975 22930 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:02.845886 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 188528us
I20260709 13:19:02.848835 18131 catalog_manager.cc:5697] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.851202 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:02.834861 22454 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:02.829216 22989 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:02.807895 23156 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:02.820429 23137 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:02.824209 23130 consensus_queue.cc:1059] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:19:02.845441 22415 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:19:02.859831 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 66802.2us
W20260709 13:19:02.882474 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 50200.7us
I20260709 13:19:02.883975 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:02.863813 22951 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:02.894896 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:02.895565 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 129539us
I20260709 13:19:02.898376 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:02.900043 22936 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:02.899744 23145 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:02.901574 18130 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39270 (request call id 188) took 31140 ms (client timeout 15000 ms). Trace:
I20260709 13:19:02.880791 22836 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.902448 23175 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:02.902334 22836 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.903939 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:02.882643 23061 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:02.873396 23130 consensus_queue.cc:1243] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer e016302b7e734d74833a2bf7bab44838 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:02.907032 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:02.906677 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:02.905680 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:02.890893 23156 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:02.904832 22415 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:02.913614 23130 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:02.904461 22836 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:02.909914 23013 consensus_queue.cc:1059] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:19:02.886030 23027 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:02.930225 18201 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:02.924382 23134 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.923020 23018 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:02.927083 22930 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:19:02.938143 18202 leader_election.cc:400] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12.
I20260709 13:19:02.939704 18202 leader_election.cc:403] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:02.940984 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 57123.4us
I20260709 13:19:02.946951 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:02.947789 23130 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:02.948874 22951 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:02.949467 22951 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:02.949890 18277 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:02.950647 23130 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:02.951872 22951 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:02.943722 23014 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:02.952555 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:02.953243 23014 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:02.953510 23130 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:02.954285 23014 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.954800 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:02.955557 23130 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:02.956627 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:02.957213 22415 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:02.957342 23130 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:02.957649 22415 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.958011 22415 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:02.902050 18130 rpcz_store.cc:269] 0709 13:18:31.760897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.761175 (+   278us) service_pool.cc:224] Handling call
0709 13:18:31.908166 (+146991us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b5400200490. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14f0b2 00007fa1880c8a89 00007fa188060da6 00007fa188032088 00007fa18813037e 00007fa1865f12a4 00007fa1865f1232 00007fa1865f1161 00007fa1865f10dc
0709 13:19:02.901313 (+30993147us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:59.258392 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:59.431227 (+172835us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:59.435444 (+  4217us) write_op.cc:435] Acquired schema lock
0709 13:18:59.440155 (+  4711us) tablet.cc:662] Decoding operations
0709 13:18:59.648783 (+208628us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:59.648854 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:59.648884 (+    30us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:18:59.650392 (+  1508us) tablet.cc:701] Row locks acquired
0709 13:18:59.650410 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:18:59.650581 (+   171us) write_op.cc:270] Start()
0709 13:18:59.650733 (+   152us) write_op.cc:276] Timestamp: P: 1783603139650527 usec, L: 0
0709 13:18:59.650754 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:18:59.651535 (+   781us) log.cc:844] Serialized 7583 byte log entry
0709 13:19:00.009793 (+358258us) op_driver.cc:464] REPLICATION: finished
0709 13:19:00.153399 (+143606us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa17f1690ac 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa185ca9ef0
0709 13:19:00.239635 (+ 86236us) write_op.cc:301] APPLY: starting
0709 13:19:00.239747 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:00.695551 (+455804us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:00.695589 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:01.079463 (+383874us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:01.200314 (+120851us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=0,mrs_lookups=0
0709 13:19:01.200409 (+    95us) write_op.cc:312] APPLY: finished
0709 13:19:01.248591 (+ 48182us) log.cc:844] Serialized 172 byte log entry
0709 13:19:01.250327 (+  1736us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:01.251299 (+   972us) write_op.cc:454] Released schema lock
0709 13:19:01.251430 (+   131us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:01.252424 (+   994us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:01.252456 (+    32us) write_op.cc:454] Released schema lock
0709 13:19:01.288129 (+ 35673us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b180043be80. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f186522 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
Metrics: {"mutex_wait_us":513804,"reported_tablets":53,"spinlock_wait_cycles":62438784,"child_traces":[["op",{"apply.queue_time_us":229535,"apply.run_cpu_time_us":36843,"apply.run_wall_time_us":1012531,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83395,"num_ops":19,"prepare.queue_time_us":528830,"prepare.run_cpu_time_us":21793,"prepare.run_wall_time_us":523431,"raft.queue_time_us":127251,"raft.run_cpu_time_us":13967,"raft.run_wall_time_us":220489,"replication_time_us":358830,"spinlock_wait_cycles":17031552,"thread_start_us":609824,"threads_started":4,"wal-append.queue_time_us":191810,"wal-append.run_cpu_time_us":10631,"wal-append.run_wall_time_us":2113408}]]}
I20260709 13:19:02.947911 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:02.958655 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:02.962767 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:02.977455 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:02.978556 23018 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:02.979512 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:02.980324 23018 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:02.939332 23134 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:02.980700 23018 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:02.981104 23018 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:02.982429 23134 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:02.966799 23130 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:02.984604 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:03.001511 23178 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:19:03.002825 23027 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:03.003895 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:03.018292 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.018633 18232 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:19:03.004932 22962 raft_consensus.cc:3055] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:03.005265 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:03.019783 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.007195 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:03.009687 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:03.010047 23018 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:03.016073 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 87051.3us
I20260709 13:19:03.016641 22923 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:03.019956 23050 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:03.020076 18236 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:03.054888 23050 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:03.055404 23050 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:03.030483 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 67760.2us
I20260709 13:19:03.057104 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.021037 18960 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:19:03.059805 23060 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:03.060642 23060 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:03.019804 22962 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:03.032887 18231 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:03.062774 22962 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:03.064086 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:03.064692 18349 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:03.058686 18277 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.065593 22951 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:03.065979 22951 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:03.066337 22951 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.066478 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.067517 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:03.067816 18960 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 15 LEARNER]: Advancing to term 17
I20260709 13:19:03.068112 18231 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.064044 22962 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:03.082531 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:03.060250 18927 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:03.088878 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:03.100651 23142 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:03.101399 23142 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:03.102387 23142 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.103446 23145 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:03.104832 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 85121.4us
I20260709 13:19:03.105674 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.021320 22454 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.107817 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.107999 22454 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:03.080860 22930 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:03.110220 23018 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:03.110999 18960 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 17 LEARNER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:19:03.116760 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 56641.1us
I20260709 13:19:03.074478 23134 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:03.119589 23027 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:03.119942 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:03.120011 23027 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.126147 23018 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:03.192605 23027 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.121783 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:03.192970 23018 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:03.193423 18304 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:03.193471 23018 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:03.151599 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:03.163452 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 91671.6us
W20260709 13:19:03.164974 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 89343.6us
W20260709 13:19:03.196086 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 76978.4us
I20260709 13:19:03.196406 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:03.084533 23060 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:19:03.197551 23040 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:03.198871 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:03.201704 18304 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:19:03.203320 22454 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:03.206832 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 84733.7us
I20260709 13:19:03.207511 22951 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:03.208369 22793 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:03.176849 22923 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12.
W20260709 13:19:03.177501 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 69738.9us
I20260709 13:19:03.217828 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.178732 18236 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:19:03.076448 22836 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:03.183241 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:03.219873 18234 raft_consensus.cc:2410] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:19:03.085542 23050 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.088012 23175 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:03.188789 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:03.225081 18303 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:03.189487 18235 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:03.120216 23143 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:03.194712 22415 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:03.211185 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 90747.5us
I20260709 13:19:03.218721 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:03.220212 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:03.233896 18307 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:03.237164 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:03.237905 18303 raft_consensus.cc:2376] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14. Re-sending same reply.
I20260709 13:19:03.240193 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:03.244753 22951 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:03.245909 22415 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:03.249378 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:03.250399 18305 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:19:03.250861 18305 pending_rounds.cc:85] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 9
I20260709 13:19:03.251094 18305 pending_rounds.cc:107] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:19:03.251365 18305 raft_consensus.cc:2889] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:03.233002 23013 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:03.252190 23013 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.254413 23013 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:03.256151 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:03.260036 23050 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:03.261044 23143 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:03.262387 23143 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.237627 23093 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:03.271198 22930 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:03.271643 22930 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:03.272401 22930 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.220930 23061 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:19:03.274195 22930 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:03.281729 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:03.282356 18381 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:03.282398 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64667.7us
I20260709 13:19:03.286270 18231 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:19:03.286980 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.287354 18237 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:19:03.292080 18386 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:03.294929 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:03.243727 22793 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:03.292146 18955 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:19:03.300932 22923 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:03.312419 18349 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:19:03.317170 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.312928 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:03.304155 23050 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:03.315305 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:03.319711 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.320204 18304 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 15: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:03.302013 23145 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:03.314815 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:03.318280 18303 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:03.322160 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.322209 18305 raft_consensus.cc:2376] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15. Re-sending same reply.
I20260709 13:19:03.332088 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:03.335999 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 103709us
I20260709 13:19:03.328460 23061 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:19:03.314464 23009 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.310339 22793 raft_consensus.cc:697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:03.338850 18381 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:03.314723 23097 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:03.311465 22415 consensus_queue.cc:1059] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:19:03.337849 23009 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.343255 22793 consensus_queue.cc:237] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:03.340807 18201 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:03.331462 23013 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:03.322499 23142 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:03.328642 23060 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:03.349416 23018 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.341225 23145 raft_consensus.cc:697] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 9 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:03.367832 22454 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:19:03.371132 22463 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:03.375026 22463 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:03.376102 23009 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:03.376006 22463 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.377532 22463 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:03.338382 23130 consensus_queue.cc:1059] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:19:03.380107 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.328765 22915 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:19:03.365803 22943 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:03.383627 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:03.385646 23093 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:03.357133 23097 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.365002 23148 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:19:03.366796 22989 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:19:03.414451 18381 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:03.414711 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:03.422125 23097 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:03.424429 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:03.426216 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:03.432538 18386 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:03.409687 22943 raft_consensus.cc:697] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:03.418812 23050 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:19:03.434729 23145 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:03.436643 23027 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:03.437615 23018 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:03.439193 18960 raft_consensus.cc:2368] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:19:03.441689 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.448745 18385 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:03.409531 23134 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:03.414388 23060 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.491127 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:03.492120 18231 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.419186 23014 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:03.496940 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 112683us
I20260709 13:19:03.448859 23179 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:03.501571 18237 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:03.509500 18349 leader_election.cc:400] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:19:03.509972 18349 leader_election.cc:403] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:19:03.493690 23142 raft_consensus.cc:697] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:03.487949 23061 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:03.434613 22943 consensus_queue.cc:237] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.519297 18231 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:19:03.474714 22415 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:19:03.533315 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.533527 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:03.502061 23018 consensus_queue.cc:1059] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:19:03.502597 23014 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.537177 23014 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:03.504120 23148 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:19:03.558073 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:03.558598 18958 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 9 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:03.558811 18377 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:03.559859 23018 raft_consensus.cc:3055] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:03.528616 22454 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:19:03.561177 22454 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:03.561584 22454 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:03.562400 22454 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.563544 22454 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:03.568800 22923 raft_consensus.cc:3055] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:03.569271 22923 raft_consensus.cc:740] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:03.570098 22923 consensus_queue.cc:260] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.571488 23050 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:03.573540 23009 raft_consensus.cc:3055] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:03.573971 23009 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:03.571594 22923 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:03.574875 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.529335 22915 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:03.545166 23142 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:03.574901 23009 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:03.538246 23027 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:03.506996 23150 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:19:03.582989 23093 raft_consensus.cc:3055] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:03.583459 23093 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:03.554781 22951 raft_consensus.cc:2764] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:19:03.505088 23173 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:19:03.506582 23060 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:03.546204 18927 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:03.588399 23050 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:03.584399 23093 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.591118 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:03.592581 23009 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:03.560267 23018 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:03.608294 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:19:03.611810 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 65722.2us
W20260709 13:19:03.617406 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 66543.9us
I20260709 13:19:03.523859 23061 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.620412 22793 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:03.630579 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:03.623907 23193 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:03.629362 23130 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:03.650041 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:03.652274 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:03.652472 18310 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:03.652871 18304 raft_consensus.cc:2376] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14. Re-sending same reply.
I20260709 13:19:03.652395 23130 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.651160 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:03.651840 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.633929 23186 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:03.639715 23093 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:03.655989 18307 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:03.645483 22793 raft_consensus.cc:697] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:19:03.598814 23176 consensus_queue.cc:1175] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "459e82ee6b564cc19be6f73186938e79" responder_term: 15 status { last_received { term: 14 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:03.670867 23061 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:03.671404 23060 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:03.674379 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:03.678318 23198 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:03.670873 23130 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:03.649883 23193 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:03.692487 23193 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:03.657976 22943 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:03.692806 23018 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.693598 22943 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.693996 22943 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:03.694154 23018 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:03.696627 23040 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:03.694002 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:03.697290 23040 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:03.686753 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:03.685562 22793 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:03.698215 23040 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.699647 23040 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:03.690478 23190 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:19:03.656694 23186 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.688365 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:03.704871 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:03.705436 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:03.705732 18310 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:03.705981 18307 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:03.704874 23186 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:03.706611 22923 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:03.707226 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:03.709000 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.711158 18305 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:03.725962 18305 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:03.730129 18228 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:03.709683 22951 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:19:03.703521 23071 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:03.736399 18305 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:03.741104 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:03.739960 23191 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:03.744758 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.745415 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:03.745819 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:03.746198 18229 raft_consensus.cc:2368] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:19:03.746945 18231 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:03.753381 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:03.755690 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:03.761547 18228 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:19:03.762454 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.734297 22936 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:03.711755 23150 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:19:03.772334 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:03.773064 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:03.775295 18228 raft_consensus.cc:2368] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:19:03.775406 23206 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:03.775728 18237 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:03.776053 23206 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:03.782032 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 74886.7us
I20260709 13:19:03.783255 18202 leader_election.cc:400] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14.
I20260709 13:19:03.783555 18202 leader_election.cc:403] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:03.787236 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:03.789456 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:03.758438 22951 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:19:03.800709 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:03.775745 23200 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:03.825275 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:03.789750 22800 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:03.774642 22936 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:03.812031 22915 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:19:03.834048 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:03.803014 23175 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14.
I20260709 13:19:03.815044 23206 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:03.844687 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 61591.9us
I20260709 13:19:03.845707 18231 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:03.849226 18304 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:03.851430 18202 leader_election.cc:400] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13.
I20260709 13:19:03.851745 18202 leader_election.cc:403] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:03.855027 18351 leader_election.cc:400] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
I20260709 13:19:03.837060 22800 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:03.940632 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:03.941778 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 96459us
I20260709 13:19:03.944032 18202 leader_election.cc:400] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15.
I20260709 13:19:03.957975 18381 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:19:03.959966 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:03.965812 18926 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:03.968103 18306 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:03.927605 23175 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:03.858970 23150 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 13:19:03.979099 18275 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:04.001595 18304 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
W20260709 13:19:03.977733 23203 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:19:03.984084 23009 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.980535 23134 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:04.018252 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 158299us
I20260709 13:19:03.991634 22793 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:03.967041 22943 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.012054 23009 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.065732 18351 leader_election.cc:400] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10.
W20260709 13:19:04.069000 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 109138us
I20260709 13:19:04.070106 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:04.020498 22923 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:04.098277 23009 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:04.023850 23134 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.099136 18307 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:04.087138 23097 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.101145 23134 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:04.019047 22951 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:19:04.056339 23061 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:04.131399 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 270608us
I20260709 13:19:04.106914 22923 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:04.110559 23198 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:04.107118 23213 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:04.174827 23134 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.180800 23130 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.210024 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 140013us
I20260709 13:19:04.218418 18228 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:04.224356 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:04.226500 18202 leader_election.cc:400] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13.
I20260709 13:19:04.129663 22936 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:04.182251 23061 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.110416 23097 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:04.239226 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 145730us
W20260709 13:19:04.228272 23201 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:19:04.231389 23071 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:04.255420 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:04.256390 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:04.266808 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:04.219055 23213 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.250483 22951 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 13:19:04.289518 23217 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:19:04.290800 22951 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:04.291415 22951 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:04.292224 23215 log.cc:927] Time spent T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:19:04.232180 23130 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.228866 23134 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.319460 18304 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:04.250855 23061 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:04.313567 23191 consensus_meta.cc:287] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.007s
I20260709 13:19:04.278119 23199 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:04.326319 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 71041.9us
W20260709 13:19:04.324270 23186 consensus_meta.cc:287] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.590s	user 0.007s	sys 0.005s
W20260709 13:19:04.322641 23050 consensus_meta.cc:287] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.701s	user 0.012s	sys 0.000s
I20260709 13:19:04.337023 23223 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:04.340245 23134 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:04.260982 23216 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:19:04.348623 23013 raft_consensus.cc:1064] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:19:04.348893 23130 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:04.350919 22951 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:04.355199 22800 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:04.357345 23213 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:04.358227 23061 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:04.360376 23097 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:04.360502 23040 consensus_meta.cc:287] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.660s	user 0.014s	sys 0.001s
I20260709 13:19:04.360574 23226 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:04.361490 23018 consensus_meta.cc:287] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.667s	user 0.013s	sys 0.000s
I20260709 13:19:04.316669 22923 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.331068 23191 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:04.362536 23050 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:04.362898 23193 consensus_meta.cc:287] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.670s	user 0.000s	sys 0.010s
I20260709 13:19:04.363245 23232 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:04.334144 22943 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:04.371250 23199 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:04.372334 18383 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:04.372380 18228 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:04.374966 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:04.375588 23175 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13.
I20260709 13:19:04.376708 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:04.399559 18237 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:04.383569 23186 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:04.405704 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 71257.3us
I20260709 13:19:04.410470 18385 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:04.425606 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:19:04.429108 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 244310us
I20260709 13:19:04.406127 23040 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.445513 18303 raft_consensus.cc:2368] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15.
I20260709 13:19:04.453315 18953 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:19:04.448575 23040 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.459738 23040 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:04.434343 23199 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:04.448844 23050 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:04.462229 23199 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:04.423341 23232 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.466506 23232 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:04.408500 23193 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.469061 23193 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:04.388353 23013 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:04.470417 23191 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:04.471889 23191 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:04.472760 23050 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:04.473526 23186 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:04.477210 18385 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:04.477941 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:04.481185 18236 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:19:04.484826 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 58929.3us
I20260709 13:19:04.486145 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:04.454653 23213 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:19:04.525141 23142 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:04.530222 23142 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:04.531672 23205 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:04.535290 23142 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.476987 23235 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:19:04.548379 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:04.548600 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:04.549057 18307 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:04.490059 22951 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:19:04.569607 18305 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:04.576256 18228 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:04.580639 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:04.581293 18306 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:04.583376 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:04.583950 18310 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:04.584818 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:04.473922 23050 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.586890 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:04.590754 18311 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:04.546618 23186 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:04.600780 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:04.609236 18307 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:04.611301 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:04.611591 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:04.619040 18311 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:04.620769 18306 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:04.588997 23027 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:19:04.624907 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:04.625490 18309 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:04.627225 23229 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:19:04.629940 18276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.020s	sys 0.016s
W20260709 13:19:04.630324 18276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.020s	sys 0.016s
W20260709 13:19:04.630631 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 605894us
I20260709 13:19:04.636315 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:04.636562 23226 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.637236 23226 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.637610 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:04.637784 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:04.638125 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:04.638811 18383 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:19:04.639690 23226 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:04.641104 22915 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:04.641605 22915 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:04.644034 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:04.644768 18382 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:19:04.645520 18307 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:04.647150 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:04.654546 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:04.654966 18311 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:04.607295 23186 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.662864 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 1926) took 1015 ms. Trace:
I20260709 13:19:04.671640 23186 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:04.672209 23026 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:04.660622 23229 raft_consensus.cc:697] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:04.674546 23229 consensus_queue.cc:237] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.675236 23148 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:04.663180 18303 rpcz_store.cc:276] 0709 13:19:03.647849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.650854 (+  3005us) service_pool.cc:224] Handling call
0709 13:19:04.662731 (+1011877us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b54001df1d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:04.662821 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1819508608}
W20260709 13:19:04.680258 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 54544.3us
I20260709 13:19:04.678771 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:04.644762 22923 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.698678 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:04.708077 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:04.708724 23199 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:04.709144 23199 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.709524 23199 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:04.709872 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:04.711201 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:04.711766 18926 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:04.712414 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:04.713500 22793 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:04.713609 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:04.719321 18303 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:04.690752 23014 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.735225 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:04.687275 23071 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:19:04.781545 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.704919 23241 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:04.690222 22454 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:19:04.782219 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47095.9us
I20260709 13:19:04.785593 18953 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 17 LEARNER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:04.690526 22923 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.789162 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:04.799242 18384 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:04.783408 23198 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:19:04.808346 23251 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:19:04.809275 23226 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:04.809911 23226 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.812116 23226 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:04.814694 23240 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.321s	user 0.001s	sys 0.003s
I20260709 13:19:04.794227 23173 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:04.740190 23014 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.798432 23241 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:04.797358 23192 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:04.791286 22800 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:19:04.837334 23142 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.833966 23198 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:04.886219 23142 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.894348 23176 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:04.894543 23142 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:04.895063 23176 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:04.837848 23173 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:04.899087 18276 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:04.932049 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:04.933051 18381 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:19:04.880936 23192 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:04.944962 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:04.928596 23130 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:04.981979 18381 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:04.984220 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:04.986132 18381 raft_consensus.cc:2410] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:04.993312 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:04.981003 23013 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:05.047305 23013 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.047693 23013 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:05.046514 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 48277us
I20260709 13:19:05.006071 18382 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:05.008719 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:04.943188 23241 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:05.053915 22800 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:19:05.010370 23250 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:19:05.057003 23176 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:05.020102 22636 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:19:05.035563 23247 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:19:05.044796 23014 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:05.044670 23198 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:05.045655 23173 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:05.046506 23192 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:05.046855 22923 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:04.980427 23130 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:05.017156 22915 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:05.002126 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:19:05.071452 23237 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.577s	user 0.004s	sys 0.004s
W20260709 13:19:05.083359 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 81299.5us
I20260709 13:19:05.082629 23130 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:05.117216 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.120443 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:05.085381 23226 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:05.126214 18351 leader_election.cc:400] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15.
I20260709 13:19:05.126626 18351 leader_election.cc:403] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:05.129343 22923 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:05.147725 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:05.148679 18228 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:05.149672 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:05.150564 18237 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:05.155572 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:05.138373 23243 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15.
I20260709 13:19:05.160454 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:05.161911 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:05.163388 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:05.163944 18234 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:05.165112 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:05.165658 18234 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:19:05.166930 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:05.167460 18234 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:05.178254 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:05.179502 18236 raft_consensus.cc:2410] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:19:05.181674 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:05.183293 18234 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:05.189949 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:05.148967 23009 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:05.242231 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 116144us
W20260709 13:19:05.196063 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 146010us
I20260709 13:19:05.194213 22930 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:05.196957 22636 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:05.249320 23179 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:05.248773 23242 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:05.261078 23179 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:05.261415 23242 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:05.263175 23179 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:05.264081 23242 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:05.265178 23257 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:19:05.247474 23009 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:05.268100 22930 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:05.232864 23199 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:05.260366 18234 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:05.253655 23191 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.282085 18308 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:05.283653 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:05.288530 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:05.270447 22636 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:05.295707 18237 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 15: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:05.297868 18312 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:05.298331 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:05.299342 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:05.303134 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:05.303761 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:05.308432 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:05.310046 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:05.310657 18231 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:05.311632 18380 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:05.314708 23261 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:19:05.315521 23261 consensus_queue.cc:1243] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer 8b4fbc44aa2649f0bcac5cd70f71951d log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:19:05.315968 23261 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:05.288054 23191 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:05.317827 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:05.318436 23191 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:05.316267 23261 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:05.319847 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:05.319133 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:05.320899 18312 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:05.322934 18304 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:05.320096 23261 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:05.323890 23261 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:05.320152 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:05.292642 23226 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:05.308430 18309 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:05.293865 23239 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:05.352612 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:05.356786 18379 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:05.360630 18309 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:05.380875 18228 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:05.386534 18309 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:05.395576 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:05.405453 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:05.406230 18309 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:05.408471 18202 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:05.410625 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:05.419118 18228 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:05.376941 23239 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:05.417809 23192 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:05.447274 23235 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:05.448534 23009 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:05.436786 23232 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:19:05.453511 18237 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:05.401619 23241 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:19:05.463944 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 154219us
I20260709 13:19:05.472688 23229 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:05.473379 23229 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:05.475658 23229 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:05.413688 23013 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:05.442819 23260 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:05.492076 18228 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:19:05.454753 23192 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.446377 23143 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:19:05.450145 23191 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:19:05.478960 22989 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:05.485615 22930 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:05.512933 23192 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:05.445847 23226 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:05.522131 23199 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:05.613263 22636 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:05.671459 23268 log.cc:927] Time spent T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
W20260709 13:19:05.697049 23277 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
W20260709 13:19:05.685063 23259 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:19:05.743635 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 327783us
W20260709 13:19:05.806325 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 322618us
I20260709 13:19:05.651855 22989 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:05.823578 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 401056us
I20260709 13:19:05.625788 23255 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:19:06.026942 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:06.033722 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:06.031191 23263 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.427s	user 0.002s	sys 0.010s
W20260709 13:19:06.042676 23273 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.533s	user 0.004s	sys 0.009s
W20260709 13:19:06.042438 23272 log.cc:927] Time spent T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.549s	user 0.003s	sys 0.011s
W20260709 13:19:06.037199 23269 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.449s	user 0.000s	sys 0.013s
W20260709 13:19:06.061452 18310 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.010s	sys 0.024s
I20260709 13:19:06.070024 18201 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:19:06.084367 18310 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.010s	sys 0.024s
I20260709 13:19:06.045651 23014 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:06.082860 23143 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.086767 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:06.092676 18231 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:06.064069 22915 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:06.030476 23173 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:19:06.098167 23176 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:06.122383 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.108049 23199 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:06.099191 23071 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:06.136117 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:06.098433 23260 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.195030 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:06.127722 23283 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:19:06.201965 18236 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
W20260709 13:19:06.205493 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.214502 23302 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.215405 22989 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:06.215240 23302 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:06.216012 22989 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:06.216586 22989 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:06.218168 23302 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:06.129418 23239 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:06.219273 23280 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.365s	user 0.010s	sys 0.003s
I20260709 13:19:06.092506 23143 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:06.222669 23143 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:06.228376 23236 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:06.229092 23236 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:06.231609 23236 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:06.234759 23271 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.810s	user 0.000s	sys 0.006s
I20260709 13:19:06.232182 23236 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:06.194156 23071 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:06.117713 23176 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:06.190351 23013 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:06.256500 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 827) took 1190 ms. Trace:
I20260709 13:19:06.218799 22989 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:19:06.268950 18382 rpcz_store.cc:276] 0709 13:19:05.056271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.056448 (+   177us) service_pool.cc:224] Handling call
0709 13:19:05.056763 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.057126 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.057157 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:05.057618 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:19:05.198656 (+141038us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:05.198696 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.198782 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:06.246311 (+1047529us) raft_consensus.cc:1685] finished
0709 13:19:06.246345 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.246539 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":140653,"threads_started":1,"wal-append.queue_time_us":546051}
I20260709 13:19:06.238571 23260 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:06.304915 23071 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:06.283357 18351 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.129:43781 timed out after 1.639s (SENT) [suppressed 18 similar messages]
W20260709 13:19:06.285959 23130 consensus_meta.cc:287] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 1.155s	user 0.011s	sys 0.014s
W20260709 13:19:06.316555 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 222817us
I20260709 13:19:06.317366 18201 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:06.288345 23143 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:06.273072 23236 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:06.325920 23261 consensus_meta.cc:287] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.002s	user 0.014s	sys 0.014s
I20260709 13:19:06.296370 23225 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:06.348491 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:06.315078 23192 consensus_meta.cc:287] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.702s	user 0.012s	sys 0.003s
W20260709 13:19:06.338951 23279 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.325s	user 0.002s	sys 0.000s
I20260709 13:19:06.355891 18237 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:06.358919 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:06.357189 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:06.344750 23071 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:06.344466 23199 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.349382 23150 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.334034 23130 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:06.387915 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.392361 18236 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:06.393865 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:06.395390 23297 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.398710 18306 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:06.361728 23192 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:06.406775 18237 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:06.406826 23297 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:06.401031 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:06.355253 23143 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:06.361980 23225 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:06.398465 23298 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 13:19:06.415212 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 131900us
I20260709 13:19:06.422226 18231 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:06.372623 23150 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:06.373041 23199 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:06.434960 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:06.435696 18303 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:06.451519 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:06.453891 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:06.454283 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:06.454910 18307 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:06.456439 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:06.457233 18307 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:06.458242 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:06.458891 18307 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:06.454975 18304 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:06.477711 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:06.477888 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:06.459002 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:06.478909 18304 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:06.482420 18312 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:06.486940 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:06.425547 23176 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:06.496862 18307 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:19:06.475430 23279 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:06.499341 23093 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:06.532016 18303 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
W20260709 13:19:06.624505 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.624543 18308 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:19:06.645515 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 176084us
I20260709 13:19:06.647244 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:06.648343 23261 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:06.648808 23261 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.649284 23261 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:06.661396 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2842) took 1311 ms. Trace:
I20260709 13:19:06.501956 23313 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:06.622725 23260 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:06.500238 23235 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.140s
I20260709 13:19:06.727766 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:06.710104 23279 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:06.661938 18381 rpcz_store.cc:276] 0709 13:19:05.349867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.351085 (+  1218us) service_pool.cc:224] Handling call
0709 13:19:05.351394 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:05.351764 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.351791 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:05.352296 (+   505us) log.cc:844] Serialized 52 byte log entry
0709 13:19:05.913280 (+560984us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:05.913324 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.913395 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:06.661057 (+747662us) raft_consensus.cc:1685] finished
0709 13:19:06.661088 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.661301 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5337,"raft.queue_time_us":727,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":15888,"thread_start_us":490304,"threads_started":1,"wal-append.queue_time_us":709725}
I20260709 13:19:06.735492 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:06.738752 18231 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
W20260709 13:19:06.656652 23309 log.cc:927] Time spent T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.149s	user 0.005s	sys 0.001s
W20260709 13:19:06.699116 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 201302us
I20260709 13:19:06.741672 23192 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:06.737080 23230 consensus_queue.cc:1059] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:19:06.768533 23236 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:06.761960 23323 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:06.781597 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2614) took 1494 ms. Trace:
I20260709 13:19:06.773597 23130 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:06.809751 23324 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:06.762270 23093 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:06.880781 23324 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:06.816319 18305 rpcz_store.cc:276] 0709 13:19:05.282157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.282637 (+   480us) service_pool.cc:224] Handling call
0709 13:19:05.283048 (+   411us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:05.288364 (+  5316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.288408 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:05.293649 (+  5241us) log.cc:844] Serialized 52 byte log entry
0709 13:19:05.441677 (+148028us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:05.448867 (+  7190us) log.cc:844] Serialized 14 byte log entry
0709 13:19:05.449379 (+   512us) log.cc:844] Serialized 14 byte log entry
0709 13:19:05.477302 (+ 27923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.477376 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.730437 (+253061us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b18003eb660. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f186522 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:19:06.775862 (+1045425us) raft_consensus.cc:1685] finished
0709 13:19:06.775887 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.776045 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":705359,"prepare.queue_time_us":732071,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":4123,"raft.queue_time_us":42259,"raft.run_cpu_time_us":472,"raft.run_wall_time_us":29343,"spinlock_wait_cycles":19222784,"thread_start_us":136041,"threads_started":2,"wal-append.queue_time_us":284651}
I20260709 13:19:06.810904 23318 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:19:06.841683 23199 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:06.840082 23176 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:19:06.840241 23308 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.346s	user 0.000s	sys 0.002s
I20260709 13:19:06.892644 18200 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:06.833528 23230 consensus_queue.cc:1243] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:06.833091 23156 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:06.904153 23156 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:06.906842 23156 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:06.915446 23230 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:06.916293 23230 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:06.919865 18382 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:06.876711 23093 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:06.898932 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 121947us
I20260709 13:19:06.884994 23310 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.900254 23324 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:06.979722 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 52658us
I20260709 13:19:06.900578 23319 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:06.898375 23143 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:06.978621 23328 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:06.980922 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:06.914640 23235 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:06.984490 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 63464.9us
I20260709 13:19:06.833575 23323 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:06.994110 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:06.993176 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:06.997193 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:06.918576 23225 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:06.999460 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:06.932945 23307 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:06.924804 23297 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.014405 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:06.914242 23176 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:07.017992 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.019799 23176 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:07.020913 23321 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:19:06.989039 23319 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.023379 23319 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.024065 23297 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:19:07.017031 23325 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:19:07.024845 23297 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.027451 23297 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:06.982187 23310 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.030519 23310 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.032414 23176 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:06.986083 23324 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:07.033386 23324 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:07.033219 23176 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.038049 23176 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.038187 23323 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.039189 23332 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.039819 23332 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.042527 23332 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:07.020073 23322 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:19:07.035724 23324 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:07.105482 23260 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:07.106083 23260 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.108034 23260 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.001368 23235 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.110494 23199 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:07.129563 23093 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:07.135011 23199 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.146035 23199 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:07.151098 22915 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 1.040s	user 0.010s	sys 0.002s
I20260709 13:19:07.152055 18382 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:07.152798 23191 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.153388 23191 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.136629 23335 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:07.003144 23328 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:07.171764 23328 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:07.174525 23191 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:07.141435 23230 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:07.148392 23235 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:07.160290 23261 consensus_meta.cc:287] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.008s
I20260709 13:19:07.189042 23261 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.196707 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:07.197543 18381 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:07.201179 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:07.202021 18381 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:07.202127 23236 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:07.202776 23236 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:07.212038 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:07.213106 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:07.192139 23261 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.254740 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:07.200198 22454 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:07.264869 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:07.266050 18378 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:19:07.263444 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:07.261613 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 275863us
I20260709 13:19:07.268316 23234 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.269531 23234 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.271437 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:07.272228 18381 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:19:07.277595 18926 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:07.278625 22800 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:07.279047 22800 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:07.279453 22800 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.203826 23236 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.293485 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:07.296262 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 289366us
I20260709 13:19:07.297792 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:07.298254 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:07.297261 18235 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:07.301252 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:07.302781 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.288815 22454 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.303418 18229 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:19:07.304630 23191 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:07.306579 18228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.014s	sys 0.003s
I20260709 13:19:07.307006 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:19:07.313299 18228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.015s	sys 0.004s
I20260709 13:19:07.315112 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:07.315554 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.263880 22915 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:07.312305 23199 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:07.313678 23331 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.305955 23332 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:07.306665 23235 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
W20260709 13:19:07.318436 23311 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.008s	sys 0.021s
I20260709 13:19:07.321429 18236 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 16: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:07.327592 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:07.326531 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:07.313642 23191 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
W20260709 13:19:07.327469 23311 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.008s	sys 0.022s
I20260709 13:19:07.358676 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:07.359583 23150 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:07.323138 22915 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.358700 22454 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.326629 23199 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.364909 23093 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:07.330826 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:07.323334 22800 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:07.326056 23343 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:07.422406 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 89553.1us
W20260709 13:19:07.423071 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 96874.8us
W20260709 13:19:07.422889 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 92191.2us
I20260709 13:19:07.457603 18384 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
W20260709 13:19:07.539538 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 83177us
I20260709 13:19:07.420475 23093 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.418197 23328 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:07.465121 18201 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:07.328081 23335 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:19:07.330782 23332 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.328747 23331 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.452339 23343 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.573449 22800 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.574265 23143 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:07.574787 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:07.576889 18385 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:07.578552 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 113528us
I20260709 13:19:07.579811 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:07.581728 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:07.488332 23344 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.451505 23339 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:07.424122 22454 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
I20260709 13:19:07.543711 23342 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:07.548454 23093 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:07.573098 23345 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:07.588572 22800 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:07.607264 22800 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:07.608027 22800 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:07.616222 18385 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:19:07.624667 18926 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:07.625929 23337 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:07.634382 22915 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:07.636834 23346 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:19:07.626581 23337 raft_consensus.cc:697] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:07.641918 23337 consensus_queue.cc:237] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:07.645471 23199 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.646346 23342 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.598654 23294 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:07.594872 23143 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.588774 23319 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:07.652458 23319 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.652982 23319 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:07.643560 22800 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:07.657506 23234 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:07.595340 23344 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.664563 23332 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.586596 23343 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:07.671448 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.704011 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:07.704268 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:07.704849 18378 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:19:07.706231 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:07.696065 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 155447us
I20260709 13:19:07.703119 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:07.593534 23339 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:07.564792 23328 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:07.719817 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:07.726029 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:07.655908 23345 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.757283 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:07.761013 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47279.5us
I20260709 13:19:07.761907 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:07.759060 22800 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:19:07.780788 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:07.718912 23339 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:07.813107 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 51289.5us
I20260709 13:19:07.814620 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:07.815625 18385 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:07.712383 23344 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.830245 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.830891 18229 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:07.831461 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.834285 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.834713 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.836141 23334 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:07.835397 18232 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:07.836700 23334 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.837881 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.838479 18232 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:07.838743 23334 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.839246 23341 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:07.839825 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.841374 18385 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:07.841426 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.842265 18232 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:19:07.842875 23340 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:07.843458 23340 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.843969 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.769286 23342 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.839744 23341 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:07.832360 23234 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:07.833658 23143 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:07.851013 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.894729 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.844719 18233 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:07.871342 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:07.898751 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.898835 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.899088 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:07.901276 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:07.902209 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:07.903337 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:07.904207 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:07.899580 18236 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:07.907223 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.899603 18237 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:07.908593 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.908833 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:07.908751 18385 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:19:07.909889 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:07.907958 18235 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:19:07.915007 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:07.915985 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:07.919158 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:07.925048 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:07.861891 23343 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.870895 23192 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:07.912712 22463 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.929721 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:07.845889 23340 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:07.852656 23341 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:07.916047 23261 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:07.913558 23143 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:07.867328 23331 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.844471 23345 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.862035 23328 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:07.911741 23142 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:07.915679 23191 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:07.916500 22915 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:07.912969 23232 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:07.939677 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:07.876973 23234 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:07.916345 22454 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:07.925019 23150 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:07.948295 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:07.942914 23235 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:07.934508 22951 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:07.980201 23328 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:07.934544 23302 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:07.970492 18236 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:07.944965 22463 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:07.941740 23192 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:07.956266 23142 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:07.974329 23234 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:07.981549 22454 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:07.959193 22915 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:07.991756 22951 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:08.007948 22951 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:07.991559 23235 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:08.000996 23350 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:19:05.993788 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:07.979310 23232 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:08.007988 23343 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:07.951309 23261 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.015272 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2618) took 2721 ms. Trace:
I20260709 13:19:08.015708 18306 rpcz_store.cc:276] 0709 13:19:05.293783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.293914 (+   131us) service_pool.cc:224] Handling call
0709 13:19:05.301936 (+  8022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.406882 (+1104946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.014955 (+1608073us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000bbdd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:08.015169 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2521876864}
I20260709 13:19:08.016978 23261 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:08.009470 23319 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.010485 23235 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:07.951501 23143 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:07.999763 23142 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:08.009246 22915 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:08.011763 23232 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:08.013929 23306 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 1.512s	user 0.013s	sys 0.026s
I20260709 13:19:08.005980 22463 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:07.993876 23328 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:08.043301 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:08.028689 23319 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:08.040920 22930 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:08.046845 23287 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:08.049495 23290 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:08.036702 23009 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.030027 23143 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:08.047308 23013 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:08.037420 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:08.042936 23293 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:08.042197 22454 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:08.042992 23239 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:08.039530 23093 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.046291 23267 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:08.047825 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 1.57469e+06us
I20260709 13:19:08.099190 18277 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:08.100337 18277 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:08.031663 23192 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:07.995290 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:08.061661 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:08.114913 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 119698us
I20260709 13:19:08.115566 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:08.062233 22930 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:08.044296 18337 heartbeater.cc:646] Failed to heartbeat to 127.16.188.190:46739 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.16.188.190:46739 timed out after 15.000s (SENT)
I20260709 13:19:08.029039 23339 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.055399 23328 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:08.097013 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 69346us
I20260709 13:19:08.091888 23266 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:08.094550 23060 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:08.144760 18380 raft_consensus.cc:2393] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:08.094856 23130 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:08.160790 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:08.092783 23009 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.082882 23287 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.121794 23313 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:08.211475 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:08.212342 18234 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:19:08.213450 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:08.213806 18351 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:08.214082 18234 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 16: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:08.090610 23290 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:08.168015 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1969) took 1713 ms. Trace:
I20260709 13:19:08.097626 23013 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:08.216987 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 115615us
I20260709 13:19:08.101263 23239 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:08.166498 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.231068 23359 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:19:08.231607 23315 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 1.592s	user 0.014s	sys 0.034s
I20260709 13:19:08.156570 23266 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.232714 18958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54020 (request call id 395) took 2766 ms. Trace:
I20260709 13:19:08.233198 18958 rpcz_store.cc:276] 0709 13:19:05.466234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.466786 (+   552us) service_pool.cc:224] Handling call
0709 13:19:05.467445 (+   659us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.478329 (+ 10884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.478366 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.238419 (+760053us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b2c00047988. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:19:06.255799 (+ 17380us) log.cc:844] Serialized 572 byte log entry
0709 13:19:06.373859 (+118060us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:06.373918 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.374012 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.230992 (+1856980us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:19:08.232358 (+  1366us) raft_consensus.cc:1685] finished
0709 13:19:08.232386 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.232601 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38120960,"thread_start_us":117545,"threads_started":1,"wal-append.queue_time_us":176590}
I20260709 13:19:08.234477 23266 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:08.236101 23009 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:08.239252 23239 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:08.240038 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1971) took 1785 ms. Trace:
I20260709 13:19:08.240804 22930 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:08.240398 18311 rpcz_store.cc:276] 0709 13:19:06.454722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.481896 (+ 27174us) service_pool.cc:224] Handling call
0709 13:19:06.498600 (+ 16704us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.050951 (+1552351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.050994 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.051440 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.160150 (+108710us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:08.160189 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.161529 (+  1340us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.239841 (+ 78312us) raft_consensus.cc:1685] finished
0709 13:19:08.239861 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.239981 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1582623,"raft.queue_time_us":1553062,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":3767,"thread_start_us":108282,"threads_started":1,"wal-append.queue_time_us":186378}
I20260709 13:19:08.163225 23130 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.243605 23130 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:08.247890 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:08.167932 23288 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:08.250183 18234 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:08.157217 23225 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:08.096938 23293 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:08.254150 18277 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:08.205229 23179 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:08.254833 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:19:08.219066 23306 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:08.258668 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1975) took 1803 ms. Trace:
I20260709 13:19:08.284711 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:08.219588 18304 rpcz_store.cc:276] 0709 13:19:06.454179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.479778 (+ 25599us) service_pool.cc:224] Handling call
0709 13:19:06.480124 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.480371 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:06.503537 (+ 23166us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.162599 (+1659062us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.162676 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:08.166450 (+  3774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.167456 (+  1006us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.167930 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1170210,"prepare.queue_time_us":20091,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1224135,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":4456,"spinlock_wait_cycles":1511168,"thread_start_us":472591,"threads_started":2,"wal-append.queue_time_us":415914,"wal-append.run_cpu_time_us":2058,"wal-append.run_wall_time_us":1105604}
I20260709 13:19:08.117659 23267 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.287403 23179 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:08.287639 18201 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:08.224890 23313 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:08.254870 23226 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:08.160257 23060 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.300009 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:08.285195 18309 rpcz_store.cc:276] 0709 13:19:06.455678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.487684 (+ 32006us) service_pool.cc:224] Handling call
0709 13:19:06.488013 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.488299 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:06.659073 (+170774us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.258274 (+1599201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.258340 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:08.258395 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.258469 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.258604 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1188092,"prepare.queue_time_us":154403,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1458,"raft.queue_time_us":1203671,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":15738,"thread_start_us":424377,"threads_started":2,"wal-append.queue_time_us":256359,"wal-append.run_cpu_time_us":1537,"wal-append.run_wall_time_us":1005244}
I20260709 13:19:08.312685 18377 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:08.315394 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:08.298264 18277 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:08.294624 22930 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:08.259918 23340 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:08.251776 23288 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.301498 23179 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:08.285718 23225 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.311411 23302 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:08.347381 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:08.348242 23370 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:08.349572 23130 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:08.352733 23313 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:08.378188 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 83933.7us
I20260709 13:19:08.381706 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:08.354159 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:19:08.357453 23364 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:08.361325 23339 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:08.362298 23363 log.cc:927] Time spent T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:08.352015 23232 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.327086 22930 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:08.417762 22930 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:08.382266 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.386457 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1976) took 1930 ms. Trace:
I20260709 13:19:08.420962 18307 rpcz_store.cc:276] 0709 13:19:06.455981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.501989 (+ 46008us) service_pool.cc:224] Handling call
0709 13:19:06.644317 (+142328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.057036 (+1412719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.057084 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.089297 (+ 32213us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.164273 (+ 74976us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:08.164345 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.164471 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.386088 (+221617us) raft_consensus.cc:1685] finished
0709 13:19:08.386121 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.386368 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1412231,"raft.queue_time_us":1412368,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"thread_start_us":42249,"threads_started":1,"wal-append.queue_time_us":235308}
I20260709 13:19:08.345326 18234 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:19:08.389209 23370 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.395327 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2853) took 1463 ms. Trace:
I20260709 13:19:08.425102 18382 rpcz_store.cc:276] 0709 13:19:06.931682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.931865 (+   183us) service_pool.cc:224] Handling call
0709 13:19:06.932294 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.152481 (+220187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.395006 (+1242525us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400242554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:08.395252 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504504192}
I20260709 13:19:08.369242 23234 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.397719 22915 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.401914 23293 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:08.403354 23013 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:08.451579 23179 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.404389 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1973) took 1949 ms. Trace:
I20260709 13:19:08.454182 18308 rpcz_store.cc:276] 0709 13:19:06.455204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.484332 (+ 29128us) service_pool.cc:224] Handling call
0709 13:19:06.544049 (+ 59717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.640127 (+ 96078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.404165 (+1764038us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b540013ef50. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:08.404319 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136555904}
I20260709 13:19:08.404659 23287 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:08.454852 22915 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:08.409363 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1953) took 3097 ms. Trace:
I20260709 13:19:08.395028 23235 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.371094 23373 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.343462 23226 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:08.412717 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:08.417176 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:08.453672 23179 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:08.431540 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 77490.1us
I20260709 13:19:08.438648 23060 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:08.439170 23377 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:08.439416 23234 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:08.440541 23130 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:08.441231 23302 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:08.442747 23236 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:08.443326 23232 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:08.340791 23340 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.445372 23093 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:08.446878 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 1972) took 1991 ms. Trace:
I20260709 13:19:08.456887 23373 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:08.429746 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 48125.4us
I20260709 13:19:08.489115 18312 rpcz_store.cc:276] 0709 13:19:06.454961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.483215 (+ 28254us) service_pool.cc:224] Handling call
0709 13:19:06.483427 (+   212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.048317 (+1564890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.048361 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.048895 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.120675 (+ 71780us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:08.120715 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.120784 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.446696 (+325912us) raft_consensus.cc:1685] finished
0709 13:19:08.446714 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.446825 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1564585,"raft.queue_time_us":1567002,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":65,"thread_start_us":70903,"threads_started":1,"wal-append.queue_time_us":326418}
I20260709 13:19:08.455413 18310 rpcz_store.cc:276] 0709 13:19:05.312357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.317179 (+  4822us) service_pool.cc:224] Handling call
0709 13:19:05.317425 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.467898 (+150473us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:06.085690 (+617792us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.013385 (+1927695us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:19:08.127775 (+114390us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.142680 (+ 14905us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.142729 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:08.142772 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.409111 (+266339us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400350f54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:08.409163 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.409296 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1711827,"prepare.queue_time_us":230832,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":122,"raft.queue_time_us":1792632,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":157,"spinlock_wait_cycles":384986240,"thread_start_us":927012,"threads_started":3,"wal-append.queue_time_us":345253}
W20260709 13:19:08.482568 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 194971us
I20260709 13:19:08.473672 23377 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:08.487035 23372 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:08.487736 23370 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:08.405948 23267 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:08.459112 23226 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:08.469312 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:08.498512 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:08.479753 23302 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.437093 22951 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:08.526638 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 57425.7us
I20260709 13:19:08.527184 23142 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.529121 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.515096 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.500949 23377 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:08.506877 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.530130 18385 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:08.513311 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.498394 22923 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:08.545135 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:08.545286 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 46876.2us
I20260709 13:19:08.546258 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.549335 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.550788 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.551983 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.554282 18277 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:08.559221 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.526191 23226 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:08.562561 23235 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:08.544703 23287 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:08.608698 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.610173 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.611404 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.560331 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.612942 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 2588) took 1353 ms. Trace:
I20260709 13:19:08.613337 18384 rpcz_store.cc:276] 0709 13:19:07.259041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.260504 (+  1463us) service_pool.cc:224] Handling call
0709 13:19:08.612738 (+1352234us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540004c9d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:08.612850 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365712640}
W20260709 13:19:08.614691 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 60487us
I20260709 13:19:08.615446 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:08.564164 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.547892 22923 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:19:08.562106 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 49827.7us
I20260709 13:19:08.568467 23266 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:08.562923 23293 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:19:08.559755 23370 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:08.574045 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 592) took 1847 ms. Trace:
I20260709 13:19:08.587056 18386 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:08.591184 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2130) took 1600 ms. Trace:
I20260709 13:19:08.620486 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:08.624732 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.634778 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:08.628243 18955 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:08.517767 22915 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:08.627605 18201 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:19:08.613862 23143 consensus_meta.cc:287] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.002s
I20260709 13:19:08.635082 18380 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 16: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:08.626148 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.663446 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:08.666435 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:08.626695 23130 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:08.679591 23266 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:08.631850 18228 rpcz_store.cc:276] 0709 13:19:06.725929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.726185 (+   256us) service_pool.cc:224] Handling call
0709 13:19:06.726731 (+   546us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:07.319281 (+592550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.319320 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:07.329130 (+  9810us) log.cc:844] Serialized 52 byte log entry
0709 13:19:07.802505 (+473375us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:08.422798 (+620293us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b1800278740. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f183455 00007fa185c6b3c7 00007fa18227d9a7 00007fa18228d0bf 00007fa18228d038
0709 13:19:08.515566 (+ 92768us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.562716 (+ 47150us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.572905 (+ 10189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.573003 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.573142 (+   139us) raft_consensus.cc:1685] finished
0709 13:19:08.573158 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.573281 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55895,"prepare.queue_time_us":150761,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":294,"raft.queue_time_us":213367,"raft.run_cpu_time_us":375,"raft.run_wall_time_us":9325,"spinlock_wait_cycles":6384768,"thread_start_us":869163,"threads_started":3,"wal-append.queue_time_us":369081}
I20260709 13:19:08.629421 22923 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:08.632150 18231 rpcz_store.cc:276] 0709 13:19:06.990717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.992082 (+  1365us) service_pool.cc:224] Handling call
0709 13:19:06.992507 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.028700 (+ 36193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.028737 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:07.028787 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:07.028830 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.590896 (+1562066us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b540005ad54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:08.590954 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.591108 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82548096}
I20260709 13:19:08.677446 18276 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:08.679476 23372 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:08.703086 23071 consensus_queue.cc:1059] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:08.677807 23310 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:08.704703 23332 raft_consensus.cc:3055] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:08.705298 23332 raft_consensus.cc:740] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:08.706457 23332 consensus_queue.cc:260] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:08.708092 23332 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.680354 18384 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:08.692602 22454 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:08.678627 23384 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:19:08.693404 23179 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:08.735452 23179 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:08.735953 23179 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:08.726812 23266 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.737291 23266 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.738819 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:08.740013 18384 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:08.687358 23173 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:19:08.662719 22951 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:08.742179 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.742343 23130 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.696959 22943 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:08.742933 23130 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.743903 23340 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:08.704282 23071 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:08.744025 22943 raft_consensus.cc:3055] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:08.659443 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.667305 23013 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:08.729789 23372 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:08.730063 23267 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:08.734882 23241 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:08.745287 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:08.741053 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:08.748404 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.744691 23239 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.756868 18377 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:08.755031 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.755252 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.758704 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.758589 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.759413 18303 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:08.759472 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.756870 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.760851 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.668815 22915 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:08.763428 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.764334 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:08.693188 23260 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:19:08.770527 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.767177 22454 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:19:08.756742 23372 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.772993 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.773577 23297 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:08.748733 22943 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:08.774595 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.775444 18311 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:08.705354 23310 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:08.739444 23373 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:08.768986 18310 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:19:08.773784 18306 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:08.676687 23143 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:08.767711 18377 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:08.753484 23241 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:08.791860 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.773888 22454 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:08.758392 23267 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:08.795636 23143 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:08.796131 18382 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:19:08.796849 23266 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:08.801719 22930 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.801086 23130 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:08.804863 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:08.806353 18308 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:08.815752 18310 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:08.830674 18304 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:08.815136 23290 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:08.809374 22454 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:08.840080 22454 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.841890 22454 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:08.844173 23310 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.846858 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.848824 18303 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:08.852010 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2862) took 1136 ms. Trace:
I20260709 13:19:08.852474 18378 rpcz_store.cc:276] 0709 13:19:07.715297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.715461 (+   164us) service_pool.cc:224] Handling call
0709 13:19:08.614165 (+898704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.614339 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.614398 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.614443 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:08.614480 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.614541 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.851820 (+237279us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b540004c9d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:08.851943 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2066056448}
I20260709 13:19:08.767501 23239 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.862778 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:08.873521 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:08.874320 18308 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:08.876091 18310 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:08.877122 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:08.878816 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:08.882131 23302 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:08.884938 23328 consensus_meta.cc:287] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.727s	user 0.013s	sys 0.000s
I20260709 13:19:08.885094 23372 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:08.885243 18384 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:08.885587 23328 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.886050 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:08.884928 23302 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:08.886704 18304 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:08.888022 23328 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:08.890775 23179 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.892285 18309 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:19:08.892663 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.895763 23339 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.896390 23339 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:08.899154 23179 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:08.901922 18385 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:08.906038 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:08.907394 18312 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:08.920006 18304 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:08.909679 23302 raft_consensus.cc:2764] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:19:08.928372 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 295448us
I20260709 13:19:08.935284 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:08.930061 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.912963 22915 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:08.950238 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.951027 18310 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:08.953743 18312 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:08.952010 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.956058 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.964598 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.966156 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.967121 18310 raft_consensus.cc:2393] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:08.968070 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:08.968787 18380 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:08.969600 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.971084 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:08.975374 23304 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:08.975948 23304 raft_consensus.cc:697] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:08.984551 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:08.989588 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:08.973237 23142 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:08.991291 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:08.992275 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:08.992803 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:08.995210 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:08.996467 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:08.996608 23266 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:08.997656 23266 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:08.998029 23266 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:08.998773 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:08.999400 18228 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:19:08.998939 23266 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.000664 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:09.000953 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.002112 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.002612 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.003829 22930 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:09.006587 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:09.007222 18228 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:09.013510 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 60249.5us
I20260709 13:19:09.000306 23266 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:09.014345 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.019766 18310 raft_consensus.cc:2410] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:19:09.011641 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 132930us
I20260709 13:19:09.021938 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:08.990676 23267 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:09.046304 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:09.050467 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.050321 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.055610 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:08.990028 22923 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.061299 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.061622 18228 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:09.065455 23241 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.066831 23241 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:09.069376 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.075866 18308 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:09.077445 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:08.995483 23377 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.077447 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.078133 18233 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.017554 23304 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:09.080390 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.102108 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:09.107141 18236 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:09.107267 23385 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:19:09.107905 23371 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.672s	user 0.005s	sys 0.001s
I20260709 13:19:09.084486 23377 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:09.086324 22923 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:09.109637 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.093699 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.110688 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:09.110844 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.102262 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:09.094921 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.111865 18232 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:09.112588 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.080678 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.111217 18309 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:09.098595 23226 consensus_meta.cc:287] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.004s
I20260709 13:19:09.116997 23226 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.117966 18306 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:09.104295 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:09.120814 18382 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:09.106221 18231 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 7.
I20260709 13:19:09.077770 23288 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:09.099502 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:09.098263 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:09.123492 18228 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:09.123881 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.124424 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:09.100306 23357 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.943s	user 0.003s	sys 0.000s
I20260709 13:19:09.125546 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.115407 18311 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:09.126513 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.126735 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 1899) took 1293 ms. Trace:
I20260709 13:19:09.082928 23239 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:09.127578 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.129081 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.097354 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:09.130055 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:09.130318 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.131009 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.131707 18304 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:09.131626 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.127059 18229 rpcz_store.cc:276] 0709 13:19:07.833271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.833588 (+   317us) service_pool.cc:224] Handling call
0709 13:19:07.833904 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:07.894526 (+ 60622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:07.894562 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:07.895044 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.010021 (+114977us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:08.058381 (+ 48360us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.068318 (+  9937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.068414 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.099636 (+1031222us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:19:09.126441 (+ 26805us) raft_consensus.cc:1685] finished
0709 13:19:09.126561 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.126684 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41998,"prepare.queue_time_us":48088,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":809,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":31963,"spinlock_wait_cycles":13893376,"thread_start_us":85165,"threads_started":1,"wal-append.queue_time_us":158190}
I20260709 13:19:09.134505 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.135623 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:09.136235 18229 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:09.103684 23225 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:09.151976 18306 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:09.123494 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:09.153043 18231 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:09.154929 23226 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:09.155905 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 134168us
I20260709 13:19:09.143072 18228 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:09.143766 23339 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:09.144682 18380 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:09.165859 18309 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:09.166622 18308 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:09.146196 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:09.184526 18306 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:19:09.185009 18385 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:09.146881 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:09.186427 18310 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:19:09.187085 18305 raft_consensus.cc:2410] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:19:09.189735 18233 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:09.190132 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:09.190721 18304 raft_consensus.cc:2376] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15. Re-sending same reply.
I20260709 13:19:09.188262 23239 consensus_queue.cc:1059] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:19:09.193732 23239 raft_consensus.cc:3055] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:09.194072 23239 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:09.195083 23239 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:09.196698 23239 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:09.199329 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:09.127580 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:09.203040 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:09.203742 18312 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:09.204566 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:09.206040 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:09.207314 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:09.209049 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:09.212666 18386 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:09.213838 18385 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:09.217622 18303 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:09.167112 23394 consensus_queue.cc:1059] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:09.218541 23394 raft_consensus.cc:3055] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:09.218767 22951 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:09.218889 23394 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:09.219321 22951 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.219770 23394 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:09.221904 23394 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:09.145746 18131 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 87) took 15004 ms (client timeout 15000 ms). Trace:
W20260709 13:19:09.224666 18131 rpcz_store.cc:269] 0709 13:18:54.141141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.141633 (+   492us) service_pool.cc:224] Handling call
0709 13:19:09.145656 (+15004023us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:03.054611 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:03.055553 (+   942us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:03.055623 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:19:03.055652 (+    29us) tablet.cc:662] Decoding operations
0709 13:19:03.176037 (+120385us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:03.176192 (+   155us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:03.176242 (+    50us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:19:03.178031 (+  1789us) tablet.cc:701] Row locks acquired
0709 13:19:03.178107 (+    76us) write_op.cc:260] PREPARE: finished
0709 13:19:03.178368 (+   261us) write_op.cc:270] Start()
0709 13:19:03.178617 (+   249us) write_op.cc:276] Timestamp: P: 1783603143178280 usec, L: 0
0709 13:19:03.178643 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:19:03.209387 (+ 30744us) log.cc:844] Serialized 5101 byte log entry
0709 13:19:03.847017 (+637630us) op_driver.cc:464] REPLICATION: finished
0709 13:19:04.128971 (+281954us) write_op.cc:301] APPLY: starting
0709 13:19:04.169635 (+ 40664us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:04.389429 (+219794us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:04.389624 (+   195us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:04.684250 (+294626us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:04.737912 (+ 53662us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 13:19:04.784155 (+ 46243us) write_op.cc:312] APPLY: finished
0709 13:19:04.835346 (+ 51191us) log.cc:844] Serialized 113 byte log entry
0709 13:19:05.084102 (+248756us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:05.102616 (+ 18514us) write_op.cc:454] Released schema lock
0709 13:19:05.109367 (+  6751us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:05.135249 (+ 25882us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:05.135863 (+   614us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1231738,"reported_tablets":13,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":270612,"apply.run_cpu_time_us":43686,"apply.run_wall_time_us":1001233,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54191,"num_ops":12,"prepare.queue_time_us":36853,"prepare.run_cpu_time_us":25716,"prepare.run_wall_time_us":476889,"raft.queue_time_us":151064,"raft.run_cpu_time_us":29694,"raft.run_wall_time_us":218721,"replication_time_us":653654,"thread_start_us":818003,"threads_started":5,"wal-append.queue_time_us":682737,"wal-append.run_cpu_time_us":34630,"wal-append.run_wall_time_us":2328156}]]}
W20260709 13:19:09.231209 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.231833 22951 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:09.177451 18311 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:09.178814 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 2874) took 1242 ms. Trace:
I20260709 13:19:09.237252 18383 rpcz_store.cc:276] 0709 13:19:07.936459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:07.936720 (+   261us) service_pool.cc:224] Handling call
0709 13:19:08.398850 (+462130us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5800050198. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:19:08.399054 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.516223 (+117169us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:08.809340 (+293117us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.941075 (+131735us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.951759 (+ 10684us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.951829 (+    70us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:08.951889 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.067966 (+116077us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b18001acda0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1542a6 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1
0709 13:19:09.069790 (+  1824us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b18001acda0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:19:09.105649 (+ 35859us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b18001acda0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:19:09.151976 (+ 46327us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b18001acda0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa18614758f 00007fa17f186571 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd
0709 13:19:09.178613 (+ 26637us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400242f54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:09.178659 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.178760 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51437,"prepare.queue_time_us":84899,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":95,"raft.queue_time_us":29699,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":13240,"spinlock_wait_cycles":322358016,"thread_start_us":366884,"threads_started":2,"wal-append.queue_time_us":146984}
I20260709 13:19:09.181371 18236 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:09.156003 18237 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:09.242358 18229 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:09.142241 22943 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.248716 22943 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.249011 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:09.250180 18378 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:09.232478 18231 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
W20260709 13:19:09.235718 23337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.003s	sys 0.010s
I20260709 13:19:09.215693 18927 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:09.245512 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.246537 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:09.247756 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:09.384333 18236 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 12: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:09.385630 18236 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:09.388118 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:09.389088 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.389873 18231 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:09.391207 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.393900 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.395587 22989 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:09.395807 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:09.397081 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 181472us
I20260709 13:19:09.174197 18232 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:09.371048 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:19:09.258646 23337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.003s	sys 0.011s
I20260709 13:19:09.373463 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:09.275470 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:09.262020 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:09.186535 18306 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:09.400295 18230 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:19:09.402763 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:09.415982 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 45031.3us
I20260709 13:19:09.418285 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:09.419435 22915 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:09.420456 22915 raft_consensus.cc:697] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:09.416069 23143 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:09.422279 23143 raft_consensus.cc:697] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:09.421913 22915 consensus_queue.cc:237] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.425154 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.425714 18307 raft_consensus.cc:2393] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:09.426195 18229 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
W20260709 13:19:09.427347 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 51909.2us
W20260709 13:19:09.428007 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.435966 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:09.423549 23143 consensus_queue.cc:237] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.439479 18234 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:09.440953 18229 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:09.450227 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 44169.6us
I20260709 13:19:09.450843 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:09.447374 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:09.449353 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:09.454746 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:09.453872 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.456239 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:09.461278 18230 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:09.461524 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.462342 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.462620 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:09.463183 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.463443 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.463625 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:09.464267 18232 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:09.464743 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:09.465852 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:09.465468 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.469471 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:09.470320 18228 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:19:09.480020 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:09.471228 18230 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 14: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:09.482843 18228 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:09.485491 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:09.471226 23235 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:09.486915 23266 consensus_queue.cc:1059] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:09.489094 23226 consensus_queue.cc:1059] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:09.489403 23225 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:09.490692 18234 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:09.493813 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:09.441700 23332 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:09.441965 22943 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:09.496426 18276 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:19:09.503839 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 46897.5us
W20260709 13:19:09.504136 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 56877.6us
I20260709 13:19:09.458046 22951 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:09.522962 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:09.520474 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.524869 18235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:09.525198 18202 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:09.525574 18235 raft_consensus.cc:606] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:09.525986 18235 raft_consensus.cc:614] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:09.470772 23234 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:09.490075 23226 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:19:09.530156 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.493436 23235 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:09.490200 23225 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:09.533967 18276 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:09.535514 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:09.536321 23267 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:09.536957 23130 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:09.538178 23288 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:09.522167 23014 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:09.551365 18276 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:09.477442 23239 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:19:09.529639 23313 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:09.558251 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:09.561944 23225 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.552819 18349 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:09.531412 23226 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:09.564982 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:09.522720 23377 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:19:09.523491 23332 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.550349 23267 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.555301 23266 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:09.527606 22943 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:09.552384 23234 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:09.539338 23393 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:19:09.580962 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:09.581985 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:09.585840 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:09.577801 23288 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:09.589178 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:09.576054 22951 raft_consensus.cc:697] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:09.580006 23014 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:09.599094 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:09.599960 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:09.580386 23266 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.582304 23173 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:09.583367 23192 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:09.597544 18958 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:19:09.580066 23267 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:09.607846 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:09.598625 23377 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:09.596140 23230 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:09.606142 23319 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:09.591563 23340 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:09.624963 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 170270us
I20260709 13:19:09.617010 23392 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:09.629343 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:09.605296 23266 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:09.633855 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 179195us
I20260709 13:19:09.635999 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:09.587343 23176 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:09.631122 23241 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:09.637734 23401 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:19:09.623518 22923 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:09.657945 23339 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:09.686638 18132 catalog_manager.cc:5697] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.688935 18232 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:09.671068 18304 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:09.633927 23340 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.700968 23340 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:09.637957 23377 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:09.704867 23377 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:09.706125 23377 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.707737 23377 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.687402 23339 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:09.709427 23339 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:09.674983 23319 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:09.665019 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:09.713945 23394 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:19:09.714334 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 49431.8us
I20260709 13:19:09.716315 23241 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:09.604334 23235 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.637220 23173 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:09.721764 22943 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:09.723102 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:09.729604 18955 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:09.729986 23234 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.730928 22951 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:09.743436 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 162737us
I20260709 13:19:09.637220 23230 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:09.634982 23392 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:09.732404 23332 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:09.753839 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:09.754658 18231 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:09.621628 23226 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:09.760412 18132 catalog_manager.cc:5697] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:09.772126 18233 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
W20260709 13:19:09.759341 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 223932us
I20260709 13:19:09.774667 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:09.776162 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:09.777072 18231 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:19:09.778024 18277 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:09.783245 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 240843us
I20260709 13:19:09.754700 23392 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:09.810475 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.754287 23420 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:09.813263 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:09.831668 23130 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:09.832647 23313 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:09.834010 23313 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
W20260709 13:19:09.839543 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 288241us
W20260709 13:19:09.840354 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.850060 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:09.854688 18235 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:09.859324 23176 consensus_queue.cc:1059] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:09.860181 23418 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:09.861016 23418 consensus_queue.cc:1059] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:09.862123 23418 consensus_queue.cc:1059] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:09.862213 18235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:09.862955 18235 raft_consensus.cc:606] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:09.863323 18235 raft_consensus.cc:614] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:09.865520 23418 raft_consensus.cc:3055] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:09.865943 23418 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:09.866757 23418 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.868019 23418 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:09.870481 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:09.871742 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:09.872532 23307 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:09.873306 23307 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:09.873433 23130 raft_consensus.cc:3055] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:09.874050 23307 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:09.874617 23307 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:09.875196 23288 raft_consensus.cc:3055] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:09.875583 23288 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:09.875635 23307 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.876575 23288 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.878214 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:09.859563 23373 raft_consensus.cc:3055] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:09.874068 23130 raft_consensus.cc:740] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:09.893815 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:09.888883 18349 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:09.889029 18955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54004 (request call id 442) took 1058 ms. Trace:
I20260709 13:19:09.915369 18386 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:09.913755 18955 rpcz_store.cc:276] 0709 13:19:08.815347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.815813 (+   466us) service_pool.cc:224] Handling call
0709 13:19:08.837137 (+ 21324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.742279 (+905142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.873405 (+131126us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b5400862754. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:09.873601 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052010752}
I20260709 13:19:09.853186 23226 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:09.874478 22930 raft_consensus.cc:3055] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:09.886185 23239 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:09.931069 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:09.931247 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 53127.7us
W20260709 13:19:09.935513 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 162569us
I20260709 13:19:09.944228 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:09.907148 23373 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:09.957285 23241 consensus_queue.cc:1059] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:09.957825 23266 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.885882 22943 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:19:09.933363 23093 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:09.886405 23304 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:19:09.943631 23239 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:09.903823 23340 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.935007 22930 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:09.964453 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:09.947400 23417 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:09.954324 23288 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:09.885552 23230 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.986832 23373 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.988224 23373 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:09.989606 23339 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:09.960071 23299 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:19:09.986670 22930 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:09.992029 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 130254us
W20260709 13:19:09.994535 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 216602us
I20260709 13:19:09.995325 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:09.996212 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:09.965656 23071 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:10.005533 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.006179 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.007755 18277 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:10.008821 23339 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:09.980121 23239 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:10.010581 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.014799 18383 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:10.017277 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:09.991890 23093 raft_consensus.cc:697] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:10.027351 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:10.024082 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:10.028185 23423 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:10.028820 23434 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:10.033241 23093 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:10.034308 22930 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:10.034121 23434 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.037178 23426 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:09.985749 23130 consensus_queue.cc:260] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.054709 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:10.059314 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:10.011317 23425 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:10.037914 23434 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:10.020234 23339 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:10.064388 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:19:10.065145 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.063742 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:10.031428 23225 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:10.062258 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 96122.2us
W20260709 13:19:10.073068 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 113928us
I20260709 13:19:10.083882 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:10.074491 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:10.038599 23267 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.066694 23266 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:10.067902 23192 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:10.101395 18231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:10.147809 18231 raft_consensus.cc:606] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
W20260709 13:19:10.152745 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.148348 18231 raft_consensus.cc:614] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:10.105218 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:19:10.079126 23416 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:19:10.190246 22943 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.199806 22943 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:10.190142 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 106434us
W20260709 13:19:10.213265 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.222518 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.068063 23232 consensus_queue.cc:1059] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:19:10.083571 23422 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:10.112262 23425 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:10.238507 23434 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:10.223558 23230 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:10.239689 23230 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:10.223670 23142 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:10.241266 23142 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.146901 23192 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:10.243367 23192 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:10.243556 23142 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:10.244004 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.249770 23230 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.253087 23373 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:10.253746 23373 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.256148 23373 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:10.224447 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 119326us
I20260709 13:19:10.075053 23225 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:10.228896 23404 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:19:10.229353 23433 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:10.229552 23428 log.cc:927] Time spent T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 13:19:10.231490 23430 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:19:10.231613 23232 raft_consensus.cc:3055] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:10.233661 23267 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:10.237213 23377 consensus_meta.cc:287] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.006s
I20260709 13:19:10.108915 23427 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:10.257732 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:10.319006 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 61412.6us
I20260709 13:19:10.319952 18277 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:10.287883 23225 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:10.310684 23373 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.333658 23373 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:10.335695 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.328841 22943 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:10.328763 22930 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:10.338339 22930 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:10.339438 22930 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.275382 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:10.276628 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:10.239931 23392 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:10.274693 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 329622us
W20260709 13:19:10.314428 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 293505us
W20260709 13:19:10.266220 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 61862.5us
I20260709 13:19:10.313937 23393 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:10.316351 23232 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:10.313721 23433 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.321313 23434 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:10.328722 23340 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:10.357021 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:10.347443 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:10.363583 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:10.366833 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:10.367723 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:10.369518 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:10.372862 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:10.372008 23241 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:10.367988 23339 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:10.379786 23235 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:10.380273 23235 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:10.380717 23235 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:10.379033 23232 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.381685 23232 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:10.382249 23241 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:10.384815 18236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:10.385695 18236 raft_consensus.cc:606] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:10.386942 23433 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:10.391767 23392 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:10.385109 23176 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.406766 18277 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:10.420701 18385 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:10.365746 23307 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:19:10.310961 23239 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.439085 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:10.445658 23176 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:10.449944 23226 consensus_meta.cc:287] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.001s
I20260709 13:19:10.450163 23235 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:10.458335 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51674.4us
I20260709 13:19:10.384868 23014 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:10.460170 18277 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:10.372558 23377 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:10.420532 23433 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:10.550034 23420 raft_consensus.cc:3055] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:10.550650 23420 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:10.525549 23373 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:10.525039 22943 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:10.555896 22943 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:10.558923 22943 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:10.485157 23288 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:10.534368 23307 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:10.588635 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 128593us
I20260709 13:19:10.589957 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:10.536247 23176 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:10.658319 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.692638 18277 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:10.597057 23225 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.771410 23225 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:10.591655 23288 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:19:10.772347 23192 consensus_meta.cc:287] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.000s
I20260709 13:19:10.593495 23307 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.774076 23192 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.775992 23192 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:10.633675 23433 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:10.679382 23423 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:10.786077 23423 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.678613 23377 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:10.789324 23377 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.791546 23377 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:10.708878 23235 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:10.796118 23394 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:10.796862 23394 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:10.799417 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.801797 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:10.806699 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:10.807363 18307 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 18.
I20260709 13:19:10.815516 18377 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:10.817282 18384 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:10.818552 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:10.821795 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:10.775998 23307 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:10.833846 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:10.834656 18232 raft_consensus.cc:2393] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:19:10.834530 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 142035us
I20260709 13:19:10.836886 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:19:10.839926 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 469016us
I20260709 13:19:10.788328 23423 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:10.839306 23394 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:10.841902 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:10.848475 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:10.851519 23230 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:10.841259 23377 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:10.839589 23288 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:10.861210 23230 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:10.866083 18277 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:10.873050 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:10.873672 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:10.874378 18304 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 14: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:10.874748 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:10.866426 23433 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:10.877296 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:10.870397 23423 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:10.879760 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:10.879498 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:10.862648 23235 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:19:10.881669 18309 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:10.881568 18304 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:10.882267 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:10.890206 23423 raft_consensus.cc:697] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:10.885046 18306 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:10.959520 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:10.960664 18308 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 14: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:10.939267 18304 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:19:10.939103 18202 leader_election.cc:336] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.853s (SENT)
I20260709 13:19:10.941897 18307 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:10.940186 23393 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:10.945511 23307 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:10.981467 23307 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:10.950003 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.985916 23393 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:10.951032 23173 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:10.987316 23173 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:10.951548 23391 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:10.989130 23391 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:10.866621 23192 consensus_queue.cc:1059] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:19:10.957410 18303 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:10.994621 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:10.995986 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:10.996999 18310 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:10.997911 18303 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:11.003242 18230 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:11.003399 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:10.964184 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:10.976982 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:11.009488 18306 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:11.012682 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:11.013682 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:11.014595 18229 raft_consensus.cc:2393] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:19:10.977985 23448 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.429s	user 0.013s	sys 0.023s
I20260709 13:19:11.015844 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:11.029381 18233 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:11.018625 18235 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:11.031853 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:11.032882 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:11.033535 18382 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:11.034327 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:11.035866 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:11.037564 18237 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:11.040127 18229 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:11.040910 18230 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:11.028923 23307 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.045848 18303 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:11.048099 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:11.008692 23173 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.050709 18303 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:11.074652 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:11.075547 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:11.062474 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:11.076191 18229 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:11.085009 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:11.090809 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:11.091208 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:11.091857 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:11.092258 18303 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:11.093501 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:11.094053 18303 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.094571 18926 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:11.092314 18230 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:11.096542 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:11.098537 18228 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
W20260709 13:19:11.076484 23395 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.002s	sys 0.038s
I20260709 13:19:11.104478 18303 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:11.097831 23173 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:11.154757 23422 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:11.155335 23422 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:11.108302 23394 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:11.050875 23423 consensus_queue.cc:237] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:11.219558 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.135511 23395 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.003s	sys 0.039s
I20260709 13:19:11.109747 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:11.128737 23391 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.134660 23014 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:11.233232 18306 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
W20260709 13:19:11.240197 23461 log.cc:927] Time spent T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:19:11.244216 18233 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:11.206310 22930 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.270326 23420 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.271770 23420 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.273514 23173 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:11.273759 23446 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.841s	user 0.022s	sys 0.020s
I20260709 13:19:11.274127 23173 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.278954 23173 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.281420 23235 raft_consensus.cc:3055] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:11.282047 23235 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:11.283171 23235 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.284091 23422 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.286283 23422 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:11.260789 23465 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:11.259667 22930 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.314556 23235 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:11.312215 23465 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:11.384120 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 304791us
W20260709 13:19:11.386054 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 446859us
W20260709 13:19:11.391970 18202 leader_election.cc:336] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.015s (SENT)
W20260709 13:19:11.398562 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 94920.5us
I20260709 13:19:11.398898 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:11.423983 23288 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.425513 23288 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.430042 23412 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.431417 23412 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:11.433069 23395 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:11.434222 23395 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:11.451047 23422 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:11.454804 23288 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.456388 23424 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:11.461261 23391 consensus_queue.cc:1059] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:11.463008 23391 consensus_queue.cc:1243] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer 8b4fbc44aa2649f0bcac5cd70f71951d log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:11.464901 23457 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:11.465145 23469 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:11.465999 23469 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:11.467649 22930 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.465785 23457 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:11.468978 23399 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:11.468457 23469 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.476961 23395 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.479355 23399 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:11.464174 23391 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:11.477878 23457 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:11.428092 23142 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
W20260709 13:19:11.510670 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 89238us
I20260709 13:19:11.495888 23399 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.523144 23412 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:11.528043 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 136277us
I20260709 13:19:11.528702 23390 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:11.530114 23390 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:11.531152 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.530892 23390 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.533689 23470 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:11.534256 23470 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:11.536996 23480 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:11.537844 23480 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.536075 23470 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.561069 23470 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.564370 23390 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.590864 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:11.593178 23192 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:11.593984 23192 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:11.595534 23192 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.590885 23485 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:19:11.598541 23394 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:11.572609 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 50910.4us
W20260709 13:19:11.617054 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.628895 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:11.630511 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:11.630975 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:11.633823 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:19:11.635749 18351 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.731s (SENT) [suppressed 20 similar messages]
W20260709 13:19:11.639315 23393 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.653s	user 0.015s	sys 0.010s
I20260709 13:19:11.649695 18962 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:11.649755 23393 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.650388 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:11.568113 23234 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:11.648355 18958 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
W20260709 13:19:11.652314 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.653736 18202 leader_election.cc:336] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.937s (SENT)
I20260709 13:19:11.654356 18202 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:11.654362 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:11.652326 23234 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:11.655828 18953 raft_consensus.cc:2393] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:11.656564 23299 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:11.657228 23394 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:11.657104 23234 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.657923 23394 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:11.658553 23234 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:11.652549 18958 pending_rounds.cc:85] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Aborting all ops after (but not including) 11
I20260709 13:19:11.661366 18958 pending_rounds.cc:107] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 17.12
I20260709 13:19:11.662127 18958 raft_consensus.cc:2917] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Aborting config change with OpId 17.12: Aborted: Op aborted by new leader
I20260709 13:19:11.662755 18958 raft_consensus.cc:2889] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 18 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:11.661363 23393 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:11.671862 23394 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.672955 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:11.686817 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 53172.9us
I20260709 13:19:11.686913 18385 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
W20260709 13:19:11.683296 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 186933us
I20260709 13:19:11.706727 23470 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:11.707293 23470 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:11.707711 23470 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:11.708581 23390 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:11.709312 23390 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:11.716378 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:11.776057 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 140315us
I20260709 13:19:11.792403 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:11.793146 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:11.795651 23490 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.796589 23490 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.799288 23490 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.799755 18377 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:11.803699 22930 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:11.804489 22930 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:11.799969 18202 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.173s (SENT)
I20260709 13:19:11.808424 22930 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:11.712095 23390 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:11.825548 18202 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.210s (SENT)
I20260709 13:19:11.842300 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:11.840425 23490 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
W20260709 13:19:11.817420 23420 consensus_meta.cc:287] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.018s
I20260709 13:19:11.857143 18380 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:19:11.853587 18382 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:11.866750 18201 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:11.869267 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:11.875557 23307 consensus_queue.cc:1059] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:19:11.878423 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:11.879065 18953 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:19:11.879170 23307 raft_consensus.cc:3055] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:11.879551 23307 raft_consensus.cc:740] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:11.876068 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:11.870570 23488 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:11.881385 23239 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.866644 23490 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:11.880990 23488 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:11.886376 23488 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.888296 23288 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.888501 23307 consensus_queue.cc:260] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.889127 23480 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.889068 23288 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.889904 23307 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:11.890269 23235 consensus_meta.cc:287] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.533s	user 0.000s	sys 0.027s
I20260709 13:19:11.891400 23288 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.894330 23288 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:11.894979 23288 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:11.897523 23288 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:11.898103 23288 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.898697 23288 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.900116 18926 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:19:11.903029 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52597us
I20260709 13:19:11.866766 22930 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:11.873885 23420 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:11.901204 23288 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.913036 23411 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:11.913966 22930 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:11.916049 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 91785.1us
I20260709 13:19:11.916720 23465 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:11.918463 18385 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:11.918586 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:11.920904 22943 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.921586 23310 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:11.924098 23490 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.925849 18200 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:11.926600 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:11.947350 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:11.931250 23420 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.939929 23411 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:11.956899 23420 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:11.967922 23411 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.983233 23489 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:11.983686 23489 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:11.978053 23434 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:11.984818 23489 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.985400 23434 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.979488 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:11.989593 23469 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:11.978603 23310 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.981797 22943 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.982664 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:11.982874 18202 leader_election.cc:336] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.283s (SENT)
I20260709 13:19:11.976233 23480 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:11.980334 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35652 (request call id 33) took 1606 ms. Trace:
I20260709 13:19:11.970057 23470 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.008872 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:11.971706 23288 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:19:12.007884 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:12.010309 23470 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.010391 23288 raft_consensus.cc:3055] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:12.011085 23288 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:12.011230 23470 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:12.011654 23130 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.998648 18304 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
I20260709 13:19:12.016327 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:12.018039 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:12.018234 18384 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:12.018785 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 55549.2us
I20260709 13:19:12.007447 23489 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:12.021060 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.022693 22951 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:12.022769 23230 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:12.012549 23288 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:11.966854 23490 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.028697 22943 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.000874 18236 rpcz_store.cc:276] 0709 13:19:10.373341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.373535 (+   194us) service_pool.cc:224] Handling call
0709 13:19:11.979635 (+1606100us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b54001be7a0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821f0520 00007fa18226d652 00007fa18723b60a 00007fa1807c17d4 00007fa1807c1762 00007fa1807c1691 00007fa1807c160c 00007fa1807c08c2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:11.980067 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1974417152}
I20260709 13:19:12.023301 22951 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:12.035099 22951 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:12.035188 23418 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.035985 23418 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.037177 23288 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:12.038547 23418 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.039131 23418 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.034528 23310 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.039371 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.046490 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:12.046783 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:19:12.047863 18202 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.473s (SENT)
I20260709 13:19:12.048308 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:12.048998 18275 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:12.049528 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:12.053443 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 127806us
I20260709 13:19:12.054646 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.055707 23490 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.056483 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:12.059862 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:12.071128 23239 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:12.071590 23239 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:12.071976 23239 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.074887 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.088505 18380 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:12.039654 23418 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.097078 18229 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:12.098197 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:12.099318 23421 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:19:12.101112 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.101827 23319 consensus_queue.cc:1059] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:19:12.091359 23310 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:12.103422 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.093534 23235 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:19:12.104940 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.105911 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.108789 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.111315 18385 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:12.113369 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.115947 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:12.126124 18384 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 14: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:12.138863 23239 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:12.140911 23443 raft_consensus.cc:3055] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:12.141326 23443 raft_consensus.cc:740] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:12.142277 23443 consensus_queue.cc:260] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.123059 18131 catalog_manager.cc:5697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:12.143610 23443 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:12.146023 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.149536 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.151417 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.152446 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.154846 22930 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:12.155495 22930 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:12.149820 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.156029 22930 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.157193 23239 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:12.157879 23239 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.158396 23239 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.159147 23423 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.159704 23423 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.164774 23423 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.165220 18131 catalog_manager.cc:5697] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:12.131400 18927 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:19:12.175958 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.176832 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:12.178722 23424 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:12.179368 23424 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.181577 23424 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:12.183107 23288 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:12.183871 23288 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.187137 23477 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:12.187770 23477 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:12.188879 23434 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.188812 23477 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:12.191298 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 59708.5us
W20260709 13:19:12.215781 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 119690us
I20260709 13:19:12.218339 18927 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:12.221845 22989 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:12.224426 22930 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.227628 18237 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:12.227741 23230 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:12.220031 18927 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:12.231807 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 108070us
I20260709 13:19:12.242444 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:12.160665 23239 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:12.249435 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 105529us
I20260709 13:19:12.250895 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:12.208657 23288 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.230804 23394 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:12.245285 18131 catalog_manager.cc:5697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 3 to 13. New cstate: current_term: 13 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:12.254218 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 204361us
I20260709 13:19:12.269809 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.270476 18386 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:12.271302 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.272450 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.269933 23480 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:12.288283 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.273839 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.275123 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:12.240223 23412 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:12.279366 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.292218 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.292091 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:19:12.313692 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.314574 23420 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.316251 23490 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.316867 23490 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.318961 23490 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.321632 18311 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:12.322675 18232 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
I20260709 13:19:12.323455 23420 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.326054 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.326311 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.327095 18310 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:12.328179 18310 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:12.328377 18306 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:12.329061 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.329386 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:12.329483 18310 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:12.329941 18308 raft_consensus.cc:2376] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16. Re-sending same reply.
I20260709 13:19:12.331175 18303 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:12.331292 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.326467 18307 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: [12.6-14.7]
I20260709 13:19:12.332080 18309 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:12.261973 22930 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:19:12.335883 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.304693 18275 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:12.329968 18305 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:19:12.342373 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 65358.2us
I20260709 13:19:12.262362 23394 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:12.351794 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.361125 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.363632 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.364856 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.364959 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.365782 23418 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.365903 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.366595 18303 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:12.366994 18306 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:12.367667 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.373462 18312 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:19:12.265336 23470 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:19:12.391748 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.396782 18378 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:19:12.397217 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.398092 18233 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:12.398059 18307 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:12.399878 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.400027 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:12.400490 18306 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:12.396893 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.405567 18310 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:12.406302 18308 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:12.356441 23394 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:12.352387 22930 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:12.351322 23319 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:12.426514 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:12.431339 18927 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:12.456836 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.459079 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.465513 18927 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:12.465389 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.466209 18384 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:12.465389 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:12.473241 18305 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:12.479465 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.466828 18312 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:12.481432 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.457029 23450 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:12.491495 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.460346 23489 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:12.489025 18276 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:12.493860 18304 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:12.516862 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:12.517673 18386 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:12.519393 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.520117 18309 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:12.491223 23319 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:12.528276 23391 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.528723 23502 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:12.529098 23332 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.529348 23319 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.529743 23332 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.532186 23391 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.533413 23470 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.533891 23470 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.527587 18276 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:12.534408 23391 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.535458 23332 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.535856 23470 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.538012 23502 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:12.538470 23502 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:12.490960 23494 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.310s	user 0.002s	sys 0.000s
I20260709 13:19:12.496074 23489 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:12.540227 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.486631 23420 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:12.545305 23503 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:12.545858 23503 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.546226 23503 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:12.548993 23420 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.551134 23420 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.552066 18386 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:12.540198 23502 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:12.564049 18380 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:19:12.540599 22943 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:12.571489 22951 consensus_meta.cc:287] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 13:19:12.573324 23394 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:12.576112 23394 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.573475 23311 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:12.572037 22951 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.589000 18236 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:12.598451 23311 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:12.599023 23311 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:12.594255 22943 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.603348 22943 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.608753 18131 catalog_manager.cc:5697] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 6 to 8, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 8 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:12.610268 18131 catalog_manager.cc:5697] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 5 to 7, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 7 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:12.614301 18225 tablet_service.cc:1558] Processing DeleteTablet for tablet 1dea3366ee674017a0bbfc9bce0d9a73 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:42512
W20260709 13:19:12.618233 18132 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39270 (request call id 187) took 63340 ms (client timeout 15000 ms). Trace:
I20260709 13:19:12.618933 22930 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.639762 22930 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:12.622903 23411 consensus_meta.cc:287] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.006s
I20260709 13:19:12.624089 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.641332 18380 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:19:12.626227 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.626991 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:12.628063 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.628852 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.629644 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.632885 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.612111 18131 catalog_manager.cc:5697] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 14 to 17, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130), pending config changed. New cstate: current_term: 17 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } } pending_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:12.651772 18385 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:19:12.654199 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 176021us
I20260709 13:19:12.650612 18307 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:19:12.657322 18382 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
W20260709 13:19:12.660048 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.667063 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.674625 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:12.675699 18236 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:12.670011 23130 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:12.677438 23130 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:12.678355 22951 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:12.594923 23489 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.672320 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:12.681156 23311 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:12.649384 23411 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:12.691884 18201 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:12.696396 18201 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:12.697465 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:12.689963 18308 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 9: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:12.702867 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.704253 23411 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.704039 23503 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.683065 23502 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.706727 23503 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.707898 23502 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:12.645676 18132 rpcz_store.cc:269] 0709 13:18:09.318524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.334216 (+ 15692us) service_pool.cc:224] Handling call
0709 13:19:12.618024 (+63283808us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:10.549583 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:10.550176 (+   593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:10.550220 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:19:10.550239 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:10.550682 (+   443us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:10.550772 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:10.550803 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:19:10.551150 (+   347us) tablet.cc:701] Row locks acquired
0709 13:19:10.551171 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:19:10.551325 (+   154us) write_op.cc:270] Start()
0709 13:19:10.551452 (+   127us) write_op.cc:276] Timestamp: P: 1783603150551276 usec, L: 0
0709 13:19:10.551475 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:19:10.552247 (+   772us) log.cc:844] Serialized 935 byte log entry
0709 13:19:11.328123 (+775876us) op_driver.cc:464] REPLICATION: finished
0709 13:19:11.350007 (+ 21884us) write_op.cc:301] APPLY: starting
0709 13:19:11.350136 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:11.352360 (+  2224us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:11.352497 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:11.354731 (+  2234us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:11.354870 (+   139us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:19:11.354900 (+    30us) write_op.cc:312] APPLY: finished
0709 13:19:11.355136 (+   236us) log.cc:844] Serialized 33 byte log entry
0709 13:19:11.355306 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:11.355418 (+   112us) write_op.cc:454] Released schema lock
0709 13:19:11.355462 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:11.355859 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:11.355878 (+    19us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10123,"reported_tablets":50,"spinlock_wait_cycles":656768,"child_traces":[["op",{"apply.queue_time_us":17060,"apply.run_cpu_time_us":5312,"apply.run_wall_time_us":5878,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12471,"num_ops":2,"prepare.queue_time_us":511605,"prepare.run_cpu_time_us":45735,"prepare.run_wall_time_us":298935,"raft.queue_time_us":328787,"raft.run_cpu_time_us":9994,"raft.run_wall_time_us":36238,"replication_time_us":768951,"thread_start_us":890887,"threads_started":4,"wal-append.queue_time_us":328860,"wal-append.run_cpu_time_us":29158,"wal-append.run_wall_time_us":1578745}]]}
I20260709 13:19:12.709450 23332 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:12.710162 23332 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:12.710270 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:12.685346 23489 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:12.711625 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:12.717983 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:12.699841 18131 catalog_manager.cc:5697] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:12.657413 23418 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:19:12.662513 23288 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:12.729525 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:12.904951 18382 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:12.856729 18201 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:19:12.861179 23477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.031s	sys 0.051s
W20260709 13:19:12.813050 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 101468us
W20260709 13:19:12.913834 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.820374 23311 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.684585 23130 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:12.711589 23332 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.788421 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:12.916433 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:12.923779 18378 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:12.717473 23391 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:12.926139 18958 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:12.849143 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:12.912493 23477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.031s	sys 0.051s
I20260709 13:19:12.929884 18385 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:19:12.816758 23421 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:12.892761 18231 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:12.932942 23234 consensus_queue.cc:1059] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:12.862253 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:12.933790 18234 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
W20260709 13:19:12.748160 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.934420 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:12.934787 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:12.935451 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.935864 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.813370 23509 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:19:12.729364 23424 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:19:12.941447 23491 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:12.910567 18233 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:12.941817 23319 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:12.941924 18202 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:19:12.910797 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 119426us
I20260709 13:19:12.942925 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:12.944012 18233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:12.944387 18201 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:12.920747 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:12.920113 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:12.924824 18926 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:12.815006 22930 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.733031 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:12.936854 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:12.928388 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:12.917551 23470 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:12.919420 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:12.927935 23391 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.959594 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:12.960975 18131 catalog_manager.cc:5697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:12.956148 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:12.965646 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:12.971125 18236 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:19:12.971127 18231 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:12.967579 23510 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:19:12.967940 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:12.968735 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:12.961028 22943 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.977142 18303 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:12.977304 22943 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:12.979732 18312 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:19:12.979890 22943 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:12.980186 18312 pending_rounds.cc:85] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 8
I20260709 13:19:12.980703 18312 pending_rounds.cc:107] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:19:12.981102 18312 raft_consensus.cc:2889] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:12.982671 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:12.982947 18306 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:12.980921 18131 catalog_manager.cc:5697] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:12.984375 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:12.974143 22930 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.985463 18307 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 15: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:12.985136 18131 catalog_manager.cc:5697] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 4 to 9, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 9 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:12.986922 18305 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:12.989591 23230 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:12.937353 23421 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:12.961139 23420 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:13.006999 18232 raft_consensus.cc:2410] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:19:12.961918 23412 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:12.963548 23470 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.001226 23130 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:13.010082 18309 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:12.962677 23491 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:13.014632 18383 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:13.015594 23491 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.017112 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:12.973042 23391 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:12.985607 22930 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.020875 22930 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.021474 22930 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.021930 22930 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.024026 22930 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.014532 23130 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.010514 23420 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.024703 23418 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.033531 23418 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.035988 23418 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.037325 23391 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.038146 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:13.045657 18381 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:19:13.030121 23130 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:13.032467 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:13.029879 18231 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
I20260709 13:19:13.024492 22930 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:13.053396 22930 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.054453 23130 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.057236 22930 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.032817 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:13.059801 18386 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:13.031981 23420 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:13.058097 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:13.058295 23130 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.075989 23391 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.073274 18382 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:19:13.086410 22930 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.096725 22930 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:13.098839 23512 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.244s	user 0.002s	sys 0.000s
I20260709 13:19:13.099119 22930 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.100699 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:13.105101 23477 raft_consensus.cc:1064] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
W20260709 13:19:13.105831 23477 raft_consensus.cc:1068] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Unable to promote non-voter e016302b7e734d74833a2bf7bab44838: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:19:13.111500 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.112703 18276 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:19:13.112973 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.113896 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:13.114935 18276 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:13.115571 23239 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:13.116030 23239 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.116425 23239 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:13.118975 18961 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
W20260709 13:19:13.061081 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.121924 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.122053 18955 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:13.076054 23418 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.125846 23418 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.076012 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:13.128842 18381 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:19:13.129046 22915 raft_consensus.cc:3055] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:13.129722 22915 raft_consensus.cc:740] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:13.131078 22915 consensus_queue.cc:260] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:13.128288 23418 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.133234 23502 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:13.133512 23418 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:13.133783 23502 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.134284 23418 raft_consensus.cc:697] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:13.134363 23502 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:13.139755 23477 consensus_queue.cc:1059] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:13.141839 23477 raft_consensus.cc:1064] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:19:13.141659 23480 consensus_queue.cc:1059] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:19:13.142283 23477 raft_consensus.cc:1068] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Unable to promote non-voter e016302b7e734d74833a2bf7bab44838: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:13.142998 23480 raft_consensus.cc:3055] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:13.143455 23480 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:13.144464 23480 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:13.145819 23480 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:13.145954 23239 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.147358 23319 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.135788 23418 consensus_queue.cc:237] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.147886 23319 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.150228 23319 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.152032 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:13.013903 23470 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:13.114835 23130 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:13.095307 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:13.158071 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.159929 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:13.162981 18381 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:13.164321 18311 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 17: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:12.922714 23288 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.166657 23421 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.169996 18311 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:19:13.171377 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:13.172122 18383 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:13.173095 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:13.171674 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:13.168237 23288 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.165015 22915 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:13.201679 18382 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:13.209851 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:13.213047 18309 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:13.208451 18311 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:13.211799 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:13.216799 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:13.219596 18308 raft_consensus.cc:2376] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15. Re-sending same reply.
W20260709 13:19:13.220105 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 232726us
I20260709 13:19:13.207805 23130 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:13.224030 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:13.221982 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 278129us
I20260709 13:19:13.229297 18305 raft_consensus.cc:2376] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16. Re-sending same reply.
I20260709 13:19:13.235471 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:13.239076 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:13.239959 18308 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 14: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:13.236217 18309 raft_consensus.cc:2376] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12. Re-sending same reply.
I20260709 13:19:13.220682 23319 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.241292 18311 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:13.262704 23424 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:13.220827 23391 consensus_queue.cc:1059] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:19:13.238931 23239 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.277802 18275 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:13.284647 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:13.296552 23239 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:13.304487 18383 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:13.305451 23502 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.307974 23502 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.308723 18202 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:13.312541 18201 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:13.275548 23319 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.322660 23230 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:13.322836 23014 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:13.324127 23014 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:13.324628 23014 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:13.324733 23489 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:13.281857 23130 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:19:13.330928 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 97877us
I20260709 13:19:13.342350 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:13.343132 18386 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:13.344344 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:13.342687 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:13.346037 18377 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:13.337431 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:13.349666 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:13.345435 23522 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:13.348308 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:13.318815 23332 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.353104 18927 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:13.324807 23319 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:13.372227 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47957.4us
I20260709 13:19:13.373978 23424 raft_consensus.cc:3055] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:13.374406 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:13.374581 23424 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:13.375380 23391 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:13.375765 23424 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:13.378873 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:13.357440 23450 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:13.361398 23411 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:13.389000 18305 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:13.391885 18386 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:19:13.393821 18276 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:13.382997 22951 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:19:13.398669 18235 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:13.403625 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:13.367113 23332 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.404448 18308 raft_consensus.cc:2376] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16. Re-sending same reply.
I20260709 13:19:13.418274 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:13.400417 22943 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:13.397413 23532 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:13.401643 23535 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:13.430202 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.431083 23536 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:13.423882 23130 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.433413 23332 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.433912 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:13.435395 18305 pending_rounds.cc:85] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 11
I20260709 13:19:13.435763 18305 pending_rounds.cc:107] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 17.12
I20260709 13:19:13.436072 18305 raft_consensus.cc:2917] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Aborting config change with OpId 17.12: Aborted: Op aborted by new leader
I20260709 13:19:13.436476 18305 raft_consensus.cc:2889] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.442262 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:13.443342 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.443356 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 67998.8us
I20260709 13:19:13.443249 18386 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:13.447229 23477 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:13.458714 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:13.460191 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:13.460192 18201 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:13.424438 22943 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:13.489029 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.497682 23319 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:13.498157 23319 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:13.498487 23319 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:13.462951 22943 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:13.500384 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:13.502053 23522 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:13.502521 23522 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:13.502892 23522 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:13.438524 23532 raft_consensus.cc:697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:13.504770 23480 raft_consensus.cc:3055] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:13.505527 23480 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:13.505972 23532 consensus_queue.cc:237] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.506574 23480 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.507409 23424 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:13.494617 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 45327.1us
W20260709 13:19:13.544838 18378 consensus_meta.cc:287] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.003s
I20260709 13:19:13.545392 18378 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:13.544654 18377 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:13.546229 18379 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:13.548648 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:13.550383 23130 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:13.551076 23130 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:13.456836 23411 raft_consensus.cc:697] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:19:13.464653 23527 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:19:13.463685 23391 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:13.576486 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:13.459968 23420 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.504849 22930 raft_consensus.cc:3055] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:13.462467 23536 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:13.577522 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:19:13.590761 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 55761.1us
I20260709 13:19:13.584942 18307 raft_consensus.cc:2376] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14. Re-sending same reply.
W20260709 13:19:13.592118 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 208800us
I20260709 13:19:13.580912 23332 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.505117 18121 catalog_manager.cc:5028] TS b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): tablet 1dea3366ee674017a0bbfc9bce0d9a73 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:19:13.587570 23391 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:13.609753 18121 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 241826us
I20260709 13:19:13.459697 23535 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.622095 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:13.593052 22930 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:13.594048 23536 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:13.629510 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.600472 23418 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:13.552251 23130 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.601985 23489 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:13.630838 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:13.632505 23536 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:13.637519 23537 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:19:13.643242 22943 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.648548 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:13.633062 23480 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:13.649830 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 65815.7us
I20260709 13:19:13.650727 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:13.624738 23391 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:13.652716 23288 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:13.653254 23288 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:13.653600 23288 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:13.633620 23477 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:13.657032 23502 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:13.657145 23477 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:13.661609 23522 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.662565 23477 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.664374 23535 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.664346 23522 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.665148 23489 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.665585 23420 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.665660 23522 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:13.666527 23522 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:13.652207 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:13.669610 18385 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:19:13.671593 22930 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.672873 22930 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:13.675648 23411 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:13.676239 23546 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.185s	user 0.000s	sys 0.005s
W20260709 13:19:13.680486 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 49742.5us
W20260709 13:19:13.694178 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 180403us
I20260709 13:19:13.697266 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:13.651737 23536 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:13.699429 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47369.8us
I20260709 13:19:13.705183 23535 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:13.705505 23420 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:13.711431 18385 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:13.625520 23332 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.712146 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:13.717238 18386 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:13.711431 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:13.686823 23522 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:13.700786 23470 consensus_meta.cc:287] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.004s
I20260709 13:19:13.693158 23418 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:13.697799 23239 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:13.717552 23552 consensus_queue.cc:1059] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:19:13.723944 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:13.724180 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:13.743328 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:13.759327 18386 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:13.727063 23536 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.707577 23014 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.727063 23332 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.738524 23522 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:13.733166 23310 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:19:13.802870 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:13.803519 18386 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:13.804489 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:13.796914 18230 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:19:13.722568 23535 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.808598 18237 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:13.730465 23538 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:19:13.805575 18230 pending_rounds.cc:85] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 8
I20260709 13:19:13.821827 18230 pending_rounds.cc:107] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:19:13.822089 18230 raft_consensus.cc:2889] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.816366 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:13.738915 23470 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.724262 23420 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:13.792335 23503 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:13.788636 22943 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.828730 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:13.780972 23502 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:19:13.833876 23391 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.836908 23391 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:13.838371 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 113089us
I20260709 13:19:13.842032 18233 raft_consensus.cc:606] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:13.842628 18233 raft_consensus.cc:614] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:13.837992 23563 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:19:13.851720 18201 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:13.858577 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:13.831161 23543 raft_consensus.cc:2764] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:13.809383 23522 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.848742 23332 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:13.841975 23239 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:13.870920 23557 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:19:13.871105 23554 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:19:13.866631 22943 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:13.847354 23319 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.882795 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:13.897771 23014 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:13.898571 23014 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:13.899094 23014 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.900642 23531 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:13.901087 23531 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.901298 18236 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:13.901472 23531 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:13.904974 23548 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:13.927233 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.890383 22943 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.877746 23239 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.889806 23503 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:13.849953 23418 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:13.953603 18351 leader_election.cc:336] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.731s (SENT)
I20260709 13:19:13.963420 22943 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:14.009639 22915 consensus_meta.cc:287] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.802s	user 0.010s	sys 0.002s
I20260709 13:19:13.966079 23532 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:14.026576 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 72995.5us
W20260709 13:19:14.027384 18351 leader_election.cc:336] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.806s (SENT)
I20260709 13:19:14.030665 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35652 (request call id 34) took 1100 ms. Trace:
I20260709 13:19:14.031122 18233 rpcz_store.cc:276] 0709 13:19:12.930414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.943866 (+ 13452us) service_pool.cc:224] Handling call
0709 13:19:14.030443 (+1086577us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54002f3ad4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa18226d853 00007fa18723b60a 00007fa1807c17d4 00007fa1807c1762 00007fa1807c1691 00007fa1807c160c 00007fa1807c08c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:14.030594 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2057801472}
I20260709 13:19:14.032087 23420 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.033479 18233 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:14.035467 18237 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:13.972898 23503 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:13.965274 23548 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.012804 23502 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:14.050375 23319 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.050457 23502 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:14.055794 18351 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.838s (SENT)
W20260709 13:19:14.057415 18351 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.853s (SENT)
I20260709 13:19:14.057816 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:14.059163 18351 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.857s (SENT)
W20260709 13:19:14.063632 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 180920us
I20260709 13:19:14.069218 23234 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:14.082795 23288 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.052270 23470 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:14.114867 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 55743.1us
I20260709 13:19:14.138132 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:14.140964 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:14.139607 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:14.142643 18377 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:19:14.143214 18378 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:14.145900 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.145802 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:14.146937 18377 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 14: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:14.151010 18230 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:14.153409 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:14.101212 23014 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.161777 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:14.195533 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:14.201978 23503 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.204239 18378 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:14.209394 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:14.152030 23522 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.209447 23548 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.208285 22943 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.213619 22943 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.220901 23531 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.222997 23531 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:14.225291 23573 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:14.237583 23502 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.236114 23239 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.244690 23239 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:19:14.245725 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.246615 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 144050us
I20260709 13:19:14.247725 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:14.249547 23580 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:14.249831 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:14.250705 23580 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:14.251222 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:14.252056 23580 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:14.246691 23480 raft_consensus.cc:3055] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:14.255087 23480 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:14.259902 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:14.256299 23480 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.261381 23480 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:14.269436 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:14.270920 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:14.271711 23239 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:14.272171 23239 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.272591 23239 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:14.272193 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:14.277802 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:14.278671 23578 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:14.279352 23502 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:14.279862 23578 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:14.291632 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:14.309211 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:14.315587 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:14.276173 23580 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:14.319931 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:14.306493 23531 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:14.338749 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.317451 23418 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:14.319104 23578 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:14.318284 23234 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:19:14.318581 23502 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:14.359463 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:14.358085 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:14.316830 22915 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:19:14.318406 23192 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:19:14.317256 23543 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:19:14.373819 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:14.376473 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:14.379935 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:14.378018 18230 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:14.318315 23491 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:19:14.380139 18231 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:19:14.382385 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:14.383962 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:14.385138 18237 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 14: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:14.363162 23130 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:14.323258 23239 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.386906 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:14.388131 18234 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:14.387748 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:14.393653 18237 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:19:14.397670 18236 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:14.382251 23543 consensus_queue.cc:1243] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:14.401602 18235 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 14: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:14.386921 23477 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:19:14.409184 18386 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:14.409808 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:14.427356 18201 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:14.411402 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:14.412047 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:14.428200 22943 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:14.413941 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:14.428735 22943 raft_consensus.cc:697] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:14.416461 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:14.426316 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:14.419114 23539 raft_consensus.cc:1064] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:19:14.420148 23522 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:14.420881 18229 raft_consensus.cc:2410] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:19:14.422262 18377 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:14.397017 23424 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:14.438024 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:14.439075 18383 raft_consensus.cc:2393] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 15: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:14.435021 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:14.440222 18228 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:14.411579 18231 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:19:14.430696 18232 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
W20260709 13:19:14.429330 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 70463.5us
I20260709 13:19:14.431995 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:14.429716 22943 consensus_queue.cc:237] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.435209 18385 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:14.399619 23192 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:14.449460 18235 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:14.450793 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:14.448210 23130 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:14.451630 18380 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:14.451738 23130 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.452740 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:14.454721 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:14.455521 18380 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:14.456722 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:14.431850 23239 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.488098 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.488390 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.489423 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.501415 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.489035 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.503507 18231 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:14.448814 23424 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:14.504204 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.453042 23192 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:14.506469 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.519018 18311 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:19:14.506793 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:14.503538 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:14.521979 18228 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:14.509634 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:14.523083 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.520402 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.525537 18311 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:14.513144 18380 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:14.528540 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.529649 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.523188 18235 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:14.527918 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.553854 18234 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:14.479861 22930 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.552336 18307 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:19:14.558991 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:14.558939 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:14.560155 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:14.558890 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:14.552866 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:14.561303 18305 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:14.561575 18304 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:14.561787 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:14.560459 18311 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:14.562470 18312 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:14.564569 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:14.567659 18201 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:14.501675 23418 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.565934 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:14.459039 23522 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.588775 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:14.582430 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:14.580691 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:14.583189 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:14.590667 18306 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:14.596462 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:14.501854 23311 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:19:14.598991 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:14.607738 18234 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:19:14.577281 23480 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:14.631307 22915 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:14.631476 23480 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.631784 22915 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:14.631906 23480 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:14.632750 22915 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.634325 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:14.576664 22930 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.636727 22915 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:14.621089 23587 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:19:14.626524 23522 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.627533 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:14.628350 23538 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:14.638532 22930 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.638737 23538 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:14.529314 23578 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:19:14.629191 23477 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.629814 23535 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.592414 23489 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:14.637279 18309 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:14.647675 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.628950 22951 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:14.515085 23502 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:19:14.650642 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.652379 18308 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 14: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:19:14.668191 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 246658us
W20260709 13:19:14.669996 18202 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.563s (SENT)
I20260709 13:19:14.666167 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.670583 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:14.671435 18308 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:14.587472 23418 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.684963 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.686926 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.687964 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:14.689991 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.680693 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 217722us
I20260709 13:19:14.697180 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:14.687486 18308 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:14.702338 18382 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:14.639621 23538 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.663223 23489 raft_consensus.cc:697] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:14.715556 18231 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:14.708811 18310 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:14.720180 18236 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:14.722589 18231 pending_rounds.cc:85] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 7
I20260709 13:19:14.722918 18231 pending_rounds.cc:107] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:19:14.716442 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:14.717837 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.718658 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:14.722844 18237 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:14.724248 18312 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:14.723439 18231 raft_consensus.cc:2889] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:14.724197 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:14.652765 23477 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:14.656292 22951 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.736017 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:14.699831 23288 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.740680 18307 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:14.741730 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:14.657800 23424 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:14.758571 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 88635.2us
I20260709 13:19:14.759292 18307 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:19:14.848989 18307 pending_rounds.cc:85] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 7
I20260709 13:19:14.850188 18307 pending_rounds.cc:107] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:19:14.851311 18307 raft_consensus.cc:2889] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:14.855298 18304 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:14.851574 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:14.866417 18307 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:14.869946 23418 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.870918 23489 consensus_queue.cc:237] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.738695 23593 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:14.872980 23593 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:14.853084 23130 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.756193 23538 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:14.881364 23488 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:14.893023 23130 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:14.893662 23130 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.896026 23130 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:14.898157 18307 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:14.898357 18310 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:14.898854 18305 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:14.902032 23192 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.903723 23192 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:14.905103 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:14.906059 18234 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:14.914058 23130 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:14.914827 23130 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:14.918380 23130 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:14.935627 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.937662 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:14.938601 18958 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:19:14.950313 18311 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:14.957406 18228 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:14.958982 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:14.989269 18232 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:19:14.995110 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:14.876300 23593 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:14.997361 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 145860us
W20260709 13:19:14.997907 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 101921us
W20260709 13:19:14.998803 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.998920 18377 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:19:14.999296 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 43776.2us
I20260709 13:19:15.000401 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:15.015944 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.986913 23424 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:14.988323 23502 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.023664 23502 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:15.026728 23502 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:15.045032 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:15.049679 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:15.052138 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:15.055166 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:15.057554 22943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.034s	sys 0.031s
I20260709 13:19:15.059432 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:15.061102 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:15.066604 22943 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:14.994038 23391 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:15.077903 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 70295.4us
I20260709 13:19:15.039970 23535 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:15.065454 23130 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:19:15.104241 22943 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:15.057791 23550 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.126653 18277 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:15.093693 23548 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:15.148077 23548 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:15.148590 23548 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:15.169782 18306 consensus_meta.cc:287] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
W20260709 13:19:15.181216 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54686.3us
I20260709 13:19:15.161087 23550 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:15.096823 23288 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:15.147063 22951 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:15.115685 23535 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:15.178361 23491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.024s	sys 0.072s
W20260709 13:19:15.216609 22915 consensus_meta.cc:287] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.000s
I20260709 13:19:15.220777 23192 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:15.222234 23548 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:15.229151 23492 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.219908 23593 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
W20260709 13:19:15.241712 23480 consensus_meta.cc:287] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.000s
I20260709 13:19:15.197285 23418 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:15.251857 18309 consensus_meta.cc:287] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.002s
I20260709 13:19:15.287707 18309 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:15.260727 18306 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:15.249794 23522 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:15.262362 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:15.293315 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:15.294396 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:19:15.181696 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.249765 23543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.008s	sys 0.067s
I20260709 13:19:15.255072 23591 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:15.295557 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.264626 23491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.025s	sys 0.072s
W20260709 13:19:15.296453 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.296121 23591 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:15.297590 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.298372 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.298877 23591 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:15.299539 23543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.008s	sys 0.068s
I20260709 13:19:15.311914 18133 catalog_manager.cc:5697] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 6 to 11, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 11 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.314620 18133 catalog_manager.cc:5697] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 12 to 13, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 13 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.325135 23522 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:15.325994 23522 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:15.295725 23502 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:15.330992 23502 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:15.331736 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:15.338734 18383 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:19:15.295516 23539 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:15.331532 23502 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:15.385070 18133 catalog_manager.cc:5697] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:15.388973 18133 catalog_manager.cc:5697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 7 to 11, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 11 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.304318 18131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 88) took 4452 ms. Trace:
I20260709 13:19:15.401646 23014 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:15.419858 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.264331 23535 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:15.263489 23477 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:15.483314 18235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.018s	sys 0.012s
W20260709 13:19:15.484109 18235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.018s	sys 0.012s
I20260709 13:19:15.456255 18131 rpcz_store.cc:276] 0709 13:19:10.851918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.852109 (+   191us) service_pool.cc:224] Handling call
0709 13:19:15.304179 (+4452070us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:13.305192 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:13.305897 (+   705us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:13.305948 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:19:13.305967 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:13.307035 (+  1068us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:13.307153 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:13.307182 (+    29us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:19:13.308218 (+  1036us) tablet.cc:701] Row locks acquired
0709 13:19:13.308272 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:19:13.308470 (+   198us) write_op.cc:270] Start()
0709 13:19:13.340883 (+ 32413us) write_op.cc:276] Timestamp: P: 1783603153308384 usec, L: 0
0709 13:19:13.351117 (+ 10234us) op_driver.cc:348] REPLICATION: starting
0709 13:19:13.352063 (+   946us) log.cc:844] Serialized 4329 byte log entry
0709 13:19:13.776901 (+424838us) op_driver.cc:464] REPLICATION: finished
0709 13:19:13.878760 (+101859us) write_op.cc:301] APPLY: starting
0709 13:19:13.878884 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:14.045310 (+166426us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:14.045451 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:14.233774 (+188323us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:14.234141 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 13:19:14.234224 (+    83us) write_op.cc:312] APPLY: finished
0709 13:19:14.234714 (+   490us) log.cc:844] Serialized 97 byte log entry
0709 13:19:14.316473 (+ 81759us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:14.319274 (+  2801us) write_op.cc:454] Released schema lock
0709 13:19:14.325269 (+  5995us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:14.373056 (+ 47787us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:14.373095 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":379548,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":101488,"apply.run_cpu_time_us":18532,"apply.run_wall_time_us":487717,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45847,"num_ops":10,"prepare.queue_time_us":312854,"prepare.run_cpu_time_us":24822,"prepare.run_wall_time_us":103488,"raft.queue_time_us":137485,"raft.run_cpu_time_us":37727,"raft.run_wall_time_us":85898,"replication_time_us":425556,"thread_start_us":446708,"threads_started":4,"wal-append.queue_time_us":110523,"wal-append.run_cpu_time_us":20820,"wal-append.run_wall_time_us":1770739}]]}
I20260709 13:19:15.493498 18133 catalog_manager.cc:5697] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 12 to 13, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 13 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.495271 23550 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:15.496162 18133 catalog_manager.cc:5697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 7 to 10, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 10 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:15.453760 23480 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:15.499835 23480 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:15.501363 18133 catalog_manager.cc:5697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 10 to 11, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 11 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:15.502835 23548 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:15.263023 23288 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:15.510952 23288 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:15.511777 23288 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:19:15.513785 18384 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.004s	sys 0.029s
I20260709 13:19:15.502918 18133 catalog_manager.cc:5697] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.515993 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:19:15.514209 18384 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.004s	sys 0.029s
I20260709 13:19:15.516920 18958 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:19:15.512238 23288 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.523950 18200 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:15.525388 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:15.531013 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:15.531869 18385 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:19:15.534873 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:15.535480 18383 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:15.560716 18382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.012s	sys 0.021s
W20260709 13:19:15.561474 18382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.012s	sys 0.022s
W20260709 13:19:15.562604 18237 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.011s	sys 0.022s
W20260709 13:19:15.563097 18237 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.011s	sys 0.022s
I20260709 13:19:15.454180 23492 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:15.578608 23604 log.cc:927] Time spent T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:19:15.540835 23548 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:15.580924 18133 catalog_manager.cc:5697] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 7 to 9, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 9 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:15.581830 23522 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:15.584395 23502 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:15.592892 23602 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.111s	user 0.000s	sys 0.003s
I20260709 13:19:15.534054 23288 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:15.595144 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 2752) took 1078 ms. Trace:
W20260709 13:19:15.600063 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.610646 18309 rpcz_store.cc:276] 0709 13:19:14.517009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.588454 (+ 71445us) service_pool.cc:224] Handling call
0709 13:19:15.594923 (+1006469us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b540013f454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:15.595069 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109729664}
I20260709 13:19:15.613871 18962 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
I20260709 13:19:15.604900 23548 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.608347 18133 catalog_manager.cc:5697] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 8 to 11, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 11 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:15.616792 18383 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
W20260709 13:19:15.607959 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 389928us
W20260709 13:19:15.624872 23603 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
W20260709 13:19:15.618137 23606 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:19:15.624769 23492 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:15.620729 23548 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:15.621701 23234 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.632077 18927 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.009s	sys 0.030s
W20260709 13:19:15.632534 18927 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.010s	sys 0.030s
W20260709 13:19:15.635859 18303 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.072s	sys 0.198s
W20260709 13:19:15.640729 18303 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.072s	sys 0.198s
W20260709 13:19:15.637626 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 535743us
W20260709 13:19:15.712224 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 62099.6us
W20260709 13:19:15.720366 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.720995 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.634369 23578 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.017s	sys 0.022s
I20260709 13:19:15.712380 18133 catalog_manager.cc:5697] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 10 to 12, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 12 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:19:15.726364 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.632594 23234 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:15.735026 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:15.735599 23234 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:15.739884 18133 catalog_manager.cc:5697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 8 to 9, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 9 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:19:15.728281 23578 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.017s	sys 0.022s
I20260709 13:19:15.713784 23489 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:15.720970 23418 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:15.765444 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.721921 23192 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:19:15.771026 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2725) took 1278 ms. Trace:
I20260709 13:19:15.768867 18133 catalog_manager.cc:5697] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:19:15.776464 18276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.007s	sys 0.011s
W20260709 13:19:15.778146 18276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.008s	sys 0.012s
W20260709 13:19:15.776966 18378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.011s	sys 0.008s
W20260709 13:19:15.781450 18378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.011s	sys 0.008s
W20260709 13:19:15.779474 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 571800us
I20260709 13:19:15.801900 18380 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:19:15.843819 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 130338us
I20260709 13:19:15.870667 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:15.771613 18303 rpcz_store.cc:276] 0709 13:19:14.489538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.489655 (+   117us) service_pool.cc:224] Handling call
0709 13:19:14.528377 (+ 38722us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:14.557423 (+ 29046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.557461 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:14.598428 (+ 40967us) log.cc:844] Serialized 52 byte log entry
0709 13:19:14.991947 (+393519us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:15.645051 (+653104us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.711868 (+ 66817us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.720727 (+  8859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.720813 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.767275 (+ 46462us) raft_consensus.cc:1685] finished
0709 13:19:15.767298 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.767474 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23157,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":18416,"thread_start_us":951775,"threads_started":2,"wal-append.queue_time_us":634482}
I20260709 13:19:15.871210 18133 catalog_manager.cc:5697] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 7 to 11, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 11 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.872593 18385 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:19:15.886919 18133 catalog_manager.cc:5697] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.893915 23535 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:15.896135 23535 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:15.887399 23502 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:15.898029 23502 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:15.898511 22951 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.899480 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:15.899324 22951 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:15.898468 23502 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:15.901057 23613 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:19:15.902254 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 900) took 1015 ms. Trace:
I20260709 13:19:15.902757 18379 rpcz_store.cc:276] 0709 13:19:14.886398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.886593 (+   195us) service_pool.cc:224] Handling call
0709 13:19:14.886992 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.934978 (+ 47986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.935020 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.935651 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.262472 (+326821us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:15.262513 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.262584 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.901925 (+639341us) raft_consensus.cc:1685] finished
0709 13:19:15.901961 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.902173 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47276,"raft.queue_time_us":48563,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":326501,"threads_started":1,"wal-append.queue_time_us":698627}
I20260709 13:19:15.903102 23502 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:15.904867 22951 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:15.767289 23489 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:15.917570 18349 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:15.907815 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:15.944937 23192 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:15.945492 23192 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.945892 23192 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:15.948602 23603 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:15.874172 22915 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
W20260709 13:19:15.951332 23612 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:19:15.875924 23522 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:15.955891 18133 catalog_manager.cc:5697] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 9 to 10, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 10 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:15.957891 18133 catalog_manager.cc:5697] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:19:15.962234 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 54593.8us
W20260709 13:19:15.968384 18202 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.066s	sys 0.138s
W20260709 13:19:15.968747 18202 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.066s	sys 0.138s
W20260709 13:19:15.969333 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 908257us
W20260709 13:19:15.953253 23611 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:19:15.970139 18133 catalog_manager.cc:5697] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:15.964902 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:15.970122 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:19:15.978825 18236 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.015s	sys 0.013s
W20260709 13:19:15.979285 18236 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.015s	sys 0.013s
W20260709 13:19:15.978895 18277 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.005s	sys 0.025s
W20260709 13:19:15.980381 18277 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.005s	sys 0.025s
I20260709 13:19:15.979956 18133 catalog_manager.cc:5697] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 7 to 10, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 10 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:19:15.980932 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 686556us
I20260709 13:19:15.977684 18202 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:15.968274 22915 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:15.985410 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:15.985067 18133 catalog_manager.cc:5697] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:15.978912 18232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.006s	sys 0.021s
W20260709 13:19:15.986829 18232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.006s	sys 0.022s
I20260709 13:19:15.987092 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2037) took 1124 ms. Trace:
I20260709 13:19:15.987452 18236 rpcz_store.cc:276] 0709 13:19:14.855712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.859346 (+  3634us) service_pool.cc:224] Handling call
0709 13:19:14.859742 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.859990 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:15.263552 (+403562us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.979704 (+716152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:15.979767 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:15.979821 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.979900 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.980026 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":864758,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":99,"thread_start_us":991598,"threads_started":2}
I20260709 13:19:15.988415 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:15.989934 18133 catalog_manager.cc:5697] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.992240 22943 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:15.992367 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2038) took 1132 ms. Trace:
I20260709 13:19:15.992758 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:19:15.983847 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 254856us
I20260709 13:19:15.995216 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:16.000159 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.005419 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:16.009584 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:16.011651 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2032) took 1297 ms. Trace:
I20260709 13:19:16.013945 23391 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:15.990734 23502 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:16.019245 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2687) took 1082 ms. Trace:
W20260709 13:19:16.020848 18278 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.000s	sys 0.027s
W20260709 13:19:16.028807 18278 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.000s	sys 0.028s
I20260709 13:19:16.021173 23522 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:16.021888 23610 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
W20260709 13:19:16.025058 23615 log.cc:927] Time spent T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:19:16.026664 23489 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.027273 23418 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:16.012842 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:16.032965 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:16.030544 18382 rpcz_store.cc:276] 0709 13:19:14.937039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.937763 (+   724us) service_pool.cc:224] Handling call
0709 13:19:14.938130 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.938522 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.938560 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:15.004707 (+ 66147us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.562038 (+557331us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:15.562104 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.562212 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.018994 (+456782us) raft_consensus.cc:1685] finished
0709 13:19:16.019016 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.019153 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18208,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":31749,"thread_start_us":534182,"threads_started":1,"wal-append.queue_time_us":979459}
I20260709 13:19:16.033739 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2214) took 1430 ms. Trace:
I20260709 13:19:16.043272 18926 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:16.012171 18229 rpcz_store.cc:276] 0709 13:19:14.713912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.715037 (+  1125us) service_pool.cc:224] Handling call
0709 13:19:14.736747 (+ 21710us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.743396 (+  6649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.743431 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.743954 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.244998 (+501044us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:15.245038 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.245175 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.011357 (+766182us) raft_consensus.cc:1685] finished
0709 13:19:16.011388 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.011576 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100862,"raft.queue_time_us":6791,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":91653,"thread_start_us":337513,"threads_started":1,"wal-append.queue_time_us":722820}
I20260709 13:19:16.008792 23535 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:15.983525 23625 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:19:16.046646 18202 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:16.028221 23558 raft_consensus.cc:2764] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:19:16.049448 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:16.043185 18235 rpcz_store.cc:276] 0709 13:19:14.603245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.603628 (+   383us) service_pool.cc:224] Handling call
0709 13:19:14.646921 (+ 43293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.659458 (+ 12537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.659505 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.917245 (+257740us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b2c000014c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:19:14.917793 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.491435 (+573642us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:16.010236 (+518801us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.016728 (+  6492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.016837 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.016892 (+    55us) raft_consensus.cc:1685] finished
0709 13:19:16.031011 (+ 14119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.033685 (+  2674us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10996,"prepare.queue_time_us":242926,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":23177,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":18528,"spinlock_wait_cycles":5649152,"thread_start_us":1041892,"threads_started":2,"wal-append.queue_time_us":847992}
I20260709 13:19:16.050267 18309 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:19:16.052035 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:16.058984 18202 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:16.041523 23418 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:16.066294 22943 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.064965 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:16.047082 23535 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:16.051180 23489 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:16.066776 22943 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.055704 23319 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:16.029955 23623 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:19:16.071324 23391 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:16.100394 23391 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:16.100785 23391 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:16.105933 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2034) took 1384 ms. Trace:
I20260709 13:19:16.087901 22943 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.078231 18202 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:16.067448 23014 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:16.069820 23418 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:16.064304 23480 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:16.106300 18231 rpcz_store.cc:276] 0709 13:19:14.721906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.722040 (+   134us) service_pool.cc:224] Handling call
0709 13:19:14.722376 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:14.757318 (+ 34942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.757347 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:14.757864 (+   517us) log.cc:844] Serialized 52 byte log entry
0709 13:19:15.286299 (+528435us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:15.286370 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.286492 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.105719 (+819227us) raft_consensus.cc:1685] finished
0709 13:19:16.105739 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.105879 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81093,"raft.queue_time_us":13089,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":98866,"thread_start_us":408668,"threads_started":1,"wal-append.queue_time_us":863752}
I20260709 13:19:16.070672 23535 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:16.108359 23319 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:16.057960 23502 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:19:16.119390 23234 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:16.119860 23234 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:16.120781 23234 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.122037 23234 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:16.123751 23192 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:16.129920 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 2686) took 1193 ms. Trace:
I20260709 13:19:16.131493 18382 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:16.132238 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:16.133244 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:16.134027 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:16.090062 23628 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:16.136612 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:16.141739 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:16.133980 18384 rpcz_store.cc:276] 0709 13:19:14.936723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.936859 (+   136us) service_pool.cc:224] Handling call
0709 13:19:14.937193 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.937600 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.937632 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.938142 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.141907 (+203765us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b48001e0258. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18719caa1 00007fa187193b37 00007fa1871939ca 00007fa18728b26f 00007fa18728af37 00007fa18729f55c 00007fa18729f508 00007fa18729f488 00007fa18729f443 00007fa18729e6ec 00007fa1861c8a96
0709 13:19:15.524963 (+383056us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:15.525027 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.525127 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.113133 (+588006us) raft_consensus.cc:1685] finished
0709 13:19:16.113158 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.129833 (+ 16675us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71810,"raft.queue_time_us":1178,"raft.run_cpu_time_us":2865,"raft.run_wall_time_us":186820,"spinlock_wait_cycles":65596160,"thread_start_us":586344,"threads_started":1,"wal-append.queue_time_us":822231}
I20260709 13:19:15.992868 18237 rpcz_store.cc:276] 0709 13:19:14.859638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.859808 (+   170us) service_pool.cc:224] Handling call
0709 13:19:14.860269 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.860577 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:15.563579 (+703002us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.992011 (+428432us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:15.992069 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:15.992118 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.992193 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.992309 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127084,"prepare.queue_time_us":873459,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":8273,"thread_start_us":954688,"threads_started":2}
I20260709 13:19:16.111881 23626 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.116464 23620 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:16.145246 23480 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:16.147207 23477 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.150791 23319 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:16.148593 23620 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.151427 23628 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:16.148679 23622 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:16.170800 23548 consensus_meta.cc:287] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.003s
W20260709 13:19:16.174110 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.166249 23620 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:16.200194 23014 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:16.219731 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 247967us
W20260709 13:19:16.221556 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.153903 23626 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.181318 23628 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:16.246090 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 280124us
I20260709 13:19:16.164331 23480 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.183985 23622 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.164492 23477 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.243094 23609 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.255520 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.241511 23502 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:16.249296 23623 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:16.274144 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 220401us
I20260709 13:19:16.272682 23391 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:16.274919 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 206043us
I20260709 13:19:16.204860 23548 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:16.278523 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 265774us
I20260709 13:19:16.270643 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:19:16.277510 23470 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.004s	sys 0.019s
W20260709 13:19:16.284842 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 136896us
W20260709 13:19:16.284475 23288 consensus_meta.cc:287] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.001s
I20260709 13:19:16.292672 22943 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:16.291736 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:16.269131 23609 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.253867 23628 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:16.292284 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.330503 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 44286.8us
W20260709 13:19:16.340544 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 53641.3us
I20260709 13:19:16.341439 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:16.342307 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:16.342981 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:16.343626 23641 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:16.344108 23130 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:16.344612 23637 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:16.328487 22943 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.362036 22943 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.362593 22943 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:16.274847 23502 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.346704 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:16.298053 23535 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.366007 23014 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:16.296794 23470 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.004s	sys 0.020s
W20260709 13:19:16.352751 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 82168.3us
I20260709 13:19:16.308598 23192 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:16.303509 23477 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:16.339434 23638 raft_consensus.cc:2764] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:19:16.356076 23480 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.357950 23628 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.288388 23319 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:16.358707 23130 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:16.356086 23609 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:16.366160 23502 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.366608 23014 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:16.368748 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:16.373859 23637 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:16.301620 23626 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.308043 23489 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.278324 23623 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.366246 23535 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.302726 23622 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.383291 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:16.376123 23641 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:16.400611 23641 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.385293 23628 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:16.403400 23628 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:16.403805 23628 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:16.404569 23014 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:16.406418 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:16.318800 23288 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.408690 23592 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:16.409705 23319 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.410224 23288 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.410809 18232 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:16.386300 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:16.412122 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.385113 23489 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.413080 18236 raft_consensus.cc:2368] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11.
I20260709 13:19:16.413265 18229 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:16.414600 23489 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.386570 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:16.385203 23634 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:16.397258 23626 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:16.307811 23620 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:16.408690 18237 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:16.416030 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:16.398013 23391 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.427634 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:16.429023 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:16.429950 18312 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 17: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:16.427711 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:16.431577 18304 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:16.432945 18309 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 15: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:16.412214 18384 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
W20260709 13:19:16.421736 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 92764.8us
I20260709 13:19:16.402706 23623 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.435640 18306 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:16.438978 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:16.402873 23641 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.448065 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:16.451140 18308 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:16.452248 18962 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:19:16.386482 23477 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:19:16.432401 23593 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.461419 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:16.462568 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:16.465682 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:16.469405 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:16.478783 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:16.479597 18303 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 9.
W20260709 13:19:16.478605 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 134182us
W20260709 13:19:16.487943 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.487670 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:16.488722 18303 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:16.454159 23548 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:16.498836 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:16.499670 18384 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:16.496701 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:16.446142 23637 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:19:16.481874 23638 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:16.506592 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.435379 23634 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:16.508562 18231 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:16.492142 23538 raft_consensus.cc:3055] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:16.509008 18303 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:19:16.512665 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:16.514928 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:16.515196 18308 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:19:16.517562 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.526472 18234 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:16.519052 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.511418 23418 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:16.521471 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.522627 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.527385 18235 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:16.533466 18228 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:16.477865 23593 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.527724 18233 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:16.536811 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:16.537266 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.503243 23652 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:16.560066 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 63468.7us
I20260709 13:19:16.560982 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.513906 23548 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:16.533993 23651 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.564757 18229 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:16.563398 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:16.602541 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:16.578557 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:16.523543 23538 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:16.594297 18233 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:16.588243 18351 leader_election.cc:336] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.808s (SENT)
I20260709 13:19:16.604256 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:16.605238 18351 leader_election.cc:336] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.847s (SENT)
I20260709 13:19:16.605288 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:16.605746 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:16.610824 18233 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:16.612385 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 164237us
I20260709 13:19:16.630837 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:16.631557 18962 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:16.635550 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:16.636329 18308 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:16.642794 18351 leader_election.cc:400] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11.
I20260709 13:19:16.643198 18351 leader_election.cc:403] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:16.637814 23609 consensus_queue.cc:1059] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:19:16.607559 23626 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:16.511771 23638 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.652189 18309 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:16.628625 23558 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:16.659312 18309 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:16.609891 23651 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.566624 23652 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.629851 23548 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:16.709458 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:16.709968 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:16.710253 18312 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:16.710604 18311 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:16.711265 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:16.711980 18305 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
W20260709 13:19:16.720067 23610 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:19:16.723749 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:16.736068 18384 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:19:16.738158 18312 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:19:16.740573 18382 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 10: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:19:16.697639 23655 log.cc:927] Time spent T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
I20260709 13:19:16.745616 18311 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:16.668231 23234 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:19:16.731257 23620 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.722272 23667 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:16.741058 23477 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11.
I20260709 13:19:16.679522 23538 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:16.775786 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 88536.3us
W20260709 13:19:16.765040 23659 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:19:16.771325 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:16.762681 23418 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.789647 18310 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 10: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:19:16.805150 23660 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:19:16.805387 23638 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:16.829567 18202 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.068s (SENT) [suppressed 21 similar messages]
W20260709 13:19:16.830475 23657 log.cc:927] Time spent T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.160s	user 0.002s	sys 0.000s
I20260709 13:19:16.834453 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.835572 23651 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.837311 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.838585 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.838865 23539 raft_consensus.cc:3055] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:16.839349 18229 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:19:16.839517 23539 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:19:16.841843 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.843312 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.844084 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:16.845708 18229 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:19:16.845918 23548 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:16.844091 18236 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 15: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:16.847295 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.847553 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.848191 18232 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:16.850940 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.851811 23634 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:16.853305 23669 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:19:16.853715 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.854809 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:16.857010 18229 pending_rounds.cc:85] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 10
I20260709 13:19:16.856943 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:16.857430 18229 pending_rounds.cc:107] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:19:16.857700 18229 raft_consensus.cc:2889] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:16.861416 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 226375us
I20260709 13:19:16.862728 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:16.865660 22943 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:16.873716 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.876061 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.877278 18231 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 14: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:16.874545 18236 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
W20260709 13:19:16.879865 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 48429.5us
I20260709 13:19:16.875216 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:16.779357 23667 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.899652 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:16.899526 23548 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:16.954120 18926 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:16.895179 23667 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:16.944135 23628 consensus_meta.cc:287] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.007s
W20260709 13:19:16.944849 23613 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:19:16.946745 23538 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:16.942018 23593 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:17.016873 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.019908 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.020900 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:17.021483 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:17.023372 18310 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:17.029606 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:16.959834 23502 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.031297 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:16.964489 23311 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:17.033701 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.034857 18277 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:16.963083 23670 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.015931 23548 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:16.962761 23418 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:16.969507 23628 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.036747 18311 raft_consensus.cc:2376] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15. Re-sending same reply.
I20260709 13:19:17.042989 18962 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
W20260709 13:19:17.055212 23671 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:19:17.054714 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.022058 23637 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:17.077572 18312 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:17.054924 23650 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:17.083500 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:17.084420 18311 raft_consensus.cc:2376] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17. Re-sending same reply.
I20260709 13:19:17.085580 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:17.086470 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:17.087034 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:17.088233 18311 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:17.087392 18312 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:17.109294 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.127171 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.123771 23646 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:17.044880 23391 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:19:17.139684 23628 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:17.140223 18307 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:17.129714 23662 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:19:17.141389 23130 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.142048 23130 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.039935 23502 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.130337 23548 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:17.097826 23418 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:17.134326 23652 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:17.119431 23650 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.053833 23670 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.064823 23647 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:19:17.144450 23130 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:17.165472 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:17.128650 22951 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:17.184131 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:17.147401 18311 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
W20260709 13:19:17.146024 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 111297us
I20260709 13:19:17.185838 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.187187 18277 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.144449 23502 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:17.150183 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.152415 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:17.167539 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:17.168462 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:17.169131 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:17.190106 18306 raft_consensus.cc:2376] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14. Re-sending same reply.
I20260709 13:19:17.191107 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.191916 18306 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:17.188148 18305 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:17.192976 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.177008 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.194547 18309 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:17.195257 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.195461 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:17.195778 18309 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:17.197522 18380 raft_consensus.cc:2393] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 15: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:17.198192 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:17.199636 18309 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:19:17.178678 23679 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:19:17.218103 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 410831us
I20260709 13:19:17.198246 18305 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:17.162477 23665 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:17.234364 18379 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:17.237200 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:17.199156 23288 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:17.121382 23637 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.166158 23670 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:17.176342 23418 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:17.235592 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 48505.6us
I20260709 13:19:17.245079 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.246196 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.214044 23502 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:17.235651 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:17.183729 22951 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:17.248919 22951 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.249912 18310 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:17.250219 22951 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:17.250758 18312 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:17.254304 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:17.247857 18277 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.255077 18380 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:17.258420 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.263970 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:17.271708 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.251106 23670 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:17.252755 23665 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:17.251612 23502 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:17.282766 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47185us
I20260709 13:19:17.282836 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.284027 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:17.263945 23418 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:17.285400 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:17.284612 23628 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:17.291575 23593 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:17.296700 23192 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:17.247112 23677 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:19:17.322463 23677 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:17.322973 23677 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:17.298702 18276 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:17.324694 23192 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.325234 23192 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:17.310992 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.326422 23418 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:17.326866 23418 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.327222 23418 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:17.327685 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.329598 23288 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:17.330281 23288 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:17.311326 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:17.332047 23234 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:17.332505 23234 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.332988 23234 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:17.332701 23676 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:19:17.264137 23646 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:19:17.333202 23558 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:17.281268 23502 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:17.335526 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.336722 23641 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:17.337296 23641 raft_consensus.cc:697] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:17.338388 23641 consensus_queue.cc:237] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:17.346958 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 58314.4us
I20260709 13:19:17.312413 23578 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:17.334702 23638 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:17.319423 23593 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.352945 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.357139 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.357918 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:17.359035 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:17.361640 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:17.358716 18237 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:17.362535 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:17.363309 18231 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:17.355404 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:17.364965 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.365514 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:17.354492 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 102908us
W20260709 13:19:17.366529 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.367094 18351 leader_election.cc:336] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.970s (SENT)
I20260709 13:19:17.367105 18926 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.373697 18234 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:17.376147 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:17.378791 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.320878 23670 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:19:17.350917 23626 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:17.345928 23609 consensus_queue.cc:1059] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:19:17.364414 23652 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:17.382061 23311 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:17.323999 23677 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.395648 23677 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:17.395532 23192 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.399168 23234 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.402110 23234 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:17.402930 23637 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:17.404047 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:17.382573 23548 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:17.361516 23593 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:17.413866 23709 raft_consensus.cc:3055] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:17.414522 23709 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:17.353078 23638 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:17.390030 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.415295 23638 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:17.417552 18304 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:17.417858 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.418493 18308 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:17.418699 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.419391 18310 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:17.386839 23647 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:17.420298 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.421630 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:17.422176 18306 raft_consensus.cc:2376] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17. Re-sending same reply.
I20260709 13:19:17.423422 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:17.423930 18312 raft_consensus.cc:2376] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14. Re-sending same reply.
I20260709 13:19:17.424738 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.425246 18305 raft_consensus.cc:2376] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15. Re-sending same reply.
I20260709 13:19:17.425858 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:17.426354 18306 raft_consensus.cc:2376] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13. Re-sending same reply.
I20260709 13:19:17.428642 22943 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:17.429091 22943 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:17.431198 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.432838 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.429816 22943 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.456547 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.459035 18310 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:19:17.400015 23667 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.427352 23535 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:17.451689 23646 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:17.467815 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.456794 23697 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:17.473919 18351 leader_election.cc:336] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.133s (SENT)
I20260709 13:19:17.474046 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.463030 23647 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:17.469527 23522 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:17.476933 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.415691 23709 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.476017 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.485947 18202 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.482002 23638 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.491259 23638 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:17.474941 23651 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:17.494922 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.479969 23391 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:17.480154 23697 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:17.499776 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47966.9us
I20260709 13:19:17.494146 23014 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:17.504788 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.509032 23639 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:17.509647 23639 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.497027 23391 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.497650 23522 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:17.501019 23638 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:17.514096 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.501600 23709 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:17.521335 22943 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:17.501811 23651 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:17.521958 22943 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:17.513648 23647 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:17.502024 23418 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.526165 23697 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:17.526273 23418 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:17.506536 23014 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:17.527112 23014 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:17.528720 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.531355 23593 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.517002 23539 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.533059 23539 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:17.535008 23703 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:19:17.535702 23667 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:17.515937 23522 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:17.537143 23522 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:17.506134 23652 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:17.546691 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.516237 23391 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:17.551151 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:17.551606 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:17.551795 18377 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:17.557821 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:17.558494 18379 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:17.550204 22943 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.512248 23622 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:19:17.563896 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.563750 22951 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:17.712374 22951 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:17.712598 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 148768us
I20260709 13:19:17.713251 22951 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:17.713696 22951 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:17.714413 18377 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:17.719424 18276 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:17.739296 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.742806 23558 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:17.745421 23715 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:19:17.747988 23625 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:17.749838 22915 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:17.750429 22915 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:17.757148 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2085) took 1330 ms. Trace:
I20260709 13:19:17.757655 18307 rpcz_store.cc:276] 0709 13:19:16.426916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.427026 (+   110us) service_pool.cc:224] Handling call
0709 13:19:16.427326 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.140601 (+713275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.756850 (+616249us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b54002a2454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:17.757073 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1609373568}
W20260709 13:19:17.764755 23705 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 13:19:17.765559 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.767635 23014 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.708873 23639 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:17.556284 23651 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.728281 23418 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:17.781641 23593 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:17.782852 23592 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:17.784202 23665 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:17.826395 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:17.785331 23234 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:17.785535 23609 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:17.786160 23676 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:17.787150 23713 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:17.785367 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:17.802188 22951 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.805802 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.839316 22951 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:17.824783 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:17.784379 23502 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.820958 23592 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:17.834883 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:17.821936 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:17.842702 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.846832 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.847167 18229 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:17.825273 23418 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:17.828068 18202 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:17.854616 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:17.855386 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 70092.8us
I20260709 13:19:17.859229 18277 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.865156 23719 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:17.865671 23719 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:17.866065 23719 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:17.854357 23665 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:17.870976 23418 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.849027 23592 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:17.874647 23192 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:17.880558 23130 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:17.881448 23710 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:17.882098 23647 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:17.884074 23697 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.884603 23697 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.886816 23697 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:17.891250 18377 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:19:17.892647 18377 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:17.894917 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:17.901152 18386 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:19:17.891395 23717 log.cc:927] Time spent T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.077s	user 0.005s	sys 0.000s
W20260709 13:19:17.921227 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 61859.2us
W20260709 13:19:17.924880 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 65912us
W20260709 13:19:17.925050 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 65913.8us
I20260709 13:19:17.925729 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.926090 23724 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:17.930197 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.933293 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:17.858170 23667 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:17.936599 22943 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:17.937625 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:17.935997 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.927309 23480 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.951184 18379 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:17.947355 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:17.849810 23622 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:19:17.882098 23710 raft_consensus.cc:697] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:17.938627 23647 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:17.955739 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:17.955379 22943 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:17.932674 23288 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:17.970112 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:17.952996 23130 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:17.974462 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:17.974982 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:17.977031 18237 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:17.975229 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:17.935667 23609 consensus_queue.cc:1059] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:19:17.979609 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:17.983796 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.984413 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.984666 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:17.985033 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:17.985266 18311 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:17.985445 18303 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:17.987587 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.990087 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:17.990635 18307 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:17.994820 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:17.995452 18308 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:17.999024 23641 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:17.999742 23641 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:18.000653 18311 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:18.001889 23641 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:18.004899 18310 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:19:18.004707 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 92211.6us
I20260709 13:19:18.007690 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:18.008419 18310 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:19:18.009128 18307 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:18.024791 23710 consensus_queue.cc:237] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:18.039392 18308 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:18.040962 18310 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:18.052443 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:18.053349 18235 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:17.948565 23391 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:17.964792 23647 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:17.971027 23697 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:19:18.027300 23646 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.006s
I20260709 13:19:17.976146 23676 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.072204 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:17.981791 23667 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:19:18.074931 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 93126.6us
I20260709 13:19:18.074127 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:18.098968 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:17.957897 23480 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:18.132757 23522 consensus_meta.cc:287] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.003s
I20260709 13:19:18.133206 23522 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.133854 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:18.134096 23480 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:18.134553 18230 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:19:18.134636 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:18.135172 23522 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:18.136600 23676 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.138667 23676 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:18.102043 23646 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:18.139796 23646 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:18.141916 23737 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:18.142287 23737 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:18.143064 23737 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.144788 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:18.135458 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:17.975762 23192 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:19:18.126173 23593 raft_consensus.cc:3055] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:18.126690 23391 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:18.127585 23650 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:18.128688 23014 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:18.130347 23652 consensus_meta.cc:287] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.001s
I20260709 13:19:18.125273 23234 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:18.136068 23522 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:18.066130 23647 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:18.156776 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 200245us
I20260709 13:19:18.096740 23558 raft_consensus.cc:2764] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:19:18.145671 23641 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:18.153647 23691 log.cc:927] Time spent T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:19:18.187729 18230 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:18.144428 23628 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.180946 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:18.156263 23593 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:18.188782 18230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:18.232563 18230 raft_consensus.cc:606] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:18.232916 18230 raft_consensus.cc:614] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:18.157822 23418 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:18.234045 23418 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.155354 23665 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:18.135201 23480 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:19:18.201033 22915 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.249722 22915 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:18.203147 23650 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:18.205053 23713 raft_consensus.cc:3055] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:18.213328 22951 raft_consensus.cc:3055] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:18.251655 22951 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:18.219767 23592 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.191087 23522 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:18.165241 23130 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:18.175334 23234 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:18.178376 23652 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:18.224812 23628 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:18.260036 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 68202.2us
I20260709 13:19:18.186578 23502 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:18.194157 23641 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.229951 18229 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:18.278366 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:18.246459 18235 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:18.248236 23670 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:18.232908 23593 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.255867 23648 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.251334 23650 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:18.256857 23418 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:18.257228 23665 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.259626 18231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:18.269721 23130 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:18.260644 23713 raft_consensus.cc:740] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:18.273559 23522 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:18.270083 23667 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:18.280604 23625 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:18.274289 23628 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:18.274066 22951 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.274901 18232 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:18.280987 22943 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:18.284871 18377 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:18.289913 23609 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:18.312664 23609 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.313993 23592 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:18.314777 23609 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:18.310079 23667 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.301587 23593 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:18.319600 23667 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:18.300350 23650 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:18.303344 23130 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:18.334656 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 66107us
I20260709 13:19:18.336483 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:18.272370 23234 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.289075 23670 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.300133 23648 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.385782 23234 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:18.373112 22943 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.322304 23625 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:18.404242 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 396490us
I20260709 13:19:18.386297 23677 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.406957 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:18.412983 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.389482 23609 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:18.402324 23697 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:18.433580 18377 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:18.436399 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:18.435527 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:18.440938 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:18.422338 23738 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:18.441550 18383 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
W20260709 13:19:18.448277 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 303534us
I20260709 13:19:18.449426 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:18.383782 23713 consensus_queue.cc:260] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.428565 23609 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:18.418905 23677 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.480792 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:18.484534 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:18.485441 18385 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:18.486377 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:18.488759 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:18.489473 18384 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:18.490561 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:18.507031 23288 consensus_queue.cc:1059] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:19:18.517354 23711 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:18.517463 23625 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:18.517853 23711 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:18.518729 23670 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:18.518783 23711 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.446554 23652 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
W20260709 13:19:18.520994 23725 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:19:18.521293 18385 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:18.419847 23647 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:18.481349 23719 consensus_meta.cc:287] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.615s	user 0.005s	sys 0.008s
I20260709 13:19:18.536310 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:18.532094 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:18.478991 23628 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:18.452139 23641 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:18.539213 18380 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
W20260709 13:19:18.542474 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 67173.4us
I20260709 13:19:18.477211 23639 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:18.550683 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:18.552747 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:18.610839 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:18.523201 23678 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:18.612834 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 58871.7us
I20260709 13:19:18.624737 18237 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:18.624799 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:18.627907 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:18.632326 18379 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
W20260709 13:19:18.629868 23747 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:19:18.635023 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:18.542258 23665 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:18.526091 23710 consensus_queue.cc:1059] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:19:18.638921 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:18.641382 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:18.605760 23670 raft_consensus.cc:3055] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:18.612788 23539 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:18.615608 23738 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:18.536835 23729 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.131s
I20260709 13:19:18.649761 18276 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:18.716926 23741 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:19:18.640538 23639 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:18.545172 23719 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:18.729983 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 95048.1us
I20260709 13:19:18.650594 23670 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:19:18.723479 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 73758.8us
I20260709 13:19:18.662608 23648 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:18.725376 23738 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:18.723927 23665 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:18.726812 23592 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:18.779628 23592 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:19:18.739809 23749 log.cc:927] Time spent T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:19:18.632362 23678 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:18.660399 23628 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:19:18.637173 23609 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.739168 18276 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:19:18.785617 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 48385.2us
I20260709 13:19:18.632964 23697 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.741456 23639 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:18.769526 23719 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:18.773141 23670 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.777308 18377 raft_consensus.cc:2410] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:19:18.761148 18201 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:18.795662 22915 raft_consensus.cc:2955] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 7 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:18.797369 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:18.803399 18201 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:18.801918 18276 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:18.805390 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:18.810161 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:18.791139 23590 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.787063 23737 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:18.793260 23665 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:18.802047 23522 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:18.780969 23650 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.805698 23719 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:18.826679 23650 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:18.815531 23480 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:18.831724 23480 raft_consensus.cc:697] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:18.832824 18231 raft_consensus.cc:606] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:18.832696 23480 consensus_queue.cc:237] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.815452 23418 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:18.834338 23418 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:18.834738 23418 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:18.836138 23738 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.837632 23678 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:18.839649 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:18.840363 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:18.815191 23628 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:18.841602 23628 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:18.841455 23639 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.842041 23628 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:18.818146 23665 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:18.845664 23665 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:18.833262 18231 raft_consensus.cc:614] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:18.849116 23719 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.795261 23592 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.857508 23539 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.819471 23590 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:18.821979 23130 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:18.915907 18303 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:18.906224 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.862564 23719 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:18.941414 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.956475 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.959318 18381 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:18.960309 18385 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:18.961366 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:18.930481 23641 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:18.931022 23678 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:18.931891 23647 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:18.976567 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:18.921762 23539 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:18.980003 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:18.968321 23707 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.980845 23130 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:19.004889 23711 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:18.977641 23641 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:19.021194 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.979764 23678 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.051949 23748 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:19.052649 23748 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:19:19.023058 23234 consensus_meta.cc:287] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.630s	user 0.012s	sys 0.001s
I20260709 13:19:19.059643 23641 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.060336 23539 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:19.061252 23678 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.061412 23590 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.064960 23628 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:18.991046 23707 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.055573 23748 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.070031 23748 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:19.070487 23707 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:19.078442 23665 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.080924 23628 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.085004 23665 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.087543 23418 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.059674 18380 raft_consensus.cc:2410] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:19:19.098502 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:19.107278 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2789) took 1037 ms. Trace:
I20260709 13:19:19.107769 18307 rpcz_store.cc:276] 0709 13:19:18.069458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.069574 (+   116us) service_pool.cc:224] Handling call
0709 13:19:18.069947 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.070305 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.070329 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.117500 (+ 47171us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.391856 (+274356us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:18.411766 (+ 19910us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.421167 (+  9401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.421239 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.086031 (+664792us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b1800045be0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:19:19.100705 (+ 14674us) raft_consensus.cc:1685] finished
0709 13:19:19.107039 (+  6334us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.107194 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16370,"prepare.run_wall_time_us":34,"raft.queue_time_us":81045,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":6431,"spinlock_wait_cycles":70878464,"thread_start_us":250747,"threads_started":1,"wal-append.queue_time_us":307822}
I20260709 13:19:19.058596 23620 consensus_queue.cc:1059] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:19:19.107762 23651 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.127758 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.129190 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:19.130119 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.131260 18232 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:19.133284 18303 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:19:19.135583 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.136808 18306 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:19.139571 18231 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:19.140094 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.136152 18303 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:19.142894 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2116) took 1140 ms. Trace:
I20260709 13:19:19.145764 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.146243 18234 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:19.146807 18306 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:19.145761 18231 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:19.148459 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:19.149044 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 123937us
I20260709 13:19:19.143293 18311 rpcz_store.cc:276] 0709 13:19:18.002496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.006345 (+  3849us) service_pool.cc:224] Handling call
0709 13:19:18.006826 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.026186 (+ 19360us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:18.026852 (+   666us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.370337 (+343485us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.377518 (+  7181us) log.cc:844] Serialized 572 byte log entry
0709 13:19:18.377688 (+   170us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:18.377723 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.125828 (+748105us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b54000cadd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:19.125906 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.125982 (+    76us) raft_consensus.cc:1685] finished
0709 13:19:19.142680 (+ 16698us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.142831 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":184,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":89,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":2956,"spinlock_wait_cycles":43571456,"thread_start_us":343126,"threads_started":1,"wal-append.queue_time_us":413217}
I20260709 13:19:19.150430 18308 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:19.150483 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.151132 18311 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:19:19.151691 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.152331 18231 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:19.152661 18927 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:19.153640 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:19.151836 18236 raft_consensus.cc:2955] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 7 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:19.154175 18309 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:19.157512 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.158128 18308 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:19.159231 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:19.161055 23737 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:19.161566 23766 raft_consensus.cc:3055] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:19.161633 23737 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.162135 23766 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:19.162590 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:19.163082 23766 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:19.155985 23628 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.163997 23737 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.164674 23642 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:19.165100 23642 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.165444 23642 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:19.166802 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:19.167586 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.171908 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.164366 23628 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.168071 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.138466 23578 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:19.170354 18306 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:19.170265 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:19.179186 18308 raft_consensus.cc:2393] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 14: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:19.182451 23707 consensus_queue.cc:1059] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:19.185050 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:19.183414 23470 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:19:19.184263 23578 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.189376 23650 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:19.190207 23707 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:19.190627 23707 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:19.191416 23707 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.192198 23707 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:19.192976 23234 consensus_queue.cc:1059] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:19.196285 23746 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:19.196879 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:19.187366 23539 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:19:19.197541 23650 consensus_queue.cc:1243] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer 8b4fbc44aa2649f0bcac5cd70f71951d log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:19.197813 23234 consensus_queue.cc:1059] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:19.198272 23535 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:19.198428 23638 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:19.198817 23535 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:19.197685 23539 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:19:19.198905 23234 raft_consensus.cc:3055] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:19.199961 23535 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.201030 23234 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:19.201412 23535 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:19.202219 23234 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.203552 23234 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.199008 23638 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.200539 23711 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:19.204851 23638 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:19.204880 23711 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:19.206030 23711 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.207182 23711 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:19.209110 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:19.209506 23745 raft_consensus.cc:3055] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:19.209980 23745 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:19.211001 23745 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.213308 23539 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:19.214500 23677 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:19.214689 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:19.215294 23728 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:19.215648 23677 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:19.215749 23728 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:19.216178 23677 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:19.216717 23677 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.216748 23728 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.219064 23728 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:19.187108 23697 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:19.221679 23697 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.222256 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.223654 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2244) took 1401 ms. Trace:
I20260709 13:19:19.224062 18228 rpcz_store.cc:276] 0709 13:19:17.821766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.821899 (+   133us) service_pool.cc:224] Handling call
0709 13:19:17.824844 (+  2945us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.207373 (+382529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.207410 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.207940 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.394407 (+186467us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:18.415460 (+ 21053us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.419668 (+  4208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.223218 (+803550us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b540026a054. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:19.223267 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.223310 (+    43us) raft_consensus.cc:1685] finished
0709 13:19:19.223407 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.223590 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10194,"prepare.queue_time_us":20940,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":6257,"raft.queue_time_us":10147,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":6797,"spinlock_wait_cycles":878777984,"thread_start_us":186152,"threads_started":1,"wal-append.queue_time_us":247731}
I20260709 13:19:19.227353 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:19.230465 18381 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:19.231611 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:19.231913 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:19.232384 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:19.232796 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:19.234812 18377 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:19.142462 23651 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.222997 18232 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:19.212287 23745 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.231405 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:19.245352 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.243371 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.246222 18228 raft_consensus.cc:2410] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:19:19.187813 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.243850 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.247025 18306 raft_consensus.cc:2393] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 11: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:19.245004 18307 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:19.244123 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.248013 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.248349 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.248775 18229 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 15: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:19.248978 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:19.249264 18228 raft_consensus.cc:2410] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:19:19.251873 18309 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:19.253229 18237 raft_consensus.cc:2393] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 14: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:19.262676 18305 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:19.253671 18385 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:19:19.253706 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:19.253808 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.255144 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.256701 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.231956 18131 catalog_manager.cc:5697] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 17 to 18, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131), no longer has a pending config: VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129), VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130), VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131), VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 18 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:19.264465 18311 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:19.265455 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:19.266625 18229 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:19.269337 18237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:19.269915 18237 raft_consensus.cc:606] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:19.270243 18237 raft_consensus.cc:614] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:19.271018 18235 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:19.271426 18235 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:19.272033 23713 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:19.276909 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:19.254410 23651 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.272130 18235 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.283465 18232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:19.284282 18232 raft_consensus.cc:606] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:19.284644 18232 raft_consensus.cc:614] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:19.286002 18235 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:19.290735 18305 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:19.299559 18232 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:19.299937 18232 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:19.276371 23738 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:19:19.300637 18232 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.309883 18232 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:19.308012 18305 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:19.314803 18233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:19.315393 18233 raft_consensus.cc:606] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:19.315732 18233 raft_consensus.cc:614] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:19.282835 23719 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.321206 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:19.319825 23707 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:19.355229 23707 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:19.355664 23707 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:19.327893 23578 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.353252 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:19.348343 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:19.357729 18386 raft_consensus.cc:2410] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:19:19.358655 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.343297 23766 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:19.349134 23628 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:19.365156 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.365523 23638 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.367664 23638 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:19.368369 18381 raft_consensus.cc:2368] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15.
I20260709 13:19:19.372591 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.373423 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:19.372812 18958 raft_consensus.cc:2955] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 7 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:19.374140 18228 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 15: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:19.374933 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:19.374949 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.376866 18202 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:19.377252 18306 raft_consensus.cc:2955] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 7 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:19.382473 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:19.384734 23651 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:19.385493 23651 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:19.387017 23418 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.390954 23719 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.392820 23670 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:19.395771 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:19.396368 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:19.396377 18379 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:19.398744 18381 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:19.400744 18385 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:19.401379 22951 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:19.404289 23748 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.404824 23748 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:19.405882 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.406590 18230 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:19.406884 23676 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:19.407040 23748 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.407437 23676 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:19.408329 23676 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.411414 23676 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:19.411633 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:19.409468 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:19.413600 18276 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:19.414161 23697 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.414489 23648 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:19.415745 23648 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:19.351687 23767 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.190s	user 0.003s	sys 0.000s
I20260709 13:19:19.420648 18304 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:19.421597 23667 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:19.423079 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.423964 18230 raft_consensus.cc:2410] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:19:19.424808 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.375517 18955 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:19:19.428825 23535 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:19.431075 23642 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:19.432168 18953 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:19.384173 23677 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.434283 23677 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:19.440287 18201 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:19.440853 18953 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:19.442444 23522 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:19.442849 23522 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.443200 23522 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:19.448493 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:19.449164 18234 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:19.449857 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:19.453227 18385 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:19.459000 18131 catalog_manager.cc:5697] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:19.466296 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:19.475065 18235 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:19:19.475524 18235 pending_rounds.cc:85] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 7
I20260709 13:19:19.475762 18235 pending_rounds.cc:107] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:19:19.476006 18235 raft_consensus.cc:2889] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:19.476174 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:19:19.483466 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 71915.6us
I20260709 13:19:19.485005 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:19.488070 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:19.490324 18232 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:19:19.490783 18232 pending_rounds.cc:85] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 9
I20260709 13:19:19.491070 18232 pending_rounds.cc:107] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:19:19.482877 23719 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:19:19.491919 23677 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:19.492425 23677 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.494601 23677 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:19.494858 23535 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.495424 23535 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.496062 18276 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:19.497516 23535 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.491547 18232 raft_consensus.cc:2889] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:19.498613 23651 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:19.500561 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:19.501307 18380 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:19.500756 18231 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:19.489707 23578 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:19.506349 18276 leader_election.cc:400] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15.
I20260709 13:19:19.506690 18276 leader_election.cc:403] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:19:19.506601 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 55379.2us
I20260709 13:19:19.507539 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:19.507968 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:19.511121 18385 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:19.502761 18201 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:19.494532 23739 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:19.515205 18349 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:19.517570 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:19.518169 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:19.518440 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:19.518826 18386 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:19:19.521922 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:19.522555 18303 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:19.498832 23648 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:19.522171 18276 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:19.519071 18378 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:19:19.526859 18277 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:19.532159 18277 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:19.545202 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.546407 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.548535 23738 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:19.547952 18276 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:19.530251 23592 consensus_queue.cc:1059] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:19:19.529763 23709 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:19.551981 23709 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:19.552418 23709 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:19.529808 23641 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:19.553368 23641 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:19.554138 23641 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:19.554515 23641 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.511009 23288 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:19.554924 23641 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.514102 23651 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:19.573670 18231 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:19.514412 23502 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:19.572485 22951 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.575366 22951 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.530210 23753 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:19.586308 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.586948 18232 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:19.535836 23626 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:19.540953 23697 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:19:19.589032 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 56990.6us
I20260709 13:19:19.542325 23739 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:19.603729 22951 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:19.573076 23651 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.665393 23651 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.666006 23676 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:19.535429 23719 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:19:19.669719 18310 raft_consensus.cc:2410] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:19:19.574712 23737 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:19.534502 23707 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.590981 18380 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
W20260709 13:19:19.680858 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 79042.8us
I20260709 13:19:19.681614 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:19.592445 23697 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:19.606081 23642 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:19.676069 23741 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:19:19.620651 23753 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:19.636904 23648 raft_consensus.cc:697] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:19.687753 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:19.694146 18383 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:19.695084 23288 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15.
I20260709 13:19:19.701689 23739 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.588974 23522 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.686046 23697 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.732023 23753 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.734737 23728 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:19.735499 23728 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.740936 23718 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:19:19.742733 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.743369 23647 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:19.743760 23647 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:19.725157 23535 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.745685 23535 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.747562 23707 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:19.723886 23480 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:19.748536 23480 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.749919 23709 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:19.750984 18381 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:19.681823 23737 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.752876 23648 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.759347 18234 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:19.765684 23677 raft_consensus.cc:3055] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:19.766317 23677 raft_consensus.cc:740] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:19.767431 23677 consensus_queue.cc:260] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:19.769928 23548 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:19.770783 23647 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.774178 18303 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
W20260709 13:19:19.792985 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 199148us
I20260709 13:19:19.775162 23651 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:19.787045 23777 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:19:19.798555 23647 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.799423 23737 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.800377 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:19.792810 23548 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:19.801120 23480 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.801611 23628 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.802170 23628 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.804092 23651 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.804996 23548 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.806193 23548 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:19.808272 23667 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:19.808826 23667 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:19.809731 23667 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:19.812888 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 131372us
I20260709 13:19:19.813669 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:19.816826 23288 raft_consensus.cc:2764] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:19:19.817919 23288 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:19.819427 23288 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:19.794353 18927 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:19.816891 23779 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:19.795552 18231 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:19.804235 23628 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.829494 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:19.830654 18303 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:19:19.833259 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.833906 18312 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:19.850503 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:19.851836 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.854604 18379 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:19.856974 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:19.857762 18310 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.858232 18308 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:19:19.860123 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:19.861416 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:19.862694 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.868687 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.869273 18230 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:19.870548 18312 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:19.871112 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.838071 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.872821 18234 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:19:19.872890 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:19.873354 18234 pending_rounds.cc:85] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 9
I20260709 13:19:19.873667 18234 pending_rounds.cc:107] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:19:19.873741 18378 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:19.874184 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:19.873941 18234 raft_consensus.cc:2889] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:19.874626 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:19.874773 18386 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:19.875309 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:19.875725 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:19.876171 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:19.876468 18383 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:19.876932 18377 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:19.882787 18306 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:19.886274 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.886627 18305 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:19.933676 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.934216 18305 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:19.935127 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.935735 18305 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:19:19.867041 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.937256 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:19.937789 23522 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.938248 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:19:19.890692 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.848886 23488 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:19.940076 23488 raft_consensus.cc:697] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:19.941144 23488 consensus_queue.cc:237] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:19.884979 23535 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.849254 23677 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:19.819947 23288 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.950176 23288 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.893661 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:19.951799 18304 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:19.894243 18201 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:19.895747 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:19.895766 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.953634 18231 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:19:19.897405 22951 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.954586 22951 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.901355 18235 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:19.853403 23745 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.936446 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.834992 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:19.905742 23772 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
I20260709 13:19:19.828635 23641 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.912979 18202 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:19.914243 23697 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.971148 23697 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.900530 23650 consensus_queue.cc:1059] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:19:19.972788 18307 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 14: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:19.919672 18377 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:19.912384 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:19:19.974148 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 61874.8us
I20260709 13:19:19.976058 23480 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:19.976543 23480 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:19.976914 23288 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:19.977275 23548 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:19.978133 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 65270.2us
I20260709 13:19:19.923192 18310 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:19.978915 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:19.979502 18232 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:19.897081 23626 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:19:19.979616 22951 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:19.979197 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:19.940199 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:19.980708 23535 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:19.981369 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:19.982488 23650 raft_consensus.cc:3055] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:19.982892 23650 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:19.926612 18386 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:19.977864 23548 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.983662 23650 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:19.963884 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 69691.1us
I20260709 13:19:19.984721 23234 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:19.925793 23709 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:19.985162 23234 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.976936 23480 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:19.985692 23709 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:19.986304 23709 raft_consensus.cc:697] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:19.987134 23709 consensus_queue.cc:237] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:19.987707 23782 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:19.977334 23288 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.988435 23713 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:19.988819 23288 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:19.981456 23535 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:19.979602 18308 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:19.992269 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:19.992576 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:19.980149 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:19.923302 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:20.003813 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:19.997658 18310 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:19.998482 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:19.999287 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:20.005141 18234 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:20.013612 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:20.019382 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:20.025192 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:19.964059 23728 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:19.985106 23548 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:20.027096 18305 raft_consensus.cc:2368] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14.
W20260709 13:19:20.070399 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 45331.9us
I20260709 13:19:19.985703 23234 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:20.069440 22951 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:19:20.071002 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 49162.7us
I20260709 13:19:20.072839 18304 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:20.069001 23710 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:20.076982 18131 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.001s	sys 0.023s
I20260709 13:19:20.076339 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:20.074976 23670 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.022197 23676 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.081560 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:20.072360 23650 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:20.117964 22951 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.123651 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:20.086324 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:20.001236 23745 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.026083 23724 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:20.070009 23522 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:20.080463 18131 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.002s	sys 0.023s
I20260709 13:19:20.118821 22915 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:20.120309 18385 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:19:20.016018 23697 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:19:20.145845 18202 leader_election.cc:400] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14.
I20260709 13:19:20.143309 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:20.148528 18312 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:19:20.148952 18312 pending_rounds.cc:85] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 7
I20260709 13:19:20.149188 18312 pending_rounds.cc:107] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:19:20.149403 18312 raft_consensus.cc:2889] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:20.123145 22951 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.026902 23738 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:19:20.158186 23745 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:20.018347 23739 consensus_queue.cc:1175] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e016302b7e734d74833a2bf7bab44838" responder_term: 11 status { last_received { term: 11 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 11 index: 10 } }
I20260709 13:19:20.126520 23539 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.073500 23782 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:19:20.161000 23539 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.163257 23539 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:20.128118 23676 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.165155 23522 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.165720 23522 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.166900 23676 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:20.167541 18386 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:20.098834 23418 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:20.168706 23522 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:20.148671 23646 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:20.083348 23713 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:20.204059 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:20.172914 23787 log.cc:927] Time spent T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.284s	user 0.001s	sys 0.007s
I20260709 13:19:20.178412 18306 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:20.179688 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:20.180672 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.199653 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:20.214617 18229 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:20.199749 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:20.201833 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:20.203320 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:20.218653 18234 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:20.219137 18303 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:20.220057 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:20.223578 18303 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:20.129068 23548 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:20.204762 18305 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:20.234836 22951 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:20.235283 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:20.236016 18311 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:20.240815 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:20.241459 18386 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:20.097848 23670 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.196314 23535 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:20.205130 23753 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:20.238226 23713 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:20.226171 23548 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:20.261133 18201 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:20.264504 23753 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.292444 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:20.295738 18306 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:20.290697 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:20.303212 22915 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:20.303562 22915 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.303887 22915 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:20.304816 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:20.318616 22915 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.306193 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:20.327840 18228 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:20.287858 23548 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:20.322619 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 61634.6us
I20260709 13:19:20.301975 23753 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:20.329247 18201 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:20.338685 22915 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:20.354276 18201 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:20.355484 18201 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:20.355684 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:20.356433 18305 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:20.359591 23740 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:20.361006 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:20.329160 23707 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:20.331082 23646 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:19:20.373273 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.339097 23539 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:20.379381 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:20.379550 18383 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:19:20.380754 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 108235us
I20260709 13:19:20.381500 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:20.386402 18305 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:20.387825 18386 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:20.343461 23728 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:20.392227 18276 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:20.364465 23724 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:20.395289 18276 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:20.374816 23718 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:20.389150 23539 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.389678 23697 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.389415 23707 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:20.410184 23678 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:19:20.415834 23539 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:20.400810 23502 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:20.398162 23728 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:19:20.421605 23798 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:19:20.428790 23795 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:19:20.379199 23480 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.397325 23724 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.401340 23718 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.488740 23718 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:20.492844 23724 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:20.502537 18234 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:19:20.506938 23728 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.508966 23707 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.451378 23697 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.518698 23697 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:20.519770 23641 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:20.522063 23480 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:20.522260 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:20.523867 23234 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.547482 23234 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:20.404711 23781 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:20.555945 18306 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:20.559602 23729 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:20.563457 23740 consensus_queue.cc:1059] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:20.564203 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:20.564494 23480 raft_consensus.cc:3055] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:20.565899 23480 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:20.566952 23480 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.569378 23480 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:20.570119 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:20.580662 23638 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.581290 23638 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.583732 23638 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:20.586162 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:20.587129 18308 raft_consensus.cc:2368] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14.
I20260709 13:19:20.589740 23638 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.590509 23638 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.593578 23638 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:20.594313 23480 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:20.600932 23748 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:20.601488 23748 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:20.602361 23748 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.607790 18202 leader_election.cc:400] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14.
I20260709 13:19:20.608160 18202 leader_election.cc:403] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:19:20.609426 23737 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:20.612169 23782 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.618335 23737 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14.
I20260709 13:19:20.612720 23782 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.623764 23782 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:20.626180 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:20.627314 23648 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:20.634349 23648 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:20.634855 23648 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.638249 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:20.639015 23648 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:20.642221 23753 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.643733 18377 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:19:20.644733 23648 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:20.645432 23648 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.646459 23418 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:20.647367 23418 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:20.647696 23418 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:20.648710 23418 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.650197 23418 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:20.653977 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:20.654800 18377 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:20.656488 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:20.657298 23641 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:20.657668 23641 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:20.658047 23480 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:20.467751 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:20.658509 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:20.658936 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 264596us
I20260709 13:19:20.659009 23480 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.468173 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:20.453016 23711 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.660807 18236 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:20.660912 23711 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.661684 23480 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:20.663165 23711 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:20.664304 18383 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:20.665419 18308 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:19:20.525141 23288 consensus_meta.cc:287] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:19:20.667105 23288 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:20.465483 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 85162.3us
I20260709 13:19:20.669407 23288 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:20.535329 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:20.670156 18381 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:20.536584 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:20.502409 23535 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:20.673341 23535 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:20.674482 23488 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:20.512365 23670 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:20.676471 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:20.676856 18304 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:19:20.677273 18236 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
W20260709 13:19:20.420092 23790 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.131s	user 0.000s	sys 0.002s
I20260709 13:19:20.679888 23548 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.541913 22915 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:20.683568 23548 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:20.647699 23648 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:20.688472 23648 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:20.689244 23648 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.690450 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:20.691465 23670 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:20.691569 23648 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:20.692052 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:20.692684 18276 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:20.692888 18386 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:20.693584 23648 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:20.545446 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:20.695415 23805 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:20.698370 23646 raft_consensus.cc:697] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:20.368374 23713 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.699573 23646 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:20.701511 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 75396.7us
I20260709 13:19:20.658088 23641 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:20.692013 23670 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:20.705722 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:20.705929 23670 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:20.706583 18233 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 16: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:20.708989 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:20.709873 18233 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 14: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:20.717123 22915 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.717782 22915 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.720026 22915 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:20.538017 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:19:20.725529 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 187580us
I20260709 13:19:20.726925 23638 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:20.727658 23638 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:20.729027 23638 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:20.736688 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:20.737637 18236 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:20.740618 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:19:20.743214 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52433.7us
I20260709 13:19:20.750869 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:20.751708 18386 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:20.603755 23748 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:20.777549 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.778977 18276 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:20.780018 23288 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:20.780669 23288 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:20.781206 23288 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:20.782361 18229 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:20.785784 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:20.786650 18306 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:20.789894 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:20.804755 18201 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:20.807273 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:20.808488 18386 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:20.810839 23480 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:20.811388 23480 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:20.811898 23480 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:20.817080 23535 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:20.807385 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 59844.8us
I20260709 13:19:20.930621 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:20.819029 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:20.934672 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:20.935348 18233 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:20.822774 18381 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:20.825870 23718 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:20.846439 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 67574.2us
I20260709 13:19:20.875573 18379 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:19:20.937364 18379 pending_rounds.cc:85] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 8
I20260709 13:19:20.937734 18379 pending_rounds.cc:107] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:19:20.938063 18379 raft_consensus.cc:2889] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:20.938839 18306 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:19:20.940855 22915 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.941913 22915 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.870092 23709 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:20.937750 18381 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:20.874078 18235 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:20.905471 23620 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.948222 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:20.940943 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:20.934156 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:20.950428 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:20.952885 22951 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:20.949944 18229 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:20.903090 23724 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.958003 18231 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:20.956609 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:20.960767 18276 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:20.964150 23758 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:19:20.976316 23718 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:20.977377 18230 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:20.979322 23709 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:20.982055 23709 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:20.982514 23535 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:20.984740 23676 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:20.985318 23676 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.985749 23676 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:20.948751 23782 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:20.989110 23782 raft_consensus.cc:697] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:20.990267 23782 consensus_queue.cc:237] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.948056 23646 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.993098 23646 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.995661 23646 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:20.960083 23620 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:20.998215 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:20.998948 23620 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:19:20.964336 23710 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:21.000159 23710 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.000190 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:21.000680 23710 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:21.001011 18307 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
I20260709 13:19:21.001644 18276 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:21.003898 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:21.009799 22915 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:21.004698 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:20.926873 23670 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:21.005895 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 64294.8us
I20260709 13:19:21.030074 18236 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:21.005210 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:21.035763 23697 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:21.037241 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:21.037943 18307 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:21.041781 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:21.042759 23808 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:21.043219 18228 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:21.043426 23808 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:21.044456 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:21.044740 23808 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:21.047010 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:21.016395 23781 consensus_queue.cc:1059] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:21.019407 23480 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:21.048130 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 46593.5us
I20260709 13:19:21.048780 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:21.020242 22951 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:21.021919 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:21.049844 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:21.050556 18229 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:21.022917 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:21.051366 18310 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:21.051380 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:21.023530 23759 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:21.023802 23676 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:20.895292 23539 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:21.036458 23697 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:21.015564 23648 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:21.047557 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:21.068534 18230 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:21.054116 18303 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:19:21.070210 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:19:21.071017 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 108470us
I20260709 13:19:21.071080 18303 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:21.071404 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:21.072639 18311 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:21.012396 18231 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
I20260709 13:19:21.057964 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:21.068841 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:21.075704 18236 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:21.110312 18312 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:21.057919 23480 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:21.115760 18305 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:21.124382 18379 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:21.127075 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:21.082337 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:21.133590 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:21.134079 18311 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:21.134326 18312 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:21.133741 18303 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:21.153273 22915 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:21.153515 22951 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:21.064563 23492 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:21.153329 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:21.067131 23759 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:21.072461 23628 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:21.177085 18230 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:21.177661 18307 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
W20260709 13:19:21.133265 23822 log.cc:927] Time spent T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:21.167116 22951 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:21.170861 18303 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:19:21.174181 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:21.178835 22951 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.179579 22951 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:21.168921 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:21.176235 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:21.181149 22915 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:21.181612 22915 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.182010 22915 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:21.120077 23641 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:21.071857 23288 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:21.191814 18303 pending_rounds.cc:85] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 8
I20260709 13:19:21.198468 18303 pending_rounds.cc:107] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:19:21.199023 18303 raft_consensus.cc:2889] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:21.193678 18312 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:19:21.207856 22951 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:21.211431 22915 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:21.183578 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:21.166224 23492 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.265939 23492 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:21.223227 22915 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:21.224046 23697 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:21.178999 23753 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:21.230247 23759 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:21.232628 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:21.232892 23641 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:21.233345 18308 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:21.234895 23539 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:21.196566 23628 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:21.260135 23288 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:21.250926 18233 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:21.254745 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:21.287281 18228 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 12: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:21.156946 23707 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:19:21.265202 18306 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:21.278875 22951 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:21.283145 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 46726.4us
W20260709 13:19:21.249902 18133 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39288 (request call id 180) took 39270 ms (client timeout 15000 ms). Trace:
I20260709 13:19:21.284324 23713 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:19:21.289326 18133 rpcz_store.cc:269] 0709 13:18:41.979613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.991941 (+ 12328us) service_pool.cc:224] Handling call
0709 13:19:21.249828 (+39257887us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:16.422882 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:16.567551 (+144669us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:16.577887 (+ 10336us) write_op.cc:435] Acquired schema lock
0709 13:19:16.579730 (+  1843us) tablet.cc:662] Decoding operations
0709 13:19:16.716760 (+137030us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:16.716852 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:16.716877 (+    25us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:19:16.718454 (+  1577us) tablet.cc:701] Row locks acquired
0709 13:19:16.718473 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:19:16.718626 (+   153us) write_op.cc:270] Start()
0709 13:19:16.718760 (+   134us) write_op.cc:276] Timestamp: P: 1783603156718574 usec, L: 0
0709 13:19:16.718782 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:16.719570 (+   788us) log.cc:844] Serialized 8365 byte log entry
0709 13:19:16.848450 (+128880us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa17f1690ac 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b
0709 13:19:17.306877 (+458427us) op_driver.cc:464] REPLICATION: finished
0709 13:19:17.487943 (+181066us) write_op.cc:301] APPLY: starting
0709 13:19:17.495605 (+  7662us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:17.748354 (+252749us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b54002ae254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa18227032a 00007fa1821f5f14 00007fa1821f5ec3 00007fa1821f5e38 00007fa1821f5df3 00007fa1821f50dc 00007fa18221ee16 00007fa182206cbb 00007fa1821f139d 00007fa1821f4d75
0709 13:19:17.880279 (+131925us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:17.880311 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:18.512436 (+632125us) spinlock_profiling.cc:243] Waited 9.96 ms on lock 0x7b180010b1c0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181fb20ec 00007fa181fb4af7 00007fa181fb5fb0 00007fa185cca1bb 00007fa185d115d4 00007fa185bbd8da 00007fa185bc03cb 00007fa185bbffd3 00007fa185cbee34
0709 13:19:19.067640 (+555204us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:19.068392 (+   752us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=0,mrs_lookups=0
0709 13:19:19.068443 (+    51us) write_op.cc:312] APPLY: finished
0709 13:19:19.092107 (+ 23664us) log.cc:844] Serialized 188 byte log entry
0709 13:19:19.136938 (+ 44831us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:19.165712 (+ 28774us) write_op.cc:454] Released schema lock
0709 13:19:19.172811 (+  7099us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:19.180203 (+  7392us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:19.180238 (+    35us) write_op.cc:454] Released schema lock
0709 13:19:19.351132 (+170894us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
Metrics: {"mutex_wait_us":222257,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":168048,"apply.run_cpu_time_us":55491,"apply.run_wall_time_us":1698671,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91739,"num_ops":21,"prepare.queue_time_us":266698,"prepare.run_cpu_time_us":47000,"prepare.run_wall_time_us":636209,"raft.queue_time_us":606236,"raft.run_cpu_time_us":36485,"raft.run_wall_time_us":692399,"replication_time_us":557245,"spinlock_wait_cycles":94380416,"thread_start_us":1067613,"threads_started":6,"wal-append.queue_time_us":485854,"wal-append.run_cpu_time_us":6960,"wal-append.run_wall_time_us":1111505}]]}
I20260709 13:19:21.395030 18385 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:21.393064 23713 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.464887 23676 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:21.469805 23724 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:21.468693 23670 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:21.479123 23713 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:21.500737 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 451453us
I20260709 13:19:21.526187 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:21.527949 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:19:21.531454 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 317984us
W20260709 13:19:21.543550 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 408763us
I20260709 13:19:21.553681 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:21.545806 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:21.554813 18386 raft_consensus.cc:2368] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18.
I20260709 13:19:21.559682 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:21.541244 23781 consensus_queue.cc:1243] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:21.558473 18379 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:21.502784 23651 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 13:19:21.575673 23710 consensus_meta.cc:287] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.003s
W20260709 13:19:21.594293 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 48595.5us
I20260709 13:19:21.595322 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:21.560745 23646 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.490947 23628 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:21.546327 23707 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 13:19:21.624195 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 79729us
I20260709 13:19:21.641420 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:21.558408 23834 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:19:21.644306 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:21.650566 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:21.651471 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:21.649652 18233 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:21.651832 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:21.652189 18229 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:21.652637 18236 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:21.653918 18230 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:21.654129 18231 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 16: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:21.591817 23779 consensus_queue.cc:1059] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 13:19:21.596274 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 77008.8us
I20260709 13:19:21.663175 18276 leader_election.cc:400] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18.
I20260709 13:19:21.663481 18276 leader_election.cc:403] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:19:21.666487 18236 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:21.668300 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:21.668603 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:21.669273 18230 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 14: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:21.669306 18231 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 18: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:21.669998 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:21.673120 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:21.674134 18236 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 16: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:21.636744 23697 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:21.649770 23817 log.cc:927] Time spent T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:19:21.635679 23782 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:21.714931 18233 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
W20260709 13:19:21.906472 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 407149us
I20260709 13:19:21.681954 18237 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:21.695204 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:21.694257 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:21.917796 18308 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:21.918800 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:21.696869 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:21.737169 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 1027) took 1057 ms. Trace:
I20260709 13:19:21.709527 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:21.928987 18310 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:21.930253 18307 raft_consensus.cc:2410] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:19:21.930464 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:21.931470 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:21.688695 18386 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:21.928719 18304 rpcz_store.cc:276] 0709 13:19:20.679300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.679820 (+   520us) service_pool.cc:224] Handling call
0709 13:19:20.680147 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.680505 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.684544 (+  4039us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.685152 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.059249 (+374097us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:21.059278 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.059333 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.736900 (+677567us) raft_consensus.cc:1685] finished
0709 13:19:21.736928 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.737097 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":196,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":373568,"threads_started":1,"wal-append.queue_time_us":605109}
I20260709 13:19:21.779990 18958 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:21.945861 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:21.947041 18304 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:21.950402 18306 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:21.820300 22915 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:21.957140 22915 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:21.959074 22915 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:21.961804 22915 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:21.967888 18131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 89) took 5910 ms. Trace:
I20260709 13:19:21.968904 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:21.971634 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:21.975989 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:21.993079 22951 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:21.748224 23492 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:22.000398 23492 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:19:21.705291 23641 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:21.849517 23648 raft_consensus.cc:3055] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:22.045459 23648 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:22.047276 23648 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:21.633421 23646 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:21.712898 23697 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.049213 18958 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:22.051350 23697 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:21.706121 23707 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:22.051940 23646 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.052903 18305 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:21.598430 23710 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.056757 23450 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:21.731787 23782 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.059341 23782 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:21.680649 23823 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 13:19:21.872076 23829 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.283s	user 0.003s	sys 0.000s
W20260709 13:19:21.731032 23826 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.339s	user 0.001s	sys 0.000s
W20260709 13:19:21.705374 23831 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:19:22.088881 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:19:21.680485 23833 log.cc:927] Time spent T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:19:22.091974 18383 raft_consensus.cc:2368] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18.
I20260709 13:19:21.676270 23836 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:21.829777 23837 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:19:21.818173 23844 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.002s
I20260709 13:19:22.016183 22951 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.114338 22951 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:22.001832 23535 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.038174 23805 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.039085 23806 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:22.039875 23808 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:22.042619 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:22.121903 23808 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.043267 23779 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:21.968395 18131 rpcz_store.cc:276] 0709 13:19:16.063820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.068938 (+  5118us) service_pool.cc:224] Handling call
0709 13:19:21.967640 (+5898702us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:20.167760 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:20.168396 (+   636us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:20.168432 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:19:20.168444 (+    12us) tablet.cc:662] Decoding operations
0709 13:19:20.252277 (+ 83833us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:20.252358 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:20.252399 (+    41us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:19:20.252796 (+   397us) tablet.cc:701] Row locks acquired
0709 13:19:20.252821 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:19:20.253024 (+   203us) write_op.cc:270] Start()
0709 13:19:20.253170 (+   146us) write_op.cc:276] Timestamp: P: 1783603160252961 usec, L: 0
0709 13:19:20.253201 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:19:20.254016 (+   815us) log.cc:844] Serialized 989 byte log entry
0709 13:19:20.919099 (+665083us) op_driver.cc:464] REPLICATION: finished
0709 13:19:21.183941 (+264842us) write_op.cc:301] APPLY: starting
0709 13:19:21.187310 (+  3369us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:21.224255 (+ 36945us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:21.224370 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:21.225842 (+  1472us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:21.226054 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:19:21.226107 (+    53us) write_op.cc:312] APPLY: finished
0709 13:19:21.226366 (+   259us) log.cc:844] Serialized 33 byte log entry
0709 13:19:21.282378 (+ 56012us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:21.285136 (+  2758us) write_op.cc:454] Released schema lock
0709 13:19:21.287249 (+  2113us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:21.400732 (+113483us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:21.415356 (+ 14624us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":195605,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":228792,"apply.run_cpu_time_us":5579,"apply.run_wall_time_us":126199,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12471,"num_ops":2,"prepare.queue_time_us":683756,"prepare.run_cpu_time_us":3631,"prepare.run_wall_time_us":86578,"replication_time_us":665694,"thread_start_us":861421,"threads_started":2}]]}
I20260709 13:19:22.081087 23670 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:22.082334 23711 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:22.083915 23713 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.540s	user 0.016s	sys 0.000s
I20260709 13:19:22.089057 23710 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:22.090200 18379 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:21.712540 23835 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:19:22.132838 23711 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.133533 23738 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:22.092377 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2836) took 1352 ms. Trace:
I20260709 13:19:22.135694 23711 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:22.134589 18309 rpcz_store.cc:276] 0709 13:19:20.739851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.740566 (+   715us) service_pool.cc:224] Handling call
0709 13:19:20.740932 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.741316 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.741348 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.741840 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.130652 (+388812us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:21.130702 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.130781 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.091979 (+961198us) raft_consensus.cc:1685] finished
0709 13:19:22.092018 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.092197 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1033,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":388474,"threads_started":1,"wal-append.queue_time_us":558937}
I20260709 13:19:22.136837 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:22.137600 18309 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:22.103173 23856 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.223s	user 0.000s	sys 0.002s
I20260709 13:19:22.121009 23535 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:22.141717 23779 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.144797 23670 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.149230 23707 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:22.144148 23535 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:22.150714 23707 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.151371 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 3143) took 1093 ms. Trace:
I20260709 13:19:22.122330 23808 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:22.129523 22951 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.081115 23781 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.136502 23713 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.128221 18305 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:22.151989 18383 rpcz_store.cc:276] 0709 13:19:21.057513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.057704 (+   191us) service_pool.cc:224] Handling call
0709 13:19:22.150997 (+1093293us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b5400081454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:22.151258 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2274466688}
I20260709 13:19:22.148324 23670 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.177011 23781 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.178817 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:22.179517 18958 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:19:22.180713 18385 raft_consensus.cc:2368] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19.
I20260709 13:19:22.181542 23713 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:22.191139 18307 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:22.121089 23805 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.195890 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:22.201198 23724 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:22.201908 23724 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:22.203330 23724 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.205312 18308 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:22.168653 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 960) took 1135 ms. Trace:
W20260709 13:19:22.169246 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 506036us
W20260709 13:19:22.162001 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 62348us
I20260709 13:19:22.177048 23836 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.205071 23832 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.220480 18200 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:22.220700 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:22.231668 18306 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:22.239580 22951 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:22.200343 23806 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:19:22.215245 18377 rpcz_store.cc:276] 0709 13:19:20.995788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.997377 (+  1589us) service_pool.cc:224] Handling call
0709 13:19:20.997720 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.998034 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.998060 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.998484 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.293441 (+294957us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:21.293505 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.293597 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.101358 (+807761us) raft_consensus.cc:1685] finished
0709 13:19:22.108401 (+  7043us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.131271 (+ 22870us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12656,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":294638,"threads_started":1,"wal-append.queue_time_us":499310}
I20260709 13:19:22.251935 18237 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:22.261055 23779 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.261410 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:22.269603 18309 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
I20260709 13:19:22.281517 23836 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.276016 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:22.294994 23845 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:22.269338 23832 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.307646 23832 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:22.292212 18233 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:22.297639 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:22.301368 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:22.281630 23852 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:22.314373 23845 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:22.313545 23852 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.342646 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:22.341521 23628 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:22.341522 18380 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:22.377724 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:22.378820 18236 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:22.388142 18233 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:22.374111 23852 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:22.390236 18276 leader_election.cc:400] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19.
I20260709 13:19:22.390957 18276 leader_election.cc:403] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:22.375780 23724 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.393461 23807 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:19:22.398350 23865 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.151s	user 0.005s	sys 0.000s
I20260709 13:19:22.395326 23807 raft_consensus.cc:697] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:22.402144 23807 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:22.405819 23866 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:19:22.385308 23781 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.383201 23628 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:22.388228 23648 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:22.384940 23805 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.415319 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:22.421880 18237 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
I20260709 13:19:22.423895 23781 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.424641 23781 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.425698 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:22.430876 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 87192.3us
W20260709 13:19:22.437484 23869 log.cc:927] Time spent T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:19:22.438206 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.442804 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.444278 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:22.449818 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 73345.4us
I20260709 13:19:22.452699 23855 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:19:22.457266 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.458628 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.459185 18386 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:22.464058 18236 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:19:22.465271 23781 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.466454 23628 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.473536 23779 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:22.474285 23871 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:19:22.466568 23845 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.474292 23779 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.498755 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.479185 18229 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:22.480614 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:22.482138 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:22.472788 23724 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.493618 23847 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:22.497745 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:22.510464 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.510680 18383 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:22.511760 23847 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.518689 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.514312 23779 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.516027 18304 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:19:22.516345 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.484032 23808 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.494746 23782 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:22.528128 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 75817.9us
I20260709 13:19:22.528962 23782 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:22.530977 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:22.518697 23847 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:22.537281 18386 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:22.538126 23651 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:22.538666 23641 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18.
I20260709 13:19:22.550173 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:22.563305 18310 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:22.568423 18307 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:19:22.573477 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:22.574098 18304 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:22.552454 23847 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:22.583973 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 61661.2us
I20260709 13:19:22.583738 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.593724 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.593716 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:22.595085 18309 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:22.596930 23718 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:22.596537 18130 catalog_manager.cc:5697] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 10 to 15, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 15 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:22.597671 23718 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.598726 18130 catalog_manager.cc:5697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 6 to 14, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 14 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:22.600064 23718 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:22.602406 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 71546.8us
I20260709 13:19:22.604272 18384 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:22.538727 23651 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.580847 23781 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:22.600203 18130 catalog_manager.cc:5697] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 7 to 12, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 12 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:22.606030 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:22.583113 23641 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:22.627029 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:19:22.630067 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 53063.4us
I20260709 13:19:22.633420 23724 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.635993 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:22.636835 18309 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:22.637367 23808 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.637894 23480 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:22.639671 23855 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19.
I20260709 13:19:22.630041 23781 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:22.650614 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:19:22.654343 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52715.6us
I20260709 13:19:22.658005 18386 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:22.652782 23707 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.611817 23641 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.671653 18309 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:22.672703 18311 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:19:22.673164 18311 pending_rounds.cc:85] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 9
I20260709 13:19:22.673451 18311 pending_rounds.cc:107] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:19:22.673563 23641 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.671533 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:22.673753 18311 raft_consensus.cc:2889] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:22.667567 18130 catalog_manager.cc:5697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 9 to 13, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 13 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:22.656728 23535 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:22.657498 23480 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:22.664656 23836 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:22.656044 23724 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:22.691401 23724 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.693516 23288 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:22.693956 23288 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.694291 23288 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:22.697023 23863 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:22.696353 23748 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:22.698081 23748 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.699188 23861 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.689389 18130 catalog_manager.cc:5697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 11 to 14, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 14 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:22.688450 18303 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:22.705750 23707 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.706569 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:22.707741 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:22.708252 18308 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:22.714488 23535 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.715603 23880 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:22.713007 18130 catalog_manager.cc:5697] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:19:22.717991 23874 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:19:22.716673 23535 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.672019 23852 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:22.697664 23863 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.725800 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:22.699769 23861 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.732945 18311 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:22.710088 23707 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:22.730353 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.732280 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.734773 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:22.736821 18201 leader_election.cc:400] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18.
I20260709 13:19:22.737135 18201 leader_election.cc:403] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:19:22.737818 23852 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:22.738234 23882 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18.
I20260709 13:19:22.738706 23748 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.739398 23670 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:22.739853 23670 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.740243 23670 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:22.741530 23651 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.716348 23880 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:22.709452 23836 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.746587 23806 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:22.746517 23480 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.751309 23863 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.753166 23882 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:22.755240 18201 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:22.758487 23861 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.760716 23882 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:22.765105 23781 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:22.768353 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:22.747226 23880 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:22.775068 18311 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:22.734516 18130 catalog_manager.cc:5697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 10 to 13, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 13 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:22.781247 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:22.787576 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:22.782318 23882 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.788105 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:22.793501 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.795749 18275 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:22.795939 23882 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:22.799726 23779 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:22.800504 23836 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.801973 18386 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:22.806742 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.810290 18130 catalog_manager.cc:5697] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 5 to 13. New cstate: current_term: 13 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:22.812472 18130 catalog_manager.cc:5697] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 10 to 14, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 14 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:22.814180 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 2183) took 1106 ms. Trace:
I20260709 13:19:22.820106 18310 rpcz_store.cc:276] 0709 13:19:21.708221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.930088 (+221867us) service_pool.cc:224] Handling call
0709 13:19:22.813933 (+883845us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b540013ef54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:22.814077 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399914240}
I20260709 13:19:22.814859 18277 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:22.822472 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:22.815495 23779 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:22.823288 23855 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:22.836699 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:22.837718 18231 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:22.837561 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:22.838230 18228 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:22.840705 23861 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:22.841205 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 212401us
I20260709 13:19:22.841550 23861 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.842312 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:22.848747 23832 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:22.849202 23832 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.849058 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:22.849915 23832 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:22.850004 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.851076 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.852788 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:22.852823 23858 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:22.863047 23724 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.865139 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.865903 18382 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:22.867156 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:22.867923 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.869526 23728 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:22.869896 18382 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:22.869903 23728 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:22.870373 23728 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:22.851298 23535 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:22.874552 18306 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:19:22.844157 23861 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.873525 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:22.882138 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 59770.3us
I20260709 13:19:22.883659 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:22.882189 18304 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:22.891515 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.905483 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.908018 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:22.911476 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.913039 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:22.916256 18381 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:22.900767 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:22.888159 23718 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:19:22.924571 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:22.894200 23781 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:22.932132 18312 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:22.934139 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:22.898483 23855 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:22.931035 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:22.938202 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:22.946101 18235 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:19:22.939178 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:22.927918 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:22.912607 23535 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.940397 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:22.940600 18130 catalog_manager.cc:5697] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 10 to 13, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 13 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:22.910136 23861 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:22.954717 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:22.955785 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:22.955911 23808 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:22.956884 23808 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:22.957803 23808 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.962482 23806 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.962929 23806 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.966542 23480 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:22.967262 23535 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.894757 23670 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.905555 23779 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:19:22.904942 23724 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:19:22.970350 18311 raft_consensus.cc:2368] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17.
I20260709 13:19:22.970752 23641 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:22.971714 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:22.974958 23638 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:22.927770 23805 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:22.976421 23638 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:22.976505 23805 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.977273 23805 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:22.977741 23638 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:22.978329 23806 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:22.978828 23638 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:22.975983 18130 catalog_manager.cc:5697] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:22.954775 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:22.980258 18130 catalog_manager.cc:5697] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 6 to 11, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 11 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:22.997421 18130 catalog_manager.cc:5697] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 8 to 14, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 14 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:22.998003 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:22.998869 18130 catalog_manager.cc:5697] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 8 to 11, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 11 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:23.002684 23288 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.008948 18309 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:19:23.036013 18307 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:23.038826 23863 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.045066 23863 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.048724 23858 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:23.049046 23782 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:23.051288 23863 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:23.053380 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:23.006440 23861 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.056222 23806 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:23.060139 23861 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:23.039124 23882 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.077907 23882 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:23.084481 23288 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:23.085232 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 43636.6us
I20260709 13:19:23.086053 18130 catalog_manager.cc:5697] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 8 to 13, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 13 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:23.060381 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:23.097797 18130 catalog_manager.cc:5697] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:23.106815 23832 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.109220 23832 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:23.110031 18383 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:19:23.097723 23450 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:19:23.114492 18130 catalog_manager.cc:5697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 9 to 13, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 13 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:23.116772 18130 catalog_manager.cc:5697] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:23.118860 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 58580us
I20260709 13:19:23.119773 18201 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:19:23.124903 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.125469 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:23.126305 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:23.131597 18201 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:23.137223 18130 catalog_manager.cc:5697] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 13 to 15, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 15 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:23.144140 18385 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:23.145172 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:23.120568 23882 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:23.155052 18130 catalog_manager.cc:5697] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:23.156909 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:23.158838 18308 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:23.133777 23861 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:23.094640 23805 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.165302 23805 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:23.173595 18130 catalog_manager.cc:5697] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 14 to 15, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 15 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:23.178448 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:23.182542 18309 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:23.181586 23651 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:23.182446 18381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49c6a2a19b90491f9336362305339eca"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:19:23.189049 18381 raft_consensus.cc:606] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:23.189476 18381 raft_consensus.cc:614] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:23.193270 18381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "b52e2477fc524694967c4a16afa983e3"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:19:23.193995 18381 raft_consensus.cc:606] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Received request to transfer leadership to TS b52e2477fc524694967c4a16afa983e3
I20260709 13:19:23.157019 23728 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.192233 23670 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:23.191746 23651 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.198961 23651 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:23.199658 18381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:19:23.200559 18381 raft_consensus.cc:606] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:23.200660 23288 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:23.201056 18381 raft_consensus.cc:614] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:23.201622 23670 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:23.202049 23670 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:23.205001 18383 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:23.213351 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51757.8us
I20260709 13:19:23.211118 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:23.181156 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:23.213086 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:23.149824 23724 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:23.221635 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:19:23.228127 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 181536us
I20260709 13:19:23.231057 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:23.236081 18309 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:23.240267 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:23.225350 18381 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:23.244450 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:23.249392 18307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef83aa6f9534403ebe38156348430345"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "b52e2477fc524694967c4a16afa983e3"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:19:23.246264 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:23.253430 18277 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:23.203729 23808 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:19:23.221143 23748 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:23.228972 23728 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:23.239717 23628 consensus_queue.cc:1059] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:19:23.203588 23670 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.271512 23670 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:23.278578 23648 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:23.287240 23648 raft_consensus.cc:3055] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:23.287676 23648 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:23.288491 23648 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.290005 23648 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:23.291263 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:23.292728 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:23.292784 23638 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:23.293515 23638 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:23.293723 22951 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:23.293982 23638 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:23.294423 22951 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:23.295493 22951 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.242654 18130 catalog_manager.cc:5697] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 9 to 15, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 15 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:23.296904 18351 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:23.301540 23892 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:23.302141 23892 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:23.303151 23892 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.303795 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:23.304700 18385 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:23.305356 23858 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:23.305565 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:23.313179 23638 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.315929 23782 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:23.318128 18228 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:23.328822 23638 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:23.345137 23648 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:23.347115 23648 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.349025 18307 raft_consensus.cc:606] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Received request to transfer leadership to TS b52e2477fc524694967c4a16afa983e3
I20260709 13:19:23.349474 18307 raft_consensus.cc:614] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:23.350302 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 96979.4us
I20260709 13:19:23.351325 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:23.353649 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:23.358152 18202 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:23.365177 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:23.374318 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:23.353209 23628 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:23.380277 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:23.383116 18202 leader_election.cc:400] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17.
I20260709 13:19:23.383652 18202 leader_election.cc:403] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:23.382493 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:23.385301 18202 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:23.385404 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:23.359107 23748 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:23.366204 23782 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:23.393075 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:23.395205 18385 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:23.398109 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:23.398870 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:23.377956 23863 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:23.392269 23805 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:23.382166 23808 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:23.403980 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:23.411252 18306 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:23.404579 23805 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:23.395747 23651 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:23.402925 23535 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:23.412901 18235 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:23.413546 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:19:23.414199 23728 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:23.414608 23728 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:23.415483 23728 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.419750 23648 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:23.378077 23882 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:19:23.421423 23882 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:23.421797 23882 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:23.422791 23882 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.424156 23882 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:23.426034 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:23.413960 23653 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:19:23.428609 23863 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.428733 23858 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:23.429271 23863 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.431429 18381 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:23.435132 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:23.441869 23535 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:23.407768 23852 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:23.442631 23651 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17.
I20260709 13:19:23.447252 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:23.449699 18236 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:23.449527 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:23.452689 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:23.455029 18307 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:23.451607 23863 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:23.456360 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:23.457595 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:23.458213 18304 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:23.455847 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 54368.1us
I20260709 13:19:23.454252 23670 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:23.463507 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:23.467429 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:23.464195 18231 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:23.477376 18304 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:23.466535 23670 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:23.478259 23904 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:23.478811 23904 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.479156 23904 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:23.479228 23670 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.479949 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:23.481217 18379 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:23.485201 18377 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:23.486594 23904 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.488046 18383 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:23.473626 23880 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:23.493898 18202 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:23.495714 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:23.498529 18306 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:23.466787 23782 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:23.500125 23535 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:23.503224 18230 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:23.506865 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:23.509939 23901 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.089s	user 0.005s	sys 0.000s
W20260709 13:19:23.526005 23900 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.093s	user 0.001s	sys 0.001s
I20260709 13:19:23.495365 23648 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:23.529889 23641 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:23.530390 23836 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:23.528435 23782 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:23.534338 18201 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:23.503976 23781 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:23.539628 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:23.531934 23651 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:23.540606 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:23.532369 23535 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:23.567728 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:23.542394 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:23.543155 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:23.543414 18231 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:23.547397 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:23.570304 18306 raft_consensus.cc:2410] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:19:23.570673 18305 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:19:23.548055 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:23.548338 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:23.548578 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:23.549729 18303 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:23.550585 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:23.566241 18228 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:23.541699 23648 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:23.586495 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:23.572600 18307 raft_consensus.cc:2410] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:19:23.574769 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:23.587175 18310 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:19:23.571693 23904 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:23.595811 23904 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:23.554857 23852 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:19:23.599561 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:23.600277 18234 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:23.610562 23535 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.620479 18236 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:23.622994 18230 raft_consensus.cc:2410] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:19:23.635509 18304 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:19:23.646335 23728 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:23.650318 18228 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:19:23.653519 23898 log.cc:927] Time spent T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.237s	user 0.002s	sys 0.000s
I20260709 13:19:23.658895 23648 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:23.585551 23781 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.663822 23781 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:23.629076 23641 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:23.665120 23641 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:23.665603 23641 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:23.665650 18232 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:23.681723 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:23.684459 18228 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:19:23.686892 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:23.631722 23779 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:23.704756 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:23.582794 23836 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:23.738262 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 203956us
I20260709 13:19:23.768050 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:23.702157 23832 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.768968 18309 raft_consensus.cc:2410] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:19:23.776252 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:23.776818 18311 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:23.736830 23904 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:23.778585 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:23.785688 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:23.708199 23779 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.791368 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:23.793778 18304 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 17: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:23.768941 23808 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:19:23.707924 23782 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.778242 23892 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:19:23.777278 23832 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.788892 23904 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:23.816913 23806 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.820086 23899 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.401s	user 0.003s	sys 0.000s
I20260709 13:19:23.850092 18311 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:23.834268 23718 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:23.864102 23806 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.867811 23651 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.868060 23905 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:19:23.868398 23651 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.870563 23651 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:23.871384 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:23.872534 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:23.874075 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:23.875355 23882 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:23.875845 23882 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:23.876809 23882 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.878096 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:23.879068 23779 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:23.879974 23911 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:23.880582 23911 raft_consensus.cc:697] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:23.890892 18234 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:23.892638 23535 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:23.845811 23724 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:23.903759 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:23.925216 18377 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:23.904287 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:23.929697 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 47554.9us
W20260709 13:19:23.882951 23903 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:19:23.849263 23892 consensus_queue.cc:1059] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 13:19:23.944368 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 107727us
I20260709 13:19:23.957813 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:23.867815 23806 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:23.972674 18231 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:23.884377 23718 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:23.988309 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 48295.9us
I20260709 13:19:23.881620 23911 consensus_queue.cc:237] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.954945 23724 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:23.998366 23724 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:23.960523 23836 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:24.011760 23892 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:24.046070 23904 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:24.049932 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:24.027426 23641 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.054816 23641 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:24.020691 23707 raft_consensus.cc:3055] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:24.060326 18304 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:24.081875 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.084723 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.077400 23832 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:24.077481 23707 raft_consensus.cc:740] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:24.088709 23707 consensus_queue.cc:260] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.090220 23707 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:24.100683 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:24.105432 18233 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:24.115520 18381 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:24.125015 18383 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:24.125550 18383 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:24.126709 18383 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.128149 18383 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:24.132866 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 175161us
I20260709 13:19:24.134181 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:24.138650 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:24.138046 23782 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:24.147769 23779 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 13:19:24.152861 23902 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.449s	user 0.004s	sys 0.000s
I20260709 13:19:24.139775 23832 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:19:24.158540 23912 raft_consensus.cc:993] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: : Instructing follower b52e2477fc524694967c4a16afa983e3 to start an election
I20260709 13:19:24.162171 23728 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.162775 23728 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.164868 23935 consensus_queue.cc:1059] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:24.165567 18275 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:24.166003 23935 raft_consensus.cc:3055] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:24.166229 23940 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:24.166477 23935 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:24.168938 23912 raft_consensus.cc:1081] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Signalling peer b52e2477fc524694967c4a16afa983e3 to start an election
I20260709 13:19:24.170511 23628 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:24.170970 18201 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:24.172710 23480 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:24.173131 23480 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.173465 23480 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:24.168311 23935 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:24.179087 23718 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:24.197595 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:24.205905 18383 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:19:24.206008 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:24.206506 18383 pending_rounds.cc:85] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 7
I20260709 13:19:24.206758 18383 pending_rounds.cc:107] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:19:24.207123 18383 raft_consensus.cc:2889] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:24.149223 23707 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:24.206733 18235 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:24.210291 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:19:24.254904 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 64934.1us
I20260709 13:19:24.257077 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:24.258438 23935 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:24.372251 22951 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:24.372818 22951 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:24.301378 23728 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:24.290488 18230 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:24.256207 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:24.208349 23718 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:24.369975 23836 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:24.385890 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 129755us
I20260709 13:19:24.384951 22951 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.414335 22951 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:24.378882 23858 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:19:24.376945 23707 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:24.417689 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:24.422245 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:24.404366 23782 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:24.402715 23718 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:24.420818 23779 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.423635 23892 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:24.427146 23931 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:24.451622 23718 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.461378 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:24.463845 23904 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:24.464609 23904 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:24.468741 23904 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:24.468964 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:24.474840 23779 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.477161 23779 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:24.485311 23707 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.418772 23932 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:19:24.490780 23932 consensus_queue.cc:1243] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:24.491412 23925 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:24.494087 23480 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.419705 23836 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.498893 23858 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:24.499414 23858 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:24.503185 23858 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.505148 23858 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:24.464661 23914 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.508996 23914 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.555363 23480 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:24.573966 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 144483us
I20260709 13:19:24.545060 23910 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:19:24.576308 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:24.577947 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 137063us
I20260709 13:19:24.584772 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.585623 18383 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:24.591105 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.592370 18383 raft_consensus.cc:2410] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:19:24.597965 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:24.600865 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.566985 23836 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:24.603226 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.606314 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.605572 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:24.570747 23782 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:24.608300 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.597895 23914 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:24.619092 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:24.620075 18377 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:24.601904 23779 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.624627 18385 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:24.633533 23944 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:24.635017 22951 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:24.635481 22951 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:24.638216 23946 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:24.639135 23946 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:24.639533 23946 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.639912 23946 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:24.644495 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 46593.1us
W20260709 13:19:24.664494 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 50675.4us
I20260709 13:19:24.669400 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:24.674283 18235 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:24.685473 18237 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:24.693818 23955 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:24.698393 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:24.705833 18233 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:24.672751 23904 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:24.708662 23931 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:24.671895 23913 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:24.674520 23628 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:24.643579 23779 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.715691 23779 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:24.695717 18229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
 from {username='slave'} at 127.0.0.1:42520
I20260709 13:19:24.704668 23836 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:24.717020 23836 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.719914 23836 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:24.720839 18229 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:24.721498 18229 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:24.731088 23628 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.687100 23782 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.734380 23628 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:24.728598 23913 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:24.716199 23942 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.183s	user 0.002s	sys 0.000s
I20260709 13:19:24.749408 18377 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:19:24.705574 23955 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.712284 23904 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.751837 18229 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.731314 23931 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:24.759104 18378 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:19:24.773123 23931 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.784987 18229 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:24.786527 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 110575us
I20260709 13:19:24.787482 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:24.789795 22951 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.790705 22951 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:24.792900 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:24.782338 23904 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:24.814383 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:24.794184 23781 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:24.801077 23628 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:24.818132 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 110965us
I20260709 13:19:24.809294 23852 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.823082 23852 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.820155 23628 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:24.825664 23628 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:24.825282 23782 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:24.815006 23779 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:19:24.831738 23913 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:24.833151 23955 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:24.834239 23951 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:19:24.836712 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.842218 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.843353 18382 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:19:24.843739 18382 pending_rounds.cc:85] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 8
I20260709 13:19:24.843935 18382 pending_rounds.cc:107] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:19:24.828473 23956 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:24.844362 18382 raft_consensus.cc:2889] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:24.845714 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:24.846378 18384 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:24.846701 18384 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:24.847426 18384 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.850286 23946 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.852250 18304 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:24.848441 18384 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:24.858817 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:24.859445 18307 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:24.860868 23852 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:24.861276 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:24.865226 18309 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:24.866612 22951 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:24.874334 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.874614 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.876353 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.891690 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.891968 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:24.895545 18384 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:19:24.897399 18230 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:24.903146 18231 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:24.903604 18234 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:24.904207 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:24.926474 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.927249 23628 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.927239 23946 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:24.882853 23956 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:24.943611 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:24.943812 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 51954.9us
I20260709 13:19:24.960156 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:24.962805 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:24.965425 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:24.969821 23944 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:24.970232 23925 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:24.972702 23910 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:24.973667 23806 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:24.949216 23956 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.966390 18309 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:19:24.977981 23956 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:24.978883 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.979943 18384 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:24.991144 23779 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:24.991866 23779 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:24.994385 23779 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:25.008316 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:24.964464 23904 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:25.030606 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:25.031358 18303 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:25.035284 18309 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:19:25.036357 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:25.037671 18304 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:25.037408 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:25.048141 18304 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:25.048357 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:25.046217 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 73953.1us
I20260709 13:19:25.052312 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:25.045434 18310 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:19:25.052994 18305 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:19:25.056974 18312 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:19:25.053762 18202 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:25.006896 23935 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:25.049340 18201 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:25.062024 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:25.064324 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:25.064978 18311 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:25.065635 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:25.071534 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:25.069075 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:25.072752 18306 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:25.073539 18307 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:25.075035 18304 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:25.081837 18312 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:19:25.080111 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:25.083410 18231 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:25.061447 23946 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.063103 23718 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:25.086273 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:25.090036 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:25.070645 23929 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:25.070453 23535 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:25.056253 23911 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:19:25.069734 23935 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.100611 23946 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:25.102641 23967 log.cc:927] Time spent T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:19:25.108913 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:25.119015 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:25.084493 23863 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:25.128633 18308 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:25.113692 23806 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:25.133246 23806 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:25.133761 23806 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:25.137184 18303 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:19:25.137969 18310 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
W20260709 13:19:25.143363 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.154701 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:25.097191 23718 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:25.162441 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 76799.9us
I20260709 13:19:25.165591 23946 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:25.167037 18305 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:19:25.166975 23914 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:25.167569 18305 pending_rounds.cc:85] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 7
I20260709 13:19:25.167923 18305 pending_rounds.cc:107] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 14.8
W20260709 13:19:25.167970 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 53085.1us
I20260709 13:19:25.168293 18305 raft_consensus.cc:2889] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:25.170428 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:25.171304 23863 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:25.171615 23935 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:25.135699 23535 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:25.173677 23852 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:25.173278 23535 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.174117 23852 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.174518 23852 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:25.175504 18311 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:19:25.173301 23863 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:19:25.182039 23935 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:25.183624 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:25.184279 23863 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:25.159380 23718 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:25.188040 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:25.193147 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:25.196643 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:25.194521 23728 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:19:25.199142 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:25.204802 23929 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:25.206010 23929 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:25.208743 23892 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:25.209263 23628 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:25.195010 23925 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:19:25.209101 23929 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.214251 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:25.242264 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:25.221490 23944 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:19:25.246222 23944 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:25.246663 23944 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:25.251276 18311 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:25.260900 22951 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:25.262666 23480 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:25.263340 23480 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:25.225740 23909 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:25.302515 23852 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.305665 23852 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:25.308738 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:25.309523 18307 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:19:25.312304 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 149104us
I20260709 13:19:25.313169 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:25.310571 23480 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.316435 23480 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:25.306725 23628 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.211593 23960 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:19:25.341848 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:25.342614 18235 raft_consensus.cc:2368] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20.
I20260709 13:19:25.333348 23628 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.345353 23628 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:25.347633 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:25.314519 23935 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:19:25.348718 23904 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:25.354526 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:25.355036 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:25.355809 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:25.356642 18236 raft_consensus.cc:2410] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:19:25.356894 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:25.334209 23852 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:25.375269 23909 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:25.375948 23909 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:25.378664 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:25.381793 18307 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:19:25.382593 18277 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:25.380044 23852 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.393925 23718 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.411366 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:25.416040 23781 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:25.416882 23852 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:25.383013 23628 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:25.421780 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:25.420233 23628 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.425331 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:25.437911 18230 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:25.422482 23955 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:25.447853 23941 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:25.448429 23941 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:25.449712 23718 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:25.419822 23913 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.450965 23913 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.451339 23941 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:25.452330 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:25.462003 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:25.463526 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:25.464689 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:25.427352 23628 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:25.464136 18380 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:19:25.468163 22951 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:25.431342 23956 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:25.464995 23781 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:25.460872 23909 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.479597 23945 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:19:25.514635 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 50005.5us
I20260709 13:19:25.472388 23847 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
W20260709 13:19:25.493256 23971 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.284s	user 0.000s	sys 0.005s
W20260709 13:19:25.522045 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 52225.5us
I20260709 13:19:25.522966 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:25.499528 23913 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:25.531656 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:25.538400 18926 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:25.539680 23933 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:25.540386 23933 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:25.532056 23913 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:25.541004 23933 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:25.542035 23852 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:25.546144 23909 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:25.549465 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:19:25.548453 23978 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:25.555773 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:25.557906 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:25.558072 23781 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:25.579274 23985 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:19:25.580417 23984 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:19:25.581053 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:25.582338 23628 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:25.583278 23986 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:19:25.558418 23945 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:25.585826 23962 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.381s	user 0.005s	sys 0.000s
I20260709 13:19:25.588842 23994 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:25.590158 18277 leader_election.cc:400] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20.
I20260709 13:19:25.590488 18277 leader_election.cc:403] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:25.591044 23954 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20.
I20260709 13:19:25.591912 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:25.607620 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:25.609366 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:25.609948 18232 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:25.605777 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:25.613692 23480 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:25.614270 23480 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:25.615089 23480 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.592309 23628 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:25.626210 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:25.607659 23945 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:25.639815 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:25.640769 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:25.641288 18303 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:25.634343 23933 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:25.647477 23933 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:25.648728 18958 raft_consensus.cc:2410] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:25.652907 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:25.659991 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:25.662881 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:25.666229 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:25.676638 18233 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:25.680197 18303 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:19:25.685923 18237 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:25.663753 18380 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:19:25.695252 18232 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:19:25.701961 18233 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:19:25.704814 18232 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:25.705526 18235 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:25.713091 18131 catalog_manager.cc:5697] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 7 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:25.714927 18131 catalog_manager.cc:5697] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:25.744177 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 106391us
I20260709 13:19:25.745874 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:25.746567 18233 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:25.711501 23945 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:25.750432 22951 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:25.751458 22951 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:25.751855 22951 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:25.761759 18381 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:19:25.770661 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:19:25.749538 23806 consensus_meta.cc:287] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.005s
I20260709 13:19:25.778707 18304 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:25.779305 18307 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:25.780241 18310 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:25.794147 18312 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:19:25.780296 23806 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.798167 23806 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:25.800431 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:25.803421 18237 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:25.805502 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:25.806231 18384 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:25.791702 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:25.756667 23995 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:19:25.811398 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:25.813625 18385 raft_consensus.cc:2410] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:19:25.775111 23931 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:25.815461 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 46508.7us
I20260709 13:19:25.818900 23925 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:25.821801 23948 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:25.822338 23948 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:25.791064 23955 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:25.833537 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:25.756976 23944 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.839401 18384 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:19:25.825603 23535 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:25.785835 23996 consensus_queue.cc:1059] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:19:25.833752 23638 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:19:25.842453 23782 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:19:25.865513 23991 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:19:25.824295 23931 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.843780 23948 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.870335 18378 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:19:25.870775 18378 pending_rounds.cc:85] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 9
W20260709 13:19:25.871165 23992 consensus_queue.cc:1175] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "459e82ee6b564cc19be6f73186938e79" responder_term: 18 status { last_received { term: 16 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:25.876089 23535 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:25.842756 23955 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:25.880581 18312 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:25.880728 18306 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:25.885665 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:25.889601 23931 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:25.870555 23948 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:25.897460 18378 pending_rounds.cc:107] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:19:25.906105 18378 raft_consensus.cc:2889] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:25.896464 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 51140.2us
I20260709 13:19:25.914624 23955 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.935913 23480 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:25.940141 23806 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:19:25.944096 18381 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:25.946874 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:19:25.981530 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.984874 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:25.987514 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:25.998238 18385 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:26.003835 18926 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:26.013386 23635 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:26.013938 23635 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:26.014791 23635 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:26.022238 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:26.023597 23944 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:26.024749 23480 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:25.995838 23638 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.029968 23638 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:25.981894 23892 consensus_queue.cc:1059] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:19:26.078296 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:19:26.083894 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 79981.8us
I20260709 13:19:26.085826 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:26.092010 23728 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:26.092955 24009 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:19:26.095007 23912 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:26.099944 22951 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:26.101308 22951 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:26.120411 18131 catalog_manager.cc:5697] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 9 to 12, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 12 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:26.121973 18131 catalog_manager.cc:5697] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 8 to 11, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 11 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:25.986846 23535 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:26.130963 23993 raft_consensus.cc:3055] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:26.131390 23993 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:26.132216 23993 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:26.136418 23993 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:26.144929 23480 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:26.146060 18201 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:26.161783 23480 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.162349 23480 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:26.180775 18234 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:26.208106 23480 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:26.208794 23480 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:26.201210 23728 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:19:26.215744 18130 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39284 (request call id 177) took 14230 ms (client timeout 15000 ms). Trace:
W20260709 13:19:26.216333 18130 rpcz_store.cc:269] 0709 13:19:11.985263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.987236 (+  1973us) service_pool.cc:224] Handling call
0709 13:19:26.215637 (+14228401us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:23.872851 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:23.873844 (+   993us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:23.873912 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:19:23.873926 (+    14us) tablet.cc:662] Decoding operations
0709 13:19:23.875783 (+  1857us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:23.875883 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:23.875928 (+    45us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:19:24.025958 (+150030us) tablet.cc:701] Row locks acquired
0709 13:19:24.026017 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:19:24.026235 (+   218us) write_op.cc:270] Start()
0709 13:19:24.026435 (+   200us) write_op.cc:276] Timestamp: P: 1783603164026149 usec, L: 0
0709 13:19:24.026475 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:19:24.027376 (+   901us) log.cc:844] Serialized 8756 byte log entry
0709 13:19:24.511636 (+484260us) op_driver.cc:464] REPLICATION: finished
0709 13:19:24.695172 (+183536us) write_op.cc:301] APPLY: starting
0709 13:19:24.703926 (+  8754us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:24.864121 (+160195us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:24.864277 (+   156us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:25.351465 (+487188us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:25.351911 (+   446us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0709 13:19:25.351975 (+    64us) write_op.cc:312] APPLY: finished
0709 13:19:25.365016 (+ 13041us) log.cc:844] Serialized 196 byte log entry
0709 13:19:25.481388 (+116372us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:25.498147 (+ 16759us) write_op.cc:454] Released schema lock
0709 13:19:25.519913 (+ 21766us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:25.558844 (+ 38931us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:25.560099 (+  1255us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2044,"reported_tablets":55,"spinlock_wait_cycles":4480,"child_traces":[["op",{"apply.queue_time_us":117267,"apply.run_cpu_time_us":45923,"apply.run_wall_time_us":865111,"cfile_cache_hit":90,"cfile_cache_hit_bytes":95911,"num_ops":22,"prepare.queue_time_us":211735,"prepare.run_cpu_time_us":12627,"prepare.run_wall_time_us":198573,"raft.queue_time_us":333962,"raft.run_cpu_time_us":27713,"raft.run_wall_time_us":99587,"replication_time_us":473142,"thread_start_us":476709,"threads_started":5,"wal-append.queue_time_us":274841,"wal-append.run_cpu_time_us":24870,"wal-append.run_wall_time_us":1138030}]]}
I20260709 13:19:26.241509 23638 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:26.238095 23991 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:26.237627 23929 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:19:26.267786 23991 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:26.326671 23991 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:26.337517 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:26.350696 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.352908 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:26.382571 23892 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:26.399590 23892 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:26.401857 23892 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:26.405618 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:26.414215 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:26.415107 18310 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 16: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:26.483474 18232 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:26.477795 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:26.493736 18311 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.050s	sys 0.138s
W20260709 13:19:26.494182 18311 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.050s	sys 0.138s
I20260709 13:19:26.462847 23995 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.488305 18234 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:26.507155 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:26.512658 23909 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:26.593660 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 80237.4us
I20260709 13:19:26.594612 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:19:26.596302 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 79241us
I20260709 13:19:26.607857 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:26.611544 18378 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:26.628069 18384 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:26.582319 23909 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:26.633270 18236 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:26.609330 23954 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.513979 23995 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:26.658030 23993 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:26.617275 23944 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:26.660498 24025 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:19:26.649019 23781 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:19:26.682111 23781 consensus_queue.cc:1243] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer 8b4fbc44aa2649f0bcac5cd70f71951d log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:19:26.677978 24018 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:19:26.657495 23954 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:26.688642 23954 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:26.689126 24028 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:19:26.689637 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 2937) took 1050 ms. Trace:
I20260709 13:19:26.680964 23909 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:26.681444 23991 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:26.695842 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:26.697858 18230 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:26.697902 18386 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:26.690057 18311 rpcz_store.cc:276] 0709 13:19:25.638800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.639414 (+   614us) service_pool.cc:224] Handling call
0709 13:19:25.655162 (+ 15748us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:25.829516 (+174354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.829548 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:25.836793 (+  7245us) log.cc:844] Serialized 52 byte log entry
0709 13:19:26.494544 (+657751us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:26.494590 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.494661 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:26.689411 (+194750us) raft_consensus.cc:1685] finished
0709 13:19:26.689433 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.689571 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43712,"raft.queue_time_us":69672,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":9726,"thread_start_us":706325,"threads_started":2,"wal-append.queue_time_us":666072}
I20260709 13:19:26.704025 18379 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:19:26.708602 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:26.709326 18236 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:26.711380 24028 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:26.672286 23944 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:26.719766 23944 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:26.730042 23781 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:26.733600 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:26.756661 18308 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:19:26.758263 23994 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:26.758738 23994 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.759078 23994 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:26.776145 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:26.777319 23995 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:26.781788 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:26.782403 18230 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:26.783505 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:26.789758 23925 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:26.790226 23925 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.790551 23925 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:26.794539 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:26.800675 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:26.801589 23535 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:26.802502 24036 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:19:26.805840 18201 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:26.806771 18383 pending_rounds.cc:85] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 9
I20260709 13:19:26.807178 18383 pending_rounds.cc:107] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:19:26.807427 23976 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:26.807971 23976 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:26.808334 23976 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:26.807416 18383 raft_consensus.cc:2889] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:26.818372 23976 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:26.839690 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:26.849865 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 45080.3us
I20260709 13:19:26.861449 18379 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:26.820398 23944 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:26.878638 23994 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:26.896145 18311 raft_consensus.cc:2368] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18.
I20260709 13:19:26.882370 23976 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:26.876222 24031 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:19:26.925542 23925 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:26.936980 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:26.972378 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:26.973610 18311 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 16: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:26.939057 23944 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:26.947486 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:26.951062 23994 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:26.956163 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:26.993432 18230 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:26.964730 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:26.972858 18386 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:26.995074 18234 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:26.996191 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:19:27.010857 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 126135us
W20260709 13:19:27.014463 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 153657us
I20260709 13:19:27.016597 24034 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:27.025843 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:27.029487 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:27.030737 18310 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:26.986080 23995 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.037948 18351 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:27.019220 24040 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:19:27.049912 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:27.017859 23925 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:27.019778 23931 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:27.047230 23991 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:27.054629 23728 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:19:27.046880 23995 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.072685 23995 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:27.077580 18202 leader_election.cc:400] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18.
I20260709 13:19:27.081347 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:27.083127 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:27.089558 18311 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:27.090548 18307 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:27.092748 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:27.093540 18305 raft_consensus.cc:2368] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18.
I20260709 13:19:27.074839 23931 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:27.104411 18230 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:19:27.108850 23931 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:27.109890 24042 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.134s	user 0.000s	sys 0.002s
I20260709 13:19:27.123600 18383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35ee2a6512e24d10af3526398de71490"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:19:27.124356 18383 raft_consensus.cc:606] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:27.124747 18383 raft_consensus.cc:614] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:27.150022 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:27.157852 18202 leader_election.cc:400] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18.
I20260709 13:19:27.158283 18202 leader_election.cc:403] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:19:27.160697 23909 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:27.161669 23910 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18.
I20260709 13:19:27.194085 24047 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:27.194648 24047 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.197901 18379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:19:27.198650 18379 raft_consensus.cc:606] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:27.199054 18379 raft_consensus.cc:614] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:27.199311 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:27.200181 23946 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:27.200560 24047 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:27.200806 23946 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:27.201915 23946 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.210330 18386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:19:27.210970 18386 raft_consensus.cc:606] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:27.211386 18386 raft_consensus.cc:614] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:27.218806 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 68891.9us
I20260709 13:19:27.220847 23944 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:27.221313 23944 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.221640 23944 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:27.226663 18237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:27.227290 18237 raft_consensus.cc:606] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:27.249966 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:27.262347 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:27.262990 18377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:19:27.263311 18304 raft_consensus.cc:2393] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:27.263679 18377 raft_consensus.cc:606] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:27.264055 18377 raft_consensus.cc:614] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:27.266224 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:27.268316 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:27.280874 23977 raft_consensus.cc:993] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: : Instructing follower 459e82ee6b564cc19be6f73186938e79 to start an election
I20260709 13:19:27.281459 23977 raft_consensus.cc:1081] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Signalling peer 459e82ee6b564cc19be6f73186938e79 to start an election
I20260709 13:19:27.327317 23944 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.329335 18386 raft_consensus.cc:2368] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17.
I20260709 13:19:27.332994 23956 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:27.333133 18201 leader_election.cc:400] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17.
I20260709 13:19:27.333772 18201 leader_election.cc:403] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:27.335786 24047 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:27.333741 23956 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.347234 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:27.348035 18386 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:27.350749 18276 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:27.348496 23956 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:27.353382 23781 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:27.355190 23781 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:27.355590 23781 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:27.390559 23931 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:27.401458 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 48304.1us
I20260709 13:19:27.406945 24047 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17.
I20260709 13:19:27.407684 23931 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.408877 23781 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.409976 23931 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:27.417626 23944 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:27.417860 23781 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:27.418859 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:27.424938 18311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:43794
I20260709 13:19:27.425568 18311 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:27.426015 18311 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:27.443534 23781 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.444108 18379 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:27.444157 23781 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.445256 18276 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:27.446512 23781 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:27.447052 23781 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:27.449568 23781 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:27.450739 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:27.451529 18230 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:27.454041 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:27.454982 18230 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:27.456856 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:27.452128 23781 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.476464 18131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 90) took 4462 ms. Trace:
I20260709 13:19:27.481061 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:27.481880 23944 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:27.482390 23944 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.479007 18311 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.482764 23944 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:27.484278 18311 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:27.485163 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:27.488953 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:27.489560 18377 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:27.490144 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:27.493323 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:27.493852 18306 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:27.493872 18230 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:27.499323 23944 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.500610 18377 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:27.479826 18131 rpcz_store.cc:276] 0709 13:19:23.048755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.048943 (+   188us) service_pool.cc:224] Handling call
0709 13:19:27.476388 (+4427445us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:26.296002 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:26.318785 (+ 22783us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:26.318836 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:19:26.318858 (+    22us) tablet.cc:662] Decoding operations
0709 13:19:26.357132 (+ 38274us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:26.358433 (+  1301us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:26.367811 (+  9378us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:19:26.463398 (+ 95587us) tablet.cc:701] Row locks acquired
0709 13:19:26.463418 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:19:26.478513 (+ 15095us) write_op.cc:270] Start()
0709 13:19:26.502703 (+ 24190us) write_op.cc:276] Timestamp: P: 1783603166474360 usec, L: 0
0709 13:19:26.502738 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:19:26.580614 (+ 77876us) log.cc:844] Serialized 1758 byte log entry
0709 13:19:26.761511 (+180897us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa17f1690ac 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b
0709 13:19:27.217626 (+456115us) op_driver.cc:464] REPLICATION: finished
0709 13:19:27.411667 (+194041us) write_op.cc:301] APPLY: starting
0709 13:19:27.411750 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:27.414923 (+  3173us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:27.414957 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:27.451243 (+ 36286us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:27.451536 (+   293us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 13:19:27.451597 (+    61us) write_op.cc:312] APPLY: finished
0709 13:19:27.451814 (+   217us) log.cc:844] Serialized 49 byte log entry
0709 13:19:27.451983 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:27.452096 (+   113us) write_op.cc:454] Released schema lock
0709 13:19:27.452138 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:27.452636 (+   498us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:27.452670 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":519732,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":193752,"apply.run_cpu_time_us":7528,"apply.run_wall_time_us":40916,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20815,"num_ops":4,"prepare.queue_time_us":108604,"prepare.run_cpu_time_us":31261,"prepare.run_wall_time_us":612688,"raft.queue_time_us":87397,"raft.run_cpu_time_us":55387,"raft.run_wall_time_us":120515,"replication_time_us":710410,"spinlock_wait_cycles":4518144,"thread_start_us":591341,"threads_started":4,"wal-append.queue_time_us":395024}]]}
I20260709 13:19:27.505879 18306 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:27.518913 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:27.525516 18276 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:27.526407 23944 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:27.527100 23944 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:27.526558 23956 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:27.527812 23944 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:27.528072 23956 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:27.529400 23956 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.529852 23944 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.532840 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:27.544708 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:27.545509 18230 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:19:27.549779 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 43978.4us
I20260709 13:19:27.565318 18311 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:27.567490 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:27.567796 23992 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:27.568548 18237 raft_consensus.cc:2410] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:19:27.571597 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:27.572248 18237 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:27.572631 18237 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:27.570000 18128 catalog_manager.cc:5697] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 11 to 13, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 13 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:27.575376 18237 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.581638 18237 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:27.583523 18128 catalog_manager.cc:5697] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 12 to 13, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 13 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:27.589799 18128 catalog_manager.cc:5697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 11 to 14, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 14 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:27.595937 18237 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
W20260709 13:19:27.601192 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 44116.1us
I20260709 13:19:27.665673 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:27.658092 18128 catalog_manager.cc:5697] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:27.668049 23781 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:27.667681 18128 catalog_manager.cc:5697] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:27.670132 18128 catalog_manager.cc:5697] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 9 to 14, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 14 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:27.660717 18230 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:27.658074 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:27.692785 18237 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:27.691195 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 89304.5us
I20260709 13:19:27.710100 22951 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:27.718739 18237 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:27.724702 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:27.731123 18128 catalog_manager.cc:5697] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:19:27.745944 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 79022.8us
I20260709 13:19:27.733290 23944 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:27.754755 18236 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:27.766816 18128 catalog_manager.cc:5697] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:27.768657 18128 catalog_manager.cc:5697] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:27.770025 18128 catalog_manager.cc:5697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 9 to 11, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 11 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:27.772986 23944 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:27.771557 18128 catalog_manager.cc:5697] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 9 to 11, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 11 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:27.784161 18379 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:27.785192 24066 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:27.792452 23781 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:19:27.788121 23956 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:27.803470 23944 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.821069 23956 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:27.864315 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:27.866382 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:27.869400 18236 raft_consensus.cc:2368] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 16. Current term is 17.
I20260709 13:19:27.871454 18277 leader_election.cc:400] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 16. Current term is 17.
I20260709 13:19:27.871768 18277 leader_election.cc:403] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:27.862793 18128 catalog_manager.cc:5697] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 10 to 12, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 12 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:27.878923 18128 catalog_manager.cc:5697] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 10 to 11, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 11 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:27.873157 23946 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:27.870155 23956 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:27.880481 18128 catalog_manager.cc:5697] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 9 to 12, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 12 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:19:27.937364 24067 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:19:27.988255 18305 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:27.990991 18386 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:27.992707 23956 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:27.950891 23946 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 16. Current term is 17.
I20260709 13:19:28.018082 23931 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:19:28.048902 18379 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:28.052745 23781 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:28.067380 18230 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:28.111559 18230 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:28.116199 23931 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:28.124785 24032 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:28.145721 18236 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:28.269659 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:28.285044 24076 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.170s	user 0.004s	sys 0.000s
I20260709 13:19:28.342698 18305 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:19:28.406106 23931 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:19:28.373605 24085 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:19:28.428332 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 77603.9us
W20260709 13:19:28.448904 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 108017us
W20260709 13:19:28.604599 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 204052us
I20260709 13:19:28.611894 18236 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:19:28.623884 24091 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:28.633469 24092 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:19:28.770135 18127 catalog_manager.cc:5697] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 12 to 13, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 13 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:28.851583 18128 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39288 (request call id 181) took 26682 ms (client timeout 15000 ms). Trace:
W20260709 13:19:28.852180 18128 rpcz_store.cc:269] 0709 13:19:02.169473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.289627 (+120154us) service_pool.cc:224] Handling call
0709 13:19:02.804624 (+514997us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b54002ae254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dd090 00007fa18227bf3a 00007fa1880321cc 00007fa18813037e 00007fa1865f12a4 00007fa1865f1232 00007fa1865f1161 00007fa1865f10dc 00007fa1865f0392 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:28.851445 (+26046821us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:28.114779 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:28.115437 (+   658us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:28.115469 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:19:28.115489 (+    20us) tablet.cc:662] Decoding operations
0709 13:19:28.116988 (+  1499us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:28.117077 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:28.117108 (+    31us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:19:28.118255 (+  1147us) tablet.cc:701] Row locks acquired
0709 13:19:28.118276 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:19:28.118465 (+   189us) write_op.cc:270] Start()
0709 13:19:28.118604 (+   139us) write_op.cc:276] Timestamp: P: 1783603168118406 usec, L: 0
0709 13:19:28.118621 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:19:28.128398 (+  9777us) log.cc:844] Serialized 5628 byte log entry
0709 13:19:28.258183 (+129785us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b54002ae254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa18226ee28 00007fa185ca9581 00007fa185ca8d58 00007fa185cad9f1 00007fa185cad9a9 00007fa185cad939 00007fa185cad901 00007fa185cacb2d 000000000038f354 000000000038f199
0709 13:19:28.408423 (+150240us) op_driver.cc:464] REPLICATION: finished
0709 13:19:28.446887 (+ 38464us) write_op.cc:301] APPLY: starting
0709 13:19:28.446967 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:28.649154 (+202187us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:28.649185 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:28.735818 (+ 86633us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:28.736121 (+   303us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 13:19:28.736166 (+    45us) write_op.cc:312] APPLY: finished
0709 13:19:28.736506 (+   340us) log.cc:844] Serialized 129 byte log entry
0709 13:19:28.750888 (+ 14382us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:28.751064 (+   176us) write_op.cc:454] Released schema lock
0709 13:19:28.751121 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:28.777327 (+ 26206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:28.777360 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":54,"spinlock_wait_cycles":79276416,"child_traces":[["op",{"apply.queue_time_us":35302,"apply.run_cpu_time_us":18267,"apply.run_wall_time_us":327751,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62535,"num_ops":14,"prepare.queue_time_us":73398,"prepare.run_cpu_time_us":9416,"prepare.run_wall_time_us":143614,"replication_time_us":253051,"spinlock_wait_cycles":17137536,"thread_start_us":75394,"threads_started":2}]]}
I20260709 13:19:28.872987 18127 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 91) took 1361 ms. Trace:
I20260709 13:19:28.873420 18127 rpcz_store.cc:276] 0709 13:19:27.511500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.511785 (+   285us) service_pool.cc:224] Handling call
0709 13:19:27.547748 (+ 35963us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5400200490. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14f0b2 00007fa1880c8a89 00007fa188060da6 00007fa188032088 00007fa18813037e 00007fa1865f12a4 00007fa1865f1232 00007fa1865f1161 00007fa1865f10dc
0709 13:19:28.872869 (+1325121us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:28.851022 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:28.863830 (+ 12808us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:28.863858 (+    28us) write_op.cc:435] Acquired schema lock
0709 13:19:28.863871 (+    13us) tablet.cc:662] Decoding operations
0709 13:19:28.864193 (+   322us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:28.864248 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:28.864279 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:19:28.864461 (+   182us) tablet.cc:701] Row locks acquired
0709 13:19:28.864479 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:19:28.864670 (+   191us) write_op.cc:270] Start()
0709 13:19:28.864817 (+   147us) write_op.cc:276] Timestamp: P: 1783603168864600 usec, L: 0
0709 13:19:28.864839 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:28.865478 (+   639us) log.cc:844] Serialized 539 byte log entry
0709 13:19:28.867522 (+  2044us) op_driver.cc:464] REPLICATION: finished
0709 13:19:28.867990 (+   468us) write_op.cc:301] APPLY: starting
0709 13:19:28.868087 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:28.869038 (+   951us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:28.869146 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:28.869845 (+   699us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:28.870034 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:19:28.870085 (+    51us) write_op.cc:312] APPLY: finished
0709 13:19:28.870296 (+   211us) log.cc:844] Serialized 25 byte log entry
0709 13:19:28.870472 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:28.870565 (+    93us) write_op.cc:454] Released schema lock
0709 13:19:28.870624 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:28.871012 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:28.871038 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":29455232,"child_traces":[["op",{"apply.queue_time_us":244,"apply.run_cpu_time_us":2974,"apply.run_wall_time_us":2974,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4172,"num_ops":1,"prepare.queue_time_us":67854,"prepare.run_cpu_time_us":2770,"prepare.run_wall_time_us":14878,"replication_time_us":2527,"spinlock_wait_cycles":116608,"thread_start_us":26543,"threads_started":1}]]}
I20260709 13:19:29.129321 18134 catalog_manager.cc:5697] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.133764 18134 catalog_manager.cc:5697] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.137105 18134 catalog_manager.cc:5697] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.160593 18134 catalog_manager.cc:5697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 10 to 14, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 14 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:19:29.156169 18129 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39284 (request call id 176) took 37338 ms (client timeout 15000 ms). Trace:
W20260709 13:19:29.188140 18129 rpcz_store.cc:269] 0709 13:18:51.818482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.818798 (+   316us) service_pool.cc:224] Handling call
0709 13:18:52.173698 (+354900us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b5400200490. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14f640 00007fa188026b76 00007fa188130c3e 00007fa1865f12a4 00007fa1865f1232 00007fa1865f1161 00007fa1865f10dc 00007fa1865f0392 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:29.156019 (+36982321us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":507513,"reported_tablets":55,"spinlock_wait_cycles":4445440}
I20260709 13:19:29.189785 18134 catalog_manager.cc:5697] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:19:29.422077 18134 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39270 (request call id 189) took 29027 ms (client timeout 15000 ms). Trace:
W20260709 13:19:29.422552 18134 rpcz_store.cc:269] 0709 13:19:00.395076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.395354 (+   278us) service_pool.cc:224] Handling call
0709 13:19:29.421953 (+29026599us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:29.259681 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:29.260226 (+   545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:29.260260 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:19:29.260272 (+    12us) tablet.cc:662] Decoding operations
0709 13:19:29.260945 (+   673us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:29.260999 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:29.261029 (+    30us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:19:29.261590 (+   561us) tablet.cc:701] Row locks acquired
0709 13:19:29.261608 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:19:29.261745 (+   137us) write_op.cc:270] Start()
0709 13:19:29.261855 (+   110us) write_op.cc:276] Timestamp: P: 1783603169261700 usec, L: 0
0709 13:19:29.261877 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:29.263175 (+  1298us) log.cc:844] Serialized 2109 byte log entry
0709 13:19:29.266304 (+  3129us) op_driver.cc:464] REPLICATION: finished
0709 13:19:29.268065 (+  1761us) write_op.cc:301] APPLY: starting
0709 13:19:29.268174 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:29.273519 (+  5345us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:29.273635 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:29.318312 (+ 44677us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:29.318527 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 13:19:29.318573 (+    46us) write_op.cc:312] APPLY: finished
0709 13:19:29.318868 (+   295us) log.cc:844] Serialized 57 byte log entry
0709 13:19:29.323273 (+  4405us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:29.323397 (+   124us) write_op.cc:454] Released schema lock
0709 13:19:29.326258 (+  2861us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:29.334751 (+  8493us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:29.334783 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57351,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":1506,"apply.run_cpu_time_us":8963,"apply.run_wall_time_us":66636,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20860,"num_ops":5,"prepare.queue_time_us":3358,"prepare.run_cpu_time_us":3422,"prepare.run_wall_time_us":4790,"replication_time_us":4256}]]}
I20260709 13:19:29.446954 18132 catalog_manager.cc:5697] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:29.464228 18135 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39284 (request call id 175) took 62056 ms (client timeout 15000 ms). Trace:
I20260709 13:19:29.465420 18132 catalog_manager.cc:5697] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:29.468236 18132 catalog_manager.cc:5697] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 13 to 14, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 14 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:29.469858 18132 catalog_manager.cc:5697] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:29.470890 18135 rpcz_store.cc:269] 0709 13:18:27.407528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.407756 (+   228us) service_pool.cc:224] Handling call
0709 13:19:29.463993 (+62056237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4896,"reported_tablets":54}
I20260709 13:19:29.474879 18132 catalog_manager.cc:5697] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 11 to 13, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 13 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:29.476504 18132 catalog_manager.cc:5697] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 12 to 13, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 13 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:29.478339 18132 catalog_manager.cc:5697] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:29.504205 18132 catalog_manager.cc:5697] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 14 to 15, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 15 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:29.505908 18132 catalog_manager.cc:5697] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 12 to 14, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 14 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:29.507256 18132 catalog_manager.cc:5697] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:29.509177 18132 catalog_manager.cc:5697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:29.529975 18132 catalog_manager.cc:5697] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:29.548472 18132 catalog_manager.cc:5697] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:29.569193 18132 catalog_manager.cc:5697] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:29.600997 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:29.830941 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 118867us
W20260709 13:19:29.926810 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 59127.3us
W20260709 13:19:29.924598 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 53360.5us
W20260709 13:19:30.009850 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 75240.9us
W20260709 13:19:30.020649 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 82586.8us
W20260709 13:19:30.025473 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63381.3us
W20260709 13:19:30.095506 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 68659.5us
I20260709 13:19:30.147328 18133 catalog_manager.cc:5697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 13 to 15, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 15 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.163725 18132 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39270 (request call id 190) took 9912 ms. Trace:
I20260709 13:19:30.165038 18133 catalog_manager.cc:5697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 14 to 18, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 18 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.180318 18133 catalog_manager.cc:5697] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 11 to 14, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 14 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.186630 18133 catalog_manager.cc:5697] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 15 to 16, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 16 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.190348 18133 catalog_manager.cc:5697] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.192915 18133 catalog_manager.cc:5697] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:30.198727 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 113401us
I20260709 13:19:30.164203 18132 rpcz_store.cc:276] 0709 13:19:20.251659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.268465 (+ 16806us) service_pool.cc:224] Handling call
0709 13:19:20.593808 (+325343us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b5400200490. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14f0b2 00007fa1880c8a89 00007fa188060da6 00007fa188032088 00007fa18813037e 00007fa1865f12a4 00007fa1865f1232 00007fa1865f1161 00007fa1865f10dc
0709 13:19:30.163145 (+9569337us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:29.657678 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:29.731746 (+ 74068us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:29.731781 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:19:29.731799 (+    18us) tablet.cc:662] Decoding operations
0709 13:19:29.733076 (+  1277us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:29.733135 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:29.733162 (+    27us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:19:29.734190 (+  1028us) tablet.cc:701] Row locks acquired
0709 13:19:29.734204 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:19:29.734344 (+   140us) write_op.cc:270] Start()
0709 13:19:29.734462 (+   118us) write_op.cc:276] Timestamp: P: 1783603169734298 usec, L: 0
0709 13:19:29.734480 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:19:29.735070 (+   590us) log.cc:844] Serialized 5628 byte log entry
0709 13:19:29.737554 (+  2484us) op_driver.cc:464] REPLICATION: finished
0709 13:19:29.738125 (+   571us) write_op.cc:301] APPLY: starting
0709 13:19:29.738227 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:29.800493 (+ 62266us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:29.809930 (+  9437us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:29.947399 (+137469us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:29.947654 (+   255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 13:19:29.947698 (+    44us) write_op.cc:312] APPLY: finished
0709 13:19:29.948010 (+   312us) log.cc:844] Serialized 129 byte log entry
0709 13:19:29.953984 (+  5974us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:29.956856 (+  2872us) write_op.cc:454] Released schema lock
0709 13:19:29.956911 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:29.972681 (+ 15770us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:29.972747 (+    66us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":410527,"reported_tablets":54,"spinlock_wait_cycles":23140736,"child_traces":[["op",{"apply.queue_time_us":302,"apply.run_cpu_time_us":22563,"apply.run_wall_time_us":234491,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58408,"num_ops":14,"prepare.queue_time_us":151,"prepare.run_cpu_time_us":4793,"prepare.run_wall_time_us":85949,"replication_time_us":2920,"spinlock_wait_cycles":3456}]]}
I20260709 13:19:30.260723 18133 catalog_manager.cc:5697] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.263983 18382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49c6a2a19b90491f9336362305339eca"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:19:30.288218 18382 raft_consensus.cc:606] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:30.288659 18382 raft_consensus.cc:614] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:30.294545 18133 catalog_manager.cc:5697] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 15 to 16, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 16 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:30.307335 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 57256.2us
I20260709 13:19:30.305136 18133 catalog_manager.cc:5697] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:30.310089 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 249097us
I20260709 13:19:30.319887 18382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:19:30.320629 18382 raft_consensus.cc:606] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:30.321038 18382 raft_consensus.cc:614] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:30.335332 18235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:30.336107 18235 raft_consensus.cc:606] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:30.357434 18232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:30.358057 18232 raft_consensus.cc:606] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:30.361178 18232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:30.361666 18232 raft_consensus.cc:606] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:30.361971 18232 raft_consensus.cc:614] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:30.363250 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:30.365058 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:19:30.365357 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 105691us
I20260709 13:19:30.371611 24120 raft_consensus.cc:993] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3: : Instructing follower 459e82ee6b564cc19be6f73186938e79 to start an election
I20260709 13:19:30.372287 24120 raft_consensus.cc:1081] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Signalling peer 459e82ee6b564cc19be6f73186938e79 to start an election
I20260709 13:19:30.378088 18309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:43794
I20260709 13:19:30.378625 18309 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:30.378937 18309 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:30.311848 18133 catalog_manager.cc:5697] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 12 to 15, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 15 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.381683 18133 catalog_manager.cc:5697] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 11 to 14, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 14 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.389593 18309 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:30.393527 18309 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:30.393630 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:30.394198 18235 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:30.394500 18235 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:30.395182 18235 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:30.396018 18235 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:30.395838 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:30.396632 18382 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:30.402575 18235 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:30.404084 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:30.407918 24117 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:30.408591 24117 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:30.411516 24117 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:30.428159 18382 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:30.473587 18384 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:30.722476 18130 catalog_manager.cc:5697] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 12 to 14, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 14 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.726433 18130 catalog_manager.cc:5697] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.750124 18130 catalog_manager.cc:5697] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 16 to 17, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 17 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.751364 24102 raft_consensus.cc:993] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3: : Instructing follower 459e82ee6b564cc19be6f73186938e79 to start an election
I20260709 13:19:30.751904 24102 raft_consensus.cc:1081] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Signalling peer 459e82ee6b564cc19be6f73186938e79 to start an election
I20260709 13:19:30.756862 18305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:43794
I20260709 13:19:30.757470 18305 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:30.757861 18305 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:30.757965 18130 catalog_manager.cc:5697] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 13 to 18, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 18 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.759516 18130 catalog_manager.cc:5697] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 13 to 16, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 16 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.765632 18133 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39288 (request call id 182) took 7642 ms. Trace:
I20260709 13:19:30.766412 18130 catalog_manager.cc:5697] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.770727 18130 catalog_manager.cc:5697] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 14 to 15, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 15 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.767844 18133 rpcz_store.cc:276] 0709 13:19:23.105204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:23.105455 (+   251us) service_pool.cc:224] Handling call
0709 13:19:30.747861 (+7642406us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:30.515529 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:30.516160 (+   631us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:30.516200 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:19:30.516219 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:30.517223 (+  1004us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:30.517308 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:30.517337 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:19:30.518287 (+   950us) tablet.cc:701] Row locks acquired
0709 13:19:30.518307 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:19:30.518447 (+   140us) write_op.cc:270] Start()
0709 13:19:30.518558 (+   111us) write_op.cc:276] Timestamp: P: 1783603170518401 usec, L: 0
0709 13:19:30.518582 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:19:30.519280 (+   698us) log.cc:844] Serialized 4455 byte log entry
0709 13:19:30.556686 (+ 37406us) op_driver.cc:464] REPLICATION: finished
0709 13:19:30.578156 (+ 21470us) write_op.cc:301] APPLY: starting
0709 13:19:30.578257 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:30.611382 (+ 33125us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:30.611523 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:30.649009 (+ 37486us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:30.649307 (+   298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 13:19:30.649353 (+    46us) write_op.cc:312] APPLY: finished
0709 13:19:30.649708 (+   355us) log.cc:844] Serialized 105 byte log entry
0709 13:19:30.664547 (+ 14839us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:30.664723 (+   176us) write_op.cc:454] Released schema lock
0709 13:19:30.664789 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:30.665231 (+   442us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:30.665264 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3497,"reported_tablets":54,"spinlock_wait_cycles":6400,"child_traces":[["op",{"apply.queue_time_us":19980,"apply.run_cpu_time_us":16639,"apply.run_wall_time_us":87070,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50019,"num_ops":11,"prepare.queue_time_us":90255,"prepare.run_cpu_time_us":4060,"prepare.run_wall_time_us":4061,"replication_time_us":37940,"thread_start_us":99374,"threads_started":2}]]}
I20260709 13:19:30.773881 18130 catalog_manager.cc:5697] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 12 to 17, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 17 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.790585 18130 catalog_manager.cc:5697] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 11 to 14, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 14 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.791863 18130 catalog_manager.cc:5697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.793417 18130 catalog_manager.cc:5697] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 13 to 17, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 17 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.801903 18130 catalog_manager.cc:5697] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.772818 18305 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:30.805420 18130 catalog_manager.cc:5697] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 12 to 16, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 16 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.809544 18305 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:30.810330 18130 catalog_manager.cc:5697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.812006 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:30.811797 18130 catalog_manager.cc:5697] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 15 to 18, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 18 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:30.812805 18236 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:30.813264 18236 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:30.813228 18130 catalog_manager.cc:5697] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 15 to 16, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 16 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.814407 18236 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:30.814893 18130 catalog_manager.cc:5697] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 18 to 19, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 19 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.815922 18236 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:30.816407 18130 catalog_manager.cc:5697] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 16 to 18, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 18 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:30.836663 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:30.837381 18386 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:30.853487 18236 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:30.856851 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:30.881453 18232 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:30.893853 18386 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:30.862727 24115 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:30.883627 24113 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
W20260709 13:19:30.957157 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 48279.7us
I20260709 13:19:30.989835 24115 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:31.024798 18386 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:19:31.024565 24115 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:31.039225 24112 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:31.107307 18383 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:31.157162 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 123969us
I20260709 13:19:31.216481 18958 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:31.218525 24123 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:31.218904 18306 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:31.216986 18132 catalog_manager.cc:5697] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:31.225013 18132 catalog_manager.cc:5697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:31.226172 18132 catalog_manager.cc:5697] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 16 to 19, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 19 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.227249 18132 catalog_manager.cc:5697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 14 to 15, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 15 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:31.228659 18132 catalog_manager.cc:5697] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 18 to 19, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 19 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:31.230093 24068 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:31.241158 18132 catalog_manager.cc:5697] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:31.261808 18132 catalog_manager.cc:5697] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 17 to 20, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 20 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.263665 18132 catalog_manager.cc:5697] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 16 to 18, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 18 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:31.282625 24068 raft_consensus.cc:2955] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:31.284415 18311 raft_consensus.cc:2955] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:31.301855 18955 raft_consensus.cc:2955] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:31.308848 18130 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39284 (request call id 178) took 4215 ms. Trace:
I20260709 13:19:31.309357 18130 rpcz_store.cc:276] 0709 13:19:27.093581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.094602 (+  1021us) service_pool.cc:224] Handling call
0709 13:19:31.308770 (+4214168us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:30.900960 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:30.946151 (+ 45191us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:30.946240 (+    89us) write_op.cc:435] Acquired schema lock
0709 13:19:30.946263 (+    23us) tablet.cc:662] Decoding operations
0709 13:19:30.947920 (+  1657us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:30.947990 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:30.948027 (+    37us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:19:31.011421 (+ 63394us) tablet.cc:701] Row locks acquired
0709 13:19:31.011445 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:19:31.011603 (+   158us) write_op.cc:270] Start()
0709 13:19:31.011741 (+   138us) write_op.cc:276] Timestamp: P: 1783603171011561 usec, L: 0
0709 13:19:31.011766 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:19:31.012579 (+   813us) log.cc:844] Serialized 7192 byte log entry
0709 13:19:31.015810 (+  3231us) op_driver.cc:464] REPLICATION: finished
0709 13:19:31.016269 (+   459us) write_op.cc:301] APPLY: starting
0709 13:19:31.016346 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:31.058335 (+ 41989us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:31.058441 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:31.170368 (+111927us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:31.170675 (+   307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=0,mrs_lookups=0
0709 13:19:31.170725 (+    50us) write_op.cc:312] APPLY: finished
0709 13:19:31.171128 (+   403us) log.cc:844] Serialized 164 byte log entry
0709 13:19:31.174045 (+  2917us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:31.174253 (+   208us) write_op.cc:454] Released schema lock
0709 13:19:31.174325 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:31.190090 (+ 15765us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:31.190127 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26077,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":258,"apply.run_cpu_time_us":22954,"apply.run_wall_time_us":173786,"cfile_cache_hit":72,"cfile_cache_hit_bytes":75096,"num_ops":18,"prepare.queue_time_us":1197,"prepare.run_cpu_time_us":7157,"prepare.run_wall_time_us":123686,"replication_time_us":3917}]]}
I20260709 13:19:31.343045 18120 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2682a7690fb640b1a9ad52d5fa19e281 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:19:31.366631 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:31.427883 18130 catalog_manager.cc:5697] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 13 to 14, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New cstate: current_term: 18 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:31.455433 18383 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:31.457434 24146 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:31.466691 18225 tablet_service.cc:1558] Processing DeleteTablet for tablet 2682a7690fb640b1a9ad52d5fa19e281 with delete_type TABLET_DATA_TOMBSTONED (TS b52e2477fc524694967c4a16afa983e3 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:42512
I20260709 13:19:31.508124 18132 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39270 (request call id 191) took 1008 ms. Trace:
I20260709 13:19:31.508625 18132 rpcz_store.cc:276] 0709 13:19:30.500118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.500274 (+   156us) service_pool.cc:224] Handling call
0709 13:19:31.508016 (+1007742us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:31.324900 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:31.328976 (+  4076us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:31.329019 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:19:31.329040 (+    21us) tablet.cc:662] Decoding operations
0709 13:19:31.330029 (+   989us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:31.330087 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:31.330114 (+    27us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:19:31.330911 (+   797us) tablet.cc:701] Row locks acquired
0709 13:19:31.330932 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:19:31.331111 (+   179us) write_op.cc:270] Start()
0709 13:19:31.331259 (+   148us) write_op.cc:276] Timestamp: P: 1783603171331053 usec, L: 0
0709 13:19:31.331281 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:31.331959 (+   678us) log.cc:844] Serialized 3282 byte log entry
0709 13:19:31.334185 (+  2226us) op_driver.cc:464] REPLICATION: finished
0709 13:19:31.334648 (+   463us) write_op.cc:301] APPLY: starting
0709 13:19:31.334733 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:31.338927 (+  4194us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:31.339034 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:31.380879 (+ 41845us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:31.381069 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 13:19:31.381111 (+    42us) write_op.cc:312] APPLY: finished
0709 13:19:31.381362 (+   251us) log.cc:844] Serialized 81 byte log entry
0709 13:19:31.382181 (+   819us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:31.382306 (+   125us) write_op.cc:454] Released schema lock
0709 13:19:31.382358 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:31.382845 (+   487us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:31.382871 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30463,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":252,"apply.run_cpu_time_us":10920,"apply.run_wall_time_us":48172,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33376,"num_ops":8,"prepare.queue_time_us":829,"prepare.run_cpu_time_us":3958,"prepare.run_wall_time_us":7373,"replication_time_us":2776}]]}
I20260709 13:19:31.527362 18235 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:31.530776 24112 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:31.534935 18130 catalog_manager.cc:5697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 14 to 15, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 15 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.537729 18130 catalog_manager.cc:5697] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 18 to 19, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 19 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:31.549800 24160 tablet_replica.cc:333] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:19:31.551069 24160 raft_consensus.cc:2243] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.552148 24160 raft_consensus.cc:2272] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.596925 24160 ts_tablet_manager.cc:1916] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:31.646615 24160 ts_tablet_manager.cc:1929] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260709 13:19:31.647300 24160 log.cc:1199] T 2682a7690fb640b1a9ad52d5fa19e281 P b52e2477fc524694967c4a16afa983e3: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-0-root/wals/2682a7690fb640b1a9ad52d5fa19e281
I20260709 13:19:31.649994 18121 catalog_manager.cc:5028] TS b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): tablet 2682a7690fb640b1a9ad52d5fa19e281 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
W20260709 13:19:32.291102 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 44740.5us
W20260709 13:19:32.390776 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 96086us
W20260709 13:19:32.450233 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 126794us
W20260709 13:19:32.512671 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 105685us
I20260709 13:19:32.654098 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:32.721469 18382 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:32.738235 18311 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:19:32.738842 18349 consensus_peers.cc:597] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe9abdaa4bb845cd8d40c4f182cf98c9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:32.751672 18230 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:32.760703 24174 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:32.764278 24158 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:32.795312 24158 raft_consensus.cc:2955] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:32.801515 18230 raft_consensus.cc:2955] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:32.850169 18235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:32.851190 18235 raft_consensus.cc:606] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:32.854524 18235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:32.855084 18235 raft_consensus.cc:606] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:32.866654 18235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:32.867302 18235 raft_consensus.cc:606] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:32.870162 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:32.871929 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:32.885216 18311 raft_consensus.cc:2955] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:32.894841 18130 catalog_manager.cc:5697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index -1 to 10, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 17 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:32.907310 24105 raft_consensus.cc:993] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:19:32.908102 24105 raft_consensus.cc:1081] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:19:32.933314 18383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46844
I20260709 13:19:32.934016 18383 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:32.934376 18383 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.034492 18383 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:33.040812 18383 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:33.042832 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:33.043708 18235 raft_consensus.cc:3055] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:33.044034 18235 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:33.045244 18235 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:33.047142 18235 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.054422 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:33.059823 18305 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:33.062667 18235 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:33.064273 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:33.052488 18309 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:33.065622 24068 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:33.066146 24068 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:33.067093 24068 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:33.075263 18305 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:33.106856 24105 raft_consensus.cc:993] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: : Instructing follower 459e82ee6b564cc19be6f73186938e79 to start an election
I20260709 13:19:33.107672 24109 raft_consensus.cc:1081] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Signalling peer 459e82ee6b564cc19be6f73186938e79 to start an election
W20260709 13:19:33.113315 18275 consensus_peers.cc:597] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 39dd19f13a42412b9dda536e24c324b1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.123731 18305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:43794
I20260709 13:19:33.124423 18305 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:33.124826 18305 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:33.138938 18305 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:33.144292 18382 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:19:33.144886 18305 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:33.147877 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:33.148643 18235 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:33.148957 18235 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:33.148635 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:33.150009 18382 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:33.151309 18235 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:33.152587 18235 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:33.157594 24115 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:19:33.172233 18382 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:19:33.178938 18235 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:19:33.180698 18276 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:33.183920 18232 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:19:33.187112 24112 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:33.187711 24112 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:33.188645 24112 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:33.190809 24166 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:33.205202 24109 raft_consensus.cc:993] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3: : Instructing follower 459e82ee6b564cc19be6f73186938e79 to start an election
I20260709 13:19:33.216187 24165 raft_consensus.cc:1081] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Signalling peer 459e82ee6b564cc19be6f73186938e79 to start an election
I20260709 13:19:33.357969 18309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:43794
I20260709 13:19:33.359439 18309 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:33.359828 18309 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:33.365707 18309 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:33.367713 18309 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:33.372020 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:33.372771 18236 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:33.373090 18236 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:33.374007 18236 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:33.375442 18236 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:33.392007 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:33.392665 18383 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:33.400372 18130 catalog_manager.cc:5697] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 19 to 20, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 20 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:33.436878 18236 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:33.442306 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:33.443418 24204 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:33.444420 24204 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:33.448727 24204 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:33.513440 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 122493us
I20260709 13:19:33.518611 18382 raft_consensus.cc:2955] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:33.454936 24189 raft_consensus.cc:2955] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:33.605515 18383 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:33.607867 18130 catalog_manager.cc:5697] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 15 to 16, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 16 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:33.611356 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 92191.1us
W20260709 13:19:33.627509 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 269916us
W20260709 13:19:33.661336 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 149227us
I20260709 13:19:33.688589 18135 catalog_manager.cc:5697] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 13 to 14, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 14 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:33.728951 24205 ts_tablet_manager.cc:933] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:33.776813 18305 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:33.786592 18232 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:33.788286 18236 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:19:33.803824 18235 raft_consensus.cc:2955] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:33.814163 24202 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:19:33.817101 24215 ts_tablet_manager.cc:933] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:33.818540 18382 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:19:33.820458 24204 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:33.822672 24115 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:33.845328 24203 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:33.805747 24205 tablet_copy_client.cc:323] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.131:44265
I20260709 13:19:33.853046 18396 tablet_copy_service.cc:140] P 8b4fbc44aa2649f0bcac5cd70f71951d: Received BeginTabletCopySession request for tablet fe9abdaa4bb845cd8d40c4f182cf98c9 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:43098)
I20260709 13:19:33.853878 18396 tablet_copy_service.cc:161] P 8b4fbc44aa2649f0bcac5cd70f71951d: Beginning new tablet copy session on tablet fe9abdaa4bb845cd8d40c4f182cf98c9 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:43098: session id = e016302b7e734d74833a2bf7bab44838-fe9abdaa4bb845cd8d40c4f182cf98c9
I20260709 13:19:33.865432 18130 catalog_manager.cc:5697] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index -1 to 12, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 18 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:33.883787 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:33.968907 24215 tablet_copy_client.cc:323] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.130:34605
I20260709 13:19:34.051446 18396 tablet_copy_source_session.cc:215] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:34.062696 18231 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:19:34.071341 18322 tablet_copy_service.cc:140] P 459e82ee6b564cc19be6f73186938e79: Received BeginTabletCopySession request for tablet 39dd19f13a42412b9dda536e24c324b1 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46642)
I20260709 13:19:34.072019 18322 tablet_copy_service.cc:161] P 459e82ee6b564cc19be6f73186938e79: Beginning new tablet copy session on tablet 39dd19f13a42412b9dda536e24c324b1 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46642: session id = e016302b7e734d74833a2bf7bab44838-39dd19f13a42412b9dda536e24c324b1
I20260709 13:19:34.162483 24205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9abdaa4bb845cd8d40c4f182cf98c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.133626 24204 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:19:34.218444 18322 tablet_copy_source_session.cc:215] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:34.293782 24215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39dd19f13a42412b9dda536e24c324b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:34.338744 18232 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:34.378311 18377 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:19:34.384838 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 99128.8us
W20260709 13:19:34.399637 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 123480us
W20260709 13:19:34.499639 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 47330.2us
I20260709 13:19:34.491751 24217 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:19:34.525705 18382 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:19:34.527209 18200 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: efd953e96dc54f10a635581a413244e2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:34.543488 24197 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:34.520486 24205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53364 (request call id 511) took 1080 ms. Trace:
I20260709 13:19:34.597088 24205 rpcz_store.cc:276] 0709 13:19:33.444609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:33.444768 (+   159us) service_pool.cc:224] Handling call
0709 13:19:33.729483 (+284715us) ts_tablet_manager.cc:934] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
0709 13:19:34.145787 (+416304us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:19:34.292495 (+146708us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:34.292696 (+   201us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:19:34.519682 (+226986us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:19:34.520013 (+   331us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:34.520332 (+   319us) ts_tablet_manager.cc:989] Replica registered.
0709 13:19:34.520385 (+    53us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":46132,"tablet-copy.queue_time_us":207728,"thread_start_us":111123,"threads_started":2}
I20260709 13:19:34.599876 24205 tablet_copy_client.cc:806] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:34.600666 24205 tablet_copy_client.cc:670] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:34.528604 24215 tablet_copy_client.cc:806] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
W20260709 13:19:34.613763 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 110738us
W20260709 13:19:34.624747 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 63177.5us
I20260709 13:19:34.626914 24215 tablet_copy_client.cc:670] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:34.640542 24205 tablet_copy_client.cc:538] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:34.645790 18304 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:34.701746 24215 tablet_copy_client.cc:538] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:34.736951 24245 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:34.744236 24195 raft_consensus.cc:2955] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:34.793356 18382 raft_consensus.cc:2955] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:34.796582 24205 tablet_bootstrap.cc:492] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:19:34.801313 24215 tablet_bootstrap.cc:492] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:19:34.820247 18133 catalog_manager.cc:5697] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index -1 to 12, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 19 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:34.873762 18379 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:34.909180 18231 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:19:34.909641 18349 consensus_peers.cc:597] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c6cd802105b49c68d85e7abdce24871. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:34.910547 18309 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:34.913440 24199 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:34.915366 24199 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:34.930615 24242 raft_consensus.cc:2955] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:34.940003 18232 raft_consensus.cc:2955] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:34.950206 18309 raft_consensus.cc:2955] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:34.993853 18309 raft_consensus.cc:2955] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:35.112830 18130 catalog_manager.cc:5697] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index -1 to 10, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 14 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:35.246032 24205 tablet_bootstrap.cc:492] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:35.253496 24205 tablet_bootstrap.cc:492] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:19:35.254303 24205 ts_tablet_manager.cc:1403] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.458s	user 0.046s	sys 0.009s
I20260709 13:19:35.263722 24205 raft_consensus.cc:359] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:35.272693 24205 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:19:35.273548 24205 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:35.276396 24205 ts_tablet_manager.cc:1434] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.001s
I20260709 13:19:35.260293 24215 tablet_bootstrap.cc:492] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:35.277907 24215 tablet_bootstrap.cc:492] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:19:35.278726 24215 ts_tablet_manager.cc:1403] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.478s	user 0.052s	sys 0.048s
I20260709 13:19:35.283176 24215 raft_consensus.cc:359] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:35.283769 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:35.284101 24215 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:19:35.286311 24215 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:35.298854 24215 ts_tablet_manager.cc:1434] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:19:35.307489 18322 tablet_copy_service.cc:342] P 459e82ee6b564cc19be6f73186938e79: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-39dd19f13a42412b9dda536e24c324b1 received from {username='slave'} at 127.0.0.1:46642
I20260709 13:19:35.308055 18322 tablet_copy_service.cc:434] P 459e82ee6b564cc19be6f73186938e79: ending tablet copy session e016302b7e734d74833a2bf7bab44838-39dd19f13a42412b9dda536e24c324b1 on tablet 39dd19f13a42412b9dda536e24c324b1 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:19:35.345496 24255 ts_tablet_manager.cc:933] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:19:35.349241 24255 tablet_copy_client.cc:323] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.129:43781
I20260709 13:19:35.349711 24254 ts_tablet_manager.cc:933] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:35.351428 18246 tablet_copy_service.cc:140] P b52e2477fc524694967c4a16afa983e3: Received BeginTabletCopySession request for tablet efd953e96dc54f10a635581a413244e2 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46128)
I20260709 13:19:35.352089 18246 tablet_copy_service.cc:161] P b52e2477fc524694967c4a16afa983e3: Beginning new tablet copy session on tablet efd953e96dc54f10a635581a413244e2 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46128: session id = e016302b7e734d74833a2bf7bab44838-efd953e96dc54f10a635581a413244e2
I20260709 13:19:35.354975 18396 tablet_copy_service.cc:342] P 8b4fbc44aa2649f0bcac5cd70f71951d: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-fe9abdaa4bb845cd8d40c4f182cf98c9 received from {username='slave'} at 127.0.0.1:43098
I20260709 13:19:35.355464 18396 tablet_copy_service.cc:434] P 8b4fbc44aa2649f0bcac5cd70f71951d: ending tablet copy session e016302b7e734d74833a2bf7bab44838-fe9abdaa4bb845cd8d40c4f182cf98c9 on tablet fe9abdaa4bb845cd8d40c4f182cf98c9 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:19:35.366811 18246 tablet_copy_source_session.cc:215] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:35.378790 24254 tablet_copy_client.cc:323] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.131:44265
I20260709 13:19:35.390173 18396 tablet_copy_service.cc:140] P 8b4fbc44aa2649f0bcac5cd70f71951d: Received BeginTabletCopySession request for tablet 3c6cd802105b49c68d85e7abdce24871 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:43098)
I20260709 13:19:35.390832 18396 tablet_copy_service.cc:161] P 8b4fbc44aa2649f0bcac5cd70f71951d: Beginning new tablet copy session on tablet 3c6cd802105b49c68d85e7abdce24871 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:43098: session id = e016302b7e734d74833a2bf7bab44838-3c6cd802105b49c68d85e7abdce24871
I20260709 13:19:35.401419 24255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efd953e96dc54f10a635581a413244e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:35.401754 18958 raft_consensus.cc:1217] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 13:19:35.402922 18396 tablet_copy_source_session.cc:215] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:35.419919 24254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6cd802105b49c68d85e7abdce24871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:35.444249 24255 tablet_copy_client.cc:806] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:35.444864 24255 tablet_copy_client.cc:670] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:35.453266 18309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49c6a2a19b90491f9336362305339eca"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:19:35.454064 18309 raft_consensus.cc:606] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:35.455754 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:19:35.457665 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:35.479065 24255 tablet_copy_client.cc:538] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:35.496842 24255 tablet_bootstrap.cc:492] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
W20260709 13:19:35.596385 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 95352.2us
W20260709 13:19:35.690992 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 92591.4us
I20260709 13:19:35.808189 24254 tablet_copy_client.cc:806] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
W20260709 13:19:35.815644 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 101797us
W20260709 13:19:35.816241 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 152087us
W20260709 13:19:35.817327 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 157972us
I20260709 13:19:35.828567 24254 tablet_copy_client.cc:670] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:35.850438 18958 raft_consensus.cc:1217] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 13:19:35.864430 24217 raft_consensus.cc:993] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:19:35.865167 24217 raft_consensus.cc:1081] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:19:35.867614 18379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49c6a2a19b90491f9336362305339eca"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:19:35.868378 18379 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:35.868830 18379 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:35.872591 24254 tablet_copy_client.cc:538] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:35.892603 24268 raft_consensus.cc:1064] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
W20260709 13:19:35.896068 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 170848us
I20260709 13:19:35.897982 18379 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:35.919795 18379 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:35.928910 24268 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:35.932693 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 218371us
I20260709 13:19:35.951287 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:35.952081 18237 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:35.980278 18237 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:35.981346 18232 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:35.990599 24254 tablet_bootstrap.cc:492] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:19:36.000808 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:36.001932 24258 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:36.007922 24258 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:36.008982 24258 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:36.014792 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:36.030814 18304 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:36.031104 18304 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:36.032451 18304 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:36.037822 18304 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:36.052608 18958 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 17 LEARNER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:19:36.108887 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 48904.5us
I20260709 13:19:36.114244 24238 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
W20260709 13:19:36.108302 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 50971.6us
I20260709 13:19:36.116737 18304 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:36.126978 18237 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:36.131467 18133 catalog_manager.cc:5697] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 17 to 18, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 18 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:36.133450 24169 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:36.150066 18311 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:36.166700 24169 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:19:36.176254 24255 tablet_bootstrap.cc:492] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:36.177963 24255 tablet_bootstrap.cc:492] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:19:36.204396 24209 raft_consensus.cc:1064] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:19:36.199146 24255 ts_tablet_manager.cc:1403] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.711s	user 0.066s	sys 0.016s
I20260709 13:19:36.235064 24169 raft_consensus.cc:2955] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:36.237591 18958 raft_consensus.cc:2955] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:36.341499 24209 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:36.350672 24255 raft_consensus.cc:359] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:36.351624 24255 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:19:36.352762 24255 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:36.370249 24255 ts_tablet_manager.cc:1434] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.153s	user 0.008s	sys 0.007s
I20260709 13:19:36.380712 18311 raft_consensus.cc:2955] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:36.396085 18231 raft_consensus.cc:2955] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:36.411978 24254 tablet_bootstrap.cc:492] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:36.439414 18246 tablet_copy_service.cc:342] P b52e2477fc524694967c4a16afa983e3: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-efd953e96dc54f10a635581a413244e2 received from {username='slave'} at 127.0.0.1:46128
I20260709 13:19:36.439929 18246 tablet_copy_service.cc:434] P b52e2477fc524694967c4a16afa983e3: ending tablet copy session e016302b7e734d74833a2bf7bab44838-efd953e96dc54f10a635581a413244e2 on tablet efd953e96dc54f10a635581a413244e2 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:19:36.478449 24254 tablet_bootstrap.cc:492] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:19:36.494838 24254 ts_tablet_manager.cc:1403] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.520s	user 0.030s	sys 0.016s
I20260709 13:19:36.513731 18230 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:19:36.515501 24270 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:36.517254 18237 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:36.520438 24209 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:19:36.540194 18958 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 18 LEARNER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:36.539985 24254 raft_consensus.cc:359] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:36.540982 24254 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:19:36.541716 24254 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:36.546770 24262 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:36.557787 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:36.564154 18135 catalog_manager.cc:5697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 10 to 11, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:36.585668 18386 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:36.594295 24254 ts_tablet_manager.cc:1434] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.001s
I20260709 13:19:36.600174 18955 raft_consensus.cc:1217] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:19:36.600287 24293 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:36.645399 18396 tablet_copy_service.cc:342] P 8b4fbc44aa2649f0bcac5cd70f71951d: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-3c6cd802105b49c68d85e7abdce24871 received from {username='slave'} at 127.0.0.1:43098
I20260709 13:19:36.646091 18396 tablet_copy_service.cc:434] P 8b4fbc44aa2649f0bcac5cd70f71951d: ending tablet copy session e016302b7e734d74833a2bf7bab44838-3c6cd802105b49c68d85e7abdce24871 on tablet 3c6cd802105b49c68d85e7abdce24871 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:19:36.726042 18306 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:19:36.759187 18958 raft_consensus.cc:1217] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.11->[19.12-19.12]   Dedup: 19.12->[]
I20260709 13:19:36.774627 24169 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
W20260709 13:19:36.984498 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 132498us
W20260709 13:19:37.016328 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 136676us
W20260709 13:19:37.073079 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54833.4us
I20260709 13:19:37.149421 24293 raft_consensus.cc:2955] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:37.153272 18958 raft_consensus.cc:2955] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:19:37.243355 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 112477us
I20260709 13:19:37.254853 18386 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:37.280305 18382 raft_consensus.cc:2955] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:19:37.311646 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 188216us
I20260709 13:19:37.368296 18955 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:37.393100 24315 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:37.396770 24300 raft_consensus.cc:1064] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:19:37.407433 18235 raft_consensus.cc:2955] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:37.424316 24300 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:37.431046 18130 catalog_manager.cc:5697] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 12 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:37.444589 18233 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:37.481379 24290 raft_consensus.cc:1064] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:19:37.489315 24268 raft_consensus.cc:2955] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:37.491461 18961 raft_consensus.cc:2955] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:37.484205 24290 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:37.514912 18953 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 14 LEARNER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:37.517280 24242 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:19:37.520658 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 52220.2us
I20260709 13:19:37.538291 24258 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:37.549794 18120 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fe9abdaa4bb845cd8d40c4f182cf98c9 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:19:37.567641 18237 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:37.591415 18309 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:37.597210 24169 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:37.607359 24169 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:37.586498 18237 raft_consensus.cc:2955] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:37.720320 18961 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 LEARNER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:19:37.724730 24227 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:37.748225 18382 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:19:37.766068 18311 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:19:37.785228 24325 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:19:37.849069 18230 raft_consensus.cc:2955] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:37.814148 24227 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:19:37.868559 18303 raft_consensus.cc:2955] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:37.891121 24266 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:37.895825 24266 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:37.914520 24290 raft_consensus.cc:2955] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:37.915838 24266 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:37.917809 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:37.918871 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:37.920885 18386 raft_consensus.cc:2955] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:37.923563 18275 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:37.924485 24217 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:37.923846 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:37.942153 24270 raft_consensus.cc:2955] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:37.946648 18961 raft_consensus.cc:2955] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.034464 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:38.044584 24341 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:38.092964 18953 raft_consensus.cc:2955] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.167788 18133 catalog_manager.cc:5697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 11 to 12, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New cstate: current_term: 17 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.173327 18303 raft_consensus.cc:2955] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.174752 18133 catalog_manager.cc:5697] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 10 to 11, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.176294 18133 catalog_manager.cc:5697] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 12 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.232764 18382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:19:38.233525 18382 raft_consensus.cc:606] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:38.256721 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:19:38.259045 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:38.256701 18230 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:38.277586 18953 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:19:38.282845 24290 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:38.286036 18379 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:38.298234 24318 raft_consensus.cc:2955] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.302532 18953 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:38.305369 24169 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:38.307499 18312 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:19:38.311740 24290 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:38.315297 18230 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:38.318562 18303 raft_consensus.cc:2955] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.320540 18953 raft_consensus.cc:2955] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.330972 18121 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet efd953e96dc54f10a635581a413244e2 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:19:38.336675 18301 tablet_service.cc:1558] Processing DeleteTablet for tablet fe9abdaa4bb845cd8d40c4f182cf98c9 with delete_type TABLET_DATA_TOMBSTONED (TS 459e82ee6b564cc19be6f73186938e79 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:46940
I20260709 13:19:38.338898 18312 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:38.322105 24169 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:19:38.363595 18135 catalog_manager.cc:5697] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: config changed from index 13 to 14, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New cstate: current_term: 19 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.365417 24268 raft_consensus.cc:2955] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.379565 18235 raft_consensus.cc:2955] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.405514 24347 tablet_replica.cc:333] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:19:38.406451 24347 raft_consensus.cc:2243] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.407213 24347 raft_consensus.cc:2272] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.409529 24242 raft_consensus.cc:993] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d: : Instructing follower 459e82ee6b564cc19be6f73186938e79 to start an election
I20260709 13:19:38.410043 24242 raft_consensus.cc:1081] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Signalling peer 459e82ee6b564cc19be6f73186938e79 to start an election
I20260709 13:19:38.412930 18371 tablet_service.cc:1558] Processing DeleteTablet for tablet efd953e96dc54f10a635581a413244e2 with delete_type TABLET_DATA_TOMBSTONED (TS 8b4fbc44aa2649f0bcac5cd70f71951d not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:53078
I20260709 13:19:38.413537 18953 raft_consensus.cc:2955] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.423806 18305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:43788
I20260709 13:19:38.424353 18305 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:38.424695 18305 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:38.447197 18305 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:38.453912 18953 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:38.455920 24217 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:38.456432 24347 ts_tablet_manager.cc:1916] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:38.469344 18130 catalog_manager.cc:5697] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 11 to 12, VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) evicted. New cstate: current_term: 14 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.479197 18230 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:38.484733 24217 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:38.497608 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:38.498361 18305 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:38.498730 18235 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:38.505985 18120 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3c6cd802105b49c68d85e7abdce24871 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:19:38.495587 18301 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c6cd802105b49c68d85e7abdce24871 with delete_type TABLET_DATA_TOMBSTONED (TS 459e82ee6b564cc19be6f73186938e79 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:46940
I20260709 13:19:38.501541 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:38.517086 18377 raft_consensus.cc:3055] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:38.517388 18377 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:38.519824 18377 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:38.521241 18377 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:38.529259 18377 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:38.529783 18235 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:38.530951 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:38.535589 24266 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:38.536080 24266 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:38.536269 24349 tablet_replica.cc:333] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:19:38.541801 24266 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:38.565094 24348 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:19:38.587733 24349 raft_consensus.cc:2243] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.594316 18230 raft_consensus.cc:2955] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.595791 24349 raft_consensus.cc:2272] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.615401 24349 ts_tablet_manager.cc:1916] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:38.622179 18130 catalog_manager.cc:5697] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index 13 to 14, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New cstate: current_term: 18 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.639724 18371 tablet_service.cc:1558] Processing DeleteTablet for tablet 39dd19f13a42412b9dda536e24c324b1 with delete_type TABLET_DATA_TOMBSTONED (TS 8b4fbc44aa2649f0bcac5cd70f71951d not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:53078
I20260709 13:19:38.647440 24262 raft_consensus.cc:2955] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.653079 18130 catalog_manager.cc:5697] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 15 to 16, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 16 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:38.665140 24347 ts_tablet_manager.cc:1929] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 13:19:38.665793 24347 log.cc:1199] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 459e82ee6b564cc19be6f73186938e79: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-1-root/wals/fe9abdaa4bb845cd8d40c4f182cf98c9
I20260709 13:19:38.667798 18121 catalog_manager.cc:5028] TS 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): tablet fe9abdaa4bb845cd8d40c4f182cf98c9 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:19:38.676131 18121 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 39dd19f13a42412b9dda536e24c324b1 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:19:38.678367 18953 raft_consensus.cc:2955] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:38.685154 24347 tablet_replica.cc:333] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:19:38.686455 24347 raft_consensus.cc:2243] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.687615 24347 raft_consensus.cc:2272] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.721805 24347 ts_tablet_manager.cc:1916] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:38.729439 24349 ts_tablet_manager.cc:1929] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260709 13:19:38.729936 24349 log.cc:1199] T efd953e96dc54f10a635581a413244e2 P 8b4fbc44aa2649f0bcac5cd70f71951d: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-2-root/wals/efd953e96dc54f10a635581a413244e2
I20260709 13:19:38.731769 18120 catalog_manager.cc:5028] TS 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): tablet efd953e96dc54f10a635581a413244e2 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:19:38.733140 24349 tablet_replica.cc:333] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:19:38.734710 24349 raft_consensus.cc:2243] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.736243 24349 raft_consensus.cc:2272] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.739261 24349 ts_tablet_manager.cc:1916] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:38.757041 24349 ts_tablet_manager.cc:1929] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260709 13:19:38.757525 24349 log.cc:1199] T 39dd19f13a42412b9dda536e24c324b1 P 8b4fbc44aa2649f0bcac5cd70f71951d: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-2-root/wals/39dd19f13a42412b9dda536e24c324b1
I20260709 13:19:38.759017 18120 catalog_manager.cc:5028] TS 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): tablet 39dd19f13a42412b9dda536e24c324b1 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:19:38.795737 24347 ts_tablet_manager.cc:1929] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:19:38.796377 24347 log.cc:1199] T 3c6cd802105b49c68d85e7abdce24871 P 459e82ee6b564cc19be6f73186938e79: Deleting WAL directory at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0/minicluster-data/ts-1-root/wals/3c6cd802105b49c68d85e7abdce24871
I20260709 13:19:38.798170 18121 catalog_manager.cc:5028] TS 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): tablet 3c6cd802105b49c68d85e7abdce24871 (table test-workload [id=c260e37555894198a5aaf373491ba341]) successfully deleted
I20260709 13:19:38.994822 18382 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:38.996407 24266 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:39.060295 18230 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:39.071159 24266 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:39.143791 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 51305.3us
W20260709 13:19:39.192694 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 74546.1us
I20260709 13:19:39.260499 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:40.381713 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:40.950446 18258 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2a40 after lost signal to thread 17141
W20260709 13:19:40.952410 18258 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7d40 after lost signal to thread 18169
W20260709 13:19:41.091715 18202 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.312s	user 0.004s	sys 0.004s
W20260709 13:19:41.092350 18202 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.312s	user 0.005s	sys 0.005s
W20260709 13:19:41.093590 18201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.005s	sys 0.005s
W20260709 13:19:41.094033 18201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.374s	user 0.005s	sys 0.005s
W20260709 13:19:41.111202 17143 debug-util.cc:398] Leaking SignalData structure 0x7b0800366060 after lost signal to thread 18203
W20260709 13:19:41.111881 17143 kernel_stack_watchdog.cc:198] Thread 18203 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 391ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260709 13:19:41.142297 18203 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.423s	user 0.001s	sys 0.009s
W20260709 13:19:41.142781 18203 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.424s	user 0.001s	sys 0.009s
I20260709 13:19:41.290026 24321 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.290722 24321 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.294206 24321 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.294857 24321 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:41.297675 24321 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.335614 24318 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.336484 24318 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.339200 24318 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.339893 24318 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.340447 24318 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.342338 24321 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.348441 24321 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.350687 24318 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.351548 24321 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.369220 24318 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.373782 24318 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.383929 24318 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.422358 24361 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.423131 24361 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.430012 24262 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:41.432319 24280 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.451603 24297 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.475898 24321 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.476505 24321 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.476177 24297 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.476996 24321 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.478785 24297 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:41.474092 24318 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:41.474886 24280 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.481215 24318 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.483727 24318 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.483817 24280 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:41.501590 18258 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa800 after lost signal to thread 18261
I20260709 13:19:41.503705 24361 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.474362 24262 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.507750 24262 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.487757 24280 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:41.519390 24217 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:41.535446 24280 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.535848 24217 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.538265 24217 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.538771 24280 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.478790 24321 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.549117 24321 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:41.549680 24321 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.558452 24321 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.558933 24370 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.559605 24370 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.561807 24370 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.565714 18235 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:41.568285 24373 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.559006 24321 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:41.617661 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.618358 24381 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.577136 24321 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.625020 24381 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.626327 24321 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.552065 24262 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:41.627923 24370 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.631297 24370 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.633710 24370 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.634331 24381 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.579632 24373 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.635567 24384 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:41.638895 24365 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.654781 24378 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:41.655769 24391 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.656342 24391 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.657565 24388 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:41.658090 24388 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.658571 24391 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.659126 24391 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:41.658344 24367 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:41.655462 24378 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.641029 24262 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.646844 24280 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:41.659137 24318 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.661722 24365 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.683554 24382 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:41.678527 24361 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:41.691587 24318 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.713241 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:41.659593 24391 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.652853 24384 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.725330 24366 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.726079 24366 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.727835 24290 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.728374 24290 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.699034 24382 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.729241 24371 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:41.730015 24318 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.729820 24371 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.730594 24318 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.730705 24290 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.731204 24318 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.731525 24290 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.706321 24388 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.691267 24280 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.700050 24361 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.675416 24367 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.744138 24378 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.732204 24371 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.740913 24358 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.732038 24290 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.765568 24376 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:41.797416 24358 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.798056 24376 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.798972 24290 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.728348 24366 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.778393 24195 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.742920 24384 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.797436 24353 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:41.829398 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:41.830443 18305 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 18.
I20260709 13:19:41.835420 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:41.836570 24353 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.838994 24353 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:41.747483 24393 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:41.800879 24195 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.840342 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:41.842790 18236 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:19:41.800287 24358 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.741708 24389 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.746863 24373 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.746050 24372 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.850420 24387 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.850790 24372 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.851620 24195 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.851225 24387 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.842376 24378 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.741537 24321 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.779229 24386 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.844656 24395 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:41.860898 24395 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.845196 24396 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.743346 24377 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.741178 24374 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.741880 24379 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.741923 24368 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.853754 18230 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 18.
I20260709 13:19:41.853245 24372 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.742328 24392 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.742120 24385 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.746531 24365 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.899726 24382 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.906531 24266 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:41.907145 24266 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.909413 24266 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.741328 24380 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.827582 24391 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.800288 24376 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.853165 24378 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.858721 24321 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.922041 24378 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.922133 24321 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.844672 24318 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.848917 24290 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.859898 24280 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.853595 24366 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:41.923512 24290 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.923741 24366 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.848285 24397 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:41.924783 24397 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.925637 24290 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.926869 24397 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.926923 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:41.928761 24366 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.928880 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:41.929270 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:41.929416 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:41.929543 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:41.930141 18306 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:41.931013 24262 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.931167 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:41.928913 24395 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.934233 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:41.934860 18310 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:41.803699 24388 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:41.741523 24390 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:41.946195 24390 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.869814 24353 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:41.868362 24377 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.874953 24368 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.875082 24392 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.871629 24374 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.870221 24396 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.877259 24398 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.877707 24217 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.868737 24361 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:41.877259 24387 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.857833 24389 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.869207 24386 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:41.880890 24400 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:41.882078 18927 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:41.883441 24384 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:41.876333 24385 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:41.897086 24379 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:42.059454 18258 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8360 after lost signal to thread 18336
I20260709 13:19:42.064113 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:42.064544 18258 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5d20 after lost signal to thread 18410
I20260709 13:19:42.062268 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.062973 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:42.064203 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 182217us
I20260709 13:19:41.950279 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.025399 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.075011 18311 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:42.058715 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.069868 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.073511 18309 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:42.077386 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:42.080322 18258 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd0e0 after lost signal to thread 18986
W20260709 13:19:42.081023 18258 debug-util.cc:398] Leaking SignalData structure 0x7b0800235360 after lost signal to thread 24332
W20260709 13:19:42.081351 18258 debug-util.cc:398] Leaking SignalData structure 0x7b080036a620 after lost signal to thread 24348
W20260709 13:19:42.082479 18258 debug-util.cc:398] Leaking SignalData structure 0x7b0800098a00 after lost signal to thread 24360
I20260709 13:19:41.972889 24397 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.084959 24397 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.086381 24389 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.086938 24397 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.957458 24380 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.086452 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:41.974480 24367 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:41.948426 24390 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:41.968992 24262 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:42.089013 24380 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.089162 24262 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.089711 24374 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:42.089165 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.066179 24400 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.090766 18309 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:42.091434 24262 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.091652 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.068293 24361 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:42.092396 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.092792 24361 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.093209 24361 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:42.093567 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.094274 18305 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:19:42.095048 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.095736 24392 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.066151 24217 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.070001 24353 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.098098 24217 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.066017 24384 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.098428 24353 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.099476 24377 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.099982 18309 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:42.098312 24400 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.100210 18307 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:19:42.100000 24384 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.066356 24398 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.101246 24386 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.103063 24398 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:42.104296 18310 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:42.093636 24396 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:42.115444 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 63734us
I20260709 13:19:42.117302 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:42.119120 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.121814 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.122143 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.122728 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.122808 18235 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:42.123400 18309 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:19:41.948112 24388 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.121181 18927 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:42.130381 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.128000 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.129118 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:42.121963 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 187811us
I20260709 13:19:42.133671 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.131175 18927 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:42.135212 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.137844 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.139328 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.139001 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.140059 18306 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:42.141016 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.142897 24320 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:42.143364 24320 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.143748 24320 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:42.143890 24379 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:42.141613 18306 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:42.138769 24297 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:42.149333 24297 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:42.149541 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.149756 24297 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:42.150858 24368 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.130450 24268 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:42.155354 24268 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.155712 24378 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:42.156322 24378 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.157516 24268 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:42.158041 24388 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:42.159317 24378 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:42.161736 24374 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:42.165088 24374 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.165411 24407 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:42.163343 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.165508 24374 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:42.202553 18303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:19:42.183795 18307 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:42.202334 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.203409 18303 raft_consensus.cc:606] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:42.168998 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.180904 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.208695 24377 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:42.209144 24377 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:42.209545 24377 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:42.167236 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.167857 24385 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.213516 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.214203 18230 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:19:42.214814 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.215969 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.214263 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.217137 18386 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:42.217944 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:19:42.219585 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:42.220641 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.221236 18382 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:42.226548 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.228369 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.229012 18382 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:42.177982 24270 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:42.230049 24270 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.230361 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.231189 24367 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:42.232271 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.231271 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.232883 18232 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:42.213287 24407 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.234964 24390 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:42.235427 24390 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.235760 24390 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.237090 24407 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:42.190356 24320 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.234081 24268 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:42.238529 24268 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.233982 24367 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.240933 24367 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:42.241705 24268 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:42.242861 24297 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.243711 24320 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.244015 18202 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.245268 24368 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:42.245662 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.245702 24368 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.246775 24368 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:42.247689 24297 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:42.245658 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.236908 24361 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:42.248970 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 112226us
I20260709 13:19:42.248301 24270 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:42.252772 18927 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:42.252190 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 120098us
I20260709 13:19:42.254845 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.255861 24375 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:42.256289 24375 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.256714 24375 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:42.259235 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.260105 24380 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:42.260708 24380 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.261085 24380 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:42.261165 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.261895 18232 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:42.262763 24368 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.263075 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.253031 24379 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:42.264776 24379 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.265161 24379 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:42.265302 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.266855 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.267406 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.268177 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.266861 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.283064 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.268116 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.389776 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.339668 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.387550 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.390563 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.399114 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.379166 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.404649 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.405977 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.391609 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:42.404960 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 122038us
I20260709 13:19:42.289956 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.406801 18235 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:19:42.391309 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.408480 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.335934 24268 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:42.415239 18237 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:19:42.415719 24268 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.411302 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.412036 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:42.417428 18231 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:19:42.382124 24270 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:42.333923 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.332139 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.419430 18386 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 7.
I20260709 13:19:42.403663 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.421981 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.434903 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.442569 18381 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:42.442801 18377 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:19:42.435874 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.441124 18958 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:42.436566 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:42.328881 24402 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:42.439177 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.405318 24361 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.333120 24368 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.386071 24385 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:42.381875 24407 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:42.382478 24411 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:42.382822 24409 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:42.334892 24364 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:42.330452 24408 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:42.385286 24406 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.444908 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.448480 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.330827 24412 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:42.434461 24270 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.383812 24375 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.447090 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.451529 24268 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:42.451659 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.452214 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.420557 24392 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:42.387705 24380 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.458412 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.459100 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.460439 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.401993 24390 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.468921 24268 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:42.469065 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.469343 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.383324 24377 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.461724 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.464949 18955 raft_consensus.cc:2393] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:19:42.464836 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.465382 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.468219 18961 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:42.468308 18383 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:42.466778 18384 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:19:42.469677 24268 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.468955 24410 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:42.557858 24417 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:42.461530 24385 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.558135 24390 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.573540 24410 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.573904 24417 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.550766 24374 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.575755 24385 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.576004 24410 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:42.576416 24417 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:42.576776 24374 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.467558 24409 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.461076 24407 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.531698 24412 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.579039 24409 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:42.561478 24270 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:42.553804 24416 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:42.579579 24412 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:42.579435 24407 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:42.580152 24416 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.581830 24416 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:42.539230 24380 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.557003 24367 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.466562 24411 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.584031 24367 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.539781 24375 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.584997 24411 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:42.585304 24379 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.467550 24392 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.586225 24392 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:42.587060 24379 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.463752 24408 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.496934 24406 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.589982 24406 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.590070 24408 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:42.591442 24377 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:42.631935 18230 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:42.417539 18228 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:42.634940 18232 raft_consensus.cc:2393] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 18: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:42.636927 18236 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 15: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:42.407689 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.637616 18234 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 16: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:19:42.675964 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 268233us
I20260709 13:19:42.412801 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:42.678045 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.678954 18386 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:42.679730 18383 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:19:42.645284 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 223447us
I20260709 13:19:42.679756 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.681236 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:42.683034 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.683243 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.458561 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:42.650565 18377 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:19:42.681284 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.685246 18309 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:42.686064 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.686467 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.686868 18381 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:42.687476 18377 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:19:42.684407 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:42.459578 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.680112 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:42.689181 18379 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:42.660984 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.662961 18382 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:42.667348 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.693090 18385 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:42.701126 18228 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
I20260709 13:19:42.703312 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.705132 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.706697 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.708280 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.681849 18384 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:42.464797 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.740924 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.742264 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.743343 18954 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:42.744627 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.708784 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.711279 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.747889 18955 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
I20260709 13:19:42.714622 18958 raft_consensus.cc:2393] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:19:42.715001 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.717713 18927 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:42.750519 18927 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:42.751385 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.718492 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.470781 18960 raft_consensus.cc:2393] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:19:42.719588 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.752485 18927 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:19:42.721371 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 46669.2us
I20260709 13:19:42.721935 18234 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:42.722009 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.727710 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.581739 24268 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:42.758296 18957 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
I20260709 13:19:42.773367 24392 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.467409 24364 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.776682 24392 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.777521 18309 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 19.
W20260709 13:19:42.766873 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63022.5us
I20260709 13:19:42.756000 24217 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:42.779923 24217 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.780586 24217 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:42.784966 18378 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:19:42.760161 24262 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:19:42.793071 24361 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:42.793764 24361 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.794236 24361 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:42.797072 24385 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:42.797719 24385 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 15 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:42.799248 24385 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.805595 24374 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:42.806137 24374 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:42.806537 24374 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.780752 24364 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:42.839354 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 88251.7us
I20260709 13:19:42.820673 24358 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.813484 24262 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:42.844411 24358 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.844802 24262 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:42.845016 24358 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.829805 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.838872 24392 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:42.852723 24392 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.847695 24280 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.859931 24392 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:42.855497 18234 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:42.856415 18230 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:42.856555 18229 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:42.866861 18235 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:42.857142 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.857388 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.858208 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.858685 24262 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.871119 18228 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:42.873034 24408 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:42.873214 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.873855 24408 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.875138 24262 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:42.860001 24280 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:42.875856 24280 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.853842 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.877583 24408 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:42.878450 24367 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:42.880023 24367 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:42.880614 24367 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.884112 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.879254 18201 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:42.886250 18201 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:42.901808 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.902344 24390 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:42.886454 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.902840 24390 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:42.903375 24390 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:42.874838 24217 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.900804 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.887442 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.887969 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.887400 18961 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:42.890329 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.891023 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.909163 18132 catalog_manager.cc:5697] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 14 to 15, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 15 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.887217 24375 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:42.912438 24358 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.897339 18235 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:42.898485 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.899256 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.899818 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.931556 18230 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:42.900046 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.932214 24418 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:42.846686 24361 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.933677 18953 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:42.900784 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.901218 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:42.886665 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:42.912796 24375 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:42.935739 24375 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:42.893339 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.855536 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.913729 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.914820 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:42.939159 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 83826.1us
I20260709 13:19:42.915903 18231 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:42.940096 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.916903 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:42.812529 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 54425.3us
I20260709 13:19:42.918602 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:42.941391 24380 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:42.942556 24380 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.924674 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:42.927738 24412 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:42.943540 24419 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:42.943953 24412 raft_consensus.cc:3055] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:42.928118 24416 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:42.944437 18927 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:42.916643 24390 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.933602 24268 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:42.946020 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:42.951930 24268 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:42.952981 24405 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:42.953541 24405 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:42.953217 24268 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.942608 24404 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:42.954502 24404 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.955026 24404 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:42.955241 24268 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:42.938995 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 45892.3us
I20260709 13:19:42.928040 24364 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:42.957769 24364 raft_consensus.cc:3055] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:42.958158 24364 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:42.959388 24364 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.944010 24419 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:42.945235 24416 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:42.945730 24420 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:42.943137 24380 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:42.945674 24412 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:42.947806 24361 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.918869 24217 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.946970 18927 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:42.953994 24405 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:42.927109 24408 consensus_queue.cc:1059] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:19:42.971666 24408 raft_consensus.cc:3055] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:42.972069 24408 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:42.973172 24408 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:42.974074 24358 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:42.974514 24408 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:42.961711 24419 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:42.963552 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:42.913709 24374 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.961967 24416 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:42.965531 18957 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:43.024859 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.966019 24412 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.026156 24412 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:43.026582 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.027709 24374 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:42.967449 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:42.977828 18275 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:19:43.029546 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 52016.7us
I20260709 13:19:43.030565 24262 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:43.031332 18275 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:42.982298 24358 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:43.032469 24262 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:43.032904 24358 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 19 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:43.034075 24358 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:42.991766 24379 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:42.986399 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:42.993124 18200 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:42.985643 24280 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:43.036058 24405 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:43.037387 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 76401us
I20260709 13:19:42.964324 24367 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:43.038347 24280 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:43.007848 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:43.039211 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 109487us
I20260709 13:19:43.008296 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:43.009507 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:43.040408 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:43.040747 24367 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:43.009796 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:43.041725 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.976462 24380 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.042624 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.042910 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.043938 24380 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:43.010605 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:43.011138 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:43.041597 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.011796 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:43.011986 24390 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:43.052983 24390 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:43.053434 24390 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:43.053638 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.053970 24390 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:43.055001 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.055657 18304 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:43.021173 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.022954 24375 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.024633 24416 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.056766 24404 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.057857 24416 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:43.028164 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:43.044335 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.010229 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:43.059011 24404 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:43.053524 18201 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.059626 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:42.963449 24364 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:43.060333 24367 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:43.060850 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.061843 18201 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:43.062103 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:43.063303 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.063969 18312 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:43.039222 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 53006.9us
I20260709 13:19:43.064898 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.065871 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.067284 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.038326 18200 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:43.043841 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:43.038100 24379 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:43.068817 24418 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:43.047695 18275 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.069643 24418 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:43.069941 18303 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:43.039459 24268 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:43.071571 24367 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:43.072059 24367 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:43.072458 24367 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:43.074167 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:43.074532 18275 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:43.044003 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.050163 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:43.011341 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:43.049317 24392 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.041527 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.070978 24280 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:43.077872 24280 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:43.078214 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.078286 24280 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:43.057785 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:43.082844 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 44659.6us
I20260709 13:19:43.085155 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:43.087162 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:43.087877 24419 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.099560 18201 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:43.100703 24379 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:43.101106 24379 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:43.101994 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.103127 24374 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:43.103585 24374 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:43.103979 24374 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:43.104286 18201 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:43.070950 24405 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:43.105101 24379 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:43.124866 18237 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:43.106770 24217 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:43.126670 18312 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:43.107815 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:43.128756 18200 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23d48585586a4bb3bc800da7f54e12f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:43.129334 18309 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:43.129907 24392 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:43.130467 24419 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:43.131469 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.132486 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.136406 18303 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:43.104336 24390 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:43.145967 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.145557 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.149089 24380 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:43.149590 24380 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:43.149981 24380 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:43.151472 24390 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:43.152570 24412 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:43.140974 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.158649 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.159281 18386 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:19:43.159924 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.163570 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.165295 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.134790 24217 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:43.170939 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 66784us
I20260709 13:19:43.171149 18304 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:43.171962 18307 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:43.172078 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:43.172135 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:43.172837 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:43.180233 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:43.172039 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.183652 18926 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:43.184775 24361 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:43.185467 24375 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:43.186470 18926 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.187342 24420 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:43.188813 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.174182 24367 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.175495 18200 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:19:43.194062 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 49529.9us
I20260709 13:19:43.194525 24377 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:43.194890 18200 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.194842 24367 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:43.197081 18200 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.198355 24367 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:43.198606 18200 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.198877 24390 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:43.202294 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.200752 24392 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:43.201778 24377 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:43.199589 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 91895.7us
I20260709 13:19:43.204399 24377 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.192444 24217 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:43.210757 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:43.201018 18386 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:43.213550 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:43.213665 24374 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:43.214196 24377 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:43.285527 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.301025 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:43.232686 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.292167 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:43.274886 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.304809 18232 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:43.227278 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.228082 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.258387 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:43.259439 18229 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:43.244880 24412 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:43.233174 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.285598 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.217031 18201 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:43.238940 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.279626 18377 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:43.270478 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:43.219640 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.232999 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.232481 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:43.313457 18232 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:43.216238 24374 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:43.219067 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.265252 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.321909 18234 raft_consensus.cc:2393] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 16: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:43.233103 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:43.324499 18378 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:43.216367 24377 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:43.322491 18380 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:43.326499 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:43.329958 18308 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:43.331718 18231 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 20: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:43.332774 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:19:43.334348 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 56546.3us
I20260709 13:19:43.331717 24364 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:43.336937 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:43.245074 24416 consensus_queue.cc:1059] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.086s
W20260709 13:19:43.344341 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 79130.8us
I20260709 13:19:43.267963 24280 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:43.350502 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:43.354475 18229 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:43.351938 24385 consensus_queue.cc:1059] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:19:43.361217 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:43.367503 18378 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:43.368853 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:43.369760 18957 raft_consensus.cc:2393] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:19:43.369473 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:43.372200 18953 raft_consensus.cc:2393] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 10: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:19:43.373888 18309 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:43.375849 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:43.375974 18959 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 15 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:43.379534 24361 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:43.380960 24404 raft_consensus.cc:993] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:19:43.348599 24412 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.372207 24358 raft_consensus.cc:3055] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:19:43.386451 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 169582us
I20260709 13:19:43.372161 24374 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:43.360965 24380 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.386809 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.385820 24404 raft_consensus.cc:1081] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:19:43.389894 24408 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:19:43.393177 24420 consensus_queue.cc:1059] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:43.393985 24408 raft_consensus.cc:3055] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:43.394371 24408 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:43.394821 24320 raft_consensus.cc:3055] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:43.395264 24320 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:43.395309 24408 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.391726 18229 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:43.388672 24358 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:43.396490 24320 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:43.400225 24358 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:43.401427 24320 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.401685 24358 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:43.405449 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.407135 24404 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:43.407192 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.408648 24427 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:43.411046 24412 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:43.408711 24262 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:43.414152 24408 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:43.417956 24411 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:43.420186 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.421129 24268 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:43.422370 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.424605 24280 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:43.424924 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:43.385887 24379 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.427155 18233 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:43.428360 24379 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:43.428586 18276 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.430563 24262 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:43.431695 24367 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:43.431977 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.436790 24262 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:43.438215 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 45486.6us
I20260709 13:19:43.439402 18201 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:43.440389 24377 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:43.440912 24377 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:43.441349 24377 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:43.442780 18237 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:43.443222 24268 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:43.443917 24380 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:43.444165 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.452983 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.454727 24268 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:43.456055 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.453745 24412 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:43.457593 24412 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:43.457983 24412 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:43.460727 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.476385 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:19:43.488682 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 75293us
W20260709 13:19:43.491611 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52324.7us
I20260709 13:19:43.436067 24217 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:43.495383 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.491626 24262 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:19:43.497078 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 65210.2us
I20260709 13:19:43.506474 24427 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:43.506736 24431 consensus_queue.cc:1059] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:43.493240 24268 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:43.499890 24405 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:43.510327 18307 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:43.497155 24404 consensus_queue.cc:1059] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:19:43.512997 24404 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:43.513404 24404 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:43.514283 24404 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.515610 24404 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:43.515719 18276 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.494402 24280 consensus_queue.cc:1059] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:19:43.517465 18276 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.518606 18386 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:19:43.505447 18201 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:43.526199 24412 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.527856 24412 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:43.534193 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:43.529801 24262 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:43.543198 24262 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:43.545917 24379 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:43.546169 24364 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:43.546558 24379 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:43.546721 24364 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:43.547627 24379 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.547770 24364 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:43.550230 24364 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:43.550738 18132 catalog_manager.cc:5697] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 18 to 19, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 19 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:43.552142 24374 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:43.542150 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:43.553407 24380 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:43.537496 24416 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
W20260709 13:19:43.568689 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 51353.3us
I20260709 13:19:43.573195 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:43.575995 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.578614 18237 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:43.580350 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.581254 24427 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:43.580251 24367 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:43.582305 24367 raft_consensus.cc:697] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:43.583349 24367 consensus_queue.cc:237] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:43.586279 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 80916us
I20260709 13:19:43.595294 18229 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:43.566700 24374 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:43.603516 18237 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:43.614614 18349 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.615167 24268 raft_consensus.cc:3055] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:43.615463 24217 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:43.615764 24268 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:19:43.615988 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 121081us
I20260709 13:19:43.616945 24268 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.617425 18349 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.618328 24268 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:43.619565 18276 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.621843 24416 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:43.623263 24416 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:43.625485 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:43.628276 24408 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:43.629022 24408 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:43.615231 24390 raft_consensus.cc:2955] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:43.629527 24268 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:43.631024 24268 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:43.632102 24268 raft_consensus.cc:3055] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:43.632440 24268 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:43.634380 24268 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:43.636838 24416 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:43.637344 24416 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:43.637615 24268 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.641013 24419 raft_consensus.cc:3055] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:43.638345 24416 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.641466 24419 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:43.642431 24416 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:43.642518 24419 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.641467 18312 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:19:43.652959 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 154719us
I20260709 13:19:43.561582 24377 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.664919 24431 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:43.665349 24419 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:43.665541 24431 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:43.585074 24411 consensus_queue.cc:1059] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
W20260709 13:19:43.674886 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 65996.7us
I20260709 13:19:43.630340 24408 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.676981 24400 consensus_queue.cc:1059] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:43.677938 24411 raft_consensus.cc:3055] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:43.678056 24436 raft_consensus.cc:3055] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:19:43.676299 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.607429 24418 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:19:43.678436 24411 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:43.679952 18234 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:43.681970 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.667292 24217 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:43.685515 24411 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:43.689579 18276 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.690815 24432 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:43.691084 18276 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.692091 24431 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:43.693861 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:43.689726 24411 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:43.696979 24418 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:43.678598 24436 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:43.697537 24418 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:43.698660 24404 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:43.698284 24436 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.699739 24436 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:43.699010 24418 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.677030 24408 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:43.725524 24358 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:43.730139 18381 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:19:43.731472 24418 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:43.732816 24358 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:43.692301 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:19:43.740815 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 58923.5us
I20260709 13:19:43.742300 24377 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:43.743417 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 51181.6us
I20260709 13:19:43.744298 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.744721 24262 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:43.745055 24432 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:43.745564 24435 consensus_queue.cc:1059] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:43.746241 24432 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:43.744426 24405 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:43.746657 24432 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:19:43.764060 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 146763us
I20260709 13:19:43.746692 24435 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:43.765403 18349 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.769198 18309 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:43.772778 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.777887 18305 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:43.775636 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:43.772065 18311 raft_consensus.cc:2955] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:43.747948 24432 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.818125 18312 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:43.809798 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:43.815327 18305 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
W20260709 13:19:43.813748 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 78491us
I20260709 13:19:43.765050 24262 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:43.851375 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.768822 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:19:43.852813 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.859511 18201 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:43.851300 24431 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:43.864872 24412 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:43.865119 24431 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.865511 24412 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.867473 24431 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:43.867722 24412 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:43.868054 24431 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:43.868213 24379 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:43.866062 18201 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:43.875115 24379 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:19:43.875593 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 114953us
W20260709 13:19:43.878286 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 113015us
I20260709 13:19:43.768200 24435 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:43.822329 24268 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:43.867054 18133 catalog_manager.cc:5697] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 13 to 14, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 14 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.821939 24416 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:43.802843 24404 consensus_queue.cc:1059] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 13:19:43.875619 24379 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:43.884601 18349 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:19:43.899775 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.822434 24364 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:43.906466 18201 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:43.907233 24412 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:43.907869 24412 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.909951 24412 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:43.881035 24408 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:43.911372 24408 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.912667 24440 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:43.913244 24440 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:43.913337 24408 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:43.913666 24440 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:43.887228 24392 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:19:43.914841 24392 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:43.915210 24392 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:43.916081 24392 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:43.821772 24434 consensus_queue.cc:1059] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:19:43.918744 24408 raft_consensus.cc:3055] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:43.919224 24408 raft_consensus.cc:740] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:43.919708 24427 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:43.920131 24427 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:43.920480 24427 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:43.920733 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.925209 24408 consensus_queue.cc:260] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:43.926991 24408 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:43.929265 24392 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:43.930608 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.929509 18201 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:43.936604 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:43.937834 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:43.937526 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:43.945569 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:43.946800 24434 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:43.906250 24432 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:43.949935 18276 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.954423 24439 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:43.962779 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.886638 24431 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.904542 24268 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.965550 24367 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:43.991175 24268 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:43.969398 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 90449.9us
I20260709 13:19:43.991628 24431 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:43.992580 18349 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:43.969461 24280 raft_consensus.cc:3055] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:43.993391 24280 raft_consensus.cc:740] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:43.994354 24280 consensus_queue.cc:260] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.995805 24280 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:43.970395 18276 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:43.970217 24374 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.967651 24436 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:43.943259 24364 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.984791 24435 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:43.964104 24390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:54578 (request call id 1) took 2381 ms. Trace:
I20260709 13:19:44.006898 24435 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:44.007087 24439 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:43.988896 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 59541.6us
I20260709 13:19:44.009374 18201 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:44.007310 24440 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.011274 18201 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:43.997896 24217 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:43.998333 18276 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.009620 24439 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:44.017975 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:44.018923 18349 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:44.019287 24419 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:44.020345 24419 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:44.020900 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 58193.9us
I20260709 13:19:44.024750 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.025104 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.025466 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:44.026065 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.026161 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.027242 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:44.028582 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:44.030705 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.031859 24268 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:44.032629 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.032773 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:44.034435 24440 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:44.033701 18349 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:44.041066 24377 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:44.041826 24408 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:44.042445 24380 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:44.049779 24418 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:44.049991 24380 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:44.050426 24380 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:44.051822 24364 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:44.052966 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:44.039108 24374 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:44.054124 24217 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:44.006547 24390 rpcz_store.cc:276] 0709 13:19:41.563754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.563937 (+   183us) service_pool.cc:224] Handling call
0709 13:19:41.572434 (+  8497us) log.cc:844] Serialized 513 byte log entry
0709 13:19:41.931155 (+358721us) spinlock_profiling.cc:243] Waited 9.87 ms on lock 0x7b2c000014c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7ba0a 00007fa180b7b693 00007fa180b7b631 00007fa1822afb52 00007fa1822afcf5 00007fa1821ec691 00007fa1821cceaa 00007fa1821d3d53 00007fa1821d3cd9 00007fa1821d3c69
0709 13:19:41.947226 (+ 16071us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b18002c38e0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822afd01 00007fa1821ec691 00007fa1821cceaa 00007fa1821d3d53 00007fa1821d3cd9 00007fa1821d3c69 00007fa1821d3c31 00007fa1821d2dfd 000000000038f354 000000000038f199
0709 13:19:41.962625 (+ 15399us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b18002c38e0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822afd01 00007fa1821ec691 00007fa1821cceaa 00007fa1821d3d53 00007fa1821d3cd9 00007fa1821d3c69 00007fa1821d3c31 00007fa1821d2dfd 000000000038f354 000000000038f199
0709 13:19:43.940847 (+1978222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60710,"raft.queue_time_us":272367,"raft.run_cpu_time_us":10507,"raft.run_wall_time_us":407211,"spinlock_wait_cycles":504937344,"thread_start_us":60329,"threads_started":1,"wal-append.queue_time_us":74396,"wal-append.run_cpu_time_us":14852,"wal-append.run_wall_time_us":1227726}
I20260709 13:19:44.043406 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:44.047112 24408 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:44.047235 24431 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:44.047358 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:44.047694 24447 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:44.063820 24364 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:44.064193 24374 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:44.064052 24431 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.064465 24364 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.066286 24431 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:44.066443 24364 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:44.047868 24268 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:44.067065 24408 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.067408 18349 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:44.049207 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.069609 24408 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:44.070128 24408 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:44.070819 24408 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:44.072122 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.075579 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:44.072470 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:44.076817 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:44.077160 24431 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:44.072707 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:44.073333 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.078001 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.073590 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.073858 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.067097 24268 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.078934 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:44.074254 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.080219 24268 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:44.064770 24374 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:44.080802 24374 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:44.082150 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:44.061954 18276 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.040217 24439 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:44.090291 24268 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:44.090802 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.092651 24435 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:44.093205 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52786.3us
I20260709 13:19:44.095506 24439 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:44.097107 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.100230 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.100862 24435 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:44.101614 24435 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:44.102087 24435 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:44.095296 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52084us
I20260709 13:19:44.105105 18201 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:44.105728 24217 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:44.106583 18201 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:44.107378 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.108579 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.110826 24268 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:44.111353 24439 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:44.111925 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.113564 24379 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.115091 24217 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:44.115888 24379 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:44.116931 18276 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.115103 18304 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:19:44.119673 24440 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:44.061555 24380 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.124138 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:44.120185 24440 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:44.125213 24436 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:44.120285 24375 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:44.123528 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:44.124363 18276 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.127662 24375 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:44.135413 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:44.131181 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:44.126958 24440 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:44.141113 24436 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:19:44.143534 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.145336 24390 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:44.145929 24390 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:44.146974 24390 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.135596 24375 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:44.149102 24374 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.150316 18229 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:44.152047 24374 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:44.143599 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:44.153254 24280 consensus_queue.cc:1059] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:44.153798 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:44.154142 18201 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:44.154814 24436 raft_consensus.cc:3055] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:44.155310 18201 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:44.155828 24426 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:44.120095 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.137316 18237 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:44.156287 24426 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:44.157452 24426 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:44.159097 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.160732 24367 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:44.161041 24392 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:44.160758 24439 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:44.161480 24280 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:44.155261 24436 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:44.123296 24217 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.116819 24427 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.162619 24280 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:44.168684 18201 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:44.163407 24439 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:44.168869 24280 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:44.163667 24436 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.170181 24436 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:44.170325 24427 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:44.171288 24380 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:44.168383 24217 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:44.174670 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.137850 18276 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.175854 24439 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:44.170185 24280 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.178558 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.180096 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:44.183271 24419 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:44.183785 24419 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:44.184638 24419 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.185626 24375 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.187701 24375 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:44.189764 24440 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.190719 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:44.193619 24440 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:44.191655 24217 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:44.182948 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 45156.6us
W20260709 13:19:44.198654 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.196560 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:44.199469 24374 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:44.199798 18957 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:44.200058 24374 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:44.200304 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.201057 18237 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:44.201380 18379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:19:44.201134 24374 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.202121 18379 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:44.202507 18379 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:44.202140 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:44.203833 24217 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:44.204200 24217 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.204540 24217 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:44.207760 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:19:44.209189 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.213714 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.217480 24280 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:44.238054 18237 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:44.240852 24433 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:44.241046 18229 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:44.241417 18237 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:44.241968 24404 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:44.242344 24404 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:44.245930 18380 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:19:44.213193 18379 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.248958 18386 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 20. Current term is 21. Ops: []
W20260709 13:19:44.247814 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 69305.2us
I20260709 13:19:44.251289 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:44.256819 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 88201.7us
I20260709 13:19:44.266810 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:44.267586 18237 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 21: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:44.252866 24439 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:44.273193 18303 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:44.272909 24404 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.274103 24404 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:44.276986 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.277866 18386 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:44.281906 24268 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:44.261111 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.284912 18379 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:44.285830 18235 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:44.288291 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.289042 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.290299 18234 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:44.294608 18229 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:44.295451 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:44.168176 24435 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.299481 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.301976 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.302934 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.305096 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.309516 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:44.313169 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.315330 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.322168 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.330035 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.332233 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.334188 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.351373 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.359341 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.362159 18378 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:44.377343 18386 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:19:44.382903 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:19:44.381834 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 99624.3us
I20260709 13:19:44.384567 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.388068 24433 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:44.389724 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:44.399497 24432 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:44.399899 24432 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:44.400146 24420 consensus_queue.cc:1059] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:44.400864 24432 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.401584 24361 raft_consensus.cc:3055] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:44.401966 24361 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:44.402652 24262 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:44.403291 24262 raft_consensus.cc:697] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:44.402984 24361 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:44.427796 18229 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:44.428548 18385 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:19:44.430310 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.433385 18379 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:44.436825 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:19:44.437884 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 125110us
I20260709 13:19:44.438792 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:19:44.440032 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 159801us
I20260709 13:19:44.444262 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.444202 18201 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:19:44.446316 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.450407 18229 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:44.451442 24379 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:44.454288 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:44.460683 24367 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:44.460969 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:44.461196 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:44.462301 24377 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:44.464017 18383 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:19:44.383822 24419 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:19:44.463506 18201 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:44.444696 24427 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:19:44.468832 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 77760.6us
I20260709 13:19:44.471074 18201 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:44.404315 24262 consensus_queue.cc:237] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:44.469774 24377 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:44.455824 24392 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:19:44.507929 18382 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
W20260709 13:19:44.513782 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.482539 24374 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:44.529559 24268 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:44.530308 24268 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:44.533839 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 66147.2us
I20260709 13:19:44.522418 24320 consensus_queue.cc:1059] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:19:44.539078 24456 consensus_queue.cc:1059] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:19:44.540807 24320 raft_consensus.cc:3055] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:44.540902 24456 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:44.541718 24456 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:44.487061 24426 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:44.544025 18927 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:44.545003 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 74010.2us
I20260709 13:19:44.546062 18201 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:44.546994 24374 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:44.551101 18201 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:44.554867 18201 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:44.556332 18201 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:44.541499 24320 raft_consensus.cc:740] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:44.559818 18201 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:19:44.553064 18183 auto_rebalancer.cc:629] Failed to schedule move for tablet e0d4b879cb5a45d0ab3dc5401e957620: Illegal state: Replica 459e82ee6b564cc19be6f73186938e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:44.576824 24268 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:44.561174 24427 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:44.577696 24375 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:44.578830 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.579056 24419 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:44.562183 18237 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:44.582055 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:44.605336 18303 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:44.587432 24217 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:44.604342 24358 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:44.558182 24374 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:44.608681 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:44.601974 24426 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:44.584136 24367 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:19:44.562919 24435 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:44.556478 24390 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:44.612275 24268 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:44.612739 24268 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:44.613204 24268 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:44.616606 24419 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:44.603863 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 59926.3us
W20260709 13:19:44.602196 24453 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.133s	user 0.001s	sys 0.001s
I20260709 13:19:44.618201 18385 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:44.579969 24320 consensus_queue.cc:260] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:44.619289 24419 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:44.619685 24320 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:44.602536 24456 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.621870 24456 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:44.623117 24432 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:44.623646 24358 consensus_queue.cc:1059] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:44.625291 24460 raft_consensus.cc:3055] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:44.625809 24217 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:44.625806 24460 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:44.627424 24460 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:44.629400 18927 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.631032 18135 catalog_manager.cc:5697] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: config changed from index -1 to 11, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 14 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
W20260709 13:19:44.637627 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.595391 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:44.634447 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:44.653215 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:44.653888 18961 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:44.654044 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 58774.9us
I20260709 13:19:44.655246 18201 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:44.642333 18135 catalog_manager.cc:5697] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 19 to 20, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 20 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.658213 24268 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.688477 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:44.641661 24420 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.696902 18385 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 18: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:44.661684 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:44.700685 18303 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:44.656678 24419 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:44.641556 24464 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:44.661072 24390 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:44.712007 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 50431.3us
I20260709 13:19:44.720438 18201 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:44.663203 24367 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:44.662791 24439 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:44.716785 18961 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:19:44.717641 24268 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:44.724285 18275 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:44.728368 24268 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:44.728943 24268 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.716847 24374 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:44.750932 24268 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:44.755460 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:44.759022 18381 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:44.715765 24420 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:44.737841 24367 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:44.733990 24419 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:44.765904 24419 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.772902 24420 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:44.779217 24367 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:44.752949 24262 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:44.731005 24439 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:44.783921 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 63596.8us
I20260709 13:19:44.785110 24467 ts_tablet_manager.cc:933] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:19:44.785003 24367 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.792184 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:44.793020 18308 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:19:44.793776 24361 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:44.793933 24390 raft_consensus.cc:697] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:44.795040 24390 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:44.797500 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:44.798089 24460 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:44.798283 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 76410.2us
I20260709 13:19:44.764194 24435 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:19:44.784607 24262 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:44.810976 24439 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:44.811884 24262 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:44.823987 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:44.828395 24466 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:44.832788 24466 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.831784 24439 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:44.834496 24454 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:44.835853 24466 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:44.853982 18310 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:44.855417 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:44.863160 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:44.863955 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:44.864382 18235 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:44.863368 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.862685 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.866443 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.866879 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.867354 18231 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 14: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:44.867609 18236 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:44.868278 18232 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:44.868636 18234 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 16: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:44.869369 18233 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:44.868831 18229 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 14: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:44.844163 24472 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:19:44.871132 18201 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:44.873641 18201 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:44.873780 24379 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:44.874892 18201 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:44.881317 18303 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:44.881413 24375 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:44.846340 24454 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:44.869432 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:44.897265 18310 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:44.843050 24439 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.882625 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:44.875470 24379 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:44.860242 24467 tablet_copy_client.cc:323] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.129:43781
I20260709 13:19:44.899828 18201 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:44.880357 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.899735 18385 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:19:44.897413 18230 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:44.902549 24454 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:44.904568 24262 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:44.860023 24470 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:44.908502 24439 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:44.908702 24433 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:19:44.917563 18305 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:19:44.909076 24470 raft_consensus.cc:697] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:44.920218 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:44.919999 24470 consensus_queue.cc:237] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.920907 18311 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:44.912904 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:44.925753 18312 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:44.913686 24435 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:19:44.929514 24454 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:44.932446 24262 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:44.934051 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.934852 18229 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 16: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:44.940300 24465 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:44.940980 24465 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:44.941849 24432 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:44.942318 24465 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.943073 24380 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:44.944605 24380 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:44.946410 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.947644 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:44.948820 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:44.950932 18230 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:19:44.954463 18304 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:44.969614 18133 catalog_manager.cc:5697] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 14 to 15, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 15 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.972532 18133 catalog_manager.cc:5697] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 19 to 20, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 20 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.975122 18133 catalog_manager.cc:5697] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 16 to 17, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 17 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.980744 24473 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:44.981539 24473 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:44.981947 24439 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:44.982630 24439 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:44.982707 24473 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:44.983652 24439 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:44.993988 24268 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:44.986485 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:44.989750 18386 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:44.993026 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 45444.2us
I20260709 13:19:44.995373 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:19:44.986253 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 92793.4us
I20260709 13:19:44.994552 24268 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:44.996241 24268 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:45.010191 18386 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:44.943065 24432 raft_consensus.cc:3055] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:45.028636 24492 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:45.029304 24492 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:45.031878 24492 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.029399 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:45.041417 18229 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:45.056485 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:44.940940 24454 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:19:45.026098 24432 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:45.062772 24470 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.109551 24268 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.058733 24358 consensus_queue.cc:1059] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:19:45.072820 24262 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:19:45.128659 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:45.129843 18230 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:45.133002 18246 tablet_copy_service.cc:140] P b52e2477fc524694967c4a16afa983e3: Received BeginTabletCopySession request for tablet 23d48585586a4bb3bc800da7f54e12f0 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46128)
I20260709 13:19:45.133908 18246 tablet_copy_service.cc:161] P b52e2477fc524694967c4a16afa983e3: Beginning new tablet copy session on tablet 23d48585586a4bb3bc800da7f54e12f0 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46128: session id = e016302b7e734d74833a2bf7bab44838-23d48585586a4bb3bc800da7f54e12f0
I20260709 13:19:45.141086 18961 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:45.143548 24268 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.144616 24461 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 13:19:45.146226 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:45.146559 24297 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.147121 24297 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:45.149559 24297 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
W20260709 13:19:45.137020 24481 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.229s	user 0.002s	sys 0.000s
I20260709 13:19:45.154006 24268 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.154822 24268 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:45.156731 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 53357us
I20260709 13:19:45.164999 18961 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:45.118404 24470 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.177351 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:45.178110 18304 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:19:45.178483 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:45.150868 24497 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:45.182097 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:45.190567 24427 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:45.191956 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.192714 24268 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.192853 18230 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:19:45.195122 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:45.185220 24440 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:45.210361 18380 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:45.214319 24268 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:45.229348 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:45.213666 24464 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:45.231747 24464 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.231617 24472 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:45.232231 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.177436 24262 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:19:45.232275 24464 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.235517 24493 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:45.235918 24493 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.236245 24493 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:45.232928 18229 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:19:45.242161 18386 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:45.184633 24466 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:45.244421 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:45.245090 24454 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:45.245689 24466 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.184806 24497 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:45.246141 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.246528 24497 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:45.246819 18229 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:45.248064 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:45.248860 24491 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:45.249334 24491 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.249709 24491 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:45.214887 24268 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.243012 24470 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.223109 18380 raft_consensus.cc:2955] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:45.259761 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:45.260578 18310 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:45.279424 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:45.269088 24476 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.301039 24427 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.303144 24476 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:45.305371 24476 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:45.310009 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.311070 18233 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 14: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:45.303620 24427 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:45.320006 24427 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:45.326447 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:45.326718 18229 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:45.327183 18957 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:45.329272 18200 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:45.331112 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:45.331804 18379 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:19:45.333240 18303 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:45.334357 18310 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
I20260709 13:19:45.345232 24268 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.283340 24297 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:45.350641 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:45.348474 18926 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:45.316906 24470 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.352192 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:45.352782 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:45.324463 24361 raft_consensus.cc:3055] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:45.353060 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:45.349825 18246 tablet_copy_source_session.cc:215] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:45.357923 24470 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.358573 24472 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:45.400753 24472 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.401281 24472 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:45.358933 24217 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:45.404938 24217 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.407325 24217 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:45.408000 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.408643 18233 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:45.413048 24419 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:19:45.359928 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 75737us
I20260709 13:19:45.361743 18303 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:45.363399 24507 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:45.364952 24512 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:45.463141 24512 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:45.464030 24512 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.339134 24433 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:45.366328 24464 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:45.370909 24493 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.360481 24297 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:45.473024 18384 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:45.349007 24492 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.360731 24262 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:19:45.383554 24497 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.388998 18310 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:45.394454 24470 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.394565 24432 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.361409 24361 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:45.399258 24491 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.359117 24390 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.413878 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:19:45.499827 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 86013.8us
I20260709 13:19:45.501050 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:45.418519 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.419489 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:45.502704 18305 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:45.442056 18312 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:45.449384 18379 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:45.504235 24268 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:45.504735 24268 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.505093 24268 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:45.452329 18380 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:19:45.452960 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:45.461401 18304 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:19:45.462641 24467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d48585586a4bb3bc800da7f54e12f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.470321 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:45.436465 24419 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:45.473436 24435 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.490806 24427 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.482921 24507 raft_consensus.cc:697] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:45.491822 24456 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.512925 24512 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:45.521525 24512 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:45.513437 24439 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:45.537283 24361 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:45.539060 24361 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:45.530900 24512 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.541811 24497 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.544440 24492 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.548177 24464 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:19:45.549846 24268 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.511109 24390 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:45.498895 24433 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.551978 24268 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.550284 18957 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:19:45.549793 24491 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.563939 24482 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:45.564136 24297 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.565871 24482 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:45.566349 24482 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.569494 24419 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.571240 24419 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:45.527642 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:45.573982 18130 catalog_manager.cc:5697] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 8 to 9, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 9 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:45.522624 24435 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:45.586371 24435 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:45.587054 18961 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:45.588418 24493 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.531234 24427 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.575724 18130 catalog_manager.cc:5697] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:45.591568 24427 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:45.592657 18233 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:45.591061 18130 catalog_manager.cc:5697] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 15 to 16, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 16 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:45.597880 24217 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.598417 24217 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.561062 24439 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:45.600059 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 80843.2us
I20260709 13:19:45.601187 18276 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:45.603803 24439 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.605167 24262 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:45.552814 24432 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:45.612965 24507 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:45.612977 24516 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:45.614331 24498 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:19:45.615563 24472 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:45.617858 24514 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:19:45.524217 24456 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:45.619690 24515 log.cc:927] Time spent T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:19:45.620893 24433 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:45.621085 24454 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:45.619719 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.622088 24390 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:45.622471 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:45.624011 24217 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:45.624873 24519 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:19:45.628381 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:45.629531 24493 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:45.630283 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:45.633543 18135 catalog_manager.cc:5697] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 13 to 14, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 14 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:45.717396 18135 catalog_manager.cc:5697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 20 to 21, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 21 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:45.637902 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.660789 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.664214 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:19:45.663635 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 152641us
I20260709 13:19:45.721309 18233 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:45.671557 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:45.703465 18229 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
W20260709 13:19:45.706449 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 173397us
I20260709 13:19:45.722414 18380 raft_consensus.cc:2368] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20.
I20260709 13:19:45.708441 18961 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:45.713021 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:45.724606 18304 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:45.724720 18312 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:45.728734 24500 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:19:45.730469 24456 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:45.733623 24472 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:45.743057 18276 leader_election.cc:400] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20.
I20260709 13:19:45.743392 18276 leader_election.cc:403] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:45.743405 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 242465us
I20260709 13:19:45.745113 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:45.745749 18953 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:45.747090 18304 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:19:45.748579 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:45.749485 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:45.750063 18380 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:45.750763 18233 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 16: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:45.751341 24268 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:45.747954 18275 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:45.751888 24268 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.753170 18231 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:45.753969 24268 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.752462 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:45.754824 18232 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 14: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:45.755592 18276 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:45.747102 24470 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:19:45.756596 24491 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:45.757025 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:45.757622 18228 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:45.743362 24493 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:45.759519 24493 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:45.760658 24454 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:19:45.762198 24491 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.763739 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:45.764339 18236 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:45.750278 24516 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.766474 24516 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.770095 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:45.770630 18961 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:19:45.773689 18236 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:19:45.723975 24439 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:45.775301 18349 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:45.778748 18228 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:45.776697 24465 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:45.781611 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:45.780614 24268 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:45.794095 24268 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:45.801288 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:45.801510 24268 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:45.774627 24456 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:45.803706 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.808809 18233 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 20.
I20260709 13:19:45.810083 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:45.814158 18231 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:19:45.814970 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 86210.1us
I20260709 13:19:45.784271 24427 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:19:45.780277 24493 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:45.786293 24491 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.779798 24470 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:45.774852 24516 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:45.834342 18953 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:45.811192 24456 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.835523 18927 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:45.837417 18304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:19:45.862854 18304 raft_consensus.cc:606] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:45.863376 18304 raft_consensus.cc:614] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:45.846832 24390 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:45.877650 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:45.847582 24375 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:45.851509 24470 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.885416 24527 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:45.886021 24527 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.886380 24527 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:45.887223 24470 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.852897 24268 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:45.793016 24439 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.857954 18231 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:19:45.889992 24268 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:45.890113 24439 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:45.883378 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:45.863819 24456 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:45.900581 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:45.899559 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.899955 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.898167 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:45.903002 18236 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 16: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:45.903091 18229 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:45.924939 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.925823 18234 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 15: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:45.926330 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.927085 18228 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:45.916630 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:45.928222 18233 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 8: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:45.925758 18231 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:45.929476 24523 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.930032 24523 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.931442 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:45.915755 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.933015 24268 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:45.934314 18232 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 16: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:45.934722 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:45.935463 18383 raft_consensus.cc:2393] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:45.936794 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.900906 24466 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:45.939762 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.940618 18228 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:45.940433 18953 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:19:45.823824 24520 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.248s
I20260709 13:19:45.937414 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:45.942042 18349 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:45.835843 24493 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.932448 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:45.937582 18231 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:19:45.945231 24268 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:45.945832 24268 raft_consensus.cc:697] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:45.946780 24268 consensus_queue.cc:237] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.942538 18233 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:45.932256 24523 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:45.938150 18200 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:45.914958 24262 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.933157 24461 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:45.967759 18380 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:45.940261 24466 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:45.941291 24375 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:45.944321 24470 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:45.956485 24439 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:45.990067 24433 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:46.000221 24433 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:45.993580 18304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:19:46.001384 18304 raft_consensus.cc:606] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:46.001720 18304 raft_consensus.cc:614] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:46.002584 24433 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:45.972419 24461 raft_consensus.cc:697] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 14 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:46.004776 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:46.005589 18961 raft_consensus.cc:2368] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 16. Current term is 17.
I20260709 13:19:46.005247 24461 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:45.973687 24512 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.966771 24262 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:45.984661 24474 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:46.009141 24474 raft_consensus.cc:697] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:46.010128 24474 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:46.014973 24512 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:46.024688 24470 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:46.025611 18961 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:46.025978 24470 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.033205 18235 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:46.031797 18275 leader_election.cc:400] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 16. Current term is 17.
I20260709 13:19:46.047030 18275 leader_election.cc:403] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:46.047101 18229 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:19:46.050223 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:46.050884 18380 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:46.051906 18276 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:46.052568 18229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:46.053016 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:46.053392 18229 raft_consensus.cc:606] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:46.053056 24217 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:46.054270 24217 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.054538 24217 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:46.056036 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:46.056867 18230 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 14: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:19:46.056946 24530 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:19:46.058631 24454 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20.
I20260709 13:19:46.058876 24493 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:46.062397 24501 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:19:46.064908 24492 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:46.065598 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:46.065783 24492 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:46.068176 24492 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:46.068342 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:45.975435 24466 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:46.081853 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:46.010218 24262 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:46.116788 18380 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:46.115159 24217 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.036070 24482 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:45.970068 24491 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.140s
I20260709 13:19:46.136183 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:46.142469 18308 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:46.046301 24439 raft_consensus.cc:697] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:46.051630 24433 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.049891 24497 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:46.144793 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63080.7us
I20260709 13:19:46.096844 24523 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:46.155265 24523 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.155687 24523 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:46.145630 24525 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:46.055233 24456 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:46.152395 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:46.091818 24472 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.158730 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:46.052100 24375 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:46.165813 18957 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:46.183101 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:46.183828 18383 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:19:46.190251 24426 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.190411 24456 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:46.190847 24426 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.196856 24374 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.197431 24374 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.199885 24374 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:46.204870 18304 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 21: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:46.166425 18953 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:46.175935 18230 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 20: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:46.179708 24217 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:46.217546 24525 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:46.218843 24525 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.219307 24439 consensus_queue.cc:237] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:46.205500 24472 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:46.226195 24482 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:46.152422 24262 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.230516 24262 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:46.235095 24419 consensus_meta.cc:287] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.004s
I20260709 13:19:46.237279 24527 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.239854 24527 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:46.161830 24497 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:46.242185 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:46.245816 18384 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.247035 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:46.112484 24493 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:19:46.247531 18132 catalog_manager.cc:5697] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:46.166028 24512 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.291149 18235 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 14: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:46.313179 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:46.316368 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:46.321069 24217 consensus_queue.cc:1059] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:46.322532 24217 raft_consensus.cc:3055] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:46.322938 24217 raft_consensus.cc:740] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:46.326308 18383 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:19:46.323889 24217 consensus_queue.cc:260] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:46.328665 24217 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:46.264078 24535 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:19:46.330641 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:46.347213 18926 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:46.361269 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:19:46.346210 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 45345.8us
I20260709 13:19:46.364246 24540 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:46.367403 24375 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:46.328830 24512 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.369721 24433 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 16. Current term is 17.
I20260709 13:19:46.341493 24374 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:19:46.370676 24512 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:46.372282 18304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:19:46.373104 18304 raft_consensus.cc:606] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:46.373502 18304 raft_consensus.cc:614] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:46.382251 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:46.383903 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:46.418069 18308 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:46.420920 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:46.421496 18308 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.385632 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:46.387035 18311 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:46.394901 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:46.424857 18304 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:19:46.425949 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:46.427193 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:46.384750 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:46.430949 18312 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:46.415093 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 43710.5us
I20260709 13:19:46.382773 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:46.411689 18307 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:46.440863 18384 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:46.442625 18309 raft_consensus.cc:2368] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11.
I20260709 13:19:46.361384 24497 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:46.450204 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:46.451624 18309 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:46.452505 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:46.389640 24524 raft_consensus.cc:993] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:19:46.462980 18349 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:46.469486 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:46.473958 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:46.403651 24374 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.483821 24217 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:46.464221 18276 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:46.393527 24472 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:46.486757 18312 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:19:46.488775 24217 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:46.494772 18311 raft_consensus.cc:2410] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:19:46.491453 24217 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:46.496505 18230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:46.497632 24217 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.443018 24527 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.487847 18276 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:46.505317 18304 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:19:46.507723 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:46.497805 18230 raft_consensus.cc:606] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:46.380448 24466 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:46.491390 18303 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:46.503221 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:46.517584 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:46.508490 18380 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:46.513466 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:46.515230 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:46.469295 24500 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.514205 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:46.522675 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:46.478703 24497 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:46.522177 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:46.569633 18237 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:46.570209 18234 raft_consensus.cc:2393] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:46.568346 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:46.521337 18235 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:19:46.520206 18276 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:46.486064 24262 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:46.573302 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:46.573221 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 55745us
I20260709 13:19:46.573752 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:46.498533 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54004 (request call id 548) took 2022 ms. Trace:
I20260709 13:19:46.508981 24465 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.584249 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:46.517520 24455 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.511229 24367 raft_consensus.cc:1081] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:19:46.585719 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:46.586242 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:46.586257 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:46.517786 24419 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:46.589255 18228 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:46.590077 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:46.590715 18234 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.590922 24439 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:46.591418 24439 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:46.591900 24439 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:46.595119 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:46.572309 24500 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.598208 24523 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.599937 24500 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:46.602129 24525 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:46.586593 18349 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:46.606586 18953 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:46.610342 18309 raft_consensus.cc:2368] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19.
I20260709 13:19:46.618569 18304 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:46.568768 24497 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:46.516902 24527 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.629861 18236 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:46.631120 24527 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:46.582784 24377 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:46.632733 24523 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:46.635008 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:46.611181 24525 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:46.639053 24472 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:46.504427 24374 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.582484 24392 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.604771 24262 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:46.679700 18308 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:46.643579 24497 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:46.587085 24512 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:46.605435 24456 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.622350 24419 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:46.705550 24419 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.699878 24456 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:46.714493 24456 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:46.716815 24512 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:46.717404 24512 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.721333 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:46.722043 18231 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:46.722649 24512 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:46.682483 18953 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:19:46.686569 18236 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:46.610710 24455 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.585040 24467 rpcz_store.cc:276] 0709 13:19:44.443138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.447518 (+  4380us) service_pool.cc:224] Handling call
0709 13:19:44.785672 (+338154us) ts_tablet_manager.cc:934] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
0709 13:19:45.461191 (+675519us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:19:46.017062 (+555871us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:46.017229 (+   167us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:19:46.166863 (+149634us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:19:46.321248 (+154385us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:46.450278 (+129030us) ts_tablet_manager.cc:989] Replica registered.
0709 13:19:46.456767 (+  6489us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":26721,"tablet-copy.queue_time_us":285827,"thread_start_us":289377,"threads_started":2}
I20260709 13:19:46.610586 24465 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:46.680331 24262 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.700496 18130 catalog_manager.cc:5697] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 9 to 10, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 10 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.758293 18130 catalog_manager.cc:5697] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 17 to 18, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 18 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:46.750206 24268 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:46.675272 24525 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:46.751825 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 231679us
I20260709 13:19:46.761307 24262 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:46.735888 24390 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.767407 18237 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:19:46.684717 24392 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.747156 24512 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:46.648430 18228 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:19:46.784416 18234 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:46.787117 18130 catalog_manager.cc:5697] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 16 to 17, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 17 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.861212 18130 catalog_manager.cc:5697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 17 to 18, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 18 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.745663 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:46.827929 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:46.827821 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:46.866745 18378 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:46.828452 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:46.829116 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:46.868686 18384 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:19:46.838441 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:46.839126 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:46.840996 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:46.870431 18231 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:46.865607 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:46.889591 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:46.891435 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:46.892416 18306 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
W20260709 13:19:46.892575 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 256263us
I20260709 13:19:46.868256 18276 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:46.894889 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:46.902664 18233 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:46.895524 18959 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:46.904855 18276 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:46.834659 24500 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:46.905892 24217 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:46.910037 24217 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.910478 24217 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:46.876541 24379 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.906832 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:46.917186 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:46.874204 24467 tablet_copy_client.cc:806] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:46.873230 24454 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.917963 18231 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:46.822453 24525 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:46.926643 18200 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:46.927062 18202 leader_election.cc:400] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11.
I20260709 13:19:46.937151 18277 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:46.914652 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:46.936278 18202 leader_election.cc:403] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:46.938314 18309 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:19:46.897974 24520 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:46.905992 24544 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:19:46.948226 18231 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:46.858304 24390 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:46.915639 24527 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:46.965588 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:47.019865 18231 raft_consensus.cc:2368] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 20. Current term is 21.
I20260709 13:19:46.987238 18384 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:46.989416 24217 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:46.878346 24512 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:46.940281 24538 log.cc:927] Time spent T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.417s	user 0.001s	sys 0.000s
I20260709 13:19:46.933141 24375 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:46.926321 24493 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:46.933009 24524 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.042062 24217 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:47.049026 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 144276us
I20260709 13:19:46.906335 24497 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:47.016968 24507 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.929991 24379 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.090049 24217 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:47.110819 24217 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.069677 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:47.112133 18385 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:19:47.032824 24427 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:46.940663 24454 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.038975 24467 tablet_copy_client.cc:670] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:47.043143 24474 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:47.063151 24380 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.044189 24375 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.065354 24516 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:47.135212 24217 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.043473 24527 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:47.108220 18956 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:19:47.126006 24545 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.355s	user 0.002s	sys 0.000s
W20260709 13:19:47.130275 24543 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:19:47.115481 24374 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:47.146486 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 159428us
I20260709 13:19:47.113765 24427 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.131073 24375 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:47.130038 24530 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:19:47.070796 24493 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:47.177109 24548 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 13:19:47.178745 24525 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:47.181222 24427 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.182158 24465 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:47.182875 24455 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.091370 24507 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:47.158421 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.088907 24524 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.148952 24516 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:19:47.164461 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 237504us
I20260709 13:19:47.170328 24390 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.170550 24512 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:47.171029 24392 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.171870 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3536) took 1104 ms. Trace:
W20260709 13:19:47.125381 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 188319us
W20260709 13:19:47.211733 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 44441.7us
I20260709 13:19:47.219375 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:47.222460 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.222685 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:47.222968 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:47.224095 18237 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:19:47.220220 18961 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 8.
I20260709 13:19:47.229689 18307 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:47.223202 18309 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:47.231246 18200 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:47.233500 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:47.234108 18309 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:47.234802 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:47.235642 18312 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:47.235757 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:47.236589 18304 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:47.218257 18305 rpcz_store.cc:276] 0709 13:19:46.067116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.068615 (+  1499us) service_pool.cc:224] Handling call
0709 13:19:46.068940 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.069232 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.069256 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:46.069674 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 13:19:46.241206 (+171532us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b48002619d8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18719caa1 00007fa187193b37 00007fa1871939ca 00007fa18728b26f 00007fa18728af37 00007fa18729f55c 00007fa18729f508 00007fa18729f488 00007fa18729f443 00007fa18729e6ec 00007fa1861c8a96
0709 13:19:46.443346 (+202140us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:46.477043 (+ 33697us) log.cc:844] Serialized 14 byte log entry
0709 13:19:46.477293 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:46.477388 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:46.720028 (+242640us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b18004278a0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:19:47.171633 (+451605us) raft_consensus.cc:1685] finished
0709 13:19:47.171659 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.171792 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26122,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":1817,"raft.run_cpu_time_us":3008,"raft.run_wall_time_us":131473,"spinlock_wait_cycles":153299072,"thread_start_us":373284,"threads_started":1,"wal-append.queue_time_us":445782}
I20260709 13:19:47.244920 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.244830 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:47.252183 18385 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:47.244750 24465 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.256640 24465 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.257100 24465 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.257375 24454 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.258569 24474 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:47.258926 24507 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.259086 24474 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:47.259680 24527 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:47.267023 18962 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:19:47.230365 24512 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:19:47.269966 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.272576 18305 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:47.272766 18385 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
I20260709 13:19:47.271130 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:47.274260 18926 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:47.275220 18304 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:47.286533 24509 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.287175 24509 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:47.289793 24509 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:47.292150 24380 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11.
I20260709 13:19:47.243408 24520 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:19:47.276301 24497 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:47.282799 24493 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:47.349532 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 99839.2us
I20260709 13:19:47.304065 24491 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:47.341794 24297 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:47.344000 24525 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:47.348449 24493 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:47.377770 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.378494 18236 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:19:47.372236 24297 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.380610 24297 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.297037 24516 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.381515 24474 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.374651 24375 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.349942 24554 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:47.376160 24379 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.377549 24524 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.372283 24427 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:47.372861 24491 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:47.399353 24555 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.312s	user 0.004s	sys 0.000s
I20260709 13:19:47.384464 24474 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.433689 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:47.391644 24493 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.447671 24297 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:47.450237 24297 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:47.451026 24570 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.100s	user 0.001s	sys 0.001s
I20260709 13:19:47.452654 18953 raft_consensus.cc:2368] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14.
W20260709 13:19:47.433226 24262 consensus_meta.cc:287] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.002s
I20260709 13:19:47.454852 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:47.455606 18385 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.390229 24525 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:47.443470 24497 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:47.468850 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:47.470873 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:47.472879 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:47.473548 18236 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:47.480578 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.481415 18380 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:47.482823 18377 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:47.486791 18232 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:19:47.465198 24439 consensus_meta.cc:287] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.871s	user 0.012s	sys 0.003s
I20260709 13:19:47.498648 24439 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.503005 24493 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:47.503887 24491 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:47.488979 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.505940 18381 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:47.490684 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.495357 18927 leader_election.cc:400] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 20. Current term is 21.
I20260709 13:19:47.469906 24426 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.468035 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:47.463932 24262 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.510335 24520 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:47.511942 24439 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:47.465878 24466 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:47.512876 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.525597 18381 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:47.525813 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:47.519915 18385 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:19:47.513993 18927 leader_election.cc:403] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:19:47.523602 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:47.489871 24593 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:47.530738 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.531690 18381 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:47.527822 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:47.514588 24585 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:19:47.538759 24262 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.533344 24460 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 20. Current term is 21.
I20260709 13:19:47.514894 24427 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:47.539471 18311 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:47.496840 24591 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:19:47.514194 24525 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:47.541301 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 2687) took 1068 ms. Trace:
I20260709 13:19:47.541580 18385 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:47.533073 24520 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:47.541731 18311 rpcz_store.cc:276] 0709 13:19:46.472881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.585932 (+113051us) service_pool.cc:224] Handling call
0709 13:19:47.541087 (+955155us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b54000bc7d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:47.541237 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2185037696}
I20260709 13:19:47.544226 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.543790 18926 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:47.545738 18307 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:19:47.546444 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:47.552254 24559 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:47.553140 24559 raft_consensus.cc:697] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 14 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:47.554278 24559 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:47.486033 24497 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.562711 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.564028 18384 raft_consensus.cc:2393] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 14: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
W20260709 13:19:47.564244 24580 log.cc:927] Time spent T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:19:47.569521 18383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46844
I20260709 13:19:47.573895 24433 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:47.574752 18349 leader_election.cc:400] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14.
I20260709 13:19:47.576546 24525 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:47.519940 24465 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:47.579697 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:47.580147 24520 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:47.582654 24467 tablet_copy_client.cc:538] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:47.583582 24497 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:47.586679 18236 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:19:47.654737 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:47.588825 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.655597 18303 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:47.655922 18382 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:47.656133 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:47.656800 18308 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:47.656823 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:47.589221 18311 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:47.589890 24496 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:47.592468 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:47.592655 24593 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:47.618060 18132 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 119) took 1596 ms. Trace:
I20260709 13:19:47.594309 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:47.660805 18377 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:47.599210 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:47.661669 18385 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:19:47.602169 24375 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.603571 18383 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:47.604362 18349 leader_election.cc:403] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:47.667718 18383 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:47.668118 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 93526.7us
I20260709 13:19:47.671216 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:47.671993 18306 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:47.638774 24465 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:47.613379 24262 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:47.610494 24433 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.613179 18276 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:47.641160 24492 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:47.646938 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:47.657821 18307 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:47.593451 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.713551 18384 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:47.714099 24454 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:47.714391 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:47.705267 24456 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:47.715194 24456 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.671406 24268 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14.
I20260709 13:19:47.674438 18386 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:47.677000 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.678018 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:47.717006 18236 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:47.717779 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.678436 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.719035 18382 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:47.679562 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.679901 18231 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:47.680769 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.609725 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:47.681704 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.721407 18234 raft_consensus.cc:2393] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 15: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:47.721850 18228 raft_consensus.cc:2368] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14.
I20260709 13:19:47.687350 18377 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:47.693666 18385 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:19:47.693962 18308 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:19:47.720714 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:47.695317 18381 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:19:47.697065 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2850) took 1176 ms. Trace:
I20260709 13:19:47.724092 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:19:47.706535 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 93448.2us
I20260709 13:19:47.706568 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.706583 18232 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:47.709234 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:47.664463 18132 rpcz_store.cc:276] 0709 13:19:46.021530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.021720 (+   190us) service_pool.cc:224] Handling call
0709 13:19:47.617922 (+1596202us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:46.725012 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:46.725889 (+   877us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:46.725946 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:19:46.725975 (+    29us) tablet.cc:662] Decoding operations
0709 13:19:46.726452 (+   477us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:46.726538 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:46.726581 (+    43us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:19:46.726853 (+   272us) tablet.cc:701] Row locks acquired
0709 13:19:46.726875 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:19:46.727082 (+   207us) write_op.cc:270] Start()
0709 13:19:46.727241 (+   159us) write_op.cc:276] Timestamp: P: 1783603186727013 usec, L: 0
0709 13:19:46.727272 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:19:46.728255 (+   983us) log.cc:844] Serialized 539 byte log entry
0709 13:19:47.151768 (+423513us) op_driver.cc:464] REPLICATION: finished
0709 13:19:47.174521 (+ 22753us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b54002ae0a8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18862f9e1 00007fa18862e64c 00007fa185ca9e28 00007fa185caa489 00007fa185cac71a 00007fa185cac6a8 00007fa185cac628 00007fa185cac5e3 00007fa185cab7fc 00007fa1880de626 00007fa1880d8dd8
0709 13:19:47.513544 (+339023us) write_op.cc:301] APPLY: starting
0709 13:19:47.513649 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:47.516783 (+  3134us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:47.516811 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:47.517579 (+   768us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:47.517776 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:19:47.517836 (+    60us) write_op.cc:312] APPLY: finished
0709 13:19:47.518045 (+   209us) log.cc:844] Serialized 25 byte log entry
0709 13:19:47.518241 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:47.518313 (+    72us) write_op.cc:454] Released schema lock
0709 13:19:47.518352 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:47.557641 (+ 39289us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:47.581831 (+ 24190us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":243612,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":294457,"apply.run_cpu_time_us":4193,"apply.run_wall_time_us":57535,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8299,"num_ops":1,"prepare.queue_time_us":382123,"prepare.run_cpu_time_us":3835,"prepare.run_wall_time_us":22853,"replication_time_us":387122,"spinlock_wait_cycles":9540352,"thread_start_us":236602,"threads_started":2}]]}
I20260709 13:19:47.729897 24268 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:47.734201 24268 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:47.734638 18276 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:47.730281 18230 rpcz_store.cc:276] 0709 13:19:46.512483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.579694 (+ 67211us) service_pool.cc:224] Handling call
0709 13:19:46.580179 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.640874 (+ 60695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.640906 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:46.641319 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:19:47.217395 (+576076us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:47.242562 (+ 25167us) log.cc:844] Serialized 14 byte log entry
0709 13:19:47.642523 (+399961us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b1800417160. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa18226b060 00007fa18227d716 00007fa18228e287 00007fa18228e208
0709 13:19:47.642872 (+   349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.689106 (+ 46234us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b540026b954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:47.689155 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.689197 (+    42us) raft_consensus.cc:1685] finished
0709 13:19:47.689209 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.689338 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18524,"prepare.queue_time_us":27058,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":1303,"raft.queue_time_us":405322,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":56408,"spinlock_wait_cycles":152766976,"thread_start_us":462741,"threads_started":1,"wal-append.queue_time_us":641189}
I20260709 13:19:47.737624 18235 raft_consensus.cc:2368] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15.
I20260709 13:19:47.665681 24520 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:47.729821 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 120254us
I20260709 13:19:47.721191 18383 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.746136 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:47.747251 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:47.741223 18306 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
W20260709 13:19:47.741954 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 209391us
I20260709 13:19:47.694645 24497 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:47.751202 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 104350us
I20260709 13:19:47.752424 24268 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.752843 18383 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:47.754287 18276 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:47.758471 18351 leader_election.cc:400] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19.
I20260709 13:19:47.758812 18351 leader_election.cc:403] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:47.759277 24574 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:47.759792 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:47.760802 24568 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19.
I20260709 13:19:47.761497 24568 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:47.761974 24568 raft_consensus.cc:697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:47.762948 24568 consensus_queue.cc:237] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.764060 24456 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.764608 24574 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:47.765138 24527 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:47.765566 24433 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.766044 18956 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:19:47.765707 24574 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:47.767513 18276 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:47.699110 24262 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.769173 24456 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:47.764401 24454 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:47.751554 24520 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.770350 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:47.771284 18349 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:47.771605 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:47.719151 24554 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:47.776041 24554 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.776831 24262 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.778146 24554 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.782022 24520 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:47.769868 24456 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:19:47.782853 24527 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:47.788067 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.748098 24523 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:47.789585 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.809571 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.699796 24465 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:19:47.751791 24470 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:47.794456 24262 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:47.795969 24602 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.128s	user 0.003s	sys 0.000s
I20260709 13:19:47.790046 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:47.796751 24567 raft_consensus.cc:2764] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:19:47.788690 24525 raft_consensus.cc:2764] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:19:47.805141 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.813433 18385 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:47.837924 24501 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:47.809470 24523 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.838822 24523 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:47.784453 24467 tablet_bootstrap.cc:492] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:19:47.841768 24262 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:47.843631 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2681) took 1422 ms. Trace:
I20260709 13:19:47.843977 24262 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:47.827657 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:47.846361 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:47.789664 24433 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:47.816565 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 63224.6us
I20260709 13:19:47.770735 24439 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:47.721850 24420 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:19:47.728457 24492 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.672976 24593 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.799340 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:47.772578 24497 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.835170 24493 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:47.815681 18201 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:19:47.876714 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 61121.4us
I20260709 13:19:47.848220 18130 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39270 (request call id 221) took 1445 ms. Trace:
I20260709 13:19:47.843998 18310 rpcz_store.cc:276] 0709 13:19:46.420971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.595419 (+174448us) service_pool.cc:224] Handling call
0709 13:19:46.595782 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:46.776242 (+180460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:46.776285 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:47.502523 (+726238us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b2c0010c0c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:19:47.503003 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:19:47.720869 (+217866us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:47.720911 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:47.775098 (+ 54187us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54003c14d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:47.775166 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:47.843419 (+ 68253us) raft_consensus.cc:1685] finished
0709 13:19:47.843439 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:47.843574 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":534,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":44839,"spinlock_wait_cycles":417893888,"thread_start_us":217462,"threads_started":1,"wal-append.queue_time_us":336340}
W20260709 13:19:47.877954 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 119214us
I20260709 13:19:47.854764 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:47.879380 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:47.882028 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:47.882589 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.883050 18236 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 15: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:47.830503 18135 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39284 (request call id 212) took 1142 ms. Trace:
I20260709 13:19:47.868117 18133 catalog_manager.cc:5697] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 16 to 17, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 17 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.884979 18235 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:47.885278 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.885133 18133 catalog_manager.cc:5697] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.881070 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.877419 18201 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:47.894732 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:47.883618 18135 rpcz_store.cc:276] 0709 13:19:46.688367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.707129 (+ 18762us) service_pool.cc:224] Handling call
0709 13:19:47.830405 (+1123276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3751,"reported_tablets":3}
I20260709 13:19:47.886688 18133 catalog_manager.cc:5697] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 7 to 8, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 8 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.902822 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.903293 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.905090 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.904356 18133 catalog_manager.cc:5697] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.906715 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.910492 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.912107 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.912999 18229 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:19:47.900566 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:47.915095 18236 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:47.915498 18236 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:47.917074 18133 catalog_manager.cc:5697] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.857971 24525 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:47.923975 18383 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:47.863473 24512 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:47.924021 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:47.861232 24576 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:47.930243 18377 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:19:47.837924 24380 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:19:47.897665 24473 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:47.948661 18308 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:47.948752 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:47.949345 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:47.949968 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:47.951512 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:47.945807 18310 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:47.884774 24557 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:47.954375 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:47.958637 18308 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:47.923062 24374 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:47.877632 18130 rpcz_store.cc:276] 0709 13:19:46.402791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.403168 (+   377us) service_pool.cc:224] Handling call
0709 13:19:47.848173 (+1445005us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:46.934481 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:47.154760 (+220279us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:47.159251 (+  4491us) write_op.cc:435] Acquired schema lock
0709 13:19:47.162369 (+  3118us) tablet.cc:662] Decoding operations
0709 13:19:47.182590 (+ 20221us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:47.182641 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:47.182667 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:19:47.183086 (+   419us) tablet.cc:701] Row locks acquired
0709 13:19:47.183104 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:19:47.183252 (+   148us) write_op.cc:270] Start()
0709 13:19:47.183380 (+   128us) write_op.cc:276] Timestamp: P: 1783603187183208 usec, L: 0
0709 13:19:47.183405 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:19:47.286516 (+103111us) log.cc:844] Serialized 1708 byte log entry
0709 13:19:47.387566 (+101050us) op_driver.cc:464] REPLICATION: finished
0709 13:19:47.580808 (+193242us) write_op.cc:301] APPLY: starting
0709 13:19:47.580899 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:47.586465 (+  5566us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:47.586571 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:47.590813 (+  4242us) spinlock_profiling.cc:243] Waited 96.1 ms on lock 0x7b54002ae254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa18226ee28 00007fa185ca9581 00007fa185ca8d58 00007fa185cad9f1 00007fa185cad9a9 00007fa185cad939 00007fa185cad901 00007fa185cacb2d 000000000038f354 000000000038f199
0709 13:19:47.659428 (+ 68615us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:47.659639 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 13:19:47.659684 (+    45us) write_op.cc:312] APPLY: finished
0709 13:19:47.712023 (+ 52339us) log.cc:844] Serialized 49 byte log entry
0709 13:19:47.712226 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:47.712334 (+   108us) write_op.cc:454] Released schema lock
0709 13:19:47.712396 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:47.712796 (+   400us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:47.712825 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":192929,"apply.run_cpu_time_us":7966,"apply.run_wall_time_us":131997,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20815,"num_ops":4,"prepare.queue_time_us":4026,"prepare.run_cpu_time_us":7443,"prepare.run_wall_time_us":665237,"replication_time_us":203899,"spinlock_wait_cycles":220964608,"thread_start_us":101519,"threads_started":1}]]}
I20260709 13:19:47.934671 18236 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:47.873642 24516 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:19:47.967816 18236 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:48.001493 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51565us
I20260709 13:19:48.002892 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:47.970361 18303 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:47.934180 24568 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:48.005184 18277 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:47.999465 18201 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:47.927203 24525 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:48.009043 18308 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:19:48.011157 18201 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:48.014297 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:47.944299 24427 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:48.019220 18306 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:47.957962 24473 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.944820 24597 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:47.947067 24554 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:47.955973 24491 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:47.997140 24374 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.003046 24557 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.025764 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:47.945845 24576 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.013406 24525 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.017133 24574 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:48.053436 18236 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:19:48.022234 24392 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:48.023438 24361 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.028282 24473 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:48.108489 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 82827.4us
W20260709 13:19:47.997285 24390 consensus_queue.cc:1175] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" responder_term: 18 status { last_received { term: 18 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 18 index: 10 } }
I20260709 13:19:48.038443 24501 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:48.128446 24501 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.129011 24501 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:48.048388 24374 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.019021 24568 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:48.118691 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.100920 24361 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:48.080240 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:48.086030 24456 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:48.055100 24433 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:48.052567 24557 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:48.154501 18276 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:48.081856 24392 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:48.160010 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 79912us
I20260709 13:19:48.160657 24262 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:48.162533 18351 leader_election.cc:400] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 13. Current term is 14.
I20260709 13:19:48.163559 24262 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:48.164319 24262 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:48.164842 18351 leader_election.cc:400] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15.
I20260709 13:19:48.161199 24268 consensus_queue.cc:1059] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:48.116200 24482 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.059680 24554 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.185400 24482 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:48.186054 18956 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:19:48.186237 24361 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:48.187310 24605 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:48.187668 24482 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:48.185276 24474 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:48.190021 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:48.191980 24593 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:48.192935 24604 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:19:48.216401 24610 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:19:48.154888 24433 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.238179 24433 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:48.196986 24497 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:48.159065 24456 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.200961 24501 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.168354 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:48.201766 24576 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:48.166676 24493 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:48.247099 24474 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:19:48.254684 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 86402.1us
I20260709 13:19:48.254840 24493 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:48.201995 24374 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.255200 24474 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:48.256248 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:48.257090 24374 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:48.206131 24568 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:48.257792 24568 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:48.258594 24497 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:48.259071 24497 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:48.259868 24497 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.208884 24492 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:48.183727 24268 raft_consensus.cc:3055] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:48.262164 24268 raft_consensus.cc:740] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:48.263109 24268 consensus_queue.cc:260] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:48.264465 24268 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:48.210323 24380 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:19:48.215178 24607 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:19:48.219187 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:48.279453 18383 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:48.220310 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:48.222438 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:19:48.281147 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 58826.4us
W20260709 13:19:48.210465 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 358302us
I20260709 13:19:48.229871 24523 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:48.170854 24548 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:48.231480 18379 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:19:48.035171 24597 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:48.163154 24392 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:48.289547 18926 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:48.290441 24420 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:48.187474 24554 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:48.251012 24262 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.252578 18201 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:48.295356 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:48.274703 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:48.275357 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:48.277068 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:48.278355 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:48.293151 18230 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:48.305017 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:48.316803 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:48.290819 24420 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.322921 24377 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:48.321801 24456 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:48.325148 24374 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:48.357514 24374 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:48.358515 24374 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.361593 18379 raft_consensus.cc:2410] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:19:48.294469 24454 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:48.350477 24262 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:48.321774 24420 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:48.370222 18231 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:48.371615 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 357390us
I20260709 13:19:48.375255 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:48.376314 24262 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:48.377091 24268 consensus_queue.cc:1059] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:48.322640 24439 raft_consensus.cc:697] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:48.283960 24380 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.364190 24454 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:48.381377 24512 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:48.419948 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.385807 24492 raft_consensus.cc:3055] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:48.407300 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:48.441359 24262 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:48.379194 24493 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:19:48.394062 24454 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:48.447502 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:48.448407 24618 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.448879 24554 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.450610 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:48.462044 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:48.452018 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:48.454023 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:48.454166 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:48.455861 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:48.457013 18386 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:48.459520 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:48.466038 18303 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:19:48.460438 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:48.461220 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:48.467602 18304 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:48.468672 18311 raft_consensus.cc:2393] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 17: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:48.473594 18303 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:19:48.437785 24492 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:48.478117 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:48.478847 18303 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:19:48.497928 24390 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:48.500690 24616 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:48.519526 24390 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:48.522635 24390 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:48.501349 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:48.527101 24616 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:48.527876 24616 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:48.503787 24615 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:48.505103 24501 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:48.464651 24512 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:48.497505 24493 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:48.505429 24439 consensus_queue.cc:237] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.507036 24523 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:48.506835 24492 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.472777 24618 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:48.535892 18234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.008s	sys 0.020s
I20260709 13:19:48.511168 24380 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:48.512655 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:48.513460 24557 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.514240 24605 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:48.517253 24433 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:48.515872 24473 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.534157 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:48.478083 24525 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:48.536931 18234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.008s	sys 0.020s
I20260709 13:19:48.529891 24377 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:48.565047 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 236065us
W20260709 13:19:48.610877 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 76836.2us
I20260709 13:19:48.611680 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:48.612433 24268 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:48.612916 24268 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:48.613389 24268 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:48.613190 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:48.570559 18228 raft_consensus.cc:2393] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 16: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:48.617992 18236 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:48.472101 24593 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.127s
I20260709 13:19:48.570139 24492 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.537568 24454 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.472473 24554 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.538373 24493 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:19:48.627620 24501 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:48.634788 24470 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:48.566305 24392 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.648799 18310 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:48.629557 24268 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.618937 24524 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:19:48.655193 18311 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:48.619099 24420 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:48.661360 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:48.666139 18312 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:48.638223 24482 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:48.643466 24525 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:48.598646 24605 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.652041 24470 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:48.684912 18386 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:48.700459 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:48.701414 18311 raft_consensus.cc:2393] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:48.701933 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:48.702309 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:48.706760 18312 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:48.663277 24501 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:48.721206 24268 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:48.723664 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.671496 24358 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:48.690618 24470 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:48.629882 24616 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:48.763883 24619 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:19:48.680523 24482 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:48.707958 24464 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.084s
W20260709 13:19:48.835808 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 224197us
I20260709 13:19:48.836898 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:48.791891 24626 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:48.776891 24358 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:48.889997 24629 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:19:48.895030 24420 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:48.858525 24392 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:48.897054 24628 log.cc:927] Time spent T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:19:48.897897 24501 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.899845 24482 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:48.901433 24605 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:48.902838 24358 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:48.903661 24554 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:48.838776 24557 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:48.909559 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.916603 24473 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:48.860961 24618 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:48.861980 24626 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:48.929608 24626 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:48.855669 24493 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:48.937925 24618 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.938747 24618 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.941171 24618 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:48.944077 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:48.943909 24470 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.947710 24426 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:48.948185 24426 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:48.948382 24470 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:48.944718 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 82005us
I20260709 13:19:48.949147 24426 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.950419 24426 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:48.945130 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:48.955988 24635 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:48.956105 18306 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:19:49.018277 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:49.024878 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:49.026135 18237 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:49.033035 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:49.033849 18380 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:49.028767 24644 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:49.021915 24615 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:49.035043 24644 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:49.035626 24615 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.036839 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.037315 24644 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:49.038311 24615 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:49.038904 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:49.038940 24492 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:49.039744 24492 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.041258 18311 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:19:49.042027 24492 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:49.042456 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:49.048375 24464 consensus_queue.cc:1059] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:49.049427 24464 raft_consensus.cc:3055] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:49.049764 24464 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:49.050179 24493 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:49.051017 24433 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:49.050740 24464 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:49.042016 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:49.052083 18309 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.053879 24491 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:49.054543 24491 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:49.056923 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:49.058251 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:49.058969 18309 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
I20260709 13:19:48.971801 24524 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.060340 18927 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:49.060156 24524 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:48.975338 24618 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.063061 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:49.063933 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.067801 18378 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:49.064960 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:49.065748 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:49.069365 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:49.072638 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:49.073573 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:49.073798 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.074470 18383 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:19:49.074642 24464 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:49.076133 18386 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:49.078651 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:49.072393 24358 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:49.081100 24358 raft_consensus.cc:697] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:49.081986 24641 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:49.082247 24358 consensus_queue.cc:237] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:49.082516 24641 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.073917 24524 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.087909 24641 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:49.079990 24618 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.086302 18383 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:49.087532 24615 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:49.081033 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:49.093380 18230 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:49.091840 18349 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:49.094435 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:49.095880 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:49.097738 24562 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:49.098506 24615 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.099339 18927 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:49.022828 24525 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:49.099521 24464 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:19:49.115854 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:49.117318 18237 raft_consensus.cc:2368] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16.
I20260709 13:19:49.119441 24618 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.102087 24460 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:49.100785 24641 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:49.134513 24597 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:49.112974 24525 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:49.168241 24648 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:19:49.173923 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:49.171624 24472 raft_consensus.cc:993] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:19:49.184340 24491 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:49.235813 24464 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:49.259016 24464 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:49.261091 24454 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.253216 24562 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:49.261900 24562 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:49.273191 18380 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:49.267849 24562 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.290248 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.278656 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:19:49.268121 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 168877us
I20260709 13:19:49.303201 18378 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.279170 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.310312 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.310357 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:49.309749 24621 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:49.311740 24621 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:49.313227 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.314363 24621 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.314762 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:49.315378 24527 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:49.265794 18229 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:49.316269 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:49.317374 18962 raft_consensus.cc:2410] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:19:49.324241 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:49.327906 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 55675.6us
I20260709 13:19:49.343969 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:49.359004 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.365057 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.317269 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:49.374785 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.332147 24618 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:49.341902 24367 raft_consensus.cc:1081] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:19:49.396342 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:49.341614 24377 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:49.320082 24527 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.345906 24464 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.396586 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:49.405328 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:49.407871 18276 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:49.392158 24516 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.395103 24597 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:49.420347 18276 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:49.433424 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:49.428341 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:49.378881 24472 consensus_queue.cc:1059] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:19:49.437626 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:49.457566 18230 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 9: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:49.461655 24639 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:49.462136 24639 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:49.462525 24639 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:49.436740 24456 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:49.412113 24615 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:49.449239 18276 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:49.445297 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:49.435608 24454 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:49.470618 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:49.471339 24649 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:49.411790 24377 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.398800 24618 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.475519 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:49.464716 24650 raft_consensus.cc:3055] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:49.485641 18378 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
I20260709 13:19:49.471486 24454 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:49.444021 24597 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.473151 24456 raft_consensus.cc:2764] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:19:49.483767 24650 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:49.498245 24377 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.498149 24650 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.501528 24618 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:49.505685 24623 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.662s	user 0.000s	sys 0.005s
I20260709 13:19:49.012043 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:49.530725 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2693) took 1169 ms. Trace:
I20260709 13:19:49.491204 24454 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:49.490234 24649 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:49.437008 24516 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.541164 18236 rpcz_store.cc:276] 0709 13:19:48.361798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.361949 (+   151us) service_pool.cc:224] Handling call
0709 13:19:48.362244 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.618466 (+256222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.530473 (+912007us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540005a854. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:49.530662 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587758848}
W20260709 13:19:49.543830 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 193526us
I20260709 13:19:49.545706 18229 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
W20260709 13:19:49.549638 24654 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:49.550412 24527 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.552989 24649 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.560396 24649 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.554852 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:49.561510 24440 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:49.562628 24367 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:49.554509 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 3877) took 1239 ms. Trace:
I20260709 13:19:49.563719 18377 rpcz_store.cc:276] 0709 13:19:48.308171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.308351 (+   180us) service_pool.cc:224] Handling call
0709 13:19:48.308757 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.309164 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.309203 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:48.800784 (+491581us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b2c0010dcf8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:19:48.801183 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 13:19:49.130823 (+329640us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:49.415680 (+284857us) log.cc:844] Serialized 14 byte log entry
0709 13:19:49.415994 (+   314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.416099 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.542363 (+126264us) raft_consensus.cc:1685] finished
0709 13:19:49.547427 (+  5064us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.547651 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":365574,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":1029,"raft.run_cpu_time_us":375,"raft.run_wall_time_us":52097,"spinlock_wait_cycles":37590784,"thread_start_us":505723,"threads_started":2,"wal-append.queue_time_us":602948}
W20260709 13:19:49.568964 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.548671 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:49.570847 24649 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:49.576299 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 226128us
W20260709 13:19:49.571112 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 259240us
W20260709 13:19:49.549074 24426 consensus_meta.cc:287] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.007s
I20260709 13:19:49.578374 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.579701 18378 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:19:49.580456 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.580822 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.578712 18383 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:49.584215 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.584174 18201 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:49.586838 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2877) took 1197 ms. Trace:
I20260709 13:19:49.587807 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.587217 18231 rpcz_store.cc:276] 0709 13:19:48.389209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.389359 (+   150us) service_pool.cc:224] Handling call
0709 13:19:48.389741 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.429531 (+ 39790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.429710 (+   179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:48.429795 (+    85us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:48.429854 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.586601 (+1156747us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b54001888d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:49.586648 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.586776 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46332288}
I20260709 13:19:49.551592 24597 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:49.589493 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:49.592615 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2676) took 1713 ms. Trace:
I20260709 13:19:49.593575 24576 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:49.588416 24426 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:19:49.593029 18234 rpcz_store.cc:276] 0709 13:19:47.879590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.880625 (+  1035us) service_pool.cc:224] Handling call
0709 13:19:47.928935 (+ 48310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:47.929375 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:47.929416 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:47.943771 (+ 14355us) log.cc:844] Serialized 26 byte log entry
0709 13:19:48.600317 (+656546us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:48.600485 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:48.600594 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.504978 (+904384us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:19:49.586051 (+ 81073us) raft_consensus.cc:1685] finished
0709 13:19:49.586071 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:49.592554 (+  6483us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13048,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":12918,"spinlock_wait_cycles":5485440,"thread_start_us":576883,"threads_started":1,"wal-append.queue_time_us":762272}
I20260709 13:19:49.605896 24516 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.619616 24426 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:49.619190 18381 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46844
I20260709 13:19:49.606928 18926 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:49.649847 18381 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:49.650306 18381 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:49.586308 24525 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:49.656677 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 67254.5us
I20260709 13:19:49.656970 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.660938 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.652745 18926 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:49.592473 24473 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:49.653275 24420 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:49.667666 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:49.651721 24641 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.671964 24473 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:49.672739 24641 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.676115 24473 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.678359 24641 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:49.680456 24472 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:49.681075 24472 raft_consensus.cc:697] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:49.681998 24472 consensus_queue.cc:237] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.690219 18383 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:49.691375 24627 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.669627 24665 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:49.692276 24665 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:49.692898 24665 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.699679 18383 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:49.700491 18383 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:19:49.701009 24666 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:19:49.692250 24627 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.702057 18383 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.703646 18383 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:49.717723 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 2703) took 1263 ms. Trace:
I20260709 13:19:49.718132 18310 rpcz_store.cc:276] 0709 13:19:48.454050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.460123 (+  6073us) service_pool.cc:224] Handling call
0709 13:19:49.717464 (+1257341us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400234454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:49.717628 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414620032}
I20260709 13:19:49.719702 18303 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19. Ops: []
W20260709 13:19:49.721194 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.723191 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3569) took 1071 ms. Trace:
I20260709 13:19:49.723984 24667 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:49.723580 18303 rpcz_store.cc:276] 0709 13:19:48.651531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.651664 (+   133us) service_pool.cc:224] Handling call
0709 13:19:49.719501 (+1067837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:49.720128 (+   627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.723002 (+  2874us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400234450. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:49.723130 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2455032064}
W20260709 13:19:49.732280 18275 consensus_peers.cc:597] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6e6be0c25704f45b1b4f3c4f246fa02. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:49.733148 24262 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.733641 24262 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.735663 24262 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.705104 24627 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.731644 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:49.737186 24262 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:49.738492 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:49.739287 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.740906 24439 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:49.743950 24663 log.cc:927] Time spent T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
W20260709 13:19:49.745720 24661 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:19:49.746358 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:49.747529 24562 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.748015 24562 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:49.750919 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:49.755587 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:49.706200 24665 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:49.772480 18383 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:49.774035 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:49.755945 18386 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:19:49.778378 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.758292 18380 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:49.745795 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:49.755059 18130 catalog_manager.cc:5697] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.760768 18927 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:49.764822 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.780251 18384 raft_consensus.cc:2410] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:19:49.769284 18351 leader_election.cc:400] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16.
I20260709 13:19:49.724200 24454 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.770967 18957 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:49.780712 18351 leader_election.cc:403] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:19:49.780552 18130 catalog_manager.cc:5697] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.753048 18381 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.785085 18378 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:49.717569 24639 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.787361 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:49.789176 18381 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:49.791749 24665 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.792055 18927 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:49.793586 24520 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:49.795562 24465 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:49.796223 24358 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:49.797138 24501 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:49.797674 24501 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.771811 24562 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.781718 24456 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:49.799755 24501 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.804090 24618 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.792456 24665 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.806809 24649 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:49.807825 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:49.786674 24644 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:49.807267 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:49.802415 24593 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16.
I20260709 13:19:49.800889 24454 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:49.820921 24639 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:49.823335 24657 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 13:19:49.810715 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:49.941879 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 134146us
I20260709 13:19:49.943384 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:49.943977 18309 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:49.824247 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:49.944837 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:49.945447 18305 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:49.945760 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:49.946585 18304 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:49.833559 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:49.839295 24440 raft_consensus.cc:3055] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:49.782253 24527 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:49.844117 24655 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.321s	user 0.001s	sys 0.001s
W20260709 13:19:49.847085 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.855827 18303 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:49.870420 24520 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.869658 18957 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:49.803644 24439 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:49.887524 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.901391 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 49260.5us
I20260709 13:19:49.969375 24374 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:49.970184 18377 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:49.970872 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:49.971254 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:49.914096 24616 consensus_queue.cc:1059] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:19:49.950892 24516 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:49.960083 24576 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:49.973840 24482 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:49.974256 24576 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:49.931715 24650 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:49.899953 24467 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260709 13:19:49.806159 18133 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39288 (request call id 214) took 2899 ms. Trace:
I20260709 13:19:49.947044 18310 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:19:49.947852 18234 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 9: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:49.981065 18311 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:49.953600 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:49.956589 18309 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:49.960784 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:49.951149 18384 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 17: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:49.985327 18305 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:49.986394 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:49.987839 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:49.991542 24390 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:49.992053 24374 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:49.992573 24374 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:49.994704 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:49.995334 18303 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:49.989532 18304 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:49.980356 18133 rpcz_store.cc:276] 0709 13:19:46.882147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.882453 (+   306us) service_pool.cc:224] Handling call
0709 13:19:49.781866 (+2899413us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:48.025878 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:48.119504 (+ 93626us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:48.119558 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:19:48.119583 (+    25us) tablet.cc:662] Decoding operations
0709 13:19:48.120401 (+   818us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:48.120477 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:48.120545 (+    68us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:19:48.121198 (+   653us) tablet.cc:701] Row locks acquired
0709 13:19:48.121218 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:19:48.121447 (+   229us) write_op.cc:270] Start()
0709 13:19:48.121607 (+   160us) write_op.cc:276] Timestamp: P: 1783603188121387 usec, L: 0
0709 13:19:48.121632 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:19:48.122462 (+   830us) log.cc:844] Serialized 2104 byte log entry
0709 13:19:48.631548 (+509086us) op_driver.cc:464] REPLICATION: finished
0709 13:19:48.917332 (+285784us) write_op.cc:301] APPLY: starting
0709 13:19:48.917456 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:48.948621 (+ 31165us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:48.948754 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:48.952453 (+  3699us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:48.952769 (+   316us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 13:19:48.952820 (+    51us) write_op.cc:312] APPLY: finished
0709 13:19:48.953145 (+   325us) log.cc:844] Serialized 57 byte log entry
0709 13:19:48.954102 (+   957us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:48.954324 (+   222us) write_op.cc:454] Released schema lock
0709 13:19:48.954383 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:48.954830 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:48.954872 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6439,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":285411,"apply.run_cpu_time_us":10069,"apply.run_wall_time_us":37541,"cfile_cache_hit":22,"cfile_cache_hit_bytes":24987,"num_ops":5,"prepare.queue_time_us":1243,"prepare.run_cpu_time_us":4584,"prepare.run_wall_time_us":142981,"replication_time_us":507654,"thread_start_us":159590,"threads_started":1}]]}
I20260709 13:19:49.998454 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:50.002188 18311 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:19:49.950999 24440 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:50.006033 18200 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:50.011955 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1002) took 1025 ms. Trace:
I20260709 13:19:50.012434 18228 rpcz_store.cc:276] 0709 13:19:48.986885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.987021 (+   136us) service_pool.cc:224] Handling call
0709 13:19:48.987369 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:48.987752 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:48.987784 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:49.028710 (+ 40926us) log.cc:844] Serialized 26 byte log entry
0709 13:19:49.399308 (+370598us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:49.399374 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.399479 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:49.843316 (+443837us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:19:49.996037 (+152721us) raft_consensus.cc:1685] finished
0709 13:19:49.996061 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.011889 (+ 15828us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28401,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":24538,"spinlock_wait_cycles":16265600,"thread_start_us":364401,"threads_started":1,"wal-append.queue_time_us":487638}
I20260709 13:19:50.037912 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:50.038928 18228 raft_consensus.cc:2410] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:19:49.999459 24616 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:50.004823 24615 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:50.048384 24440 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:50.049616 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:49.979511 24520 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:50.004166 24482 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:50.006784 24492 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:50.050545 24380 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:50.060079 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:50.060225 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:50.080049 18231 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:50.080267 18312 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:19:50.060307 18303 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:50.081089 18379 raft_consensus.cc:2955] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:50.061300 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:50.060907 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:50.083521 18229 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 15: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:50.063269 18236 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:50.084625 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:50.084753 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:50.086316 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:49.983206 24501 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:19:50.048923 24574 raft_consensus.cc:2955] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:50.067023 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:50.088280 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:50.056712 18385 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:19:50.044126 24474 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:49.992082 24390 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:50.032936 24665 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:19:50.126307 18386 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:50.088915 18304 raft_consensus.cc:2368] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16.
I20260709 13:19:50.067379 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:50.090075 18229 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:50.091385 18926 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:50.093195 18235 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:50.093935 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:50.079263 24440 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:50.088220 24516 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:50.135030 24516 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:50.073679 24576 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:50.071305 24615 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:50.076917 24492 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:50.115350 24520 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:50.116351 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:50.146715 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:50.151481 18236 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:50.152153 18236 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:50.155671 18303 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:19:50.155915 18236 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:50.157984 18236 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:50.065510 24616 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:50.145282 24562 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:50.177616 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:50.182346 18236 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:50.186357 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:50.192270 24635 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:19:50.201357 24679 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:19:50.203847 18303 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:50.191782 18236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:50.247577 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:50.248698 18303 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
W20260709 13:19:50.230619 24377 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:19:50.202668 24374 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:50.271519 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:50.263711 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:50.280200 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:50.261340 24568 consensus_queue.cc:1059] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:19:50.286532 24568 raft_consensus.cc:3055] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:50.287070 24568 raft_consensus.cc:740] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:50.288136 18236 raft_consensus.cc:606] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:50.288791 18236 raft_consensus.cc:614] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:50.240685 24492 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:50.253336 24635 consensus_queue.cc:1059] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:19:50.289884 24512 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:50.290503 24635 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:50.291096 24635 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:50.291960 24616 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:50.290622 24512 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:50.317219 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:50.317764 18303 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:19:50.332993 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.333096 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:50.335970 18303 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:19:50.288309 24568 consensus_queue.cc:260] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:50.345300 24568 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:50.292122 24635 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:50.349316 24635 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:50.353160 24516 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:50.355648 24615 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:50.356372 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:50.356673 24420 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.357405 24692 ts_tablet_manager.cc:933] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:50.357131 24420 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:50.362927 24420 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:50.365605 24473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.010s	sys 0.034s
W20260709 13:19:50.366140 24473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.011s	sys 0.035s
I20260709 13:19:50.398016 18309 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:50.300868 24512 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:50.412353 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:50.418730 18309 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:50.410698 24467 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.062s	user 0.003s	sys 0.000s
I20260709 13:19:50.428893 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:50.402451 24615 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.444758 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:50.423296 24562 raft_consensus.cc:697] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 9 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:19:50.528923 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.550168 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.725075 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:50.563822 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 120734us
I20260709 13:19:50.741356 18308 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
W20260709 13:19:50.745055 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.723618 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:50.748418 18303 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
W20260709 13:19:50.517555 24682 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:19:50.439486 24615 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:50.765805 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:50.809392 18308 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:50.667601 18351 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.507s (SENT) [suppressed 1 similar messages]
I20260709 13:19:50.831535 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:50.649854 24390 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:50.676575 24433 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:50.835429 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.651350 24576 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:50.649966 24635 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:50.863575 18308 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:50.720220 24374 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:50.849758 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:50.720835 24377 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:50.846608 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:50.851123 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:50.891417 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:50.898159 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:50.899183 24694 log.cc:927] Time spent T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 13:19:50.899637 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:50.875880 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:50.820284 24524 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:50.827925 24623 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:19:50.880016 24635 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:50.873852 24562 consensus_queue.cc:237] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:50.959419 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 291860us
I20260709 13:19:50.872635 24433 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:50.991295 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:50.991804 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:50.992463 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.893986 24377 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:50.889914 24374 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:50.999621 24377 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:50.985915 18235 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:50.898206 24576 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:51.012704 24615 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:50.994859 24520 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:51.015055 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:51.014384 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 300980us
I20260709 13:19:50.999637 24374 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:51.027422 24635 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:51.018070 24568 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.033221 18277 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:51.042891 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:51.045811 18277 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:51.047616 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:51.063696 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:51.032756 24520 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:51.073058 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.077472 24467 tablet_bootstrap.cc:492] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:19:51.043573 24574 consensus_meta.cc:287] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.947s	user 0.012s	sys 0.001s
I20260709 13:19:51.066978 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:50.994628 24524 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.054641 24516 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:51.054348 24618 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:51.058646 24684 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:51.085572 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:51.089576 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:51.070652 24635 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:51.097807 24588 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:51.098529 24588 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:51.098999 24588 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:51.099105 24524 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:51.100183 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:51.105921 24433 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:51.071919 24616 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:51.107740 24616 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:51.108610 24616 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:51.091581 24618 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:51.111593 24618 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:51.091753 24615 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:51.120314 24708 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:19:51.056169 24568 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.125552 24568 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:51.127283 24520 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.127909 24520 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.131108 24520 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:51.163615 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.193274 24467 tablet_bootstrap.cc:492] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:19:51.199011 24593 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:51.206825 24593 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.208083 24616 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:51.195889 24568 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:51.209553 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 174422us
I20260709 13:19:51.196789 24576 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:51.212888 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 153033us
I20260709 13:19:51.212910 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:51.215006 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:51.217851 18379 raft_consensus.cc:2410] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:19:51.218029 18957 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:19:51.220619 18200 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:51.221493 24646 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:51.221894 24646 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:51.222257 24646 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:51.217352 24684 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:51.226424 24684 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:51.229199 24593 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:51.232539 24568 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:51.234656 24568 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:51.235765 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:51.236636 18378 raft_consensus.cc:2410] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:19:51.238657 24618 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.213286 24616 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:51.241251 24616 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:51.239041 24615 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:51.243664 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:51.249015 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:51.240860 24618 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:51.250155 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 149945us
I20260709 13:19:51.254613 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:51.256327 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.257431 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:51.257833 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:51.260550 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:51.252902 24467 ts_tablet_manager.cc:1403] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 3.469s	user 0.078s	sys 0.043s
W20260709 13:19:51.260927 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47178.4us
I20260709 13:19:51.265707 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:51.262797 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:51.262471 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:51.267633 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:51.258890 24615 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:51.257254 24568 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:51.282629 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:51.261672 24618 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:51.289072 24722 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:51.289338 24684 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:51.290365 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:51.255010 24616 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:19:51.263074 24433 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:51.305133 24516 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:51.305639 24574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46928 (request call id 2) took 6585 ms. Trace:
I20260709 13:19:51.265578 24576 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:51.308439 24588 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.320744 24618 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:51.261545 24650 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:19:51.320101 24722 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:51.354739 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 94724.4us
I20260709 13:19:51.328382 24568 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:51.356140 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:51.330628 24684 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:19:51.359223 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.346212 24520 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:19:51.359005 24692 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.015s	sys 0.007s
I20260709 13:19:51.356678 24722 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:51.369329 24562 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:19:51.397778 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 68735.9us
W20260709 13:19:51.394156 24692 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 1.035s	user 0.018s	sys 0.011s
I20260709 13:19:51.384649 24520 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:51.399806 24390 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:51.373211 24684 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:51.404892 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 138186us
W20260709 13:19:51.405355 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 136235us
I20260709 13:19:51.411319 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:51.402141 24692 tablet_copy_client.cc:323] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.130:34605
I20260709 13:19:51.419777 24684 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:51.412177 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:51.430516 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:51.431628 24720 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:51.432113 24720 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:51.432394 24723 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:19:51.432435 24720 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:51.434763 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:51.438836 24520 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:51.440966 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:51.420038 24646 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:51.400635 24562 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:51.444203 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:51.346550 24574 rpcz_store.cc:276] 0709 13:19:44.697333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.697490 (+   157us) service_pool.cc:224] Handling call
0709 13:19:44.709053 (+ 11563us) log.cc:844] Serialized 513 byte log entry
0709 13:19:44.904024 (+194971us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b1800447580. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:19:44.910689 (+  6665us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b1800447580. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:19:51.282789 (+6372100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16584,"raft.queue_time_us":3393,"raft.run_cpu_time_us":1093,"raft.run_wall_time_us":60492,"spinlock_wait_cycles":22751872,"thread_start_us":82380,"threads_started":1,"wal-append.queue_time_us":161859,"wal-append.run_cpu_time_us":1990,"wal-append.run_wall_time_us":1001993}
I20260709 13:19:51.446560 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:51.447319 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:51.448369 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:51.449437 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:51.450381 18231 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:51.451892 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:51.459826 24588 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:51.460219 18381 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:51.460749 18233 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
I20260709 13:19:51.463908 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:51.467293 24467 raft_consensus.cc:359] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:51.483399 18303 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:51.484192 18379 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:51.484288 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:51.484928 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:51.460796 24646 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:51.472776 24729 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:51.526365 24729 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:51.527603 24729 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.496155 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:51.468482 24467 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:19:51.487906 24615 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.535665 24734 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:51.491583 24732 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:51.555085 24720 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:51.557446 24562 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:51.561606 24732 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:51.560432 24615 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.804744 18386 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:51.805706 24732 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:51.558535 24734 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:51.805984 24615 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:51.807684 24734 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:51.597167 24722 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.809809 24722 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:51.598764 24720 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:51.495491 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:51.785446 24703 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.684s	user 0.005s	sys 0.000s
I20260709 13:19:51.556756 24467 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:51.857604 18312 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:51.873980 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.874821 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.880721 24684 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:51.881395 24684 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.881917 24730 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:51.882656 24730 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:51.884096 24684 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:51.884649 24684 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:51.885368 18202 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.012s	sys 0.007s
I20260709 13:19:51.885226 24684 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:51.885739 18202 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.012s	sys 0.007s
W20260709 13:19:51.886093 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 513302us
I20260709 13:19:51.892134 24576 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.892804 24576 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.888273 24730 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:51.894976 24576 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:51.892069 24729 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:51.901209 24684 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:51.898489 24729 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.908210 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:51.908800 18311 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:51.910133 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:51.910508 18305 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:51.914942 24729 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:51.935075 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:51.941633 24742 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:51.942354 24742 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:51.944008 18383 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.013s	sys 0.027s
W20260709 13:19:51.944412 18383 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.013s	sys 0.027s
I20260709 13:19:51.945153 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 1347) took 1517 ms. Trace:
I20260709 13:19:51.945525 18383 rpcz_store.cc:276] 0709 13:19:50.427912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.431416 (+  3504us) service_pool.cc:224] Handling call
0709 13:19:50.431707 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.432045 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.432069 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:51.127549 (+695480us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b1800399460. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1542a6 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a
0709 13:19:51.421277 (+293728us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b2c0010dcf8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:19:51.441572 (+ 20295us) log.cc:844] Serialized 26 byte log entry
0709 13:19:51.944761 (+503189us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:51.944814 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.944884 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:51.944938 (+    54us) raft_consensus.cc:1685] finished
0709 13:19:51.944951 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:51.945092 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1156,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":8363,"spinlock_wait_cycles":14935168,"thread_start_us":502886,"threads_started":1,"wal-append.queue_time_us":127205}
I20260709 13:19:51.947374 24742 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:51.950896 24684 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:51.951508 24684 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.956722 24707 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:51.957377 24707 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.959878 24707 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:51.965600 24684 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:51.967633 24520 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:51.967937 24742 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:51.968190 24520 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.968470 24742 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:51.970448 24520 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:51.970949 24520 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:51.971369 24520 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:51.973438 24520 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:51.973888 24520 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:51.974272 24520 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.976593 24520 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:51.977512 24742 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:51.980144 24742 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.980614 24742 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:51.981572 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:51.982416 18307 raft_consensus.cc:2368] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16.
I20260709 13:19:51.983816 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:51.984618 18306 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:51.985936 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:51.986702 18303 raft_consensus.cc:2393] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:51.990375 24742 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:51.991015 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 531516us
I20260709 13:19:51.992396 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:51.949452 24729 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:51.999497 24729 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.001880 24729 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:52.010161 24685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.659s	user 0.012s	sys 0.021s
W20260709 13:19:52.010769 24685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.659s	user 0.012s	sys 0.021s
I20260709 13:19:52.014551 18953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54004 (request call id 582) took 1683 ms. Trace:
I20260709 13:19:52.014945 18953 rpcz_store.cc:276] 0709 13:19:50.330870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.331022 (+   152us) service_pool.cc:224] Handling call
0709 13:19:50.331438 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:50.331885 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:50.331923 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:50.332372 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:19:50.563338 (+230966us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:50.563384 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.563456 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:51.784831 (+1221375us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:19:52.014215 (+229384us) raft_consensus.cc:1685] finished
0709 13:19:52.014240 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:52.014465 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31612,"raft.queue_time_us":719,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":18993,"spinlock_wait_cycles":3204352,"thread_start_us":217853,"threads_started":1,"wal-append.queue_time_us":716233}
I20260709 13:19:52.022739 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:52.023510 18310 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:52.028023 24729 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:52.028740 24729 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:52.031505 24729 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:52.032320 24618 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.032886 24618 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.035140 24618 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:52.036684 18310 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:19:52.043005 24722 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.043541 24722 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.045611 24722 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:52.046607 18378 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:19:52.046962 18378 pending_rounds.cc:85] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 8
I20260709 13:19:52.047175 18378 pending_rounds.cc:107] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:19:52.047438 18378 raft_consensus.cc:2889] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.047701 24732 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.048319 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 55996.3us
I20260709 13:19:52.048132 24732 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:52.050109 24732 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:52.050587 24732 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:52.051177 24615 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:52.051565 24615 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.051888 24615 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:52.052145 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.053691 24732 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:52.054428 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:52.054709 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.054922 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:52.055485 18306 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:52.055596 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.056253 18383 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:52.055596 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:52.057430 18303 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:52.059008 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.059490 18385 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:52.060463 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:52.061396 18309 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:19:52.062981 24524 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:52.063398 24524 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:52.064126 24524 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.068089 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:52.068231 24524 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:52.068782 18304 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:52.073086 24615 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.079137 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.079731 18385 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:52.082217 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.082922 18385 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:52.086171 24635 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:52.089885 18306 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:19:52.087752 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:52.092336 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.077641 24732 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:52.096464 24635 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.075064 24615 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:52.100847 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.101572 18386 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 21: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:52.102349 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.102887 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.103118 18381 raft_consensus.cc:2410] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:19:52.097024 24722 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:52.103433 18384 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:19:52.100224 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.104259 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.104882 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.105316 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.105535 18378 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:52.099233 24635 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:52.115599 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.114660 18276 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:52.119004 24492 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:52.116165 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:52.120846 18276 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:52.122265 18351 leader_election.cc:400] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16.
I20260709 13:19:52.123482 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:52.125785 24742 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:52.126227 24742 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:52.126595 24742 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:52.121977 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:52.129707 24732 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:52.120234 24707 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:52.129079 24568 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:52.137677 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:52.138345 18276 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:52.140275 24516 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:52.140699 24516 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:52.140825 24729 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:52.141125 24516 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:52.141327 24729 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.141827 24729 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:52.146226 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:52.146835 18308 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:52.146971 24568 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:52.148574 24568 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:52.149755 24667 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:52.150290 24667 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:52.151404 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 275805us
I20260709 13:19:52.152606 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:52.153672 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:52.136157 24635 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.157045 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 269848us
I20260709 13:19:52.158871 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:52.157550 24374 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:52.159933 24374 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:52.160490 24667 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:52.161164 24635 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.162186 24374 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:52.157723 24456 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:52.162971 24456 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:52.163396 24456 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:52.154915 18276 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:52.164619 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:52.139024 24707 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:52.139348 24732 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.167486 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:52.166680 24473 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:19:52.169832 24618 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:52.170063 24635 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:52.170327 24618 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:52.170746 24618 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:52.172680 24520 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.173190 24520 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.175524 24520 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:52.157094 24615 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:52.176957 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:52.177938 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.176697 24593 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:52.169312 24707 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:52.183617 24593 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.185412 24593 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:52.187157 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.169092 24732 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:52.165467 24722 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:52.188491 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.189332 18233 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:52.190301 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:52.191882 18228 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:19:52.178578 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:52.176774 24456 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:52.193189 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.193907 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:52.179718 24615 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:52.197299 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:52.200893 18306 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:52.199581 18231 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:19:52.196326 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:52.195510 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:52.202091 18312 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:52.202333 18308 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 8.
I20260709 13:19:52.169042 24588 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:52.204329 18228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:52.204967 18228 raft_consensus.cc:606] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:52.205737 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:52.206216 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.206385 18304 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:52.210186 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.210556 18385 raft_consensus.cc:2410] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:19:52.208956 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:52.211871 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:52.212920 18234 raft_consensus.cc:2410] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:19:52.212806 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:52.195123 24635 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:52.182313 24427 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:52.200809 24667 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:52.227636 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:52.205483 24722 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:52.233143 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:52.234005 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.234640 24646 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:52.237774 24427 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.238703 24615 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.238987 24473 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:52.239172 24390 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:52.240494 24520 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:52.216579 24492 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:52.244935 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.245590 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.247072 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.269199 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.248026 24737 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:52.248546 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.247782 18234 raft_consensus.cc:2955] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:52.203742 24588 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.253074 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.256233 18312 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:19:52.256429 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.256878 18202 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:52.251551 24439 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.217549 24525 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:52.219784 24512 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:52.284710 24588 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:52.269995 18232 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:52.292104 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.271620 24593 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.254503 24635 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:52.295462 24593 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:52.295147 24635 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.291215 24512 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.300002 24512 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:52.254240 24684 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:52.302297 24456 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:52.302453 24684 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:52.304208 24439 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.307595 24427 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:52.288772 24525 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:52.313200 24525 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:52.315495 24512 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.267086 24524 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:52.325428 24524 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:52.326589 24524 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.254982 24722 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:52.328860 24722 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:52.329963 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:52.330678 18378 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:52.330950 18385 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:52.284085 24473 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:52.268680 24492 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:52.336042 24492 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:52.289386 24520 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:52.322609 24390 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:52.340054 24390 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:52.340472 24730 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:52.341161 24390 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.342805 24390 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:52.323520 24737 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:52.344370 24737 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:52.345485 24737 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.346941 24737 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:52.349341 24427 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:52.349989 24427 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:52.351023 24427 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.286664 18231 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:52.368652 24718 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:52.369510 24718 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.373739 18309 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:52.374064 18304 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:19:52.378808 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:52.380951 24616 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:52.381598 24616 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:19:52.382675 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 852015us
I20260709 13:19:52.385673 24616 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.387373 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:52.387648 24740 consensus_queue.cc:1059] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:52.388224 18959 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:19:52.390053 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:52.391047 18957 raft_consensus.cc:2368] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13.
I20260709 13:19:52.392128 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:19:52.406724 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 149958us
I20260709 13:19:52.412570 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:52.420280 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:52.422538 18130 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 120) took 4074 ms. Trace:
I20260709 13:19:52.430567 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.431129 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:19:52.431969 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.422895 18130 rpcz_store.cc:276] 0709 13:19:48.348337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.348618 (+   281us) service_pool.cc:224] Handling call
0709 13:19:52.422477 (+4073859us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:50.311383 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:50.349131 (+ 37748us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:50.349173 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:19:50.349192 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:50.349651 (+   459us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:50.349720 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:50.349755 (+    35us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:19:50.350115 (+   360us) tablet.cc:701] Row locks acquired
0709 13:19:50.350135 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:19:50.350298 (+   163us) write_op.cc:270] Start()
0709 13:19:50.350422 (+   124us) write_op.cc:276] Timestamp: P: 1783603190350240 usec, L: 0
0709 13:19:50.350456 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:19:50.351223 (+   767us) log.cc:844] Serialized 921 byte log entry
0709 13:19:51.949041 (+1597818us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa17f1690ac 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b
0709 13:19:52.132176 (+183135us) op_driver.cc:464] REPLICATION: finished
0709 13:19:52.232374 (+100198us) write_op.cc:301] APPLY: starting
0709 13:19:52.232469 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:52.234297 (+  1828us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:52.234321 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:52.235572 (+  1251us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:52.235783 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:19:52.235829 (+    46us) write_op.cc:312] APPLY: finished
0709 13:19:52.236051 (+   222us) log.cc:844] Serialized 33 byte log entry
0709 13:19:52.254572 (+ 18521us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:52.266298 (+ 11726us) write_op.cc:454] Released schema lock
0709 13:19:52.267014 (+   716us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:52.301716 (+ 34702us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:52.301757 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":225481,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":94487,"apply.run_cpu_time_us":4686,"apply.run_wall_time_us":69317,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12471,"num_ops":2,"prepare.queue_time_us":435847,"prepare.run_cpu_time_us":36794,"prepare.run_wall_time_us":1743005,"raft.queue_time_us":96776,"raft.run_cpu_time_us":13323,"raft.run_wall_time_us":34911,"replication_time_us":1781541,"spinlock_wait_cycles":109545856,"thread_start_us":2021378,"threads_started":4,"wal-append.queue_time_us":1656061}]]}
I20260709 13:19:52.440061 18135 catalog_manager.cc:5697] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 17 to 18, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 18 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.442176 18349 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:52.419555 18385 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
W20260709 13:19:52.444476 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 203044us
I20260709 13:19:52.445762 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:52.448279 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.442190 18135 catalog_manager.cc:5697] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:52.452466 18135 catalog_manager.cc:5697] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 19 to 21, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 21 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:19:52.450706 18201 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:52.455005 18349 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:52.455210 18135 catalog_manager.cc:5697] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 13 to 15, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 15 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.296082 24732 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.457230 18135 catalog_manager.cc:5697] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 15 to 17, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 17 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.459460 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:52.461978 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:19:52.463454 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 322055us
I20260709 13:19:52.468206 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.471112 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:52.472158 18135 catalog_manager.cc:5697] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 18 to 20, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 20 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.473881 18135 catalog_manager.cc:5697] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 13 to 15, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 15 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.475602 18135 catalog_manager.cc:5697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:52.477711 18135 catalog_manager.cc:5697] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:52.481244 18135 catalog_manager.cc:5697] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 14 to 16, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 16 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.482118 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:52.483966 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.404163 24707 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.475090 24635 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:52.493858 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:52.467157 24439 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:52.466651 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:52.501652 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:52.503542 18378 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:19:52.512288 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:52.513331 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 51446.6us
I20260709 13:19:52.514101 18275 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:52.514475 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:52.480871 24380 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:52.482896 18135 catalog_manager.cc:5697] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 18 to 19, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 19 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:52.472539 24374 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:52.509337 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.509611 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:52.520778 24374 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:52.521314 24374 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:52.524477 24646 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:52.524821 24574 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:52.524976 24646 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:52.525408 24646 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:52.526954 24520 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:52.527609 24473 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:52.528002 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54546.8us
I20260709 13:19:52.528752 24473 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:52.530758 24707 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:52.500903 24729 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.532233 24684 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:52.532538 18306 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:52.533506 24729 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:52.534330 24732 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:52.534943 24732 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:52.531630 24718 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:52.536912 18380 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:52.524256 24467 ts_tablet_manager.cc:1434] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 1.256s	user 0.005s	sys 0.014s
I20260709 13:19:52.544590 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:52.557346 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.454381 24742 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:52.536084 24516 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:52.830942 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 316522us
W20260709 13:19:52.831038 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 376108us
I20260709 13:19:52.831634 18383 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:19:52.593493 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:52.610692 18304 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:52.569801 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:52.638688 18230 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:52.831758 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.598639 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.809288 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.590777 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:52.588075 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.835881 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:52.836920 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 322890us
I20260709 13:19:52.537387 24380 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.841666 24380 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:52.842161 24730 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.832970 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.842828 24751 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:52.842726 24730 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.844379 24427 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:52.844815 18275 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:52.845082 24427 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:52.845731 24576 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:52.846153 24730 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:52.847008 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.837728 18378 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:19:52.593036 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:52.593855 18377 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:52.567709 18228 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:19:52.855204 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:52.856027 18307 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:52.847613 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:52.835978 18231 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:52.638093 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 120664us
I20260709 13:19:52.869320 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:52.868714 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:52.853163 18135 catalog_manager.cc:5697] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 15 to 17, now has a pending config: VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129), VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130), VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131), NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 17 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:19:52.516669 24512 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:52.871963 18275 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:52.536557 24439 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:52.597287 18166 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2cc0 after lost signal to thread 17141
W20260709 13:19:52.893602 18166 debug-util.cc:398] Leaking SignalData structure 0x7b0800303500 after lost signal to thread 18169
W20260709 13:19:52.895336 18166 debug-util.cc:398] Leaking SignalData structure 0x7b0800034980 after lost signal to thread 18261
I20260709 13:19:52.786738 24684 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.591039 24473 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:52.590853 24701 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:52.914951 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 522254us
W20260709 13:19:52.833854 24467 ts_tablet_manager.cc:1467] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: Tablet startup took 1569ms
I20260709 13:19:52.916865 18307 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:19:52.901547 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:52.910873 24699 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:52.626034 24588 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.888990 24707 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:52.846854 24377 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:52.882215 24576 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:52.861310 24730 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.611770 24568 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:52.867065 24626 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:19:52.900297 24621 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:52.609181 24618 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.084688 24621 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.086357 24618 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.088053 24621 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:52.957365 24473 raft_consensus.cc:697] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:52.892203 24439 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:52.901465 24740 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.007s	sys 0.036s
I20260709 13:19:52.979099 24709 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:53.055625 24492 consensus_meta.cc:287] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.719s	user 0.013s	sys 0.009s
I20260709 13:19:52.915655 24684 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.083465 24730 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.044278 24757 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:53.095288 24588 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:53.101167 24646 consensus_meta.cc:287] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.575s	user 0.012s	sys 0.000s
W20260709 13:19:53.119414 24525 consensus_meta.cc:287] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.806s	user 0.010s	sys 0.001s
I20260709 13:19:52.960836 24699 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.104568 24742 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.098726 24626 consensus_queue.cc:1243] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer 8b4fbc44aa2649f0bcac5cd70f71951d log is divergent from this leader: its last log entry 21.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:19:52.923907 24701 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:53.125888 24763 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:19:53.163395 24699 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:53.163702 24684 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.163434 24701 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.155383 24709 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.053472 24766 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:53.165740 24766 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.167250 24709 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.168562 24766 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:53.151615 24737 consensus_meta.cc:287] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.003s
I20260709 13:19:53.169839 24730 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:53.172363 24722 consensus_meta.cc:287] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.843s	user 0.009s	sys 0.005s
I20260709 13:19:53.173288 24722 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:53.152696 24740 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.008s	sys 0.044s
W20260709 13:19:53.111294 24765 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:19:53.160488 24646 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:53.132879 24761 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:19:53.174363 24667 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:53.177289 24646 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.179788 24722 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:52.899328 18166 debug-util.cc:398] Leaking SignalData structure 0x7b08001aba40 after lost signal to thread 18336
W20260709 13:19:53.213742 18166 debug-util.cc:398] Leaking SignalData structure 0x7b08001abaa0 after lost signal to thread 18337
W20260709 13:19:53.216703 18166 debug-util.cc:398] Leaking SignalData structure 0x7b08003901e0 after lost signal to thread 18410
W20260709 13:19:53.220302 18166 debug-util.cc:398] Leaking SignalData structure 0x7b080016c280 after lost signal to thread 18986
W20260709 13:19:53.241664 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 372177us
I20260709 13:19:53.244108 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:53.249055 18202 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:52.922320 18236 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:53.283049 18379 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:52.956540 18231 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:19:53.254751 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:52.920188 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:53.288585 18306 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:52.922538 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:53.293583 18307 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:52.918720 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:53.295948 18384 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:53.296382 18308 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:53.279287 18277 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:52.613329 18322 tablet_copy_service.cc:140] P 459e82ee6b564cc19be6f73186938e79: Received BeginTabletCopySession request for tablet b6e6be0c25704f45b1b4f3c4f246fa02 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46642)
I20260709 13:19:52.900727 24427 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.305572 24626 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:53.307984 24427 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:53.097432 24516 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.314316 24516 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:53.315402 24516 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.105293 24568 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:53.147604 24576 raft_consensus.cc:697] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:53.318470 24576 consensus_queue.cc:237] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.156750 24492 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.322173 18386 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:53.303198 24525 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.323678 24492 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:53.323616 24684 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:53.324864 24525 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:53.326157 18383 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:53.309321 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 60668.8us
I20260709 13:19:53.324990 24684 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.320402 18307 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:53.330097 24684 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.331629 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:53.333819 18962 raft_consensus.cc:1217] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 13:19:53.333992 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:53.299803 18322 tablet_copy_service.cc:161] P 459e82ee6b564cc19be6f73186938e79: Beginning new tablet copy session on tablet b6e6be0c25704f45b1b4f3c4f246fa02 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46642: session id = e016302b7e734d74833a2bf7bab44838-b6e6be0c25704f45b1b4f3c4f246fa02
W20260709 13:19:53.326437 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47696.6us
I20260709 13:19:53.360669 24730 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:53.152812 24439 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.380788 24737 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:53.382081 24737 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:52.920469 24467 ts_tablet_manager.cc:1469] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: Trace:
0709 13:19:44.443138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.447518 (+  4380us) service_pool.cc:224] Handling call
0709 13:19:44.785672 (+338154us) ts_tablet_manager.cc:934] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
0709 13:19:45.461191 (+675519us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:19:46.017062 (+555871us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:46.017229 (+   167us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:19:46.166863 (+149634us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:19:46.321248 (+154385us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:46.450278 (+129030us) ts_tablet_manager.cc:989] Replica registered.
0709 13:19:46.456767 (+  6489us) inbound_call.cc:177] Queueing success response
0709 13:19:47.784094 (+1327327us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:19:51.277323 (+3493229us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:19:51.420178 (+142855us) tablet_replica.cc:261] Starting instrumentation
0709 13:19:51.423735 (+  3557us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":26721,"mutex_wait_us":627155,"raft.queue_time_us":604885,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":16337,"tablet-copy.queue_time_us":285827,"tablet-download-pool.queue_time_us":20474,"tablet-download-pool.run_cpu_time_us":1515,"tablet-download-pool.run_wall_time_us":433144,"thread_start_us":289377,"threads_started":2}
I20260709 13:19:53.392767 24516 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.393427 24646 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.394172 24646 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:53.397012 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 525667us
I20260709 13:19:53.399137 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:53.406810 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:53.407172 24516 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:53.409911 18277 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:53.411015 24524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.010s	sys 0.006s
I20260709 13:19:53.410952 24516 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:53.401091 18236 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:19:53.412201 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:53.412838 24750 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:53.146524 24377 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.418080 24377 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.420070 18306 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:53.420291 24737 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:53.421236 24473 consensus_queue.cc:237] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.425741 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:19:53.423813 24524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.010s	sys 0.006s
I20260709 13:19:53.430495 24646 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:53.431583 24737 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:53.434333 24377 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:19:53.401567 24374 consensus_meta.cc:287] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.880s	user 0.008s	sys 0.011s
I20260709 13:19:53.453833 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.467387 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.468644 18381 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 5.
I20260709 13:19:53.469478 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:53.470713 18382 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 20: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:53.471992 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:53.473081 18378 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 17: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:53.474488 24512 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.475431 24512 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.477316 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:53.478245 24588 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:53.478942 24588 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.480214 24737 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.480999 24615 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:53.482092 24615 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.483275 24737 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.490125 24593 raft_consensus.cc:3055] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:53.495573 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.496740 18384 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:53.479735 24377 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.492174 24593 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:53.502703 24377 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.508916 24615 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:53.511894 24593 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.515364 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:53.532548 24771 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.478s	user 0.000s	sys 0.004s
I20260709 13:19:53.533618 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:53.534018 24701 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:53.535555 24699 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:53.525606 24512 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:53.538736 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:53.541277 24593 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.542491 24439 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.543241 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2923) took 1310 ms. Trace:
W20260709 13:19:53.544881 24380 consensus_meta.cc:287] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.012s
I20260709 13:19:53.545482 24380 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.554158 24751 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:53.554737 24751 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:53.556070 24751 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.558398 24751 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:53.559280 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:53.561367 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 3943) took 1029 ms. Trace:
I20260709 13:19:53.561626 24588 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:53.494848 24374 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.573117 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:53.576735 24439 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:53.543684 18234 rpcz_store.cc:276] 0709 13:19:52.232537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.246966 (+ 14429us) service_pool.cc:224] Handling call
0709 13:19:52.247361 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.247632 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:52.415952 (+168320us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.541551 (+1125599us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b1800402220. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa185c6b3c7 00007fa18227d9a7 00007fa18228d0bf 00007fa18228d038
0709 13:19:53.542023 (+   472us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.542441 (+   418us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:53.542539 (+    98us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:53.542673 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.542828 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.543008 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97893,"prepare.queue_time_us":739997,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":24961,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":24028,"spinlock_wait_cycles":7669504,"thread_start_us":356894,"threads_started":1,"wal-append.queue_time_us":539613}
I20260709 13:19:53.579341 18386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 3948) took 1045 ms. Trace:
I20260709 13:19:53.584896 18386 rpcz_store.cc:276] 0709 13:19:52.533886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.536713 (+  2827us) service_pool.cc:224] Handling call
0709 13:19:52.850183 (+313470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.322641 (+472458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.578927 (+256286us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b5400276d54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:53.579267 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084180352}
I20260709 13:19:53.584219 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:53.588346 24701 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:53.589300 24701 raft_consensus.cc:697] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:53.590798 24701 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:53.592873 24390 consensus_meta.cc:287] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.249s	user 0.018s	sys 0.006s
I20260709 13:19:53.594094 18229 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:19:53.597638 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 2943) took 1108 ms. Trace:
I20260709 13:19:53.598174 18229 rpcz_store.cc:276] 0709 13:19:52.489729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.489850 (+   121us) service_pool.cc:224] Handling call
0709 13:19:53.597318 (+1107468us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540001aed4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:53.597539 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2472056576}
I20260709 13:19:53.602341 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:53.603456 18386 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:53.604552 24696 consensus_queue.cc:1059] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:53.612933 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.613461 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.613900 18383 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:19:53.614398 18378 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:19:53.612898 18322 tablet_copy_source_session.cc:215] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:53.616354 18322 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:46642 (request call id 1515) took 1098 ms. Trace:
I20260709 13:19:53.591720 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:53.619500 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.561844 18379 rpcz_store.cc:276] 0709 13:19:52.532310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.535204 (+  2894us) service_pool.cc:224] Handling call
0709 13:19:52.535472 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.284089 (+748617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.561077 (+276988us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b540004c4d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:53.561300 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1717085056}
I20260709 13:19:53.627272 18384 raft_consensus.cc:2410] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:19:53.629285 24696 raft_consensus.cc:3055] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:53.633857 24696 raft_consensus.cc:740] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:19:53.642745 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 151147us
I20260709 13:19:53.625450 18322 rpcz_store.cc:276] 0709 13:19:52.594116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.611949 (+ 17833us) service_pool.cc:224] Handling call
0709 13:19:53.616156 (+1004207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:53.645998 18927 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:53.651654 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.653374 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:53.654901 24667 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.654994 24627 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:53.655555 24627 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:53.656052 24627 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.655608 24667 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.641923 24588 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:53.657042 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.659694 24783 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:53.649729 24501 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.664598 24699 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:53.663437 24374 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.665079 24501 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.666299 24667 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.662437 24783 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.664000 24439 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:53.663412 24588 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.668452 24783 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:53.668583 24501 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.669193 24588 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:53.673692 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:53.674556 18384 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:53.674945 24576 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:53.675810 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:53.680480 24615 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:53.681382 24615 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.680675 24512 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:53.682441 24512 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.683204 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:53.683648 24615 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:53.684588 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.684402 24512 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:53.687038 24782 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:53.687469 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:53.687726 24782 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.688681 24512 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:53.689363 24512 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.689857 18200 leader_election.cc:400] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13.
I20260709 13:19:53.690122 24782 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:53.691625 24512 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:53.693496 24390 raft_consensus.cc:993] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:19:53.694511 24377 raft_consensus.cc:1081] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:19:53.694237 24473 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:53.696884 24473 raft_consensus.cc:3055] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:53.697243 24380 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.697345 24473 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:53.699743 18379 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 17: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:53.700134 18384 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:19:53.699640 24473 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.701776 24473 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:53.703837 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64563.9us
I20260709 13:19:53.656495 24696 consensus_queue.cc:260] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.706185 24696 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.706911 24439 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.690254 18200 leader_election.cc:403] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:19:53.721918 24439 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:53.710816 18386 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:53.713327 24627 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.714008 18927 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:53.715912 24576 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:53.717115 24684 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:53.717540 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:53.717829 24516 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:53.715930 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:53.728981 24684 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.730105 24627 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:53.730901 24516 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.731544 24684 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.732396 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:53.733220 24516 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.733547 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:53.736949 24730 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:53.737555 24730 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:53.738096 24730 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:53.736420 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:53.741851 24709 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:53.742806 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:53.744630 24766 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:53.745119 24766 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:53.745536 24766 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:53.745852 24692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e6be0c25704f45b1b4f3c4f246fa02. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:53.746953 18349 consensus_peers.cc:597] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35ee2a6512e24d10af3526398de71490. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:53.749430 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:19:53.749526 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 60080.2us
I20260709 13:19:53.749764 24374 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 12. Current term is 13.
I20260709 13:19:53.753499 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:53.756593 24374 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:53.756726 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.757328 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:53.757875 18380 raft_consensus.cc:2410] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:19:53.757548 24374 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.759717 24742 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:53.761139 24374 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:53.761610 24516 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:53.752002 24627 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:53.762866 24627 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.755105 18200 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:53.764736 18959 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:19:53.776124 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:53.776814 18246 tablet_copy_service.cc:342] P b52e2477fc524694967c4a16afa983e3: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-23d48585586a4bb3bc800da7f54e12f0 received from {username='slave'} at 127.0.0.1:46128
I20260709 13:19:53.777083 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:53.780128 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:53.781312 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:53.783202 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:53.799933 18246 tablet_copy_service.cc:434] P b52e2477fc524694967c4a16afa983e3: ending tablet copy session e016302b7e734d74833a2bf7bab44838-23d48585586a4bb3bc800da7f54e12f0 on tablet 23d48585586a4bb3bc800da7f54e12f0 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:19:53.800115 24766 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.802012 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:53.795259 18349 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:53.806226 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.806195 18233 raft_consensus.cc:2376] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13. Re-sending same reply.
I20260709 13:19:53.811046 24588 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:53.814663 24588 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:53.814747 18276 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:53.815279 24588 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.809121 24684 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:53.815961 24684 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:53.816325 18276 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:19:53.813208 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54128.1us
W20260709 13:19:53.820230 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 65222.5us
I20260709 13:19:53.816370 24684 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:53.808712 24377 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:53.805775 24439 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:53.826056 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:53.822772 24516 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:53.838763 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.842067 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.844406 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.845510 24516 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:53.846014 24516 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.848714 18312 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:19:53.832998 24766 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:53.859726 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.860491 18386 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:53.862709 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:53.863628 18384 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:53.835369 24576 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:19:53.865515 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.866505 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:53.867338 18229 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:53.868045 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:53.868973 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:53.869635 18234 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:53.879362 24790 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:53.885010 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:53.836354 24439 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.881373 24576 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.891695 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:53.895247 18959 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:53.895491 18229 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:53.905123 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:19:53.906497 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 80215us
I20260709 13:19:53.913647 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:53.916625 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:53.918494 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:53.919802 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:53.919946 18234 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:19:53.921013 24783 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:53.921358 24588 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.924217 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:53.924757 18383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46844
I20260709 13:19:53.924934 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.925199 18379 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:53.925467 18383 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:53.925889 18383 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.926047 18382 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:19:53.926465 18382 pending_rounds.cc:85] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 10
I20260709 13:19:53.926708 18382 pending_rounds.cc:107] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:19:53.927023 18382 raft_consensus.cc:2889] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:53.929844 24588 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:53.930903 24766 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:53.938024 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:19:53.932562 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.932605 24439 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:53.933825 24627 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:53.957471 18377 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:53.958461 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.957481 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:53.958997 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:53.959420 18382 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:53.961222 18230 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:19:53.963456 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:53.936687 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:53.925132 18385 raft_consensus.cc:2393] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:53.964748 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:53.965117 18233 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:53.926169 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:53.965581 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:53.964711 24730 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.967877 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:53.968130 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:53.946482 18386 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:53.931430 24684 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:53.949993 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:53.969048 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:53.969714 24730 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:53.969856 18228 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:53.950830 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:53.953998 24516 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.956679 24766 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:53.895804 24576 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:53.964872 18959 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:53.982730 18232 raft_consensus.cc:2393] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:53.942368 18384 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
W20260709 13:19:53.976728 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 68536.8us
I20260709 13:19:53.976819 18382 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:53.903498 24790 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:19:53.995543 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 92732.5us
I20260709 13:19:54.011273 18311 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:54.014588 18384 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:54.015545 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:54.014542 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:54.017232 18386 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:54.026567 18235 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:54.029367 18311 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:54.033221 18384 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:54.069648 24766 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:54.071751 24766 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:54.073076 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:54.074172 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:54.076187 18385 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:54.076254 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:54.078227 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:54.079466 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:54.080195 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:54.080590 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:54.081651 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:54.082556 18233 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:19:54.082978 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:54.083442 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:54.084805 24795 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:54.085289 24795 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:54.085708 24795 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:54.086663 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:54.086967 24790 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:54.081481 18231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:54.088464 18231 raft_consensus.cc:606] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:54.088786 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:54.117835 18311 raft_consensus.cc:1240] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:54.118309 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:54.117875 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:54.119944 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:54.120684 24798 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:54.123577 18959 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:54.125671 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:54.126758 18349 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:54.127764 18386 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:19:54.130139 18384 raft_consensus.cc:1240] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:54.111251 18383 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:54.135493 18378 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:54.121129 24798 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:54.144063 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:54.144240 18957 raft_consensus.cc:1240] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:54.149333 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:54.150303 18383 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:54.151392 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:54.150386 18236 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:19:54.156306 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:54.157783 18231 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:19:54.136271 24439 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:54.134979 24516 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:54.165803 24439 raft_consensus.cc:697] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:19:54.166110 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 46287.2us
I20260709 13:19:54.168910 18377 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:54.148818 24798 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.154150 24667 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:54.185626 24524 consensus_queue.cc:1059] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:54.186995 24524 raft_consensus.cc:3055] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:54.187330 24524 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:54.192981 24621 consensus_queue.cc:1059] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:19:54.193998 24621 consensus_queue.cc:1059] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:54.170450 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:54.199533 18237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:19:54.206848 24751 consensus_queue.cc:1059] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:54.208312 24751 raft_consensus.cc:3055] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:54.135319 24709 consensus_queue.cc:1059] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:19:54.212590 24751 raft_consensus.cc:740] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:54.220072 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:54.174213 24799 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:54.254263 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 225652us
I20260709 13:19:54.182595 24380 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:19:54.227028 24621 raft_consensus.cc:3055] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:19:54.255944 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 186306us
I20260709 13:19:54.224886 24684 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:54.188249 24524 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:54.217849 24709 consensus_queue.cc:1059] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:19:54.257431 24696 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:54.259467 24742 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:54.226253 24667 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:54.300450 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:19:54.304055 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 90197.6us
I20260709 13:19:54.266343 24621 raft_consensus.cc:740] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:54.310300 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:19:54.305912 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 151626us
I20260709 13:19:54.305179 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:54.296247 24696 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:54.312444 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:54.327061 18233 raft_consensus.cc:3055] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:54.295511 24627 consensus_queue.cc:1059] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:19:54.315044 24524 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:54.315937 24783 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.318419 24667 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:54.320286 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:54.320760 24467 ts_tablet_manager.cc:933] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:54.327490 18233 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:54.332250 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:54.306876 24799 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:19:54.328035 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 169534us
W20260709 13:19:54.339350 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.323457 24701 raft_consensus.cc:3055] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:54.302414 24684 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:19:54.342975 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:54.352797 24804 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:54.326921 24377 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:54.346007 24696 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:54.328985 24803 raft_consensus.cc:3055] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:54.286955 24439 consensus_queue.cc:237] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:54.341853 24692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54020 (request call id 471) took 4240 ms. Trace:
I20260709 13:19:54.342346 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:54.349905 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:54.357844 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:54.348169 24576 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:54.352115 24791 consensus_queue.cc:1059] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:19:54.343914 24701 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:54.359386 24742 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:54.377674 18233 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:54.358381 24799 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:54.384285 18233 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:54.384797 24799 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:54.381464 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 50443.8us
I20260709 13:19:54.364385 24803 raft_consensus.cc:740] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:54.339062 24783 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:54.377976 24615 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:54.356503 24751 consensus_queue.cc:260] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:54.437134 24701 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:54.438751 24701 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:19:54.444140 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 116468us
W20260709 13:19:54.444880 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 95161.9us
I20260709 13:19:54.419765 24804 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:54.446322 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:54.448804 24576 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:54.448829 24588 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:54.445179 24803 consensus_queue.cc:260] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:54.423540 24742 raft_consensus.cc:697] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:54.473165 24803 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:54.483191 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 108538us
I20260709 13:19:54.486279 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:54.487033 18382 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:54.480089 24696 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:54.482151 24576 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:54.496340 18926 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:54.510402 24822 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:54.511896 18310 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:54.484337 24473 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:54.513788 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:54.519399 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:54.440267 24621 consensus_queue.cc:260] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:54.491122 24804 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:19:54.532795 18382 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:54.541002 24473 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:54.536231 24576 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:54.542294 24467 tablet_copy_client.cc:323] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.131:44265
I20260709 13:19:54.543819 24473 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:54.546356 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 62873.4us
I20260709 13:19:54.492027 24795 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:54.538885 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:54.551033 24667 raft_consensus.cc:3055] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:54.531452 24751 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:54.525388 24817 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:54.556033 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 59857.3us
W20260709 13:19:54.558105 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 73860.6us
I20260709 13:19:54.551651 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:54.539459 24796 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:54.564958 18926 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:54.543828 24576 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:54.537971 24627 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:54.571792 18957 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:54.573077 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:54.551054 24684 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:54.555532 24667 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:54.578068 24822 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:54.579761 18277 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:54.551417 24439 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
W20260709 13:19:54.587757 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.574856 24615 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:19:54.374828 24692 rpcz_store.cc:276] 0709 13:19:50.098770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.099018 (+   248us) service_pool.cc:224] Handling call
0709 13:19:50.357829 (+258811us) ts_tablet_manager.cc:934] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
0709 13:19:51.308982 (+951153us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa17f1690ac 00007fa187fc3ab9 00007fa17f18569b 00007fa17f182caa 00007fa17f182bd2 00007fa1871e7131
0709 13:19:53.743889 (+2434907us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:19:53.887062 (+143173us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:53.892365 (+  5303us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:19:54.181811 (+289446us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:19:54.228107 (+ 46296us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:54.298703 (+ 70596us) ts_tablet_manager.cc:989] Replica registered.
0709 13:19:54.338833 (+ 40130us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":1769,"spinlock_wait_cycles":71618432,"tablet-copy.queue_time_us":257842,"thread_start_us":1173008,"threads_started":2}
I20260709 13:19:54.572415 24820 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:54.615181 24817 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:54.616221 24627 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:54.618330 24783 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:54.617018 24798 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:54.598879 24684 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:54.619576 24667 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:54.619724 24684 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:54.620501 24798 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:54.621070 24667 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:54.623420 24473 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:54.624557 24473 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:54.625387 24377 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:54.625788 24377 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:54.626739 24377 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:54.597834 24811 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.134s	user 0.000s	sys 0.003s
I20260709 13:19:54.548267 24742 consensus_queue.cc:237] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:54.627876 24377 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:54.531036 24791 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:19:54.570335 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:19:54.610029 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 45176.9us
I20260709 13:19:54.612723 24692 tablet_copy_client.cc:806] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:54.629935 18926 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:54.632300 18233 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:54.633518 18237 raft_consensus.cc:606] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:54.633927 18237 raft_consensus.cc:614] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:54.604192 24374 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:19:54.637288 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 67047.5us
I20260709 13:19:54.598791 24826 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:54.642004 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:54.638962 24374 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:54.644284 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:54.644743 24374 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:54.647754 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 76079.1us
W20260709 13:19:54.648082 24812 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.195s	user 0.001s	sys 0.001s
I20260709 13:19:54.648991 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:54.650578 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:54.652129 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:54.652855 24813 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.199s	user 0.000s	sys 0.003s
I20260709 13:19:54.657974 24792 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:54.700305 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 58376.5us
W20260709 13:19:54.700661 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 139120us
I20260709 13:19:54.661635 24621 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:54.663281 24814 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.211s	user 0.000s	sys 0.002s
I20260709 13:19:54.643643 24809 raft_consensus.cc:3055] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:54.643626 24692 tablet_copy_client.cc:670] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:54.639097 24796 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:54.665849 24576 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:19:54.666050 24826 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:54.642285 24783 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:54.667899 24374 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:54.672295 24822 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:54.676483 18237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
W20260709 13:19:54.678164 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.820681 18237 raft_consensus.cc:606] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:19:54.821341 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.680382 24709 consensus_queue.cc:1059] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:54.682747 18396 tablet_copy_service.cc:140] P 8b4fbc44aa2649f0bcac5cd70f71951d: Received BeginTabletCopySession request for tablet 35ee2a6512e24d10af3526398de71490 from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:43098)
I20260709 13:19:54.691452 18130 catalog_manager.cc:5697] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 9 to 11, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 11 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:54.694000 24817 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:54.696192 18310 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:54.699649 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.825449 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.778993 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 43631.7us
I20260709 13:19:54.716202 24588 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:54.826519 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:54.827638 24439 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:54.804695 24826 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:54.800165 18133 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39284 (request call id 213) took 4549 ms. Trace:
I20260709 13:19:54.805579 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:54.716502 24809 raft_consensus.cc:740] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:19:54.742357 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 90314.3us
I20260709 13:19:54.821605 18303 raft_consensus.cc:1240] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:54.719112 24615 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:19:54.816819 24783 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:54.826598 24588 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:19:54.797436 24805 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:54.726174 24820 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.109s
I20260709 13:19:54.794430 24667 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:54.811142 24795 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:54.837433 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:54.776875 24790 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:54.828840 18133 rpcz_store.cc:276] 0709 13:19:50.251036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.251569 (+   533us) service_pool.cc:224] Handling call
0709 13:19:52.372021 (+2120452us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54002ae254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dd090 00007fa18227bf3a 00007fa1880321cc 00007fa18813037e 00007fa1865f12a4 00007fa1865f1232 00007fa1865f1161 00007fa1865f10dc 00007fa1865f0392 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:54.799851 (+2427830us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8488,"reported_tablets":13,"spinlock_wait_cycles":1718182144}
I20260709 13:19:54.841550 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:54.844085 18130 catalog_manager.cc:5697] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 8 to 9, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 9 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:54.829077 18311 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:54.868141 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.876832 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 156369us
I20260709 13:19:54.837230 18396 tablet_copy_service.cc:161] P 8b4fbc44aa2649f0bcac5cd70f71951d: Beginning new tablet copy session on tablet 35ee2a6512e24d10af3526398de71490 from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:43098: session id = e016302b7e734d74833a2bf7bab44838-35ee2a6512e24d10af3526398de71490
I20260709 13:19:54.839792 24783 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:54.880604 24696 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:54.899569 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 58148.9us
I20260709 13:19:54.894003 24439 raft_consensus.cc:697] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:54.899689 18201 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:54.896773 24588 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:54.912705 24615 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.903115 24809 consensus_queue.cc:260] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:54.913426 24615 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:54.914378 24809 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:54.915798 24615 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:54.899226 24766 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:54.920674 24766 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:54.921655 24766 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:54.918481 18277 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:54.926276 18277 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:54.927731 24516 raft_consensus.cc:2764] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:19:54.931382 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:54.939436 24516 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:54.940068 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:54.941072 24516 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:54.941574 24380 raft_consensus.cc:3055] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:54.942034 24380 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:54.942734 18277 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:54.942888 24380 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:54.943571 24516 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:54.902364 24696 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:54.949097 18386 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:54.950527 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:54.964608 18311 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 18.
I20260709 13:19:54.944484 24380 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:54.984696 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.967480 18396 tablet_copy_source_session.cc:215] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:54.986313 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:54.972112 24615 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:54.963261 24825 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:54.968382 24377 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:55.001816 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:54.999989 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:55.002015 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:54.998505 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.005092 18386 raft_consensus.cc:2393] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:55.007710 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:55.009210 18381 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:55.007884 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:55.014802 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64386.6us
I20260709 13:19:55.011529 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:54.978904 24696 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:55.031950 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:55.032408 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:55.034132 18382 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:19:55.036693 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:55.033883 18237 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:55.037362 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:54.969343 24751 consensus_queue.cc:1059] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:19:55.000850 24615 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.004534 24627 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:55.034468 18382 pending_rounds.cc:85] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 7
I20260709 13:19:55.073619 18382 pending_rounds.cc:107] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:19:55.074015 18382 raft_consensus.cc:2889] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:55.070722 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 52900.8us
I20260709 13:19:55.069602 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:55.079680 18234 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 20: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:55.029450 24804 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.030268 24825 raft_consensus.cc:697] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:55.041332 24795 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:55.032794 24377 raft_consensus.cc:697] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:55.091895 18235 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:55.072924 24615 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:55.080809 24692 tablet_copy_client.cc:538] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:19:55.103003 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 119191us
I20260709 13:19:55.085554 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:55.108193 24790 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.108752 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:55.109368 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:55.109722 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:55.110124 18309 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 17: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:55.110355 18306 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:55.111342 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:55.112176 18310 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 16: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:55.113010 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.113631 18310 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:19:55.114676 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:55.115826 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.116398 18307 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:55.118741 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.084686 24751 consensus_queue.cc:1243] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer 8b4fbc44aa2649f0bcac5cd70f71951d log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:55.129385 18308 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:19:55.082842 24791 consensus_queue.cc:1059] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:19:55.133179 24825 consensus_queue.cc:237] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:55.137718 24818 raft_consensus.cc:3055] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:55.138303 24818 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:55.139422 24818 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:55.007983 24439 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:55.142900 24818 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:55.117295 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.142349 18306 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:19:55.144702 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:55.144819 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 104726us
I20260709 13:19:55.100399 24795 raft_consensus.cc:697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 18 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:55.103704 24837 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:55.149377 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.148315 18309 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
W20260709 13:19:55.124176 24832 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.229s	user 0.003s	sys 0.000s
I20260709 13:19:55.145555 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:55.158756 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:55.095321 24793 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.159s
I20260709 13:19:55.162343 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:55.160298 18306 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:55.165077 24377 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:55.165740 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.166451 18304 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:55.166774 24838 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:55.167961 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.168581 24795 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:55.169140 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.123932 24804 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:55.169818 18305 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:55.171547 24804 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:55.172546 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.108846 24790 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:55.180449 18382 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:19:55.181300 18311 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:55.180838 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:55.190935 18311 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:55.183252 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:55.192981 18310 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:55.196097 18305 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:19:55.196687 18308 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 15: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:55.198220 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:55.199072 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.199463 18309 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:55.196631 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:55.196769 18304 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:19:55.201179 18384 raft_consensus.cc:2393] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:19:55.201826 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.200438 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:55.203742 18309 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:19:55.207094 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 48506.7us
I20260709 13:19:55.212369 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.153932 24809 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:19:55.214514 18307 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:55.215287 18308 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:55.216624 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.217671 18310 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:55.190794 24837 raft_consensus.cc:697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:55.222672 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.225232 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.231405 18305 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19. Ops: [17.12-18.13]
I20260709 13:19:55.227929 18304 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:19:55.214251 24783 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:55.239362 18308 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
W20260709 13:19:55.241348 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.243409 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.256556 18305 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:55.257052 18383 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:55.260926 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.212285 24796 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:19:55.264607 24829 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:55.268043 18959 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:19:55.273108 18310 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:55.265347 24829 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:55.275446 24829 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:55.276104 18306 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:55.281692 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.293031 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:19:55.297072 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.313831 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.315451 24837 consensus_queue.cc:237] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:55.319254 24692 tablet_bootstrap.cc:492] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:19:55.322847 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.322201 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:55.325301 18308 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:55.326165 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.330544 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.331880 18306 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:55.333263 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.340341 18305 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
W20260709 13:19:55.352795 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.353091 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.354463 18306 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:55.355434 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.355953 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.357743 18305 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:55.368153 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.375465 24783 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:55.369518 18308 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:55.384881 24615 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:55.386219 18377 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:19:55.369359 18236 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
I20260709 13:19:55.395686 18956 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:55.396836 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:55.397114 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:55.397653 18233 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:55.395686 18310 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:19:55.350275 24838 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:19:55.409112 24840 log.cc:927] Time spent T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.245s	user 0.003s	sys 0.003s
I20260709 13:19:55.423228 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:55.410959 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.411654 24790 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:55.416561 18927 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:55.425313 24809 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:55.425706 24809 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:55.426296 24809 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.419368 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:55.425732 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.420064 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.428124 18959 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:19:55.420145 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.422183 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:55.429524 18231 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:55.429999 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:55.428476 18306 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:19:55.454161 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:55.454579 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:55.454938 18233 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:19:55.454880 18201 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:55.459517 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.461778 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:55.467806 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:55.466583 18233 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:55.480125 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.459263 18956 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:55.456847 24803 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:55.485575 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:55.507481 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:55.467005 24793 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.469743 24820 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:55.512041 18233 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:19:55.474189 24524 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:55.524886 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.527040 18228 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:55.487169 24615 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:55.464643 24857 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:19:55.529074 18229 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:55.466763 24684 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
W20260709 13:19:55.541734 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 142125us
I20260709 13:19:55.488031 24825 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:19:55.519793 24524 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.524753 24829 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.562894 24374 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.559471 18275 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:55.525457 24845 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:19:55.564121 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 105706us
I20260709 13:19:55.561730 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:55.563477 24374 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:55.529609 24828 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:55.517532 24803 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:55.577453 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.557278 24524 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:55.522452 24820 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:55.614518 24467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ee2a6512e24d10af3526398de71490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.615051 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:55.578909 24845 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:55.569393 24829 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:55.524493 24793 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:55.617758 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.563539 24858 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.529424 24838 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:55.569223 24804 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:55.625113 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:55.629822 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:55.631875 18230 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:55.632462 24374 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:55.620756 24791 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.636225 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:55.647003 18310 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:55.579267 24792 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.062s
I20260709 13:19:55.658331 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:19:55.660638 24855 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:19:55.666291 24856 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:19:55.667485 24380 raft_consensus.cc:993] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:19:55.674676 24576 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:55.676739 24829 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:55.651422 24615 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:55.615048 24828 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:55.687937 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:55.694571 24841 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:55.686797 24615 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:55.696766 24615 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:55.697134 24828 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:55.697250 24615 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:55.699622 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:55.700163 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:55.700902 18233 raft_consensus.cc:3055] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:55.701032 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:55.705323 24380 raft_consensus.cc:1081] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:19:55.706681 24835 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:55.706838 18383 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:19:55.707980 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.708544 24854 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:55.708458 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:55.712149 24825 consensus_queue.cc:1059] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:55.713028 24837 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:19:55.687522 18202 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.846s (SENT) [suppressed 18 similar messages]
W20260709 13:19:55.736013 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 48509.7us
I20260709 13:19:55.707930 18378 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:55.701378 18233 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:55.736765 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:55.718968 18304 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:19:55.700850 18312 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:55.647804 24791 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:55.721089 18310 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:55.742590 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:55.743194 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:55.744153 18377 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:19:55.721561 24835 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:19:55.746798 24860 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:19:55.747098 18383 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:55.747630 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:55.755285 18386 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:19:55.634999 24858 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:55.750653 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.752916 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:55.760980 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:19:55.767203 24869 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:19:55.768488 24863 log.cc:927] Time spent T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:19:55.769891 24866 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:19:55.781728 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 65505.3us
I20260709 13:19:55.750468 24783 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:55.750257 24852 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:55.791370 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 74007.5us
I20260709 13:19:55.800336 18231 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:19:55.795810 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:55.807705 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 46826.7us
I20260709 13:19:55.771579 24841 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:55.808900 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:55.793836 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:55.782179 24439 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:55.819779 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:55.789449 24783 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:55.771260 24828 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:19:55.770653 24837 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:55.782850 24627 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:19:55.789140 24790 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:19:55.834266 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:55.828783 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:55.815312 24841 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:55.824961 24439 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:55.849828 24684 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:55.850646 24684 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:55.830250 24783 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:55.830039 24792 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:55.820043 24751 consensus_queue.cc:1059] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:19:55.832432 24820 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:55.832208 24803 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:55.855990 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:55.835711 24882 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:55.843030 24793 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:55.866428 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:55.847283 24841 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:55.872033 24870 log.cc:927] Time spent T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:55.871944 24845 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:55.853919 24439 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:55.859092 24627 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:55.882061 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:55.883275 24795 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.887876 24524 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:55.875902 24828 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:55.842871 24835 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:55.905437 24861 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260709 13:19:55.906056 24862 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.270s	user 0.003s	sys 0.000s
I20260709 13:19:55.906776 24380 raft_consensus.cc:3055] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:55.858807 24792 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:55.921098 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:55.982666 18236 raft_consensus.cc:2393] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 18: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:55.897079 24858 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:55.923161 18231 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:19:56.013356 24798 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:56.014051 24798 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:55.925864 18312 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
W20260709 13:19:55.933452 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 114079us
I20260709 13:19:55.909438 24684 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:55.946781 24795 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:56.028033 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:56.029258 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:56.031141 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:56.034523 24791 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:56.035145 24886 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.035679 24886 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:56.036947 24838 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:56.038302 24838 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:56.038461 24878 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.038727 24838 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.039113 24838 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:56.038934 24878 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:56.040055 24873 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.181s	user 0.000s	sys 0.003s
I20260709 13:19:56.040832 24888 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:56.036255 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.041819 24858 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:56.049443 24524 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:56.009555 24792 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:56.055166 18135 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39270 (request call id 222) took 3957 ms. Trace:
I20260709 13:19:56.058724 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:56.059376 18378 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:56.059940 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:56.061143 18382 raft_consensus.cc:2393] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 9: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:56.061517 18233 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:56.062633 18233 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:56.064723 18381 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:55.983302 24380 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:56.068679 24380 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.069487 18130 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 121) took 2395 ms. Trace:
I20260709 13:19:56.070276 18379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46844
I20260709 13:19:56.072896 24795 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:56.075778 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.080968 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:56.079654 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:56.015401 24798 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.093730 24868 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.093838 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:56.094326 24868 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:56.095728 18962 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 14 LEARNER]: Advancing to term 15
I20260709 13:19:56.095909 24684 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:56.097116 18961 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 18 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:56.097421 24684 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:56.098263 24792 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.069825 24380 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:56.100186 24792 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:55.969388 24835 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:55.974970 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:55.947474 18230 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:19:55.948704 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 82385us
I20260709 13:19:56.128383 18201 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:56.131052 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:56.131479 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:19:55.979698 24809 consensus_meta.cc:287] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.553s	user 0.013s	sys 0.000s
I20260709 13:19:55.983992 18234 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:55.986567 24841 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:55.951036 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 69201.2us
W20260709 13:19:56.001188 24876 log.cc:927] Time spent T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:19:56.004202 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:56.005817 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:56.008317 18385 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:56.141633 18201 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:56.008636 24837 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:56.094604 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:56.101166 24783 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.104892 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:56.146862 18953 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:56.145586 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:19:56.119906 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.950917 24374 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:56.132272 18957 raft_consensus.cc:2393] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:55.865531 24882 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:56.135501 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 104436us
I20260709 13:19:55.988588 24887 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:56.037833 24886 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:56.135987 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:56.163179 18384 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:56.144904 18233 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:56.140934 18276 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:19:56.144603 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 146146us
I20260709 13:19:56.156872 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:56.069825 18130 rpcz_store.cc:276] 0709 13:19:53.674337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.674641 (+   304us) service_pool.cc:224] Handling call
0709 13:19:56.069426 (+2394785us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:55.279649 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:55.280449 (+   800us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:55.280498 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:19:55.280551 (+    53us) tablet.cc:662] Decoding operations
0709 13:19:55.281052 (+   501us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:55.281170 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:55.281217 (+    47us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:19:55.315289 (+ 34072us) tablet.cc:701] Row locks acquired
0709 13:19:55.315310 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:19:55.315488 (+   178us) write_op.cc:270] Start()
0709 13:19:55.315627 (+   139us) write_op.cc:276] Timestamp: P: 1783603195315434 usec, L: 0
0709 13:19:55.315649 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:55.316417 (+   768us) log.cc:844] Serialized 925 byte log entry
0709 13:19:55.583874 (+267457us) op_driver.cc:464] REPLICATION: finished
0709 13:19:55.836017 (+252143us) write_op.cc:301] APPLY: starting
0709 13:19:55.844732 (+  8715us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:55.893860 (+ 49128us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:55.893957 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:55.895191 (+  1234us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:55.895383 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:19:55.895424 (+    41us) write_op.cc:312] APPLY: finished
0709 13:19:55.895629 (+   205us) log.cc:844] Serialized 33 byte log entry
0709 13:19:55.895799 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:55.895888 (+    89us) write_op.cc:454] Released schema lock
0709 13:19:55.895928 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:55.978001 (+ 82073us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:55.987341 (+  9340us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":261745,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":205039,"apply.run_cpu_time_us":5519,"apply.run_wall_time_us":96761,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12471,"num_ops":2,"prepare.queue_time_us":135272,"prepare.run_cpu_time_us":3691,"prepare.run_wall_time_us":37135,"replication_time_us":246574,"thread_start_us":198213,"threads_started":2}]]}
I20260709 13:19:56.150687 18381 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:19:56.167309 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:56.143119 24742 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:56.161863 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:56.055822 18135 rpcz_store.cc:276] 0709 13:19:52.097887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.098066 (+   179us) service_pool.cc:224] Handling call
0709 13:19:56.054853 (+3956787us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:53.405000 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:53.406070 (+  1070us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:53.406133 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:19:53.408288 (+  2155us) tablet.cc:662] Decoding operations
0709 13:19:53.423931 (+ 15643us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:53.456707 (+ 32776us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:53.465583 (+  8876us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:19:53.565929 (+100346us) tablet.cc:701] Row locks acquired
0709 13:19:53.566014 (+    85us) write_op.cc:260] PREPARE: finished
0709 13:19:53.566331 (+   317us) write_op.cc:270] Start()
0709 13:19:53.566543 (+   212us) write_op.cc:276] Timestamp: P: 1783603193566223 usec, L: 0
0709 13:19:53.566581 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:19:53.567930 (+  1349us) log.cc:844] Serialized 5086 byte log entry
0709 13:19:53.848689 (+280759us) op_driver.cc:464] REPLICATION: finished
0709 13:19:54.117356 (+268667us) write_op.cc:301] APPLY: starting
0709 13:19:54.117455 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:54.207160 (+ 89705us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:54.207333 (+   173us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:54.453657 (+246324us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:54.454050 (+   393us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=0,mrs_lookups=0
0709 13:19:54.454109 (+    59us) write_op.cc:312] APPLY: finished
0709 13:19:54.454484 (+   375us) log.cc:844] Serialized 113 byte log entry
0709 13:19:54.454672 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:54.454811 (+   139us) write_op.cc:454] Released schema lock
0709 13:19:54.454876 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:54.455360 (+   484us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:54.455390 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28434,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":268317,"apply.run_cpu_time_us":25274,"apply.run_wall_time_us":337958,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54191,"num_ops":12,"prepare.queue_time_us":511859,"prepare.run_cpu_time_us":39621,"prepare.run_wall_time_us":258064,"raft.queue_time_us":321725,"raft.run_cpu_time_us":53244,"raft.run_wall_time_us":410882,"replication_time_us":270643,"thread_start_us":883141,"threads_started":5,"wal-append.queue_time_us":146184}]]}
I20260709 13:19:56.128350 24524 consensus_queue.cc:1059] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
W20260709 13:19:56.202241 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 61403.4us
I20260709 13:19:56.172688 18926 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:56.140528 24857 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:19:56.204983 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 48201.9us
I20260709 13:19:56.150264 24588 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:56.173012 24374 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:56.176383 24742 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:56.181039 24878 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:56.181587 24828 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:56.176618 24795 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:19:56.183100 24868 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:56.186508 24439 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.188421 24783 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:56.163834 24790 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:19:56.164233 24882 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:56.196591 24841 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:56.144359 24809 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:56.199806 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:56.261636 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:56.150774 24377 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:56.196161 24467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53364 (request call id 610) took 1987 ms. Trace:
I20260709 13:19:56.208969 18349 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:56.170073 24829 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:56.214525 18927 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:56.170948 24825 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:19:56.224802 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:56.225660 24792 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:19:56.253226 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 48762.1us
I20260709 13:19:56.253571 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:56.259840 24684 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:56.265084 24439 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:56.267050 24845 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:19:56.263185 24374 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.253310 24823 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:56.293910 18200 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:19:56.254422 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 48704.8us
I20260709 13:19:56.300452 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:56.303838 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:56.269078 24868 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:19:56.278301 24795 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:56.315907 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:56.318836 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 157035us
I20260709 13:19:56.275947 24809 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:56.276782 24377 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.228755 24588 raft_consensus.cc:697] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:56.262724 24524 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:56.223636 24804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.011s	sys 0.028s
I20260709 13:19:56.224717 24857 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:56.259574 24627 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:56.291280 24374 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.317003 24828 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:56.272929 18386 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
W20260709 13:19:56.277168 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 68342.6us
I20260709 13:19:56.370247 18234 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
W20260709 13:19:56.277792 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63380.5us
I20260709 13:19:56.287199 24820 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:19:56.278043 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:56.287019 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:56.258473 18962 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 15 LEARNER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:56.221556 24742 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:56.279091 24792 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:56.380733 24792 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:56.387010 18377 raft_consensus.cc:2393] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 11: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:56.388993 24380 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:56.389735 18927 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:56.287499 24883 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:19:56.277336 24829 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.367506 24524 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:56.362282 24804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.011s	sys 0.028s
I20260709 13:19:56.277266 24841 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:56.369442 24627 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:56.356348 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:56.310284 24615 consensus_meta.cc:287] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.003s
I20260709 13:19:56.217919 24796 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:56.305722 24823 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:56.365006 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 44158us
I20260709 13:19:56.315562 24845 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:56.370885 18234 pending_rounds.cc:85] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 8
I20260709 13:19:56.282071 24684 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:56.316018 24887 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
W20260709 13:19:56.424928 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 105038us
I20260709 13:19:56.360687 24377 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:56.398250 24374 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:56.402057 18308 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
W20260709 13:19:56.401757 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 114816us
I20260709 13:19:56.412112 18927 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:56.407742 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:56.431423 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:56.414988 18234 pending_rounds.cc:107] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:19:56.433091 18234 raft_consensus.cc:2889] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:56.418177 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:56.405303 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:56.414152 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:56.433418 24374 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:56.400616 24841 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.392959 24829 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:56.415170 24823 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.409693 24852 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:56.444945 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:56.445621 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:56.396727 24857 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:56.398475 24804 raft_consensus.cc:697] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:56.410175 24796 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.392041 24838 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.400276 24820 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:56.399405 24818 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:56.447675 24845 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:56.458902 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:56.397408 24795 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:19:56.397020 24524 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:56.486476 18235 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
I20260709 13:19:56.448653 24841 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:56.394941 24882 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.511418 18383 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:56.393215 24883 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.411365 24615 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.447780 24885 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:56.431697 24799 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:19:56.408200 24627 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:56.531464 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 84572.7us
W20260709 13:19:56.527983 24870 log.cc:927] Time spent T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:19:56.523352 18303 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:56.523484 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:56.523728 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:56.544099 18379 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:56.544744 18379 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:56.525749 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:56.475790 24820 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:56.487857 24878 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.392704 24588 consensus_queue.cc:237] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.531862 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:56.558184 18306 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:56.276840 24467 rpcz_store.cc:276] 0709 13:19:54.208409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.208579 (+   170us) service_pool.cc:224] Handling call
0709 13:19:54.343516 (+134937us) ts_tablet_manager.cc:934] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
0709 13:19:55.469710 (+1126194us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:19:55.935564 (+465854us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:55.935760 (+   196us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:19:56.195260 (+259500us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:19:56.195628 (+   368us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:56.196002 (+   374us) ts_tablet_manager.cc:989] Replica registered.
0709 13:19:56.196063 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":14990,"tablet-copy.queue_time_us":9521,"thread_start_us":55366,"threads_started":1}
I20260709 13:19:56.475852 24796 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:56.524296 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:56.545652 18305 raft_consensus.cc:2376] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19. Re-sending same reply.
I20260709 13:19:56.500555 24783 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
W20260709 13:19:56.561012 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 94124.4us
I20260709 13:19:56.564440 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:56.570086 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:56.571048 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:56.529647 24883 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.574808 18310 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:56.576004 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:56.577517 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:56.571327 24627 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:56.594795 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:56.564851 24878 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.600631 18306 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:56.598942 24818 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.614653 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:56.598176 24888 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:56.573225 24804 consensus_queue.cc:237] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:56.651316 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:56.611982 24818 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:56.609464 24803 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:56.662672 24798 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:56.586194 24820 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.680608 24888 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:56.681090 24818 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:19:56.704025 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:56.704331 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:56.704706 18310 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:56.704907 18303 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
W20260709 13:19:56.712283 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 101834us
I20260709 13:19:56.713558 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:56.715328 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:56.675789 24838 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:56.722293 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:56.664636 24803 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:56.703491 24615 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:56.712647 24783 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:56.708468 24882 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:56.741444 18312 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:56.741683 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:56.745476 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:56.746328 18303 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
W20260709 13:19:56.750379 24902 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.195s	user 0.001s	sys 0.001s
W20260709 13:19:56.756367 24835 consensus_meta.cc:287] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.000s
I20260709 13:19:56.755106 24909 raft_consensus.cc:2955] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
W20260709 13:19:56.757128 24907 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:19:56.761679 24882 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:56.763979 24908 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:19:56.743218 24820 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:56.770783 24905 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:19:56.795933 18310 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:56.794958 18379 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.766295 24783 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:56.799340 18380 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 19. Ops: []
I20260709 13:19:56.772905 24882 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:19:56.812089 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 96835.9us
I20260709 13:19:56.815572 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:19:56.812098 24906 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:19:56.810257 24882 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:56.880038 24912 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:19:56.880179 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64698.8us
I20260709 13:19:56.880802 24912 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:56.881335 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:56.881783 24912 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.882697 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:56.884883 24888 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:56.885617 24888 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.798594 24742 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.870770 24878 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:56.889226 24882 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:56.914485 18311 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: [19.13-19.13]
W20260709 13:19:56.938956 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 54704.8us
I20260709 13:19:56.894238 24911 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:19:56.944993 24742 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:56.945331 24919 log.cc:927] Time spent T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:19:56.947564 24922 log.cc:927] Time spent T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:19:56.948889 24377 consensus_meta.cc:287] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.010s
W20260709 13:19:56.949020 24929 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:19:56.949388 24377 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.951972 24377 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:56.953240 24923 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:19:56.966612 18312 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:56.969482 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:56.973173 18309 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:19:56.974540 18304 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:56.970963 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:56.984145 24915 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:57.001698 24915 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.984333 24798 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.986776 24467 tablet_copy_client.cc:806] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:56.988945 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:57.010113 18304 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
I20260709 13:19:56.919878 24783 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.995023 24883 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:56.997239 24792 consensus_meta.cc:287] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.004s
I20260709 13:19:56.986838 24793 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:57.002838 18379 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:57.010179 24798 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:56.986724 24895 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:57.011919 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.021798 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:46844 (request call id 4003) took 1017 ms. Trace:
I20260709 13:19:57.022168 24895 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.023192 24798 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.020242 24888 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:57.029284 24895 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.023291 24792 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.030714 18310 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:57.031687 24792 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.024022 24684 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:57.025839 24467 tablet_copy_client.cc:670] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:57.033396 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:57.026558 18379 rpcz_store.cc:276] 0709 13:19:56.004541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.010024 (+  5483us) service_pool.cc:224] Handling call
0709 13:19:56.999453 (+989429us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b5400075154. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa18226aa3d 00007fa18723acd0 00007fa1807bf254 00007fa1807bf1e2 00007fa1807bf111 00007fa1807bf08c 00007fa1807be342 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:57.021687 (+ 22234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1088083328}
I20260709 13:19:57.010574 24803 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.037034 24837 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.109885 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:57.056953 24841 consensus_meta.cc:287] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.003s
I20260709 13:19:57.115891 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:57.117687 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:57.112172 24818 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.148705 24818 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:57.151648 24818 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:57.152897 24796 consensus_meta.cc:287] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.582s	user 0.003s	sys 0.009s
I20260709 13:19:57.021620 24793 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.155966 24793 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:57.159269 24627 consensus_meta.cc:287] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.563s	user 0.012s	sys 0.000s
I20260709 13:19:57.050381 24615 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.111s
I20260709 13:19:57.153434 24796 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.160781 18305 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
W20260709 13:19:57.164527 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47909.3us
W20260709 13:19:57.113502 24829 consensus_meta.cc:287] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.646s	user 0.013s	sys 0.000s
W20260709 13:19:57.169232 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 57350us
I20260709 13:19:57.190480 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:57.186411 24823 consensus_meta.cc:287] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.705s	user 0.013s	sys 0.000s
I20260709 13:19:57.171355 24915 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:57.187345 24868 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.019s	sys 0.054s
W20260709 13:19:57.260207 24868 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.020s	sys 0.054s
W20260709 13:19:57.189250 24937 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:19:57.113183 24837 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:57.262719 24837 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:57.163434 24841 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:57.186757 24829 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.265194 24829 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.188006 24939 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:19:57.266320 18381 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:19:57.265221 24841 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:57.211671 24796 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.238601 24467 tablet_copy_client.cc:538] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:57.260253 24823 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:57.275497 24823 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.276819 18960 raft_consensus.cc:2368] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10.
I20260709 13:19:57.238603 24858 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:57.277667 24858 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:57.278971 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:57.279768 18379 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.231787 24803 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:57.281497 24803 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:57.283581 24803 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.242360 24882 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.279824 24858 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:57.191269 18385 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:19:57.307164 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:57.329602 18379 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:19:57.329517 18386 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 18.
I20260709 13:19:57.330528 18380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4001) took 1615 ms. Trace:
I20260709 13:19:57.333772 18926 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:19:57.333753 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.335386 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:57.331395 18380 rpcz_store.cc:276] 0709 13:19:55.711708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.726846 (+ 15138us) service_pool.cc:224] Handling call
0709 13:19:55.745715 (+ 18869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:56.804405 (+1058690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.327235 (+522830us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400075154. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:57.327536 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2422597504}
I20260709 13:19:57.340663 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:57.339542 24823 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:57.342133 24823 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.342686 24823 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.345793 18385 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:57.352552 24882 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:57.365170 24909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:35944 (request call id 2) took 4989 ms. Trace:
I20260709 13:19:57.365732 24909 rpcz_store.cc:276] 0709 13:19:52.376047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.376242 (+   195us) service_pool.cc:224] Handling call
0709 13:19:52.457438 (+ 81196us) log.cc:844] Serialized 513 byte log entry
0709 13:19:53.438120 (+980682us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b18003fb7a0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa1821ccb0b 00007fa182251b63 00007fa182279752 00007fa187239d29
0709 13:19:57.365037 (+3926917us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":529365,"raft.queue_time_us":860430,"raft.run_cpu_time_us":3018,"raft.run_wall_time_us":173458,"spinlock_wait_cycles":310736000,"thread_start_us":188775,"threads_started":1,"wal-append.queue_time_us":456257,"wal-append.run_cpu_time_us":8035,"wal-append.run_wall_time_us":1280614}
I20260709 13:19:57.371409 24467 tablet_bootstrap.cc:492] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:19:57.382865 18385 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:57.454119 24924 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:19:57.499527 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 1.04062e+06us
I20260709 13:19:57.500573 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:57.500792 24904 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:57.501799 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:57.503690 24835 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:57.499256 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1061) took 1086 ms. Trace:
I20260709 13:19:57.507491 24627 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:57.508037 24627 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.509984 24943 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.510358 24627 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.511040 24627 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:57.510711 24943 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:57.511626 24627 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.501678 24904 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:57.512723 24868 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:57.513320 24829 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:57.525384 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:57.505497 18232 rpcz_store.cc:276] 0709 13:19:56.412781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.412924 (+   143us) service_pool.cc:224] Handling call
0709 13:19:56.434227 (+ 21303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:56.434402 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:56.454394 (+ 19992us) log.cc:844] Serialized 14 byte log entry
0709 13:19:56.454728 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:19:57.021186 (+566458us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b18000da6e0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:19:57.498589 (+477403us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18000da6e0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa18226b060 00007fa18227d716 00007fa18228e287 00007fa18228e208
0709 13:19:57.498766 (+   177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:57.498885 (+   119us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:57.498967 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.499054 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:57.499183 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":487609,"prepare.queue_time_us":78283,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":79,"raft.queue_time_us":1042465,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":191,"spinlock_wait_cycles":50154624}
I20260709 13:19:57.519649 24374 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.498575 24915 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:57.532289 24374 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.515949 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:57.527006 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:57.536983 18309 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.504093 24835 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:57.501168 24823 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:57.504200 24825 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:19:57.496475 24924 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:57.549031 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:57.560563 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:57.567055 24374 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.569010 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:57.540359 24835 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:57.596359 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 80462.3us
I20260709 13:19:57.602246 18202 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:57.604151 24374 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:57.549984 24904 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:57.534291 24829 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.532271 24868 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.619845 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:57.621027 24374 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:57.622345 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:57.575590 24928 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:57.575803 24841 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:57.538520 24915 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.605808 24792 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.608289 24895 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:57.647122 24374 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:57.675941 24374 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.676568 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:57.617272 24939 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:19:57.648170 18232 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:19:57.653689 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:57.653925 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:57.566567 24798 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.656201 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:57.649487 24904 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.658686 18230 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:57.659451 24627 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.668368 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:57.651861 24943 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:57.576092 24882 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:19:57.699290 18385 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:57.613966 24588 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:19:57.677802 18384 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:57.652158 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:57.681252 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:57.706751 18231 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:57.707849 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:57.682080 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:57.623714 24837 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:19:57.684863 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:57.713158 18228 raft_consensus.cc:3055] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:57.677047 24524 consensus_queue.cc:1059] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:19:57.687795 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:57.688396 24904 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.688799 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:57.689810 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:57.576505 24887 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:57.692655 24798 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.693876 24627 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:57.694937 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:57.655844 24380 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:57.667273 24377 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:57.715237 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:57.775544 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:57.677997 24841 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.717443 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:57.780053 18231 raft_consensus.cc:2368] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18.
I20260709 13:19:57.781100 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:57.678308 24928 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:57.728338 24374 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.718393 18309 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 10.
I20260709 13:19:57.753530 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:57.736475 18926 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:57.730737 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:57.785017 18235 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:57.720750 18236 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:19:57.767257 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:57.769618 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:19:57.770284 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 112963us
W20260709 13:19:57.787760 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 92904.2us
I20260709 13:19:57.788138 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:57.736006 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:57.773743 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:57.776064 18233 raft_consensus.cc:2410] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:19:57.713507 18228 raft_consensus.cc:740] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:57.790452 18228 consensus_queue.cc:260] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.790906 24958 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:57.791769 24958 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.793581 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:57.794332 18309 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:57.795392 24958 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.686630 24792 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:57.719169 24924 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:57.797696 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:57.776602 24692 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:19:57.799439 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:57.813310 18236 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:19:57.799402 18201 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:57.800207 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:57.798468 24374 consensus_queue.cc:1059] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:19:57.802111 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 65758.5us
I20260709 13:19:57.817903 18926 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:57.802220 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:57.808360 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:57.812350 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:57.697710 24895 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.832381 18231 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:57.823279 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:57.825026 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:57.833446 18230 raft_consensus.cc:2410] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:19:57.825240 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:57.825856 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:57.834753 24374 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:57.826488 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:57.835441 24374 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:57.835695 18307 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:57.828824 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:57.833490 18311 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:57.830170 24948 raft_consensus.cc:3055] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:57.837064 24374 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.838804 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:57.839735 18233 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:57.840628 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:57.842167 18309 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:57.845772 18311 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:57.848031 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:57.848335 18309 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:19:57.851588 24904 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.852423 18303 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:57.853935 18312 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:19:57.824339 18277 leader_election.cc:400] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18.
I20260709 13:19:57.855034 18277 leader_election.cc:403] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:19:57.804801 24943 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:57.776773 24887 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:57.865726 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:57.831375 24377 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:57.847437 24948 raft_consensus.cc:740] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:57.787096 24380 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:57.879298 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:57.858582 24823 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.879393 18927 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:57.875473 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:57.848451 24803 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:57.859529 24895 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.847923 24950 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:57.886301 18307 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:19:57.865494 24904 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:57.888429 18277 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:57.894243 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4011) took 1635 ms. Trace:
I20260709 13:19:57.871204 24954 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18.
I20260709 13:19:57.901518 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:57.862296 24946 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:19:57.894835 18381 rpcz_store.cc:276] 0709 13:19:56.258700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.258866 (+   166us) service_pool.cc:224] Handling call
0709 13:19:56.288042 (+ 29176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:57.266927 (+978885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.893904 (+626977us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b54000cd0d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:57.894161 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2249095936}
I20260709 13:19:57.882921 24829 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:57.922183 18307 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:19:57.882081 24958 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:57.926170 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:57.892792 24943 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:57.906230 24895 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:57.878328 24377 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:57.906723 24964 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:19:57.947923 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 68710.9us
I20260709 13:19:57.909543 24950 raft_consensus.cc:697] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:57.933382 24958 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.891141 24803 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:57.942150 24957 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:19:57.971133 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 45180us
I20260709 13:19:57.960618 24964 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:57.978386 24841 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:57.987416 24964 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:57.988859 24883 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:19:57.989607 24947 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:19:57.989423 24883 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:57.991600 24883 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:57.969915 24958 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:57.981885 24377 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:58.044605 24909 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:57.955986 24943 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.047019 24959 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:19:58.053390 24959 consensus_queue.cc:1243] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:19:58.045825 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:58.055418 24959 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:58.055644 18303 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:58.038667 24957 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.056833 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:58.058736 24957 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:58.058805 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:58.059480 24957 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:58.037488 24917 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:58.059866 24959 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:58.060165 24887 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:58.060456 24959 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:58.061861 24841 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.062541 18276 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:58.061096 24959 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:58.063798 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:57.974470 24588 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:58.064590 24965 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:58.065011 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3666) took 1492 ms. Trace:
I20260709 13:19:58.047854 24380 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:58.062361 24841 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.065423 18305 rpcz_store.cc:276] 0709 13:19:56.572313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.954925 (+382612us) service_pool.cc:224] Handling call
0709 13:19:56.955302 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:57.161179 (+205877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.064746 (+903567us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54003c14d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:58.064919 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471977728}
I20260709 13:19:58.052205 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:58.071171 18229 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:19:57.999671 24823 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:58.066959 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:19:58.072223 18960 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54020 (request call id 503) took 1873 ms (client timeout 1642 ms). Trace:
I20260709 13:19:58.049240 24909 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:58.060379 24917 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:58.074921 18960 rpcz_store.cc:269] 0709 13:19:56.199026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.199307 (+   281us) service_pool.cc:224] Handling call
0709 13:19:58.068840 (+1869533us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54006301d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:58.072071 (+  3231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304071424}
I20260709 13:19:57.892036 24928 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:58.093391 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 285135us
I20260709 13:19:58.094264 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:57.951468 24948 consensus_queue.cc:260] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.048482 24792 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:58.078661 24692 tablet_bootstrap.cc:492] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:58.097520 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:58.051268 24943 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:58.059902 24957 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:58.125151 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:58.124802 24957 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:58.126420 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:58.126739 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:58.127185 18305 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 15: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:19:58.127681 24883 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:58.128114 18307 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:58.079324 24798 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:58.074736 24615 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:58.047291 24803 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:58.121508 24374 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:58.053920 24964 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:58.125252 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:58.128968 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 65251.4us
I20260709 13:19:58.079913 24915 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:58.076485 24909 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:58.129405 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:19:58.118523 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 281594us
I20260709 13:19:58.116623 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3522) took 1724 ms. Trace:
I20260709 13:19:58.131160 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:58.084746 24524 raft_consensus.cc:3055] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:19:58.132495 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 174029us
I20260709 13:19:58.084854 24963 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:58.093719 24895 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:58.128851 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 258802us
I20260709 13:19:58.123349 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:58.093885 24823 raft_consensus.cc:697] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:19:58.140914 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:58.085049 24439 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:58.128259 24883 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:58.153360 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:58.133562 24792 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:58.137038 24615 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:58.179941 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.181087 24374 consensus_queue.cc:1059] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:58.146059 24948 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:58.159947 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:58.048841 24950 consensus_queue.cc:237] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:58.171514 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:58.173089 18381 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:58.173805 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:58.191673 18379 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:19:58.174074 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:58.174811 18385 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:58.175588 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:58.156826 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:58.181986 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:58.198928 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:58.197433 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:58.184958 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:58.171578 18230 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:58.200601 18962 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:58.201066 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:58.159127 24909 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:58.186772 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:58.187582 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:58.204669 24374 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:58.153576 18378 rpcz_store.cc:276] 0709 13:19:56.392156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:56.400012 (+  7856us) service_pool.cc:224] Handling call
0709 13:19:56.400281 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:56.607158 (+206877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:56.607179 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:56.649520 (+ 42341us) log.cc:844] Serialized 26 byte log entry
0709 13:19:56.816800 (+167280us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:56.816873 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.083129 (+1266256us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54000ba4d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:19:58.083178 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.083217 (+    39us) raft_consensus.cc:1685] finished
0709 13:19:58.083228 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.116551 (+ 33323us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70432,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":17714,"spinlock_wait_cycles":446726912,"thread_start_us":154184,"threads_started":2,"wal-append.queue_time_us":258672,"wal-append.run_cpu_time_us":2232,"wal-append.run_wall_time_us":1034626}
I20260709 13:19:58.155834 24803 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.176391 24792 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:19:58.203388 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.204631 18230 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 21: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:19:58.206302 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 83048.6us
I20260709 13:19:58.249176 18202 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:58.199921 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:58.155248 24524 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:58.240135 24374 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.185432 24615 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.190819 24837 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:58.252377 24374 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.164249 24895 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.188871 24588 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:19:58.197338 24943 raft_consensus.cc:3055] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:58.237635 24692 tablet_bootstrap.cc:492] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:19:58.179845 24439 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.247664 24946 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:58.252880 24792 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:58.188000 24939 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:19:58.268369 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:58.352553 18309 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:19:58.252592 24835 consensus_meta.cc:287] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.004s
I20260709 13:19:58.460088 24835 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:58.463671 24835 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:58.398574 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:58.318097 24904 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:58.205684 24820 raft_consensus.cc:2764] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:19:58.465485 24904 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:58.236065 24380 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:58.465687 18307 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:19:58.391928 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 235204us
I20260709 13:19:58.466163 24380 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:58.466028 24904 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:58.466728 24380 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:58.405700 24374 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:58.468338 24837 raft_consensus.cc:697] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:19:58.406581 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 248429us
I20260709 13:19:58.164567 24963 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:58.253530 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:58.363234 24943 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:58.357448 24961 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.391135 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:58.356606 24829 consensus_queue.cc:1059] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260709 13:19:58.236065 24887 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:58.471868 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:58.540712 18236 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:58.412663 24841 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:58.261984 24917 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:58.350394 24516 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.396932 24880 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.534890 18235 raft_consensus.cc:2410] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:19:58.466296 24898 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.357779 24965 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:58.254567 24803 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:58.362658 24958 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.465826 24820 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:58.553086 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:58.357221 24823 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:58.566594 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 366734us
I20260709 13:19:58.551016 24692 ts_tablet_manager.cc:1403] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 3.232s	user 0.084s	sys 0.023s
W20260709 13:19:58.566635 24970 log.cc:927] Time spent T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.401s	user 0.002s	sys 0.000s
W20260709 13:19:58.630180 24973 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:19:58.649397 18236 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:19:58.630491 24803 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:58.576875 24917 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:58.550455 24524 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.625881 24820 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.728592 24895 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:58.687665 24828 raft_consensus.cc:3055] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:58.729261 24820 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:58.635412 24958 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:58.729538 24828 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:58.635962 18956 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:58.730571 24828 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.731786 24828 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:58.576627 24898 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:58.702811 24909 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:58.732693 24615 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:58.641000 24915 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:58.733883 24915 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:58.640689 24684 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:58.561053 24841 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:19:58.693375 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 70344.9us
I20260709 13:19:58.734932 24684 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:58.736042 24915 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:58.641177 24829 raft_consensus.cc:3055] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:58.736456 24841 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:58.736672 24829 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:58.572469 24880 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.737085 24841 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.737123 24684 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:58.737591 24829 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:58.642310 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:58.739427 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.740731 24883 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:58.626132 24964 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:58.632387 24988 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:58.743336 24974 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:19:58.545012 24887 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:58.744902 24980 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:19:58.745548 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2807) took 1084 ms. Trace:
I20260709 13:19:58.638727 18305 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:19:58.733716 24909 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.745654 24963 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:58.633432 24982 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:19:58.694868 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2986) took 1003 ms. Trace:
I20260709 13:19:58.733244 18237 raft_consensus.cc:2393] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 20: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:19:58.624789 24837 consensus_queue.cc:237] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:58.768220 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.760809 18236 rpcz_store.cc:276] 0709 13:19:57.691673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.666535 (+974862us) service_pool.cc:224] Handling call
0709 13:19:58.694283 (+ 27748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:58.694492 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.694527 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:58.694581 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:58.694618 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.694677 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.694802 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:58.727272 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 260106us
I20260709 13:19:58.568948 24516 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.539510 24961 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.746081 18231 rpcz_store.cc:276] 0709 13:19:57.661112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.867013 (+205901us) service_pool.cc:224] Handling call
0709 13:19:57.867274 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:57.867482 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.867505 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.867925 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:19:57.972838 (+104913us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:57.972875 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.973577 (+   702us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.745299 (+771722us) raft_consensus.cc:1685] finished
0709 13:19:58.745329 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.745472 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":78934,"threads_started":1,"wal-append.queue_time_us":264275}
I20260709 13:19:58.787412 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2988) took 1095 ms. Trace:
I20260709 13:19:58.787933 18231 rpcz_store.cc:276] 0709 13:19:57.692195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.786432 (+1094237us) service_pool.cc:224] Handling call
0709 13:19:58.786799 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:58.787007 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.787044 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:58.787096 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:58.787144 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.787213 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.787347 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:58.734932 24615 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:58.749763 24887 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:19:58.761212 24959 consensus_meta.cc:287] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.697s	user 0.007s	sys 0.004s
I20260709 13:19:58.813732 18958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53364 (request call id 619) took 1017 ms. Trace:
I20260709 13:19:58.814036 24959 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.814311 18958 rpcz_store.cc:276] 0709 13:19:57.728733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.729009 (+   276us) service_pool.cc:224] Handling call
0709 13:19:57.777972 (+ 48963us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:57.778433 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.778479 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.814179 (+ 35700us) log.cc:844] Serialized 26 byte log entry
0709 13:19:58.096267 (+282088us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:58.096310 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.096383 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.745862 (+649479us) raft_consensus.cc:1685] finished
0709 13:19:58.745883 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.746010 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19205,"raft.queue_time_us":610,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":15401,"thread_start_us":214496,"threads_started":1,"wal-append.queue_time_us":656661}
I20260709 13:19:58.785178 24524 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:58.817550 24883 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:58.792814 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2989) took 1100 ms. Trace:
I20260709 13:19:58.819484 18231 rpcz_store.cc:276] 0709 13:19:57.692473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.790585 (+1098112us) service_pool.cc:224] Handling call
0709 13:19:58.791760 (+  1175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:58.792133 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.792192 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:58.792273 (+    81us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:58.792341 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.792459 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.792699 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:58.822042 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2990) took 1126 ms. Trace:
I20260709 13:19:58.822506 18231 rpcz_store.cc:276] 0709 13:19:57.695684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.820811 (+1125127us) service_pool.cc:224] Handling call
0709 13:19:58.821219 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:58.821432 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.821478 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:58.821535 (+    57us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:58.821573 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.821626 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.821757 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:58.781306 18960 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:58.785162 24684 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.643105 24943 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:58.805558 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 69235.3us
I20260709 13:19:58.747011 24917 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.834784 24684 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:58.835553 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 773879us
I20260709 13:19:58.838411 24904 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.839000 24961 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:58.839887 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46128 (request call id 1064) took 1302 ms. Trace:
I20260709 13:19:58.861937 18232 rpcz_store.cc:276] 0709 13:19:57.537922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.540034 (+  2112us) service_pool.cc:224] Handling call
0709 13:19:58.839705 (+1299671us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b540029bdd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:58.839822 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191968000}
I20260709 13:19:58.848130 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:58.849268 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:58.849849 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:58.864368 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:58.865003 18379 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:58.853494 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:58.816324 24959 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:58.845808 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:58.863404 18381 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
I20260709 13:19:58.863431 18383 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:19:58.872128 18383 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:19:58.879626 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:58.846282 24957 consensus_meta.cc:287] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.720s	user 0.012s	sys 0.000s
I20260709 13:19:58.884967 18380 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 16: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:58.885128 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:58.887162 18378 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:58.893206 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47481.2us
I20260709 13:19:58.895632 18275 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:58.895975 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:58.900259 18383 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:58.905025 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:58.905050 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:58.876888 24953 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.873570 24939 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:58.924090 18379 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:58.936267 24971 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.936985 24971 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.938694 24692 raft_consensus.cc:359] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:58.939625 24971 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:58.885200 24977 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:58.940490 24880 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:58.941156 24984 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:58.940894 24977 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:58.941643 24984 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:58.943073 24977 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:58.943653 24984 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:58.945336 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:58.983314 18378 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
I20260709 13:19:58.949117 18953 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:58.953500 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2822) took 1051 ms. Trace:
I20260709 13:19:58.886570 24439 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:58.953866 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:58.948066 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.010342 18232 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
W20260709 13:19:58.955525 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 53804.1us
I20260709 13:19:58.947737 24374 consensus_queue.cc:1059] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
W20260709 13:19:58.946766 24982 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:58.905928 24915 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:58.945284 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:59.011935 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:58.954124 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:59.017644 24868 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:59.018411 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.020344 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:58.904865 24946 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
W20260709 13:19:59.002990 24380 consensus_meta.cc:287] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 13:19:59.006498 18312 rpcz_store.cc:276] 0709 13:19:57.902153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.902591 (+   438us) service_pool.cc:224] Handling call
0709 13:19:57.902976 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:58.071098 (+168122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.071142 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:58.086174 (+ 15032us) log.cc:844] Serialized 52 byte log entry
0709 13:19:58.356824 (+270650us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:58.356868 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.356934 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:58.953298 (+596364us) raft_consensus.cc:1685] finished
0709 13:19:58.953318 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:58.953446 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10049,"raft.queue_time_us":52198,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":6239,"thread_start_us":368486,"threads_started":2,"wal-append.queue_time_us":762675}
I20260709 13:19:59.025166 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.086691 18379 raft_consensus.cc:2368] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19.
I20260709 13:19:59.087082 18307 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:59.087561 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.088323 18379 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:59.069720 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:59.071281 18275 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:59.071622 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.088690 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.089505 18307 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:19:58.945073 24516 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:58.944432 24792 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:59.093701 24841 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:59.094352 24792 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:59.095019 18308 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:59.080713 24825 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:59.081712 24377 raft_consensus.cc:3055] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:59.096886 24377 raft_consensus.cc:740] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:19:59.097144 18384 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:59.097790 24377 consensus_queue.cc:260] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.099104 24377 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:59.071576 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:19:59.073355 24948 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.873s	user 0.010s	sys 0.000s
W20260709 13:19:59.077436 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 65614.2us
I20260709 13:19:59.109158 18385 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:59.109519 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:59.109736 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.108875 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:58.939698 24692 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:19:59.021946 18233 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:59.021533 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 2994) took 1324 ms. Trace:
I20260709 13:19:59.111646 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.082437 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:59.080502 18383 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 16: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:19:58.950590 24684 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:59.089768 18309 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:19:59.116217 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.089833 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.091728 24951 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.095865 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.120016 18380 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:19:58.945536 24953 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.035388 24904 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:59.102039 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:59.080964 24793 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:58.926750 24950 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:59.102474 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:58.946321 24917 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:59.104117 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:58.885418 24996 consensus_queue.cc:1059] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.241s
I20260709 13:19:59.150142 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:19:59.037408 24990 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:19:59.111806 18237 rpcz_store.cc:276] 0709 13:19:57.696873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.720477 (+ 23604us) service_pool.cc:224] Handling call
0709 13:19:59.021297 (+1300820us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b5400269b54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:19:59.021464 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2169492352}
I20260709 13:19:59.115756 18229 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:19:58.893126 24957 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:59.125949 18349 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:19:59.129462 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.129570 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.133596 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:59.165472 18383 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:19:58.892721 24961 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:59.039680 24898 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:59.101584 24439 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:59.133394 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:19:59.140735 24993 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:59.141130 24950 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.077548 18956 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:19:59.148922 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:59.116706 24792 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:59.152689 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:19:59.189291 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.000066 24939 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.135535 24837 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:59.096745 24825 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:59.173951 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.105943 24380 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.180989 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.136641 24841 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:59.185451 18349 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:19:59.185607 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 52302.7us
I20260709 13:19:59.180909 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2813) took 1373 ms. Trace:
I20260709 13:19:59.200971 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.189692 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.191159 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:59.201735 18232 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:59.205786 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:19:59.162565 24692 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:19:59.189051 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:59.202407 18386 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:59.202440 18380 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:19:59.200871 18306 rpcz_store.cc:276] 0709 13:19:57.807230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.812605 (+  5375us) service_pool.cc:224] Handling call
0709 13:19:57.829648 (+ 17043us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:57.830115 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.830149 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:57.830812 (+   663us) log.cc:844] Serialized 52 byte log entry
0709 13:19:58.129286 (+298474us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:58.153183 (+ 23897us) log.cc:844] Serialized 14 byte log entry
0709 13:19:58.153813 (+   630us) log.cc:844] Serialized 14 byte log entry
0709 13:19:58.154607 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.154688 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:59.180650 (+1025962us) raft_consensus.cc:1685] finished
0709 13:19:59.180674 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.180830 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62504,"prepare.queue_time_us":19533,"prepare.run_wall_time_us":37,"raft.queue_time_us":4205,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":9346,"spinlock_wait_cycles":6835456,"thread_start_us":298065,"threads_started":1,"wal-append.queue_time_us":405675}
I20260709 13:19:59.180141 24439 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:59.192058 24950 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:59.148123 24793 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.223143 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.190532 25001 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:59.199110 24917 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:59.223905 18232 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
I20260709 13:19:59.229115 18379 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:59.187333 24961 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.214010 24742 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:19:59.251339 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 131593us
I20260709 13:19:59.253980 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.251709 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:59.255092 18232 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.256770 18957 raft_consensus.cc:1217] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 17 LEARNER]: Deduplicated request from leader. Original: 15.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 13:19:59.251181 18927 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:19:59.222501 24439 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:59.208760 25006 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:59.232684 24917 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:59.300110 24953 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:59.301050 18379 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20. Ops: []
W20260709 13:19:59.301482 25008 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:19:59.220566 24820 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:19:59.303646 24793 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:59.305924 24692 ts_tablet_manager.cc:1434] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.651s	user 0.013s	sys 0.010s
W20260709 13:19:59.306277 24692 ts_tablet_manager.cc:1467] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Tablet startup took 682ms
I20260709 13:19:59.309950 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2987) took 1618 ms. Trace:
I20260709 13:19:59.258948 18276 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:19:59.271857 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 146421us
I20260709 13:19:59.286854 24882 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:59.288429 24961 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:59.290071 24795 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:59.295332 24841 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.295928 24959 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:59.333779 24959 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:59.334985 24524 consensus_meta.cc:287] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.003s
I20260709 13:19:59.335711 18230 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:19:59.244652 24792 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.337137 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:59.337683 24380 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:59.333283 24841 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:59.338886 18306 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:59.339934 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:59.340325 24957 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:59.341027 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.341187 24958 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:59.341509 18307 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:59.322227 24795 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:59.342134 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.342412 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:19:59.333323 25007 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:19:59.228335 25001 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:19:59.343286 25001 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:59.343475 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.198071 24993 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:59.148314 24951 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:59.346304 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2991) took 1650 ms. Trace:
I20260709 13:19:59.310497 18236 rpcz_store.cc:276] 0709 13:19:57.691929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.778622 (+1086693us) service_pool.cc:224] Handling call
0709 13:19:58.779908 (+  1286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:58.828812 (+ 48904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.828880 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:58.829341 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.005220 (+175879us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:59.073218 (+ 67998us) log.cc:844] Serialized 14 byte log entry
0709 13:19:59.308493 (+235275us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b180036dd80. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa18226b060 00007fa18227d716 00007fa18228e287 00007fa18228e208
0709 13:19:59.309443 (+   950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.309533 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:59.309588 (+    55us) raft_consensus.cc:1685] finished
0709 13:19:59.309697 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.309867 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33387,"prepare.queue_time_us":75619,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":301473,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"spinlock_wait_cycles":9434496,"thread_start_us":98840,"threads_started":1,"wal-append.queue_time_us":239205}
I20260709 13:19:59.328989 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2810) took 1640 ms. Trace:
I20260709 13:19:59.331817 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2821) took 1430 ms. Trace:
I20260709 13:19:59.308791 24917 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:59.336944 24792 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:59.311846 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 53008.9us
I20260709 13:19:59.395535 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:19:59.341022 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.351119 18235 rpcz_store.cc:276] 0709 13:19:57.688177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.622363 (+934186us) service_pool.cc:224] Handling call
0709 13:19:58.622889 (+   526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:58.643007 (+ 20118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.643036 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:58.643475 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.036735 (+393260us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b18003c2560. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:19:59.176732 (+139997us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:59.176777 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.177475 (+   698us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:59.328603 (+151128us) raft_consensus.cc:1685] finished
0709 13:19:59.328632 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.328911 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19708,"raft.queue_time_us":30700,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":9976,"spinlock_wait_cycles":6455680,"thread_start_us":139406,"threads_started":1,"wal-append.queue_time_us":562900}
W20260709 13:19:59.356748 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.350871 18231 rpcz_store.cc:276] 0709 13:19:57.695975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.823606 (+1127631us) service_pool.cc:224] Handling call
0709 13:19:58.823970 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:58.845323 (+ 21353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:58.845394 (+    71us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:58.846335 (+   941us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.141530 (+295195us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:59.141697 (+   167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.141967 (+   270us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:59.346048 (+204081us) raft_consensus.cc:1685] finished
0709 13:19:59.346072 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.346231 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20469,"raft.queue_time_us":20624,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":16403,"thread_start_us":241030,"threads_started":1,"wal-append.queue_time_us":326176}
W20260709 13:19:59.398211 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 179639us
I20260709 13:19:59.401899 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.342268 24795 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:59.321705 24793 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:59.317049 24882 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:59.405833 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:19:59.420671 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.408351 18231 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:19:59.405326 18276 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:59.401373 18232 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:19:59.422642 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:19:59.424765 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.407616 24958 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:59.418283 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:59.424330 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.416896 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2996) took 1711 ms. Trace:
I20260709 13:19:59.425585 18236 rpcz_store.cc:276] 0709 13:19:57.705371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.415733 (+1710362us) service_pool.cc:224] Handling call
0709 13:19:59.416102 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.416344 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.416382 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:59.416565 (+   183us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:59.416627 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.416696 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.416827 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:59.426512 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.335953 24959 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:59.438100 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.440171 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.441067 18306 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:19:59.441255 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:59.434343 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2997) took 1722 ms. Trace:
I20260709 13:19:59.399360 18304 rpcz_store.cc:276] 0709 13:19:57.901488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.901663 (+   175us) service_pool.cc:224] Handling call
0709 13:19:57.902162 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:57.906330 (+  4168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.906365 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.911508 (+  5143us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.069393 (+1157885us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b1800321c40. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:19:59.208833 (+139440us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:59.208884 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.208975 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:59.331500 (+122525us) raft_consensus.cc:1685] finished
0709 13:19:59.331526 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.331747 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3688,"raft.queue_time_us":45220,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":4775,"spinlock_wait_cycles":6313216,"thread_start_us":139218,"threads_started":1,"wal-append.queue_time_us":1345708}
I20260709 13:19:59.436667 18276 leader_election.cc:400] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19.
I20260709 13:19:59.443284 18276 leader_election.cc:403] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:59.443427 18307 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:59.442790 18231 rpcz_store.cc:276] 0709 13:19:57.711691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.407764 (+1696073us) service_pool.cc:224] Handling call
0709 13:19:59.408071 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.434019 (+ 25948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.434273 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:59.438767 18236 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:19:59.437336 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 2995) took 1740 ms. Trace:
I20260709 13:19:59.445431 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:59.444449 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.446642 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.446879 18231 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:19:59.445912 18235 rpcz_store.cc:276] 0709 13:19:57.697192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.417530 (+1720338us) service_pool.cc:224] Handling call
0709 13:19:59.436773 (+ 19243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.437029 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.437053 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:59.437095 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:59.437127 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.437176 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.437281 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:59.446224 18276 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:59.454246 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.442176 24377 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:59.455590 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.457790 18276 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:59.456812 24377 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:59.459000 18235 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:19:59.459877 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:59.434931 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:59.461439 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.462088 18236 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:59.455142 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:59.462903 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.463212 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.492170 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.499843 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.460392 18235 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:59.502288 24972 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:59.502920 24972 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:59.503381 24972 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:59.451642 24898 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.507413 24898 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.462419 24793 raft_consensus.cc:697] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:59.509431 24793 consensus_queue.cc:237] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.512501 24898 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:59.446741 24958 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.518435 24958 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:59.494555 18236 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:19:59.520083 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.520932 18236 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:19:59.448292 24971 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.515607 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.522054 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:59.524178 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:59.533643 18235 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:19:59.535099 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.536275 18235 raft_consensus.cc:2410] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:19:59.526167 24377 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:59.449479 24615 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:19:59.523778 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 68682.5us
I20260709 13:19:59.538019 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.538889 18235 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:19:59.540025 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:19:59.541538 18235 raft_consensus.cc:2410] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:19:59.455806 24946 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.550917 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:59.462236 24912 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:59.592114 18236 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:59.594491 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3004) took 1792 ms. Trace:
I20260709 13:19:59.594780 18236 rpcz_store.cc:276] 0709 13:19:57.802068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.591646 (+1789578us) service_pool.cc:224] Handling call
0709 13:19:59.591954 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.594239 (+  2285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.594435 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:59.494962 18379 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:19:59.599058 18235 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:59.599396 18307 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:59.599977 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2815) took 1478 ms. Trace:
I20260709 13:19:59.600550 18235 rpcz_store.cc:276] 0709 13:19:58.121418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.598455 (+1477037us) service_pool.cc:224] Handling call
0709 13:19:59.598820 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.599690 (+   870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.599911 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:59.460949 25003 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:59.531297 24895 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:59.491580 25017 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:59.607554 18235 pending_rounds.cc:85] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 9
I20260709 13:19:59.634184 18235 pending_rounds.cc:107] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:19:59.634483 18235 raft_consensus.cc:2889] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:59.609858 18236 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:19:59.604310 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:59.635021 18236 pending_rounds.cc:85] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 10
I20260709 13:19:59.635264 18236 pending_rounds.cc:107] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:19:59.635485 18236 raft_consensus.cc:2889] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:59.636049 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2817) took 1514 ms. Trace:
I20260709 13:19:59.636298 18236 rpcz_store.cc:276] 0709 13:19:58.121951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.604000 (+1482049us) service_pool.cc:224] Handling call
0709 13:19:59.604275 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.635805 (+ 31530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.635965 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:59.637557 18236 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:19:59.610353 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 153416us
I20260709 13:19:59.543081 24615 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.541661 24904 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:19:59.650040 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 45873.1us
W20260709 13:19:59.650067 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 192303us
I20260709 13:19:59.651271 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:59.651455 18276 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:59.652318 24377 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:59.653628 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:59.612596 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.614090 25015 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:59.614301 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:59.615338 24958 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:59.602700 24627 consensus_queue.cc:1059] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:19:59.547976 24971 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.625319 24951 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:59.552366 24796 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:19:59.591388 24882 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:19:59.629269 25019 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:19:59.640087 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:59.638288 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2820) took 1511 ms. Trace:
I20260709 13:19:59.658293 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:59.523653 24858 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.111s
I20260709 13:19:59.601794 24524 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:59.649081 24825 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:59.604837 24912 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:19:59.652729 24615 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:59.689157 18236 rpcz_store.cc:276] 0709 13:19:58.127055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.636988 (+1509933us) service_pool.cc:224] Handling call
0709 13:19:59.637311 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.638006 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.638233 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:59.695242 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 55252.3us
I20260709 13:19:59.659590 24948 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:59.696506 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:59.592535 24946 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.702004 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:59.682446 24898 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:59.658070 24958 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:19:59.667346 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 111104us
I20260709 13:19:59.704059 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:19:59.705506 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:59.698416 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:19:59.696900 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2821) took 1569 ms. Trace:
I20260709 13:19:59.689186 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:59.699137 24912 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:59.707201 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:19:59.695199 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 43856.6us
I20260709 13:19:59.706832 18236 rpcz_store.cc:276] 0709 13:19:58.127314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.696025 (+1568711us) service_pool.cc:224] Handling call
0709 13:19:59.696333 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.696546 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.696573 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:59.696621 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:59.696662 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.696730 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.696847 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:59.683687 24895 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:59.697209 24951 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:59.658995 25003 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:59.661232 24439 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.714272 18231 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:19:59.702697 24882 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:59.706135 24958 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:59.701710 24996 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:59.712651 24467 tablet_bootstrap.cc:492] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:19:59.703313 24820 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:59.714519 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:19:59.720474 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:59.714525 24951 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.723498 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.714185 24904 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:59.748524 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.724771 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:19:59.714885 25006 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:59.711572 24959 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:59.726135 25028 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:59.719112 24841 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:59.747321 18380 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 9.
W20260709 13:19:59.755954 25022 log.cc:927] Time spent T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:19:59.757639 24439 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:19:59.760536 24950 consensus_meta.cc:287] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.516s	user 0.004s	sys 0.004s
I20260709 13:19:59.760986 24950 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:59.762288 18954 raft_consensus.cc:2393] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 16: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:19:59.763362 24971 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:19:59.747804 24880 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:59.764008 24880 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:59.764396 24880 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:59.748930 24951 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:59.770469 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.770485 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2818) took 1648 ms. Trace:
I20260709 13:19:59.771149 18312 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:19:59.754664 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:59.756073 24467 tablet_bootstrap.cc:492] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:19:59.773221 24467 ts_tablet_manager.cc:1403] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 2.402s	user 0.043s	sys 0.038s
I20260709 13:19:59.708642 24957 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:19:59.776741 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.771189 18235 rpcz_store.cc:276] 0709 13:19:58.122190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.606753 (+1484563us) service_pool.cc:224] Handling call
0709 13:19:59.607275 (+   522us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:59.697305 (+ 90030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.697343 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:59.699741 (+  2398us) log.cc:844] Serialized 52 byte log entry
0709 13:19:59.746574 (+ 46833us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:59.746615 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.747116 (+   501us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:59.770031 (+ 22915us) raft_consensus.cc:1685] finished
0709 13:19:59.770082 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.770358 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27955,"raft.queue_time_us":27452,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4546,"thread_start_us":32734,"threads_started":1,"wal-append.queue_time_us":56671}
I20260709 13:19:59.745509 24792 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:59.753180 24837 consensus_meta.cc:287] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.002s
I20260709 13:19:59.779446 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:59.780216 25034 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:59.789953 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.744944 24895 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.796660 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:59.802351 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:19:59.800091 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 92990.1us
I20260709 13:19:59.723909 25001 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:59.781816 25015 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:59.816041 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.789268 24837 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:59.819792 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:59.799703 25034 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.803752 24793 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:59.824965 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:19:59.826601 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.828624 18383 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:59.833292 24946 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:19:59.844151 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.844591 24950 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:19:59.813426 25015 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:59.809406 25033 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:19:59.830494 25029 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:59.853500 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:59.800901 24615 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.851833 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.823083 24792 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:59.862847 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:19:59.866219 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:19:59.831187 24971 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:59.831667 24796 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:59.828228 25034 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:59.306618 24692 ts_tablet_manager.cc:1469] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Trace:
0709 13:19:50.098770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.099018 (+   248us) service_pool.cc:224] Handling call
0709 13:19:50.357829 (+258811us) ts_tablet_manager.cc:934] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
0709 13:19:51.308982 (+951153us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa17f1690ac 00007fa187fc3ab9 00007fa17f18569b 00007fa17f182caa 00007fa17f182bd2 00007fa1871e7131
0709 13:19:53.743889 (+2434907us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:19:53.887062 (+143173us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:53.892365 (+  5303us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:19:54.181811 (+289446us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:19:54.228107 (+ 46296us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:54.298703 (+ 70596us) ts_tablet_manager.cc:989] Replica registered.
0709 13:19:54.338833 (+ 40130us) inbound_call.cc:177] Queueing success response
0709 13:19:55.318754 (+979921us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:19:58.654459 (+3335705us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:19:58.797359 (+142900us) tablet_replica.cc:261] Starting instrumentation
0709 13:19:58.936673 (+139314us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":1769,"mutex_wait_us":33175,"raft.queue_time_us":8391,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":18285,"spinlock_wait_cycles":71618432,"tablet-copy.queue_time_us":257842,"tablet-download-pool.queue_time_us":97439,"tablet-download-pool.run_cpu_time_us":2003,"tablet-download-pool.run_wall_time_us":235942,"thread_start_us":1173008,"threads_started":2}
I20260709 13:19:59.843614 24972 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:59.850840 25032 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:19:59.857290 25015 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:59.874686 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.853734 24793 raft_consensus.cc:697] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:59.878722 18312 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:19:59.880178 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:19:59.880534 25001 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:59.880739 18312 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:59.882375 25003 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:19:59.848438 24958 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:59.876597 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 102505us
I20260709 13:19:59.875226 24957 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:59.874042 25028 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:59.869050 25029 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:59.870718 24837 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:59.857932 24795 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:19:59.897554 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:59.894464 24968 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 1.787s	user 0.004s	sys 0.005s
I20260709 13:19:59.890862 24796 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:59.911031 24951 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.913460 24792 consensus_queue.cc:1059] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:59.915318 24615 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:19:59.915778 24793 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:59.916237 24971 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:59.921306 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.875031 24439 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
W20260709 13:19:59.924567 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 53335.5us
I20260709 13:19:59.876583 24820 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:19:59.923206 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2825) took 1027 ms. Trace:
I20260709 13:19:59.948699 18236 rpcz_store.cc:276] 0709 13:19:58.878706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.715841 (+837135us) service_pool.cc:224] Handling call
0709 13:19:59.716178 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.716399 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:59.814834 (+ 98435us) log.cc:844] Serialized 14 byte log entry
0709 13:19:59.905494 (+ 90660us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:59.905906 (+   412us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:59.905980 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.906376 (+   396us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:59.906542 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":144636,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":94,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":87,"thread_start_us":168228,"threads_started":2}
I20260709 13:19:59.950481 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:59.894750 24957 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:19:59.896915 25028 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:59.903018 25005 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.884s	user 0.002s	sys 0.001s
I20260709 13:19:59.920215 18132 catalog_manager.cc:5697] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 17 to 19, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 19 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:59.893281 24880 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:19:59.889068 25016 consensus_queue.cc:1059] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:19:59.922806 24837 raft_consensus.cc:697] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:19:59.959832 18312 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:19:59.993654 18132 catalog_manager.cc:5697] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 16 to 17, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 17 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:19:59.893966 25001 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:19:59.861486 25033 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.930351 24965 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.960239 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.988639 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:19:59.925992 24796 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:19:59.963341 18309 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:19:59.992602 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 101967us
I20260709 13:19:59.998133 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:19:59.957518 24957 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.002316 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:19:59.995257 18132 catalog_manager.cc:5697] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 16 to 17, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 17 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:00.012827 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:00.013803 18312 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:00.013638 18132 catalog_manager.cc:5697] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 20 to 21, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 21 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:59.986502 25044 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.003057 24467 raft_consensus.cc:359] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 19 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:19:59.961200 25028 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:00.020848 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:00.025971 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:00.049304 18378 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:19:59.987159 24895 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:00.015401 18132 catalog_manager.cc:5697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index -1 to 9, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added, no longer has a pending config: VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129), VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130), VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131), NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 17 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:20:00.056324 18132 catalog_manager.cc:5697] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 20 to 21, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 21 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:00.064958 25044 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.067807 25044 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:00.069028 24467 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
W20260709 13:20:00.021708 24917 consensus_meta.cc:287] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.001s
I20260709 13:20:00.072760 18236 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:20:00.075255 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:00.076149 18312 raft_consensus.cc:2393] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:00.076747 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2802) took 2413 ms. Trace:
I20260709 13:20:00.079236 18234 rpcz_store.cc:276] 0709 13:19:57.657536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.857534 (+199998us) service_pool.cc:224] Handling call
0709 13:19:57.857835 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:57.858056 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.858079 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.860928 (+  2849us) log.cc:844] Serialized 26 byte log entry
0709 13:19:57.952226 (+ 91298us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:57.952267 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:57.952352 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:59.768593 (+1816241us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:00.070806 (+302213us) raft_consensus.cc:1685] finished
0709 13:20:00.070829 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.071055 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8595712,"thread_start_us":62432,"threads_started":1,"wal-append.queue_time_us":106015}
W20260709 13:20:00.085744 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.086509 18234 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:00.086130 24467 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:00.098691 25015 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.117106 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:00.129288 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:00.095300 25042 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:00.076818 24917 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.116317 24993 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:00.131784 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:00.138716 18312 raft_consensus.cc:2393] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:00.007866 24965 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.147516 24467 ts_tablet_manager.cc:1434] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.374s	user 0.009s	sys 0.016s
I20260709 13:20:00.146925 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:00.050431 25029 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.157265 25029 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:00.158470 18379 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:00.129562 24795 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:00.087073 24796 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:00.188781 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:00.193768 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.093848 24837 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:00.197151 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:00.198447 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:00.199739 18957 raft_consensus.cc:1240] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:00.162243 24972 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:00.193817 25003 raft_consensus.cc:1064] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:20:00.187700 24951 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:00.209112 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:00.209713 18312 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 10.
I20260709 13:20:00.193045 24796 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:00.241308 25033 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:00.241802 25047 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:20:00.242837 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:00.243456 18312 raft_consensus.cc:2376] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16. Re-sending same reply.
I20260709 13:20:00.207820 24880 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:00.227929 25001 raft_consensus.cc:1064] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:20:00.260473 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:00.210783 24898 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:00.268098 24898 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:00.268973 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:00.273545 18230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 3007) took 2376 ms (client timeout 2179 ms). Trace:
W20260709 13:20:00.274290 18230 rpcz_store.cc:269] 0709 13:19:57.896831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.268035 (+371204us) service_pool.cc:224] Handling call
0709 13:20:00.273279 (+2005244us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b54001883d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:00.273426 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020147968}
I20260709 13:20:00.279363 18962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54020 (request call id 519) took 1240 ms. Trace:
W20260709 13:20:00.572537 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 551705us
I20260709 13:20:00.433174 18378 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:00.372321 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2830) took 2246 ms. Trace:
I20260709 13:20:00.296664 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:00.474596 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:00.374255 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 1406) took 1526 ms. Trace:
I20260709 13:20:00.576818 18305 rpcz_store.cc:276] 0709 13:19:58.125640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.127983 (+  2343us) service_pool.cc:224] Handling call
0709 13:19:58.128288 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:58.746335 (+618047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.372019 (+1625684us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b54003309d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:00.372229 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1173392256}
W20260709 13:20:00.390537 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.286756 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:00.584555 18312 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 14: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:00.496721 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:00.291062 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4033) took 1437 ms. Trace:
I20260709 13:20:00.280009 18962 rpcz_store.cc:276] 0709 13:19:59.039193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.278063 (+1238870us) service_pool.cc:224] Handling call
0709 13:20:00.278560 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.278846 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.278891 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:00.278984 (+    93us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:00.279037 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.279123 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.279279 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.581506 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:00.601790 18306 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 14: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:00.602483 18304 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 15: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:00.579205 18384 rpcz_store.cc:276] 0709 13:19:58.847464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.847623 (+   159us) service_pool.cc:224] Handling call
0709 13:19:58.847979 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.097527 (+249548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.374011 (+1276484us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400074254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:00.374189 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572617600}
I20260709 13:20:00.603515 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:00.601138 18381 rpcz_store.cc:276] 0709 13:19:58.853595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.870537 (+ 16942us) service_pool.cc:224] Handling call
0709 13:19:58.873705 (+  3168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.212844 (+339139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.212879 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:59.212937 (+    58us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:59.213014 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.289166 (+1076152us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540033d954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:00.289241 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.290779 (+  1538us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b540033d950. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:00.290957 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":785867392}
I20260709 13:20:00.604773 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:00.606083 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 3678) took 1234 ms. Trace:
I20260709 13:20:00.608137 18307 rpcz_store.cc:276] 0709 13:19:59.339408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.342220 (+  2812us) service_pool.cc:224] Handling call
0709 13:20:00.499057 (+1156837us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54002238d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:00.574184 (+ 75127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230929792}
W20260709 13:20:00.363065 25039 log.cc:927] Time spent T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.412s	user 0.000s	sys 0.004s
W20260709 13:20:00.335398 25001 raft_consensus.cc:1068] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Unable to promote non-voter e016302b7e734d74833a2bf7bab44838: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:20:00.518712 24975 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 1.759s	user 0.005s	sys 0.000s
W20260709 13:20:00.368572 24989 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 1.682s	user 0.002s	sys 0.001s
W20260709 13:20:00.426724 25017 consensus_meta.cc:287] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.757s	user 0.006s	sys 0.005s
I20260709 13:20:00.619834 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:00.537228 24912 consensus_meta.cc:287] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.822s	user 0.012s	sys 0.000s
I20260709 13:20:00.342274 24917 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:00.632972 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:00.373615 25043 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:00.300386 24939 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:00.297400 24924 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:00.358747 25034 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:00.655494 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 349780us
W20260709 13:20:00.637610 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.642558 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:00.657253 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:00.618763 24984 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.331s	user 0.004s	sys 0.011s
I20260709 13:20:00.657864 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:00.659021 18307 raft_consensus.cc:2410] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:20:00.607419 24993 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:00.601308 24965 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:00.600878 24898 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:00.612875 24439 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:00.633587 18228 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:20:00.617672 24979 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:00.647894 25017 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19.
W20260709 13:20:00.631440 24928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.542s	user 0.023s	sys 0.053s
I20260709 13:20:00.630424 24858 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:00.323997 24957 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:00.374548 25028 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.664388 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:00.647208 24887 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:00.632264 24803 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.839s	user 0.015s	sys 0.002s
I20260709 13:20:00.650332 25016 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:20:00.707599 24803 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.937s	user 0.016s	sys 0.002s
W20260709 13:20:00.669234 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 49513.9us
I20260709 13:20:00.707612 24887 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:00.660790 24984 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.373s	user 0.004s	sys 0.012s
I20260709 13:20:00.648921 25043 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:00.651749 24924 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:00.670470 24971 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:00.706614 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2815) took 2887 ms. Trace:
I20260709 13:20:00.705080 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 3689) took 1359 ms. Trace:
I20260709 13:20:00.706214 24953 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:00.670173 24928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.588s	user 0.023s	sys 0.053s
I20260709 13:20:00.728793 18382 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:00.730271 24898 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:00.731019 24898 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.732751 24996 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:00.733421 24996 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:00.735877 24996 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:00.741467 25043 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.708757 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:00.649988 24912 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.742941 25043 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:00.743856 24898 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:00.715647 18305 raft_consensus.cc:2410] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:20:00.670410 25048 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.669855 24979 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:00.745180 25048 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.747082 24979 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:00.747556 25048 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:00.747938 24953 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:00.749647 18962 raft_consensus.cc:3055] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:00.750032 18962 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:00.750326 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:00.750661 24957 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:00.744378 25035 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:00.751231 18380 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:00.736459 24996 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:00.669847 25040 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:00.721681 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:00.753659 18311 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:00.706117 25028 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:00.720463 18310 rpcz_store.cc:276] 0709 13:19:57.819511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.838265 (+ 18754us) service_pool.cc:224] Handling call
0709 13:19:57.863331 (+ 25066us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:57.865355 (+  2024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:57.865386 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:57.872870 (+  7484us) log.cc:844] Serialized 26 byte log entry
0709 13:19:58.159715 (+286845us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:58.159757 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:58.159833 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.344602 (+2184769us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:00.706352 (+361750us) raft_consensus.cc:1685] finished
0709 13:20:00.706372 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.706559 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5353,"raft.queue_time_us":7951,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":13023,"spinlock_wait_cycles":143192832,"thread_start_us":232968,"threads_started":1,"wal-append.queue_time_us":676539}
I20260709 13:20:00.703613 25001 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:20:00.752691 25061 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.051s	user 0.002s	sys 0.000s
I20260709 13:20:00.753458 25040 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.744027 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:20:00.725386 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:00.760881 18303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 2842) took 1349 ms (client timeout 1591 ms). Trace:
W20260709 13:20:00.761328 18303 rpcz_store.cc:269] 0709 13:19:59.411757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.447696 (+ 35939us) service_pool.cc:224] Handling call
0709 13:20:00.760655 (+1312959us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54003c14d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:00.760817 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420291840}
I20260709 13:20:00.762006 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:00.759840 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:00.763420 18311 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:00.750859 18962 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:00.764815 18962 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:00.767959 25028 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:00.768967 25028 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.770798 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:00.773115 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:00.708063 25016 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:00.776609 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:00.778017 25001 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:00.779279 25001 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:00.779719 25057 log.cc:927] Time spent T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:00.779722 25001 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:00.782272 25001 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:00.782681 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:00.783386 18303 raft_consensus.cc:2376] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17. Re-sending same reply.
I20260709 13:20:00.754591 24996 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.786904 24996 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:00.787456 24928 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:00.773970 25028 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.789983 25040 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:00.791270 25034 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:00.771303 25035 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:00.792655 25035 raft_consensus.cc:697] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:00.755311 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:00.718008 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 1567) took 1821 ms. Trace:
I20260709 13:20:00.793365 18201 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:00.803454 18308 rpcz_store.cc:276] 0709 13:19:58.896440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.896928 (+   488us) service_pool.cc:224] Handling call
0709 13:19:58.944922 (+ 47994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.095394 (+150472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.717693 (+1622299us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54001df454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:00.717937 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344656640}
I20260709 13:20:00.808106 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:00.810755 25035 consensus_queue.cc:237] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.812456 24898 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:00.813074 24898 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:00.813583 24898 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:00.817366 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:00.818928 24995 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:00.819406 24995 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:00.819767 24995 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:00.821152 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:00.822255 18310 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:00.823208 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:00.823772 18275 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.132:42479 timed out after 1.684s (SENT) [suppressed 19 similar messages]
I20260709 13:20:00.823907 18310 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:00.825845 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:00.796821 18228 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:00.722127 18307 rpcz_store.cc:276] 0709 13:19:59.345866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.664038 (+1318172us) service_pool.cc:224] Handling call
0709 13:20:00.704996 (+ 40958us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.784380 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:00.828179 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:00.828833 18303 raft_consensus.cc:2410] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:20:00.830076 18308 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 21: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:20:00.830648 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.835866 18962 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:20:00.836265 18228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 2806) took 3167 ms (client timeout 1762 ms). Trace:
I20260709 13:20:00.842579 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:00.846216 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:00.837869 18228 rpcz_store.cc:269] 0709 13:19:57.660756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.684591 (+ 23835us) service_pool.cc:224] Handling call
0709 13:20:00.487853 (+2803262us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b5800569cd0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821cf0aa 00007fa182251447 00007fa182269fe7 00007fa18226b7de 00007fa18227727c 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c
0709 13:20:00.828430 (+340577us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17533184}
I20260709 13:20:00.847221 18377 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:20:00.755205 24971 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:00.853015 18201 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:00.792070 24924 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:00.827915 24868 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.865460 24377 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:00.834604 24953 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:00.871628 24377 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.864492 18308 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:00.830612 24957 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:00.860749 24961 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.869374 18380 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:00.873608 18312 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:20:00.874776 24868 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.877280 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3684) took 1532 ms. Trace:
I20260709 13:20:00.880306 18308 rpcz_store.cc:276] 0709 13:19:59.344504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.849385 (+1504881us) service_pool.cc:224] Handling call
0709 13:20:00.864204 (+ 14819us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:00.876831 (+ 12627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.877175 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.876188 24377 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:00.882067 24377 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:00.882679 24377 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.850291 24909 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:20:00.869354 25062 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:00.889325 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:00.893479 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:00.896260 18308 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:00.899734 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3694) took 1491 ms. Trace:
I20260709 13:20:00.900382 18308 rpcz_store.cc:276] 0709 13:19:59.408074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.894673 (+1486599us) service_pool.cc:224] Handling call
0709 13:20:00.895804 (+  1131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.896709 (+   905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.899644 (+  2935us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.907932 25044 raft_consensus.cc:3055] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:00.910292 24971 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:00.912006 25055 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:20:00.912253 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:00.912613 24984 raft_consensus.cc:3055] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:00.913146 24984 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:00.914111 24984 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.918398 25031 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:00.918674 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:00.919368 18380 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:00.920212 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3559) took 1902 ms. Trace:
I20260709 13:20:00.920972 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:00.921298 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:00.921942 18377 raft_consensus.cc:2393] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 16: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:00.923143 24984 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:00.890112 24887 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:00.920892 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:00.931380 24964 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:00.887406 24996 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:00.931983 24964 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:00.932833 24996 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:00.933346 24996 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:00.934653 24964 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:00.941146 24377 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:00.918859 25031 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:00.945169 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:00.944422 18926 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:20:00.952188 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.902480 18308 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:00.920641 18383 rpcz_store.cc:276] 0709 13:19:59.018260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.208188 (+189928us) service_pool.cc:224] Handling call
0709 13:19:59.208490 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.831915 (+623425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.919959 (+1088044us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b540012a054. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:00.920141 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425611520}
I20260709 13:20:00.948478 18381 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:00.887318 24957 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:00.961323 18926 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:00.955344 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2844) took 1542 ms. Trace:
I20260709 13:20:00.962335 18308 rpcz_store.cc:276] 0709 13:19:59.412984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.901611 (+1488627us) service_pool.cc:224] Handling call
0709 13:20:00.902015 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.955054 (+ 53039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.955284 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.963555 18308 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:00.964092 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2847) took 1550 ms. Trace:
I20260709 13:20:00.897290 25062 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:00.883786 24961 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:00.969971 18202 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:00.968966 18926 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:00.970772 18380 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 19.
I20260709 13:20:00.970155 24818 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:00.908468 25044 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:20:00.968416 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 115532us
I20260709 13:20:00.964387 18308 rpcz_store.cc:276] 0709 13:19:59.413923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.963101 (+1549178us) service_pool.cc:224] Handling call
0709 13:20:00.963415 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.963913 (+   498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.964043 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.979485 24377 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:00.979931 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:00.969698 25000 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:00.988286 24377 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:01.001842 18308 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:01.005951 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2848) took 1591 ms. Trace:
I20260709 13:20:01.000749 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:01.006446 18308 rpcz_store.cc:276] 0709 13:19:59.414135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.001302 (+1587167us) service_pool.cc:224] Handling call
0709 13:20:01.001651 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.005655 (+  4004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.005885 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:01.008498 18308 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:00.972790 18396 tablet_copy_service.cc:342] P 8b4fbc44aa2649f0bcac5cd70f71951d: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-35ee2a6512e24d10af3526398de71490 received from {username='slave'} at 127.0.0.1:43098
I20260709 13:20:00.980628 24950 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:01.013463 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2851) took 1594 ms. Trace:
I20260709 13:20:01.013059 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:01.015221 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:00.969588 25062 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:00.993584 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.024829 18380 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:01.024607 18308 rpcz_store.cc:276] 0709 13:19:59.414993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.008087 (+1593094us) service_pool.cc:224] Handling call
0709 13:20:01.008363 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.009014 (+   651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.009211 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.973244 24964 consensus_queue.cc:1059] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:20:00.978343 24818 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:01.026721 24818 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:01.026826 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3697) took 1594 ms. Trace:
I20260709 13:20:01.011413 24377 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.027405 18308 rpcz_store.cc:276] 0709 13:19:59.432885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.025899 (+1593014us) service_pool.cc:224] Handling call
0709 13:20:01.026240 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.026440 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:01.026478 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:01.026524 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:01.026557 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.026646 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.026752 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:00.968401 25028 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.009569 24979 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:20:01.049104 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 46872.5us
I20260709 13:20:01.037540 18308 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:01.038554 18396 tablet_copy_service.cc:434] P 8b4fbc44aa2649f0bcac5cd70f71951d: ending tablet copy session e016302b7e734d74833a2bf7bab44838-35ee2a6512e24d10af3526398de71490 on tablet 35ee2a6512e24d10af3526398de71490 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:20:01.055207 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2854) took 1602 ms. Trace:
I20260709 13:20:01.055428 18384 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:01.055855 18308 rpcz_store.cc:276] 0709 13:19:59.452815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.029605 (+1576790us) service_pool.cc:224] Handling call
0709 13:20:01.030022 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.053646 (+ 23624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.055137 (+  1491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:01.004107 24898 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:01.059373 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 82621.6us
I20260709 13:20:01.062026 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2855) took 1145 ms. Trace:
I20260709 13:20:01.062453 18308 rpcz_store.cc:276] 0709 13:19:59.917085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.061099 (+1144014us) service_pool.cc:224] Handling call
0709 13:20:01.061486 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.061707 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:01.061733 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:01.061780 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:01.061820 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.061874 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.061974 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:01.065541 24943 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.066530 24742 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:01.067001 24742 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:01.069777 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2856) took 1152 ms. Trace:
I20260709 13:20:01.070122 18308 rpcz_store.cc:276] 0709 13:19:59.917336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.068948 (+1151612us) service_pool.cc:224] Handling call
0709 13:20:01.069274 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.069455 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:01.069478 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:01.069521 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:01.069553 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.069600 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.069711 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:01.024313 25001 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.039585 25070 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:01.004415 25031 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.057492 25000 raft_consensus.cc:697] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:01.069916 24950 raft_consensus.cc:3055] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:01.048287 24803 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
W20260709 13:20:01.079344 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 66433.6us
I20260709 13:20:01.081030 18926 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:01.041456 24957 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.074361 25070 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.081847 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:01.084386 18229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 3008) took 3186 ms (client timeout 2034 ms). Trace:
W20260709 13:20:01.085542 18229 rpcz_store.cc:269] 0709 13:19:57.897494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.097023 (+199529us) service_pool.cc:224] Handling call
0709 13:20:01.084212 (+2987189us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b540037e1d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:01.084318 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2212189568}
I20260709 13:20:01.086337 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:01.089355 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.089772 18386 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:01.090016 18381 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:20:01.091125 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4030) took 2235 ms. Trace:
I20260709 13:20:01.091811 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:01.092085 18926 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:01.055588 24979 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:01.095038 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:01.091488 18382 rpcz_store.cc:276] 0709 13:19:58.851540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.852068 (+   528us) service_pool.cc:224] Handling call
0709 13:19:58.852523 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.729247 (+1876724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.087204 (+357957us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54000f2654. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:01.087322 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4314386688}
I20260709 13:20:01.081204 24950 raft_consensus.cc:740] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:01.049234 25044 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.083127 25031 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:01.080858 25016 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:01.057946 25071 consensus_queue.cc:1059] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:20:01.091902 24964 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:01.106675 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:01.090085 25070 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:01.112303 25063 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:20:01.115439 18349 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:01.116681 25065 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:20:01.105010 25076 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:20:01.116830 24858 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:20:01.118842 25003 raft_consensus.cc:1068] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Unable to promote non-voter e016302b7e734d74833a2bf7bab44838: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:20:01.120812 18956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53364 (request call id 621) took 2958 ms (client timeout 2090 ms). Trace:
I20260709 13:20:01.120072 25000 consensus_queue.cc:237] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:01.121236 18956 rpcz_store.cc:269] 0709 13:19:58.162655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.166294 (+  3639us) service_pool.cc:224] Handling call
0709 13:20:01.120554 (+2954260us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54005609d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:01.120699 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241045376}
I20260709 13:20:01.123034 24961 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:01.125279 18961 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:01.129712 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.153612 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:01.131611 24958 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:01.131943 24828 raft_consensus.cc:3055] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:01.132443 24977 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:01.132732 18958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54020 (request call id 510) took 2234 ms. Trace:
I20260709 13:20:01.094748 25043 consensus_queue.cc:1059] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:20:01.133400 25045 raft_consensus.cc:3055] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:01.136142 24904 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:01.140096 24868 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:01.166569 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:01.141353 25028 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:01.088690 24995 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.145680 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3572) took 1227 ms. Trace:
W20260709 13:20:01.146528 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.128329 24912 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:01.109025 24803 consensus_queue.cc:1243] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer 8b4fbc44aa2649f0bcac5cd70f71951d log is divergent from this leader: its last log entry 12.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:20:01.105269 25080 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:01.160180 18958 rpcz_store.cc:276] 0709 13:19:58.898015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.898156 (+   141us) service_pool.cc:224] Handling call
0709 13:19:58.935900 (+ 37744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:58.953494 (+ 17594us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:19:59.083597 (+130103us) log.cc:844] Serialized 14 byte log entry
0709 13:19:59.447924 (+364327us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:59.447983 (+    59us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:19:59.448036 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.132453 (+1684417us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b54006f72d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:01.132500 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.132651 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":260168,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":59,"raft.queue_time_us":81,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6624,"spinlock_wait_cycles":40577152,"thread_start_us":491714,"threads_started":2,"wal-append.queue_time_us":525297,"wal-append.run_cpu_time_us":1400,"wal-append.run_wall_time_us":1089640}
I20260709 13:20:01.117584 25076 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:01.145437 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:01.159595 24964 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 19 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:01.177150 18379 rpcz_store.cc:276] 0709 13:19:59.917751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.009543 (+ 91792us) service_pool.cc:224] Handling call
0709 13:20:00.009875 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.162549 (+152674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.145434 (+982885us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400129b54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:01.145620 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325364480}
W20260709 13:20:01.177691 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:01.179190 25066 log.cc:927] Time spent T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:20:01.180852 25038 consensus_queue.cc:1059] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 13:20:01.182570 25074 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:01.164182 24950 consensus_queue.cc:260] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.183450 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:01.171924 24951 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:20:01.159703 24828 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:01.185133 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:01.185995 24898 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:01.163791 25045 raft_consensus.cc:740] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:01.182453 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:01.196899 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:01.200871 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 92653.8us
I20260709 13:20:01.257416 18311 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
W20260709 13:20:01.199537 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.217806 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:01.165457 25044 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:01.176219 18956 raft_consensus.cc:1217] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.12->[19.13-19.13]   Dedup: 19.13->[]
W20260709 13:20:01.262629 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 65846us
I20260709 13:20:01.188341 25015 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:01.266834 18309 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 2852) took 1845 ms (client timeout 1594 ms). Trace:
I20260709 13:20:01.233639 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3701) took 1237 ms. Trace:
I20260709 13:20:01.267591 18310 rpcz_store.cc:276] 0709 13:19:59.996106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.232487 (+1236381us) service_pool.cc:224] Handling call
0709 13:20:01.232926 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.233211 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:01.233250 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:01.233319 (+    69us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:01.233366 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.233437 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.233566 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:01.269297 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:01.270001 18310 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.262552 18956 raft_consensus.cc:2955] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 19 LEARNER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:20:01.275504 24995 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:01.277738 24818 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.230722 25080 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.282954 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4028) took 3084 ms. Trace:
I20260709 13:20:01.256492 24912 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.283506 18385 rpcz_store.cc:276] 0709 13:19:58.198551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.202116 (+  3565us) service_pool.cc:224] Handling call
0709 13:19:58.202394 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.109771 (+907377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.282637 (+2172866us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54000cd5d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:01.282873 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2084717824}
I20260709 13:20:01.284276 18322 tablet_copy_service.cc:342] P 459e82ee6b564cc19be6f73186938e79: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-b6e6be0c25704f45b1b4f3c4f246fa02 received from {username='slave'} at 127.0.0.1:46642
I20260709 13:20:01.284860 18322 tablet_copy_service.cc:434] P 459e82ee6b564cc19be6f73186938e79: ending tablet copy session e016302b7e734d74833a2bf7bab44838-b6e6be0c25704f45b1b4f3c4f246fa02 on tablet b6e6be0c25704f45b1b4f3c4f246fa02 with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:20:01.284675 24996 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.285938 24829 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.286798 24996 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:01.287896 24928 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:01.283746 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:01.288975 25043 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:01.240240 18957 raft_consensus.cc:3055] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:01.229961 25076 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:01.249778 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 3699) took 1330 ms. Trace:
I20260709 13:20:01.280611 25077 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:01.258916 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2804) took 3598 ms. Trace:
W20260709 13:20:01.260043 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.239315 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:01.250878 18307 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:01.267310 18309 rpcz_store.cc:269] 0709 13:19:59.415225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.748168 (+332943us) service_pool.cc:224] Handling call
0709 13:20:01.260954 (+1512786us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54001decd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:01.261084 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479099136}
I20260709 13:20:01.304064 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:01.297411 18378 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:01.301769 18233 rpcz_store.cc:276] 0709 13:19:57.660206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.862653 (+202447us) service_pool.cc:224] Handling call
0709 13:19:59.021751 (+1159098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:59.111355 (+ 89604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.258707 (+2147352us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400269b50. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:01.258855 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664756992}
I20260709 13:20:01.290463 18957 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:01.297089 18305 rpcz_store.cc:276] 0709 13:19:59.918862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.616862 (+698000us) service_pool.cc:224] Handling call
0709 13:20:01.242798 (+625936us) spinlock_profiling.cc:243] Waited 66.8 ms on lock 0x7b54000bd6d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:01.249712 (+  6914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153569664}
I20260709 13:20:01.305332 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:01.283046 25080 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:01.350376 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.352809 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:01.307363 24803 raft_consensus.cc:3055] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:01.357611 18309 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:20:01.360904 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:01.358217 24964 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.364810 24979 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:01.290557 24952 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:20:01.365463 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:01.291043 24999 consensus_queue.cc:1059] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:20:01.366710 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:01.367456 24999 raft_consensus.cc:3055] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:01.296665 24959 consensus_queue.cc:1059] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:20:01.367861 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:01.368868 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:01.367866 24999 raft_consensus.cc:740] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:01.358876 18957 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.13, Last appended by leader: 13, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.370554 24999 consensus_queue.cc:260] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.371227 18957 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:01.371870 24999 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.364703 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:01.378718 18953 raft_consensus.cc:2368] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16.
I20260709 13:20:01.380635 24742 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.381987 18311 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:01.384087 24742 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:01.384986 24979 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.385552 24979 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.388073 24979 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:01.301614 24912 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.385288 25070 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:01.388986 24979 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:01.389899 24979 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.390654 24912 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:01.390750 25079 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:01.391690 18232 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:01.392494 24979 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:01.391251 18310 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16.
I20260709 13:20:01.393708 24829 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:01.394418 24829 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.395627 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:01.395746 24818 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:01.309976 25001 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:01.396741 24829 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:01.359133 24803 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:01.397398 24818 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:01.397993 24818 raft_consensus.cc:697] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 16 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:01.397475 25070 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:01.399672 18200 leader_election.cc:400] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16.
I20260709 13:20:01.399178 24818 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.400039 18200 leader_election.cc:403] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:01.342953 24984 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:20:01.405733 18305 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:01.406121 18310 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:01.409981 18307 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:20:01.410701 18957 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 12 index: 13. (term mismatch)
I20260709 13:20:01.413568 18309 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:01.411347 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:01.407817 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:01.411080 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:01.418598 18957 pending_rounds.cc:85] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Aborting all ops after (but not including) 12
I20260709 13:20:01.418919 18957 pending_rounds.cc:107] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Aborting uncommitted NO_OP operation due to leader change: 11.13
I20260709 13:20:01.419162 18957 raft_consensus.cc:2889] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:01.421873 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:01.424103 18305 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:01.437888 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.438639 18237 raft_consensus.cc:2410] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:20:01.412424 24952 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:01.437485 25029 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.437134 25044 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.439334 24946 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.415845 24993 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:20:01.444231 25043 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:20:01.465245 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 65716.4us
I20260709 13:20:01.444398 24952 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.482411 18233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:20:01.482873 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:01.484457 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:01.401921 24828 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.398279 24803 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.513074 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:01.525828 18228 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:01.533583 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.534179 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.535130 18384 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:01.536039 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:01.540196 18385 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:01.518180 18233 raft_consensus.cc:606] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:01.536227 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:01.549402 18233 raft_consensus.cc:614] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:01.550163 18381 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:01.520099 18229 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 10: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:01.471992 24943 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.519353 18201 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:01.597848 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 78588.9us
I20260709 13:20:01.600129 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.573208 25001 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:01.578310 25086 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:20:01.587931 24803 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:01.551602 25083 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:20:01.601745 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:01.621248 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:01.602274 18383 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:20:01.612855 25070 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.487103 25028 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.127s
I20260709 13:20:01.593518 25043 raft_consensus.cc:697] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:01.487061 24946 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.481371 25029 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:01.517285 24952 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:01.611985 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.608064 24783 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.617337 25071 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:01.623054 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.650199 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.602732 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.620808 24984 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:01.473663 25044 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:01.619333 25062 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.004s
I20260709 13:20:01.443338 24999 consensus_queue.cc:1059] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:20:01.629596 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:01.655995 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 355849us
I20260709 13:20:01.608284 24979 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:01.636201 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.664073 18382 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 16: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:01.638296 18385 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:01.638435 18958 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:20:01.617659 24981 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.615235 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:01.661130 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:01.644484 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.619055 24904 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:01.634855 25070 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.613409 25085 consensus_queue.cc:1059] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:20:01.647706 18955 raft_consensus.cc:1240] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:01.651473 18384 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:01.603801 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:01.650961 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 240968us
I20260709 13:20:01.653033 18383 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 12: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:01.625998 25077 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:20:01.654422 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.656133 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:01.675344 18233 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:01.676888 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:01.631755 18276 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:01.617812 25001 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.670972 24828 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:01.678331 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 46625.6us
I20260709 13:20:01.678501 18228 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:01.669144 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:01.681892 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.686416 18381 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 21: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:01.684638 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:01.687826 24377 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:01.687996 18229 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:01.686163 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:01.689392 18228 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 20.
I20260709 13:20:01.663561 24979 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:01.690382 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:01.695699 18228 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:01.683799 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:01.683303 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:01.693022 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:01.653824 25071 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.658641 25062 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.690438 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.705020 18380 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:20:01.696059 18202 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.016s	sys 0.021s
I20260709 13:20:01.698494 18382 raft_consensus.cc:2393] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:01.699167 18233 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:01.655830 24984 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.650795 24783 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.708220 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:01.708920 18202 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.016s	sys 0.021s
I20260709 13:20:01.706140 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:01.723328 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.724448 18380 raft_consensus.cc:2410] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:20:01.683917 24742 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:01.726517 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:01.726733 18228 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
W20260709 13:20:01.728219 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 646427us
I20260709 13:20:01.694514 25085 consensus_queue.cc:1243] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer 8b4fbc44aa2649f0bcac5cd70f71951d log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:20:01.732928 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:01.728078 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:01.747164 18232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 2830) took 2325 ms (client timeout 1591 ms). Trace:
W20260709 13:20:01.747661 18232 rpcz_store.cc:269] 0709 13:19:59.421466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.424030 (+  2564us) service_pool.cc:224] Handling call
0709 13:20:01.746935 (+2322905us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54000d1454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:01.747082 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4520995072}
I20260709 13:20:01.748982 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:01.749567 18232 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:01.748292 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.750970 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:01.751554 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:01.752699 18380 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 21: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:01.752745 18202 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:01.698237 24979 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:01.671737 24981 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.758555 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:01.759003 18380 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:01.766611 18962 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 19 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:01.767392 18202 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:01.768967 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:01.769165 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.731204 24742 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:01.756853 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54333.9us
I20260709 13:20:01.684986 25077 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.703639 25038 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
W20260709 13:20:01.758076 24975 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:20:01.819960 18232 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:01.778729 18233 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:20:01.837834 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:01.838858 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.821834 18276 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:01.839376 18232 raft_consensus.cc:2393] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 16: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:01.721814 24954 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:20:01.837966 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:01.848940 18233 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:01.766078 24904 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:01.754119 25085 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:01.877269 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2869) took 1030 ms. Trace:
I20260709 13:20:01.863972 18233 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:20:01.812798 24995 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:01.904095 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:01.904958 18233 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:01.876644 25038 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:01.835526 25015 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:20:01.811605 24988 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:01.765085 24957 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.897814 24959 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:01.895759 18229 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:01.747188 25076 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.721402 25043 consensus_queue.cc:237] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.898113 18306 rpcz_store.cc:276] 0709 13:20:00.846392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.247112 (+400720us) service_pool.cc:224] Handling call
0709 13:20:01.295077 (+ 47965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.295279 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:01.653774 (+358495us) log.cc:844] Serialized 14 byte log entry
0709 13:20:01.876726 (+222952us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:01.876831 (+   105us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:01.876908 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.877007 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.877180 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":63268,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"thread_start_us":565128,"threads_started":2}
I20260709 13:20:01.899382 18304 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:01.772938 24996 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:01.924037 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 248761us
W20260709 13:20:01.969556 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.811694 24742 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:01.901541 24971 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:01.901081 24995 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:01.927898 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.929615 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:01.933622 25070 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:01.934742 25091 consensus_queue.cc:1059] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:01.935586 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2861) took 2017 ms. Trace:
I20260709 13:20:01.930732 24957 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.942436 18961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54004 (request call id 613) took 3243 ms. Trace:
I20260709 13:20:01.946566 24829 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:01.922793 25044 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:01.954530 25076 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:01.955928 18926 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:01.921862 25038 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:01.969605 18233 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:01.971570 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:01.970002 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.970677 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:01.996536 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:01.973266 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:01.981602 18229 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:01.985141 18312 rpcz_store.cc:276] 0709 13:19:59.918374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.189387 (+1271013us) service_pool.cc:224] Handling call
0709 13:20:01.189754 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:01.190147 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:01.190175 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:01.190674 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:20:01.598202 (+407528us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:01.598276 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.598375 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.935352 (+336977us) raft_consensus.cc:1685] finished
0709 13:20:01.935375 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.935521 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4415,"raft.queue_time_us":1575,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":12273,"thread_start_us":407072,"threads_started":1,"wal-append.queue_time_us":712341}
I20260709 13:20:01.985998 18961 rpcz_store.cc:276] 0709 13:19:58.699168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:58.699355 (+   187us) service_pool.cc:224] Handling call
0709 13:20:01.125069 (+2425714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.155707 (+ 30638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.942192 (+786485us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b54005609d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:01.942356 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5577861504}
I20260709 13:20:01.998145 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.000002 18229 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:02.001398 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:02.002182 18232 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:20:01.985332 18377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.001s	sys 0.035s
I20260709 13:20:02.011531 18381 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:20:02.012108 18377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.001s	sys 0.035s
I20260709 13:20:02.003268 24999 consensus_queue.cc:1059] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:01.977015 25085 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:02.008124 25045 consensus_queue.cc:260] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.985507 24995 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:02.012976 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4049) took 1023 ms. Trace:
I20260709 13:20:02.021049 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.030234 18229 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:02.009169 24964 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:20:02.026311 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:02.032650 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:02.035527 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.963660 24959 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:01.979880 24928 consensus_queue.cc:1059] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:20:01.977464 24988 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:01.990487 18954 raft_consensus.cc:1240] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:20:02.000875 24829 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:02.100148 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.011274 25001 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:02.035619 18232 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:02.102376 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.102985 18232 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:02.103905 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.031170 18377 rpcz_store.cc:276] 0709 13:20:00.989672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.991011 (+  1339us) service_pool.cc:224] Handling call
0709 13:20:00.991647 (+   636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.992137 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:01.021174 (+ 29037us) log.cc:844] Serialized 14 byte log entry
0709 13:20:01.306939 (+285765us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b18003b4160. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e1323a 00007fa18227da2a
0709 13:20:02.012618 (+705679us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:02.012677 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:02.012729 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.012795 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.012905 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24229,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":127,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":7287552,"thread_start_us":705403,"threads_started":1}
I20260709 13:20:02.081913 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:01.996645 24996 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.032485 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.046206 25062 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.085950 25045 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:02.152902 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 200353us
I20260709 13:20:02.148907 18231 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:02.086460 24984 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:02.084646 24783 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:02.155125 18233 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:02.085256 25071 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.048305 24977 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:20:02.162020 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:02.156917 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 335193us
I20260709 13:20:02.104972 24981 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:02.162774 25070 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.225675 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.226531 18229 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:02.167114 25062 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.093853 25038 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.168671 25077 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.189555 24961 raft_consensus.cc:3055] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:02.174003 24828 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.232656 24954 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:02.232491 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 70556.5us
I20260709 13:20:02.240450 24912 raft_consensus.cc:3055] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:02.152875 24996 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:02.231099 25075 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 13:20:02.245755 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.266997 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.267794 18229 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:02.191879 25071 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:02.250244 24377 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:02.248728 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 478500us
I20260709 13:20:02.259061 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:02.300758 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:02.249320 24961 raft_consensus.cc:740] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:20:02.305696 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 46775.9us
I20260709 13:20:02.306358 18927 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:02.306690 18232 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:20:02.230223 25070 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.307063 18377 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:02.307813 18277 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:02.304118 24818 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.015s	sys 0.012s
I20260709 13:20:02.303678 18202 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:02.262512 24783 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.248369 25062 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.308189 25071 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
W20260709 13:20:02.315408 24952 consensus_meta.cc:287] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.002s
W20260709 13:20:02.316275 25101 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:20:02.317298 18312 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:02.319650 25111 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:20:02.320640 25104 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:20:02.325176 25109 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:20:02.325699 25098 log.cc:927] Time spent T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 13:20:02.325330 24961 consensus_queue.cc:260] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:02.327103 18960 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:02.328140 25044 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:02.390566 25003 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.330377 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 1572) took 1204 ms. Trace:
I20260709 13:20:02.459630 18309 rpcz_store.cc:276] 0709 13:20:01.126361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.406824 (+280463us) service_pool.cc:224] Handling call
0709 13:20:01.411518 (+  4694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.420499 (+  8981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.330097 (+909598us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b5400233f50. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:02.330299 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10114816}
W20260709 13:20:02.333422 25106 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:20:02.300796 25093 consensus_queue.cc:1059] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:20:02.260028 24912 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:02.337267 25064 raft_consensus.cc:3055] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:02.303633 25077 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:02.341642 25105 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:20:02.345412 25080 raft_consensus.cc:3055] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:20:02.347887 18237 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46128 (request call id 1071) took 3450 ms (client timeout 2541 ms). Trace:
I20260709 13:20:02.303503 24984 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:02.354163 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2870) took 1507 ms. Trace:
I20260709 13:20:02.355703 24957 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:02.359565 25085 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:02.360538 24953 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:02.318370 25103 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:20:02.364045 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2871) took 1515 ms. Trace:
W20260709 13:20:02.366173 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:02.301904 25035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.364s	user 0.025s	sys 0.020s
W20260709 13:20:02.370690 18201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.061s	sys 0.054s
W20260709 13:20:02.372200 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 68612.4us
I20260709 13:20:02.310607 24981 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:02.373790 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:02.377965 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 71691.5us
I20260709 13:20:02.394933 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:02.393303 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:02.376405 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:02.368717 24818 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.015s	sys 0.012s
I20260709 13:20:02.261673 24828 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:02.521625 18237 rpcz_store.cc:269] 0709 13:19:58.897782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.227020 (+329238us) service_pool.cc:224] Handling call
0709 13:20:02.347573 (+3120553us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b5400059454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:02.347789 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5021523200}
W20260709 13:20:02.523082 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 129901us
I20260709 13:20:02.300542 24999 consensus_queue.cc:1059] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.096s
W20260709 13:20:02.527076 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 353337us
I20260709 13:20:02.329517 24988 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:02.403141 24952 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.401775 25113 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:02.439483 25116 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:02.457746 24904 consensus_meta.cc:287] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260709 13:20:02.388876 24783 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.413888 25114 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.446668 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2838) took 3023 ms. Trace:
I20260709 13:20:02.447499 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.447707 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.448393 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.549827 18236 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:02.519376 18303 rpcz_store.cc:276] 0709 13:20:00.848396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.258486 (+410090us) service_pool.cc:224] Handling call
0709 13:20:01.301571 (+ 43085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.301772 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:01.660231 (+358459us) log.cc:844] Serialized 14 byte log entry
0709 13:20:02.333315 (+673084us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b180034bca0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa185c6b3c7 00007fa18227d9a7 00007fa18228d0bf 00007fa18228d038
0709 13:20:02.333608 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 13:20:02.363509 (+ 29901us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:02.363577 (+    68us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:02.363645 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.363805 (+   160us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.363967 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72585,"prepare.queue_time_us":493409,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":35240,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":25207,"spinlock_wait_cycles":13319424,"thread_start_us":649622,"threads_started":2,"wal-append.queue_time_us":559150}
I20260709 13:20:02.495436 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2857) took 2577 ms. Trace:
I20260709 13:20:02.523916 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:02.518532 18201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.061s	sys 0.058s
I20260709 13:20:02.518416 18311 rpcz_store.cc:276] 0709 13:20:00.847160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.258368 (+411208us) service_pool.cc:224] Handling call
0709 13:20:01.258777 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.382390 (+123613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.353791 (+971401us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54001bb554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:02.354076 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282884992}
W20260709 13:20:02.445037 25108 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:20:02.399595 24909 raft_consensus.cc:1064] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:20:02.530897 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:02.522420 24928 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.420919 24946 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:02.443464 24803 consensus_meta.cc:287] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.820s	user 0.005s	sys 0.007s
I20260709 13:20:02.459213 25044 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:02.519232 25035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.596s	user 0.025s	sys 0.024s
I20260709 13:20:02.449994 24996 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.439998 24959 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:02.579748 24783 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:02.530321 24953 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.479208 25003 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:02.530592 25077 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:02.625386 24979 consensus_meta.cc:287] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.853s	user 0.013s	sys 0.000s
I20260709 13:20:02.625896 25077 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:02.451541 25071 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.453079 25062 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.537171 18927 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:02.544909 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 237185us
W20260709 13:20:02.628062 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 90954.4us
I20260709 13:20:02.500672 24829 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.521229 25080 raft_consensus.cc:740] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:02.625932 24979 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.478104 25029 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.630925 24979 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.549929 18230 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:20:02.634835 24988 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:20:02.635331 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 2871) took 1065 ms. Trace:
I20260709 13:20:02.558642 24818 consensus_queue.cc:1059] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:20:02.400385 25078 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:02.551348 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.547947 18235 rpcz_store.cc:276] 0709 13:19:59.423383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.783240 (+359857us) service_pool.cc:224] Handling call
0709 13:20:00.378191 (+594951us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:00.615086 (+236895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:00.615136 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:00.622687 (+  7551us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.704331 (+ 81644us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:00.704393 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.704493 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:01.113961 (+409468us) raft_consensus.cc:1685] finished
0709 13:20:01.114005 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.439185 (+1325180us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b5400187ed0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:02.446591 (+  7406us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":235703,"raft.queue_time_us":236170,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":127,"spinlock_wait_cycles":1313354496,"thread_start_us":71864,"threads_started":1,"wal-append.queue_time_us":237675,"wal-append.run_cpu_time_us":4090,"wal-append.run_wall_time_us":1276875}
I20260709 13:20:02.636865 18236 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:02.637398 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:02.637794 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.638113 18235 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 21: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:02.636466 25078 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:02.638978 25078 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:02.548918 18276 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:02.635772 18230 rpcz_store.cc:276] 0709 13:20:01.569604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.448160 (+878556us) service_pool.cc:224] Handling call
0709 13:20:02.635262 (+187102us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:02.639895 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 91093.8us
I20260709 13:20:02.639961 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.640569 18230 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:20:02.640712 18276 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:02.641018 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 3026) took 1069 ms. Trace:
I20260709 13:20:02.641744 18230 rpcz_store.cc:276] 0709 13:20:01.571686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.639757 (+1068071us) service_pool.cc:224] Handling call
0709 13:20:02.640956 (+  1199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:02.642532 18276 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:02.537531 25031 consensus_meta.cc:287] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 1.430s	user 0.023s	sys 0.000s
W20260709 13:20:02.555820 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:02.543434 25112 log.cc:927] Time spent T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.236s	user 0.003s	sys 0.001s
I20260709 13:20:02.559369 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.528290 24984 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.656960 25016 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:02.658145 24984 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:02.537854 25064 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:02.660102 24961 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:02.659536 25064 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:02.660661 24954 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:02.661190 25064 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:02.663300 25031 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:02.564042 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:02.668248 18229 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:02.656380 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 3023) took 1085 ms. Trace:
I20260709 13:20:02.538949 24957 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:02.544224 24904 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:02.672636 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:02.551096 18308 rpcz_store.cc:276] 0709 13:19:59.917537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.070941 (+1153404us) service_pool.cc:224] Handling call
0709 13:20:01.243089 (+172148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:01.243394 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:01.264838 (+ 21444us) log.cc:844] Serialized 14 byte log entry
0709 13:20:01.663126 (+398288us) log.cc:844] Serialized 14 byte log entry
0709 13:20:01.663380 (+   254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:01.663437 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:01.663519 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.663610 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:01.935995 (+272385us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b180046b880. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:20:02.494632 (+558637us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b180046b880. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1542a6 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4
0709 13:20:02.495193 (+   561us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54000bd6d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:02.495354 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9395,"prepare.queue_time_us":22661,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":1421,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":5533,"spinlock_wait_cycles":524659200,"thread_start_us":363686,"threads_started":1,"wal-append.queue_time_us":720956}
I20260709 13:20:02.577052 25035 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:02.541603 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.542536 18379 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 23: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:02.542142 24912 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:02.595562 25094 log.cc:927] Time spent T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.550s	user 0.000s	sys 0.001s
I20260709 13:20:02.597884 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.598794 24909 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 11, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:02.684902 18232 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:02.685472 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 3040) took 1012 ms. Trace:
I20260709 13:20:02.685778 18232 rpcz_store.cc:276] 0709 13:20:01.673605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.597505 (+923900us) service_pool.cc:224] Handling call
0709 13:20:02.685405 (+ 87900us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:02.601574 24952 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:02.679023 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:02.570302 25044 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:02.688794 18380 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:20:02.689704 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:02.557655 25093 raft_consensus.cc:3055] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:02.693063 25093 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:02.693455 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:02.564998 24928 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:02.694028 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:02.694590 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:02.694885 18961 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:20:02.695282 18954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54020 (request call id 536) took 1329 ms. Trace:
I20260709 13:20:02.604720 24953 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:02.606956 25003 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:02.694103 18959 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:02.613806 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2883) took 1125 ms. Trace:
W20260709 13:20:02.615099 25102 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:20:02.698655 25089 raft_consensus.cc:3055] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:02.699106 25089 raft_consensus.cc:740] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:02.621287 24828 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.557430 25114 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.675832 24957 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:02.565542 24943 consensus_meta.cc:287] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.957s	user 0.013s	sys 0.000s
I20260709 13:20:02.701939 24943 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16.
I20260709 13:20:02.702728 25114 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.702842 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2880) took 1299 ms. Trace:
I20260709 13:20:02.520323 25085 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:02.448741 25070 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:02.633062 24995 consensus_meta.cc:287] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.586s	user 0.013s	sys 0.000s
I20260709 13:20:02.629209 18927 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:02.706193 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 77103.7us
I20260709 13:20:02.638912 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.527665 25028 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:20:02.640964 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:02.714056 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:02.714802 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.651415 24971 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.652540 25130 consensus_queue.cc:1059] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:20:02.653728 24742 consensus_meta.cc:287] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.666s	user 0.014s	sys 0.000s
I20260709 13:20:02.668794 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 2858) took 1131 ms. Trace:
W20260709 13:20:02.783840 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 69511.5us
I20260709 13:20:02.784097 18229 rpcz_store.cc:276] 0709 13:20:01.537382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.544173 (+1006791us) service_pool.cc:224] Handling call
0709 13:20:02.668726 (+124553us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:02.538909 25113 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:02.669102 18230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:20:02.669514 18234 rpcz_store.cc:276] 0709 13:20:01.570808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.559103 (+988295us) service_pool.cc:224] Handling call
0709 13:20:02.656307 (+ 97204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:02.669976 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.799880 18378 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:02.673448 18377 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:02.802019 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:02.802757 18377 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:20:02.674299 18237 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 20: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:02.674860 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:02.676337 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:02.798386 18230 raft_consensus.cc:606] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:02.677418 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:02.677740 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:02.805490 18384 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:20:02.681164 24912 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:02.697397 24924 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:02.811233 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:02.811519 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.628023 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:02.704775 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:02.703337 18307 rpcz_store.cc:276] 0709 13:20:01.403485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.426219 (+ 22734us) service_pool.cc:224] Handling call
0709 13:20:01.426649 (+   430us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:01.446161 (+ 19512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:01.446188 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:01.446712 (+   524us) log.cc:844] Serialized 52 byte log entry
0709 13:20:01.974380 (+527668us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:02.336854 (+362474us) log.cc:844] Serialized 14 byte log entry
0709 13:20:02.363283 (+ 26429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.363390 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:02.702631 (+339241us) raft_consensus.cc:1685] finished
0709 13:20:02.702653 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.702787 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":405869,"prepare.queue_time_us":361093,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":61331,"raft.run_cpu_time_us":436,"raft.run_wall_time_us":49578,"thread_start_us":451316,"threads_started":1,"wal-append.queue_time_us":765362}
W20260709 13:20:02.813140 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 185208us
I20260709 13:20:02.633466 25029 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.707226 18235 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:02.725605 18228 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16.
W20260709 13:20:02.727155 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 203315us
I20260709 13:20:02.814131 18230 raft_consensus.cc:2410] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:20:02.813864 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:02.815047 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:02.815165 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:02.775897 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.703527 25085 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:02.785501 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.826933 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:02.827353 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.827642 18229 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 21.
W20260709 13:20:02.793877 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:02.829074 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.802623 18201 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:02.713313 18349 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:02.811141 18385 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:02.697808 18305 rpcz_store.cc:276] 0709 13:20:01.488212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.512976 (+ 24764us) service_pool.cc:224] Handling call
0709 13:20:01.518754 (+  5778us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:01.520343 (+  1589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:01.520390 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:01.539021 (+ 18631us) log.cc:844] Serialized 52 byte log entry
0709 13:20:01.960424 (+421403us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:01.983831 (+ 23407us) log.cc:844] Serialized 14 byte log entry
0709 13:20:01.984231 (+   400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.984341 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:02.613426 (+629085us) raft_consensus.cc:1685] finished
0709 13:20:02.613468 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.613704 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1145,"prepare.queue_time_us":376003,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":8663,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":93432,"thread_start_us":331791,"threads_started":1,"wal-append.queue_time_us":603687}
W20260709 13:20:02.830077 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 116844us
I20260709 13:20:02.813759 18234 raft_consensus.cc:1240] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:02.695750 24928 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:02.830901 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2853) took 1294 ms. Trace:
I20260709 13:20:02.830741 18201 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:02.825922 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:02.765095 24964 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:02.702863 24957 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:02.831410 18234 rpcz_store.cc:276] 0709 13:20:01.536048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.813143 (+1277095us) service_pool.cc:224] Handling call
0709 13:20:02.813544 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.830674 (+ 17130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.830851 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:02.771019 25114 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:02.835043 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:02.803580 25113 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:02.700080 25089 consensus_queue.cc:260] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.695681 18954 rpcz_store.cc:276] 0709 13:20:01.366664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.369881 (+  3217us) service_pool.cc:224] Handling call
0709 13:20:01.370203 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.092117 (+721914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.695005 (+602888us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b5400630e54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:02.695197 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1359558016}
I20260709 13:20:02.810854 25099 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.842921 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:02.872053 25099 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:02.872972 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:02.874269 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:02.849557 24964 raft_consensus.cc:697] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:02.764839 24995 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.850972 25114 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.851753 24951 raft_consensus.cc:3055] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:02.852165 24957 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:02.843281 24928 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:02.859776 25113 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.826813 24803 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:20:02.879545 24951 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:02.837391 25070 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:02.888125 25070 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.888310 24943 raft_consensus.cc:993] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:20:02.840237 24904 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:02.825438 25029 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.698161 25078 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:02.816722 24971 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.871120 25075 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:02.875186 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.837128 24961 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:02.926652 24961 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:02.927138 24961 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:02.853075 25089 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:02.804005 24742 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.933974 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:02.887836 24964 consensus_queue.cc:237] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:02.693959 25093 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:02.935398 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:02.831377 24953 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:02.936537 18955 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:02.893388 24828 raft_consensus.cc:1081] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:20:02.885437 24952 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:02.894306 18235 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:02.879537 25028 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:02.922933 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:02.887845 24951 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.923964 24928 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:02.925930 18200 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:20:02.970852 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 45009us
I20260709 13:20:02.971413 18307 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:02.934249 24742 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:02.884155 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 49171.6us
W20260709 13:20:02.973886 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 318954us
I20260709 13:20:02.891132 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 3045) took 1079 ms. Trace:
I20260709 13:20:02.983206 18233 rpcz_store.cc:276] 0709 13:20:01.811843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.996250 (+184407us) service_pool.cc:224] Handling call
0709 13:20:02.890924 (+894674us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b540036abd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:02.891065 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363086720}
I20260709 13:20:02.984404 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:02.985460 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:02.985967 18233 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:20:02.879649 24939 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:02.888569 25070 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:02.946606 24953 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:02.948437 25134 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:02.948719 24971 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.950314 25029 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.921877 25113 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.952188 25114 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.952698 25099 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:02.955741 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:02.915716 24995 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:02.956900 25045 consensus_meta.cc:287] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.795s	user 0.005s	sys 0.011s
I20260709 13:20:02.987043 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:02.982692 18201 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:02.991312 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:02.991539 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 341306us
I20260709 13:20:02.998416 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2860) took 1460 ms. Trace:
I20260709 13:20:03.000056 18233 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:03.001741 24377 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:03.002866 18953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54020 (request call id 537) took 1614 ms. Trace:
I20260709 13:20:03.000072 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 3580) took 1466 ms. Trace:
I20260709 13:20:03.008119 25076 raft_consensus.cc:3055] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:03.095275 18229 rpcz_store.cc:276] 0709 13:20:01.537880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.828386 (+1290506us) service_pool.cc:224] Handling call
0709 13:20:02.891066 (+ 62680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.891278 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:02.891304 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:02.891349 (+    45us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:02.891382 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.891440 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.998179 (+106739us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b540036abd0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:02.998338 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143404800}
I20260709 13:20:03.096037 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:03.105229 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:03.105410 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:03.009660 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2856) took 1472 ms. Trace:
I20260709 13:20:03.106096 18233 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:20:03.106320 18235 rpcz_store.cc:276] 0709 13:20:01.536889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.814455 (+1277566us) service_pool.cc:224] Handling call
0709 13:20:02.837961 (+ 23506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.955844 (+117883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.009416 (+ 53572us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b5400329454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:03.009595 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129111936}
I20260709 13:20:03.010918 25000 consensus_queue.cc:1059] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:03.011451 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:03.108632 18231 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:02.948501 25078 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:03.114761 18308 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:20:03.115204 18308 pending_rounds.cc:85] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 10
I20260709 13:20:03.115465 18308 pending_rounds.cc:107] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:20:03.115751 18308 raft_consensus.cc:2889] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:02.974423 24952 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:03.089674 18386 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16.
I20260709 13:20:02.977447 25075 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:02.989957 25133 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:20:03.093415 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 110803us
I20260709 13:20:03.157713 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:03.095630 24377 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:03.093029 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 157696us
I20260709 13:20:03.158548 18201 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:03.095870 18379 rpcz_store.cc:276] 0709 13:20:01.533793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.533912 (+   119us) service_pool.cc:224] Handling call
0709 13:20:02.999785 (+1465873us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540004d3d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:02.999962 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2310353152}
I20260709 13:20:03.106930 18233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:20:03.114171 24904 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:03.160919 24904 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.106092 18229 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:20:03.017486 24953 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.160267 18233 raft_consensus.cc:606] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:03.165155 18233 raft_consensus.cc:614] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:03.039736 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 49043.2us
W20260709 13:20:03.043130 25119 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:20:03.013963 24828 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.040314 24742 raft_consensus.cc:3055] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:03.153882 18926 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:03.045068 24939 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:03.045279 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:03.095754 18953 rpcz_store.cc:276] 0709 13:20:01.388572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.388840 (+   268us) service_pool.cc:224] Handling call
0709 13:20:01.665033 (+276193us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:01.670102 (+  5069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:01.670149 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:01.679183 (+  9034us) log.cc:844] Serialized 26 byte log entry
0709 13:20:02.040553 (+361370us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:02.040599 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.040667 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:02.498561 (+457894us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:02.656608 (+158047us) raft_consensus.cc:1685] finished
0709 13:20:02.656635 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.002652 (+346017us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b5400858ed0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:03.002791 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4571,"raft.queue_time_us":6413,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":10743,"spinlock_wait_cycles":647653504,"thread_start_us":361020,"threads_started":1,"wal-append.queue_time_us":556598}
I20260709 13:20:03.093029 18384 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:03.159300 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:03.159507 18201 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:03.089922 25113 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.043397 24951 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:03.215934 24803 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:03.216481 24803 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.216871 24803 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.148891 25045 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:03.164803 24954 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:03.233175 25138 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
I20260709 13:20:03.043923 25134 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.234395 25134 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:03.230193 25045 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:03.237170 25031 consensus_meta.cc:287] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.000s
I20260709 13:20:03.238025 25136 consensus_queue.cc:1059] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:03.238866 25147 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:03.239238 25136 raft_consensus.cc:3055] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:20:03.239565 25045 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:03.239812 25136 raft_consensus.cc:740] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:03.234580 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:03.240559 18378 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
W20260709 13:20:03.245359 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.245909 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.167495 18235 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:03.247252 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2863) took 1708 ms. Trace:
I20260709 13:20:03.247747 18235 rpcz_store.cc:276] 0709 13:20:01.538740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.107730 (+1568990us) service_pool.cc:224] Handling call
0709 13:20:03.167294 (+ 59564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.246887 (+ 79593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.247165 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:03.166545 18231 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:20:03.094569 24971 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:03.094331 25029 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:20:03.262828 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.163446 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2868) took 1594 ms. Trace:
I20260709 13:20:03.263367 18229 rpcz_store.cc:276] 0709 13:20:01.568651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.162409 (+1593758us) service_pool.cc:224] Handling call
0709 13:20:03.162759 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.162994 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.163029 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.163081 (+    52us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:03.163132 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.163277 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.163385 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:03.168900 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 355112us
I20260709 13:20:03.265328 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:03.180801 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2869) took 1611 ms. Trace:
I20260709 13:20:03.170945 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:03.266429 18379 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:03.266175 18233 rpcz_store.cc:276] 0709 13:20:01.569009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.179557 (+1610548us) service_pool.cc:224] Handling call
0709 13:20:03.179912 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.180135 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.180166 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.180362 (+   196us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:03.180414 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.180480 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.180741 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:03.161471 24904 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.169375 24829 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:03.272766 24829 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.273296 24829 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:03.273800 24939 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.182214 24952 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.103267 25076 raft_consensus.cc:740] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:03.212031 18961 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:20:03.239403 25147 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.277388 18961 pending_rounds.cc:85] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Aborting all ops after (but not including) 8
I20260709 13:20:03.277688 18961 pending_rounds.cc:107] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Aborting uncommitted NO_OP operation due to leader change: 10.9
W20260709 13:20:03.256263 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.277941 18961 raft_consensus.cc:2889] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:03.280683 24377 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:02.881538 25044 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.241674 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:03.258877 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2862) took 1720 ms. Trace:
W20260709 13:20:03.260273 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 100833us
I20260709 13:20:03.260675 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2852) took 1724 ms. Trace:
W20260709 13:20:03.260901 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 101707us
I20260709 13:20:03.249461 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2867) took 1709 ms. Trace:
I20260709 13:20:03.269237 25075 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:03.164454 24957 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:03.262650 25031 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:03.170684 24928 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.114614 25131 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:03.170329 24953 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:03.282483 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:03.285291 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:03.277042 25016 consensus_meta.cc:287] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.000s
I20260709 13:20:03.157886 25133 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.292009 24377 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:03.292863 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.343722 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.292761 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:03.291477 18234 rpcz_store.cc:276] 0709 13:20:01.538451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.837946 (+1299495us) service_pool.cc:224] Handling call
0709 13:20:02.838240 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:02.843980 (+  5740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:02.844015 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:02.844672 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 13:20:03.152739 (+308067us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:03.155547 (+  2808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.156265 (+   718us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:03.258530 (+102265us) raft_consensus.cc:1685] finished
0709 13:20:03.258557 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.258788 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27315,"raft.queue_time_us":5334,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":260436,"threads_started":1,"wal-append.queue_time_us":360758}
I20260709 13:20:03.294665 24971 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:03.345872 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:03.292672 18231 rpcz_store.cc:276] 0709 13:20:01.568116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.109504 (+1541388us) service_pool.cc:224] Handling call
0709 13:20:03.166155 (+ 56651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.249111 (+ 82956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.249397 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:03.212806 24828 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:03.292301 18232 rpcz_store.cc:276] 0709 13:20:01.535796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.686474 (+1150678us) service_pool.cc:224] Handling call
0709 13:20:02.686800 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.687014 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:02.979503 (+292489us) log.cc:844] Serialized 14 byte log entry
0709 13:20:03.203972 (+224469us) log.cc:844] Serialized 14 byte log entry
0709 13:20:03.260161 (+ 56189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.260254 (+    93us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:03.260323 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.260423 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.260602 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94832,"prepare.queue_time_us":386850,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":102,"raft.queue_time_us":91964,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":27158,"thread_start_us":459398,"threads_started":2,"wal-append.queue_time_us":264489}
I20260709 13:20:03.348158 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:03.300124 25045 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:03.348853 18232 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:03.288872 25091 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:03.304610 24995 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:03.183665 24742 raft_consensus.cc:740] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:03.319777 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:03.455953 24742 consensus_queue.cc:260] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:03.457036 24742 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.262033 25113 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.457731 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:03.277508 24950 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:03.277977 25029 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.333112 25028 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:03.459235 25113 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:03.459659 25028 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.335314 18235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:20:03.484344 18235 raft_consensus.cc:606] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:03.337051 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51899.9us
W20260709 13:20:03.453001 25085 consensus_meta.cc:287] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.000s
W20260709 13:20:03.440081 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.485427 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:03.484771 18235 raft_consensus.cc:614] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:03.443504 25064 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.327548 25054 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:03.439566 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:03.544148 18231 raft_consensus.cc:2376] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16. Re-sending same reply.
I20260709 13:20:03.443849 24377 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.545338 24377 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:03.346688 24954 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:03.347218 25016 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:03.347095 25133 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:03.450448 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.333290 25003 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.381773 25045 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.326013 24957 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.203227 25043 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:03.457522 24995 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.288563 25147 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.458869 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:03.335029 18276 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:03.463243 24828 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:03.464875 24971 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.449874 24909 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:03.466326 24984 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:03.467196 24803 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:03.459146 25029 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:03.469273 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:03.588327 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:03.589562 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:03.590570 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:03.469542 24961 consensus_meta.cc:287] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.004s
W20260709 13:20:03.593179 25149 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:20:03.593405 24961 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:03.595755 24961 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:03.595216 24829 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:03.478410 18228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46128 (request call id 1075) took 1849 ms (client timeout 1653 ms). Trace:
I20260709 13:20:03.596668 18379 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:03.596768 18228 rpcz_store.cc:269] 0709 13:20:01.629019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.727784 (+ 98765us) service_pool.cc:224] Handling call
0709 13:20:03.478195 (+1750411us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b540029bdd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:03.478325 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219675904}
I20260709 13:20:03.597707 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:03.597893 18228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef83aa6f9534403ebe38156348430345"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:20:03.598439 18228 raft_consensus.cc:606] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:03.598829 18228 raft_consensus.cc:614] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:03.600076 18228 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:03.485406 25085 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:03.601285 18236 raft_consensus.cc:2393] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:03.601518 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3027) took 2029 ms. Trace:
I20260709 13:20:03.432503 18232 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 21.
I20260709 13:20:03.602445 25085 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:03.604228 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 118909us
I20260709 13:20:03.602312 18228 rpcz_store.cc:276] 0709 13:20:01.571977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.599618 (+2027641us) service_pool.cc:224] Handling call
0709 13:20:03.599889 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.600408 (+   519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.601429 (+  1021us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:03.605783 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.607407 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.607561 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3029) took 2035 ms. Trace:
I20260709 13:20:03.346726 18234 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16.
W20260709 13:20:03.608104 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 273149us
I20260709 13:20:03.608219 18228 rpcz_store.cc:276] 0709 13:20:01.586218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.606297 (+2020079us) service_pool.cc:224] Handling call
0709 13:20:03.606740 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.607063 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.607112 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.607181 (+    69us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:03.607249 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.607345 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.607487 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:03.611413 24995 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:03.611770 24954 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:03.580412 24909 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:03.612833 18228 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:03.498976 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:03.506130 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:03.448125 24912 consensus_meta.cc:287] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.003s
I20260709 13:20:03.614627 24909 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:03.521770 18307 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:03.614854 18305 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
I20260709 13:20:03.615132 18382 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:03.559907 25045 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:03.615978 25016 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:03.616500 25016 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:03.617205 25044 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:03.617319 25016 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:03.617988 18378 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:03.619699 24803 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:03.621438 24957 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:03.577044 25043 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:03.622849 18384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46844
I20260709 13:20:03.623448 18384 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:03.623870 18384 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:03.623950 25043 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:03.334942 25131 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:03.573745 25003 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:03.625412 25070 consensus_meta.cc:287] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.002s
I20260709 13:20:03.563289 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:03.626101 25003 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:03.566001 25028 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:03.443955 25076 consensus_queue.cc:260] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:03.576287 25035 consensus_meta.cc:287] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.880s	user 0.014s	sys 0.000s
I20260709 13:20:03.627830 25035 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:03.587806 24904 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.630388 18381 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:03.630616 24904 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:03.497505 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.610074 25130 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:03.631737 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.632054 25130 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:03.626154 25131 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:03.632498 25130 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:03.632629 18927 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:03.603583 18232 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:03.634075 18927 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:03.634613 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3028) took 2062 ms. Trace:
I20260709 13:20:03.635106 18232 rpcz_store.cc:276] 0709 13:20:01.572246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.602977 (+2030731us) service_pool.cc:224] Handling call
0709 13:20:03.603365 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.634366 (+ 31001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.634554 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:03.451921 25091 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.625321 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3025) took 2053 ms. Trace:
I20260709 13:20:03.625890 25070 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.309321 25136 consensus_queue.cc:260] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:03.621011 18378 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:03.569428 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 276716us
I20260709 13:20:03.637324 18377 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:03.623095 25134 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.603657 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:03.618635 25016 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:03.588196 24924 consensus_meta.cc:287] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.771s	user 0.014s	sys 0.000s
I20260709 13:20:03.555188 25054 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.556452 25064 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:03.614338 24954 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:03.638836 18232 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:03.749550 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3032) took 2135 ms. Trace:
I20260709 13:20:03.750602 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1073) took 2126 ms. Trace:
W20260709 13:20:03.750876 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.609741 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3030) took 2023 ms. Trace:
I20260709 13:20:03.651645 18383 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:03.752579 18234 rpcz_store.cc:276] 0709 13:20:01.586735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.608938 (+2022203us) service_pool.cc:224] Handling call
0709 13:20:03.609224 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.609424 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.609451 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.609490 (+    39us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:03.609535 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.609587 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.609687 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:03.645787 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:03.755715 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 109872us
I20260709 13:20:03.639706 18231 rpcz_store.cc:276] 0709 13:20:01.571414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.579054 (+2007640us) service_pool.cc:224] Handling call
0709 13:20:03.624855 (+ 45801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.625013 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.625037 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.625072 (+    35us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:03.625105 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.625155 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.625264 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:03.759574 18231 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:03.759510 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:03.605269 18277 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:03.762306 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 156991us
I20260709 13:20:03.763720 18277 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:03.747794 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.748869 18230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.079s	sys 0.138s
W20260709 13:20:03.766094 18230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.079s	sys 0.138s
I20260709 13:20:03.659209 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:03.669456 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:03.767671 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2861) took 2229 ms. Trace:
I20260709 13:20:03.768954 18385 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 16: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:03.639285 18384 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:03.769969 24959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.000s	sys 0.015s
W20260709 13:20:03.770541 24959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.000s	sys 0.015s
I20260709 13:20:03.771574 18385 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:03.771842 24959 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:03.772343 24959 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.772850 24959 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:03.650013 18927 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:03.650552 18386 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 21: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:20:03.774561 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.643208 24829 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:03.778743 18385 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:03.756402 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2872) took 2186 ms. Trace:
I20260709 13:20:03.780694 18229 rpcz_store.cc:276] 0709 13:20:01.569912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.483662 (+1913750us) service_pool.cc:224] Handling call
0709 13:20:03.484114 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.755414 (+271300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.755486 (+    72us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.755592 (+   106us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:03.755649 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.755807 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.756103 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94325,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":19000,"thread_start_us":270319,"threads_started":1}
I20260709 13:20:03.782871 24924 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:03.783751 24924 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:03.768285 18378 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:03.765686 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:03.775974 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 126748us
I20260709 13:20:03.751230 18232 rpcz_store.cc:276] 0709 13:20:01.624328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.636065 (+2011737us) service_pool.cc:224] Handling call
0709 13:20:03.636445 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.749874 (+113429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.750375 (+   501us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:03.750368 18228 rpcz_store.cc:276] 0709 13:20:01.613925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.611406 (+1997481us) service_pool.cc:224] Handling call
0709 13:20:03.612292 (+   886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.748577 (+136285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.749177 (+   600us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:03.642481 25131 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:03.699620 25070 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:03.802737 25015 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:03.803478 25015 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.804323 25015 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:03.709977 25133 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:03.675915 25134 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:03.742972 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:03.815658 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3034) took 2134 ms. Trace:
W20260709 13:20:03.817263 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.817538 18231 rpcz_store.cc:276] 0709 13:20:01.626094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.758332 (+2132238us) service_pool.cc:224] Handling call
0709 13:20:03.759029 (+   697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.760266 (+  1237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.760484 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:03.783865 18229 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:03.701567 25064 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:03.656044 25078 consensus_queue.cc:1059] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.173s
I20260709 13:20:03.802742 25131 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:03.869622 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3036) took 2223 ms. Trace:
I20260709 13:20:03.876073 18229 rpcz_store.cc:276] 0709 13:20:01.646091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.782834 (+2136743us) service_pool.cc:224] Handling call
0709 13:20:03.783498 (+   664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.869194 (+ 85696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.869534 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:03.768116 18230 rpcz_store.cc:276] 0709 13:20:01.538122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.832754 (+1294632us) service_pool.cc:224] Handling call
0709 13:20:02.845485 (+ 12731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.845741 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:03.156586 (+310845us) log.cc:844] Serialized 14 byte log entry
0709 13:20:03.766952 (+610366us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.767063 (+   111us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:03.767215 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.767340 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.767582 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":324176,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":20164,"raft.queue_time_us":2274,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":355,"thread_start_us":884796,"threads_started":2}
I20260709 13:20:03.824322 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 4062) took 1148 ms. Trace:
I20260709 13:20:03.884964 25078 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:03.885576 25078 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.886015 25078 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:03.892589 25133 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:03.894683 18230 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:03.895426 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3043) took 2199 ms. Trace:
I20260709 13:20:03.895784 18230 rpcz_store.cc:276] 0709 13:20:01.696192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.893649 (+2197457us) service_pool.cc:224] Handling call
0709 13:20:03.894196 (+   547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.895101 (+   905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.895333 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:03.664088 25089 consensus_meta.cc:287] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.002s
I20260709 13:20:03.881032 18382 rpcz_store.cc:276] 0709 13:20:02.675956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.676092 (+   136us) service_pool.cc:224] Handling call
0709 13:20:03.823743 (+1147651us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b54000ba9d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:03.824044 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1863526656}
I20260709 13:20:03.878293 25131 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:03.643115 25091 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.662014 24954 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.704885 25045 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.916870 25133 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:03.917883 25133 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.919530 25045 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:03.920655 25163 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:03.905357 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:03.922140 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 112289us
I20260709 13:20:03.645078 25000 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:03.930459 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:03.931881 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:03.936582 18384 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:03.937867 24954 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:03.699126 25054 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:03.925072 18234 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:03.946717 18237 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:03.951294 24959 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.953207 24928 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:03.953756 24928 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.954134 24928 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:03.812484 24924 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.957837 18378 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:20:03.960899 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2857) took 2420 ms. Trace:
I20260709 13:20:03.974007 18237 rpcz_store.cc:276] 0709 13:20:01.537115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.816937 (+1279822us) service_pool.cc:224] Handling call
0709 13:20:02.837456 (+ 20519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.947297 (+1109841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.948229 (+   932us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540001a9d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:03.957809 (+  9580us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2537437440}
I20260709 13:20:03.976120 18237 raft_consensus.cc:1240] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:03.967257 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1074) took 2342 ms. Trace:
I20260709 13:20:03.978035 18234 rpcz_store.cc:276] 0709 13:20:01.624613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.756102 (+2131489us) service_pool.cc:224] Handling call
0709 13:20:03.879871 (+123769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.957557 (+ 77686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.967198 (+  9641us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:03.969041 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.923491 25133 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:03.922879 25163 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:03.990545 25163 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:03.993523 25157 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:03.994088 25157 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:03.994541 25157 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:03.997123 25075 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.997447 24783 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:03.998095 25075 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.000236 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3024) took 2429 ms. Trace:
I20260709 13:20:04.000744 18235 rpcz_store.cc:276] 0709 13:20:01.571118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.487209 (+1916091us) service_pool.cc:224] Handling call
0709 13:20:03.487556 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.487769 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:03.488083 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 13:20:03.999448 (+511365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.999568 (+   120us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:03.999677 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.999795 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.000049 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":674,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":4074,"thread_start_us":479290,"threads_started":1,"wal-append.queue_time_us":498242}
I20260709 13:20:04.002712 25001 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:04.003711 18235 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:04.004570 25001 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:04.005102 25001 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:04.005198 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:04.000274 24951 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:04.006330 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.006531 24951 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:04.007117 24951 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:04.010610 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 247254us
I20260709 13:20:04.010049 18135 catalog_manager.cc:5697] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 11 to 12, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 12 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:04.011920 18277 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:04.012828 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 1430) took 1013 ms. Trace:
I20260709 13:20:04.013365 18377 rpcz_store.cc:276] 0709 13:20:02.999268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.598777 (+599509us) service_pool.cc:224] Handling call
0709 13:20:03.599102 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.645564 (+ 46462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.012235 (+366671us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b540012b954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:04.012582 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87462144}
I20260709 13:20:04.014904 18230 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:04.015805 18961 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:04.018694 25076 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:04.020702 18232 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:03.712116 25147 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.021404 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1077) took 2371 ms. Trace:
I20260709 13:20:03.704486 25029 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.022073 18234 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:04.022676 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2873) took 1916 ms. Trace:
I20260709 13:20:04.023005 18234 rpcz_store.cc:276] 0709 13:20:02.106015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.985619 (+1879604us) service_pool.cc:224] Handling call
0709 13:20:04.021642 (+ 36023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.022425 (+   783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.022606 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:04.023455 25147 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:03.960400 25093 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:04.011262 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 1586) took 1212 ms. Trace:
I20260709 13:20:04.021845 18232 rpcz_store.cc:276] 0709 13:20:01.650288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.875472 (+2225184us) service_pool.cc:224] Handling call
0709 13:20:03.922736 (+ 47264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.021153 (+ 98417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.021355 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:04.024818 18229 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:04.024494 18234 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:04.025981 18383 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:04.031010 18277 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:04.029292 18231 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:04.024166 25029 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:04.041127 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.031412 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1082) took 1276 ms. Trace:
I20260709 13:20:04.042189 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3053) took 1939 ms. Trace:
I20260709 13:20:04.042006 18235 rpcz_store.cc:276] 0709 13:20:02.728228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.002609 (+1274381us) service_pool.cc:224] Handling call
0709 13:20:04.003165 (+   556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.004222 (+  1057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.004445 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:04.028908 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:04.010044 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 3049) took 2028 ms. Trace:
I20260709 13:20:04.043139 18237 rpcz_store.cc:276] 0709 13:20:02.047021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.975295 (+1928274us) service_pool.cc:224] Handling call
0709 13:20:03.975787 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.979878 (+  4091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.985789 (+  5911us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:04.048163 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1080) took 2355 ms. Trace:
I20260709 13:20:04.048687 18229 rpcz_store.cc:276] 0709 13:20:01.692361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.883730 (+2191369us) service_pool.cc:224] Handling call
0709 13:20:03.966932 (+ 83202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.041073 (+ 74141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.048086 (+  7013us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:04.029536 18308 rpcz_store.cc:276] 0709 13:20:02.798466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.798905 (+   439us) service_pool.cc:224] Handling call
0709 13:20:02.799221 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.122983 (+323762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.010632 (+887649us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400234e54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:04.010980 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699754752}
I20260709 13:20:04.025950 24377 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:04.053092 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1078) took 2394 ms. Trace:
I20260709 13:20:04.053570 18231 rpcz_store.cc:276] 0709 13:20:01.652619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.028507 (+2375888us) service_pool.cc:224] Handling call
0709 13:20:04.028985 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.041259 (+ 12274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.046806 (+  5547us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:04.052253 18132 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39288 (request call id 215) took 9819 ms. Trace:
I20260709 13:20:04.052125 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1083) took 1322 ms. Trace:
I20260709 13:20:04.058384 18234 rpcz_store.cc:276] 0709 13:20:02.728574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.023786 (+1295212us) service_pool.cc:224] Handling call
0709 13:20:04.024193 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.045084 (+ 20891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.050908 (+  5824us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:04.027536 25129 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:04.045820 18236 rpcz_store.cc:276] 0709 13:20:01.981635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.637594 (+655959us) service_pool.cc:224] Handling call
0709 13:20:04.009406 (+1371812us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b540037e6d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:04.009725 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2214175616}
I20260709 13:20:03.998112 24783 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.956168 25080 consensus_queue.cc:260] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:04.075428 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 538542us
I20260709 13:20:04.083614 18961 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:04.025890 25078 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.072151 24783 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:04.044499 18135 catalog_manager.cc:5697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 17 to 18, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 18 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:04.089826 24837 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.090445 24837 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:04.094183 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1084) took 1365 ms. Trace:
I20260709 13:20:04.094842 18232 rpcz_store.cc:276] 0709 13:20:02.728867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.057829 (+1328962us) service_pool.cc:224] Handling call
0709 13:20:04.092724 (+ 34895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.093573 (+   849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.093623 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:04.093717 (+    94us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:04.093775 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.093872 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.094088 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:04.105309 24950 consensus_meta.cc:287] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.647s	user 0.012s	sys 0.008s
W20260709 13:20:04.107522 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.112720 25114 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:04.055933 25054 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:04.115688 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51796.3us
I20260709 13:20:04.131088 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:04.063020 25001 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.133551 25001 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:04.133394 25131 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.134785 18955 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:04.135615 24837 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:04.089378 25075 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:04.140277 24742 consensus_meta.cc:287] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.617s	user 0.013s	sys 0.007s
I20260709 13:20:04.140641 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:04.141834 18135 catalog_manager.cc:5697] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 11 to 12, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 12 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:04.145025 18959 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:20:04.145916 24818 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.146414 24818 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.147668 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:04.148790 25054 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.150456 18927 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:04.107404 25136 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:04.118287 25078 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.151708 24803 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:04.154889 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:04.155259 24803 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 21 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:04.155683 24377 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.156324 24377 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.156536 24803 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.158221 24377 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:04.160949 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:04.161543 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:04.161875 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 147952us
I20260709 13:20:04.162889 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:04.162992 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 553228us
I20260709 13:20:04.163805 25029 raft_consensus.cc:2764] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:20:04.164844 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 49865.9us
I20260709 13:20:04.165095 25080 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:04.166332 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:04.169404 18380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3607) took 1182 ms. Trace:
I20260709 13:20:04.170233 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:04.169852 18380 rpcz_store.cc:276] 0709 13:20:02.986428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.591486 (+605058us) service_pool.cc:224] Handling call
0709 13:20:03.591746 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.665672 (+ 73926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.665720 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.665787 (+    67us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:03.665835 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.168904 (+503069us) spinlock_profiling.cc:243] Waited 73.6 ms on lock 0x7b540019b254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:04.168973 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.169190 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169386752}
I20260709 13:20:04.170843 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:04.171674 18305 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:20:04.171082 18307 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.175341 18926 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:20:04.175555 25016 consensus_meta.cc:287] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.005s
I20260709 13:20:04.177862 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:04.178218 25075 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:04.178779 25075 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 17 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:04.179778 24959 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:04.182643 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.153255 18385 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:20:04.056840 18132 rpcz_store.cc:276] 0709 13:19:54.189212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.192100 (+  2888us) service_pool.cc:224] Handling call
0709 13:20:04.008208 (+9816108us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:00.325119 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:00.325993 (+   874us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:00.326043 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:20:00.326072 (+    29us) tablet.cc:662] Decoding operations
0709 13:20:00.519032 (+192960us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:00.519107 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:00.519143 (+    36us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:20:00.519741 (+   598us) tablet.cc:701] Row locks acquired
0709 13:20:00.519761 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:20:00.519937 (+   176us) write_op.cc:270] Start()
0709 13:20:00.520061 (+   124us) write_op.cc:276] Timestamp: P: 1783603200519875 usec, L: 0
0709 13:20:00.520088 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:20:00.524919 (+  4831us) log.cc:844] Serialized 2559 byte log entry
0709 13:20:01.069009 (+544090us) op_driver.cc:464] REPLICATION: finished
0709 13:20:01.470805 (+401796us) write_op.cc:301] APPLY: starting
0709 13:20:01.470914 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:01.936104 (+465190us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:01.936231 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:02.024201 (+ 87970us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:02.086222 (+ 62021us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 13:20:02.093253 (+  7031us) write_op.cc:312] APPLY: finished
0709 13:20:02.163546 (+ 70293us) log.cc:844] Serialized 65 byte log entry
0709 13:20:02.341643 (+178097us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b54002ae254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa18227032a 00007fa1821f5f14 00007fa1821f5ec3 00007fa1821f5e38 00007fa1821f5df3 00007fa1821f50dc 00007fa18221ee16 00007fa182206cbb 00007fa1821f139d 00007fa1821f4d75
0709 13:20:02.398496 (+ 56853us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:02.413743 (+ 15247us) write_op.cc:454] Released schema lock
0709 13:20:02.469467 (+ 55724us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:02.547237 (+ 77770us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:02.555503 (+  8266us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6095,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":397447,"apply.run_cpu_time_us":59412,"apply.run_wall_time_us":1064109,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29159,"num_ops":6,"prepare.queue_time_us":195989,"prepare.run_cpu_time_us":19534,"prepare.run_wall_time_us":337203,"raft.queue_time_us":175063,"raft.run_cpu_time_us":32665,"raft.run_wall_time_us":1311098,"replication_time_us":528110,"spinlock_wait_cycles":8554240,"thread_start_us":720172,"threads_started":5,"wal-append.queue_time_us":545810,"wal-append.run_cpu_time_us":12084,"wal-append.run_wall_time_us":2340912}]]}
I20260709 13:20:04.151546 25054 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:04.190795 25015 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
W20260709 13:20:04.193202 25142 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:20:04.179872 25075 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.196137 18959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53364 (request call id 650) took 1481 ms. Trace:
I20260709 13:20:04.199213 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:04.201165 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.180311 18228 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:04.200714 18959 rpcz_store.cc:276] 0709 13:20:02.715158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.717178 (+  2020us) service_pool.cc:224] Handling call
0709 13:20:04.195851 (+1478673us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540047cf54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:04.196037 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3007265536}
I20260709 13:20:04.204774 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3042) took 2513 ms. Trace:
I20260709 13:20:04.205349 18228 rpcz_store.cc:276] 0709 13:20:01.691409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.179540 (+2488131us) service_pool.cc:224] Handling call
0709 13:20:04.179983 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.202583 (+ 22600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.204684 (+  2101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:04.199962 24377 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.226754 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:04.233946 18384 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:04.221984 18135 catalog_manager.cc:5697] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:04.237293 18307 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
I20260709 13:20:04.243219 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:04.229697 25016 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.254055 24828 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:04.255064 24828 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.258150 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3604) took 1273 ms. Trace:
I20260709 13:20:04.258605 18379 rpcz_store.cc:276] 0709 13:20:02.984758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.280403 (+295645us) service_pool.cc:224] Handling call
0709 13:20:03.280837 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.597187 (+316350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.257486 (+660299us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54000cdad4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:04.257894 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725481728}
I20260709 13:20:04.269614 24951 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.271971 24951 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.251804 24954 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.272671 24377 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.274892 24954 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.277141 24928 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:04.279467 24928 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:04.280151 25128 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:20:04.282696 24953 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.936s	user 0.010s	sys 0.007s
I20260709 13:20:04.283161 24953 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.284336 18386 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:20:04.285616 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.289019 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 1427) took 1407 ms. Trace:
I20260709 13:20:04.289649 18381 rpcz_store.cc:276] 0709 13:20:02.881812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.881952 (+   140us) service_pool.cc:224] Handling call
0709 13:20:02.882370 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.630818 (+748448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.215000 (+584182us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b5400241b54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:04.288706 (+ 73706us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1719778176}
I20260709 13:20:04.293499 18955 raft_consensus.cc:2393] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 7: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
W20260709 13:20:04.295184 25130 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.011s
I20260709 13:20:04.295717 25130 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:04.297914 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.298600 25133 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.299163 25133 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.249868 18135 catalog_manager.cc:5697] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 5 to 6, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 6 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:04.317967 24377 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:04.305014 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 95247.1us
W20260709 13:20:04.305249 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 140758us
W20260709 13:20:04.311661 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 61683.8us
W20260709 13:20:04.317281 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 57800.1us
I20260709 13:20:04.300503 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:04.301965 25064 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:04.341611 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:04.342744 18961 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 13: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:04.346029 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:04.347766 24909 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:04.348628 24928 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:04.349889 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:04.349972 25076 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:04.350834 18955 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:20:04.351649 25076 consensus_queue.cc:1059] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:04.352123 24953 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:04.353013 25076 raft_consensus.cc:3055] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:04.353422 25076 raft_consensus.cc:740] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:04.354362 25076 consensus_queue.cc:260] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.355767 25076 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:04.356637 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.356958 25157 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.359390 25157 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:04.360029 18200 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:20:04.361546 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 61189.3us
I20260709 13:20:04.361768 25128 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:04.363014 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:04.363256 25128 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:04.363723 25128 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:04.365150 25128 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:04.366042 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.366706 25128 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:04.367919 25114 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:04.368710 25114 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.369912 24829 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:04.370721 24829 raft_consensus.cc:697] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:04.371045 25114 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.371727 25114 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:04.372699 24377 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:04.373445 24377 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:04.374385 24951 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.375030 24951 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.372375 25114 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:04.376706 25029 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.377429 25029 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.377889 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:04.379442 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:04.306195 25131 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:04.351826 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:04.381810 18200 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:04.303750 25070 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.340111 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:04.302557 25133 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:04.379848 25029 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.311209 25015 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.344225 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1081) took 2645 ms. Trace:
I20260709 13:20:04.384930 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:04.400179 18230 rpcz_store.cc:276] 0709 13:20:01.698738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.898792 (+2200054us) service_pool.cc:224] Handling call
0709 13:20:04.014578 (+115786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.015367 (+   789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.344027 (+328660us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x7b540037e6d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:04.344163 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123990912}
I20260709 13:20:04.387718 18959 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:20:04.402117 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:04.403103 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.390458 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:04.408360 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 43864us
I20260709 13:20:04.427692 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:04.380338 25129 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:04.411578 18927 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:04.315210 24783 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.377847 25114 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.479245 18235 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:04.430783 18135 catalog_manager.cc:5697] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 19 to 20, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 20 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:20:04.494531 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 61642.6us
I20260709 13:20:04.391117 25163 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:04.496456 18953 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 15 LEARNER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:20:04.438687 18383 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 4059) took 2786 ms (client timeout 1918 ms). Trace:
W20260709 13:20:04.503750 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 139031us
W20260709 13:20:04.502349 18383 rpcz_store.cc:269] 0709 13:20:01.620708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.683031 (+ 62323us) service_pool.cc:224] Handling call
0709 13:20:04.380968 (+2697937us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b540019a854. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:04.406962 (+ 25994us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4490896256}
I20260709 13:20:04.498399 18927 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:20:04.511029 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 109937us
I20260709 13:20:04.513229 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:04.513432 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 79174.1us
I20260709 13:20:04.514117 18381 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:04.516664 24909 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:04.518651 25038 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:04.518687 25000 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:20:04.523849 25133 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.524421 25133 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.525450 24783 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:04.527062 25089 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.527441 18385 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:04.527633 25089 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.518850 25131 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:04.528800 25131 raft_consensus.cc:697] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:04.529377 18381 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:04.530009 24818 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.529801 25131 consensus_queue.cc:237] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:04.531620 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 80806.2us
I20260709 13:20:04.533738 24377 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:20:04.535841 25091 consensus_meta.cc:287] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.606s	user 0.014s	sys 0.001s
I20260709 13:20:04.536396 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:04.536896 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:04.537573 18378 raft_consensus.cc:2376] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21. Re-sending same reply.
I20260709 13:20:04.537814 24818 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:04.541955 25064 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.542550 18236 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:04.545418 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.546047 18384 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:04.550308 24951 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:04.553357 18236 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:04.536304 25091 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.559896 18307 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 22.
I20260709 13:20:04.476267 25129 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.560806 25129 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:04.563933 25093 consensus_meta.cc:287] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.535s	user 0.003s	sys 0.009s
I20260709 13:20:04.566259 24952 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:04.566967 24952 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.569561 25130 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.498633 25070 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.490141 24803 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:04.571811 24803 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.572176 24803 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:04.513367 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:04.521777 18349 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:04.372318 24829 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.572798 25070 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.574826 25133 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:04.575585 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 54009.4us
W20260709 13:20:04.579557 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 200243us
I20260709 13:20:04.584004 18349 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:20:04.532089 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.575909 25054 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:04.590698 25054 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.400736 25016 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.502063 25163 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.430023 24742 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:04.580214 24828 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.429404 24837 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.170s
I20260709 13:20:04.599135 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:04.573624 25078 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.581223 25091 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.604930 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:04.607254 18235 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:20:04.601022 25054 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:04.619843 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:04.624159 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:04.604410 25163 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:04.581305 25070 consensus_queue.cc:1059] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:20:04.626374 24952 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:04.631467 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:04.635190 18236 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 21: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:04.623736 25089 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.629159 24783 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:04.612871 24909 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:20:04.615931 25078 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.647011 24783 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.659758 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:04.652848 25064 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:04.670974 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 62321.9us
I20260709 13:20:04.671254 25064 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:04.677258 25016 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.652730 25128 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:04.683224 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:04.711490 18385 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:04.661849 24783 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:04.719237 18386 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:04.721515 18236 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:04.672094 25064 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:04.728785 18202 leader_election.cc:336] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.155s (SENT)
I20260709 13:20:04.729358 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:04.730592 25064 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.731164 25078 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:04.735002 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:04.732412 18202 leader_election.cc:336] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.189s (SENT)
I20260709 13:20:04.681939 25128 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:04.740957 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:04.715499 25089 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:04.737159 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 229296us
I20260709 13:20:04.757113 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:04.759449 18381 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 22: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:04.731184 25064 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:04.664505 25114 consensus_queue.cc:1059] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.075s
W20260709 13:20:04.761546 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 228357us
I20260709 13:20:04.766778 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:04.767179 18385 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:04.767571 18307 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
I20260709 13:20:04.768044 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:04.768766 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2884) took 1793 ms. Trace:
W20260709 13:20:04.770026 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.769193 18229 rpcz_store.cc:276] 0709 13:20:02.975451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.059345 (+1083894us) service_pool.cc:224] Handling call
0709 13:20:04.120075 (+ 60730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.178898 (+ 58823us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:04.405698 (+226800us) log.cc:844] Serialized 14 byte log entry
0709 13:20:04.744873 (+339175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:04.744948 (+    75us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:04.768492 (+ 23544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.768607 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.768712 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":411477,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":1200,"thread_start_us":447618,"threads_started":2}
I20260709 13:20:04.773907 24377 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:04.750896 25128 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:04.774922 18927 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:04.768692 18953 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:20:04.778766 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:04.763868 25136 consensus_meta.cc:287] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.004s
I20260709 13:20:04.786932 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:04.797544 18927 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:04.803599 18308 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:20:04.801505 18307 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 19.
I20260709 13:20:04.805997 18201 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:04.804388 25093 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:20:04.808686 25183 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:20:04.813107 25016 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:04.813503 25016 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:20:04.814647 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 82271.7us
I20260709 13:20:04.815465 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:04.815794 25091 raft_consensus.cc:3055] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:04.816190 25091 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:04.816941 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:04.817674 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:04.816279 18385 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 20: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:04.777945 25075 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:20:04.818148 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:04.821321 18379 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:04.778451 25130 consensus_queue.cc:1059] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:20:04.822086 25070 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.822466 25130 raft_consensus.cc:3055] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:04.822890 25130 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:04.822700 25070 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:04.829221 25179 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:20:04.829640 24818 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:04.806414 18275 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:04.824909 25133 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:04.817214 25091 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.831278 18955 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:20:04.879284 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:04.879714 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 48730.3us
I20260709 13:20:04.830272 25016 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.880227 25070 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:04.881033 24783 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.908187 25029 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.909039 25029 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.909789 18200 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:04.910243 24783 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:04.911233 25029 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.912781 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:04.913286 25016 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:04.904328 25129 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.919142 25070 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:04.919623 25070 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.919431 24803 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.920034 25070 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:04.899835 25136 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:04.920841 25129 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.882135 18381 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:04.883939 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:04.884778 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:04.884971 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:04.922667 18385 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:04.923951 25114 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:04.924386 25114 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.894057 25133 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:04.925668 25133 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.926981 25133 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:04.883970 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:04.893549 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 87212.7us
W20260709 13:20:04.929297 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.881407 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:04.895609 24377 raft_consensus.cc:2764] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:04.803040 24742 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.901088 18953 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:20:04.908094 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:04.894958 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 98926.8us
I20260709 13:20:04.907699 25093 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 22 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:04.920890 25136 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.921733 25091 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:04.933180 18386 raft_consensus.cc:2368] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19.
I20260709 13:20:04.924782 25114 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:04.793465 25089 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:04.944474 18236 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:04.946987 25089 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.890169 24818 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.876255 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:20:04.902328 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 63209.4us
I20260709 13:20:04.943684 18382 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 15: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:04.937273 24742 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.947335 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:04.953194 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:04.952860 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 121119us
I20260709 13:20:04.954231 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:04.954722 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:04.955240 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:04.955739 25038 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:04.956581 24951 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:04.958247 24803 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:04.958076 25029 consensus_queue.cc:1059] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:04.958644 25150 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.073124 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.073361 25150 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:05.073987 18233 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:04.959928 25081 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:05.076783 25081 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.077221 25081 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:05.077644 18276 leader_election.cc:400] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19.
I20260709 13:20:05.077992 18276 leader_election.cc:403] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:20:04.960842 25130 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:05.082633 18229 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 22: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:04.962229 25093 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:04.962849 24818 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:04.963213 25147 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.897823 24829 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:20:04.882061 24954 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 13:20:04.974642 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:04.933493 25136 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:04.999485 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.928429 25163 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.063035 18379 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 17: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:20:05.069389 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 115719us
I20260709 13:20:05.062844 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:05.092816 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:05.077036 25054 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.138665 18232 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:05.139976 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:05.110486 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:05.143381 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 205934us
I20260709 13:20:05.145334 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:05.146467 18230 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:05.148252 18308 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.139197 18960 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.140620 18236 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
W20260709 13:20:05.101271 25080 consensus_meta.cc:287] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.932s	user 0.009s	sys 0.004s
I20260709 13:20:05.084100 25089 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.101097 25000 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.155900 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.160902 18228 raft_consensus.cc:2368] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 16. Current term is 17.
I20260709 13:20:05.161643 18384 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:05.161532 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:20:05.162479 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 192169us
I20260709 13:20:05.162696 24377 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:05.166672 24377 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:05.167083 24377 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.096284 25184 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.078s
I20260709 13:20:05.184690 18201 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:05.108464 25147 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.204839 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.208818 18201 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:05.160902 18954 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
W20260709 13:20:05.219352 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 161078us
I20260709 13:20:05.220314 18230 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:20:05.226256 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 81230us
I20260709 13:20:05.178489 24783 consensus_queue.cc:1059] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:20:05.163666 25089 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.179744 25000 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.233783 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.214159 25150 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:05.238600 18307 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:05.225577 25185 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:05.250188 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.256980 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:05.257717 18236 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:05.259490 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.236963 25186 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:05.241910 24783 consensus_queue.cc:1243] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer e016302b7e734d74833a2bf7bab44838 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:20:05.264824 25192 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.127s	user 0.000s	sys 0.004s
I20260709 13:20:05.265466 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:05.225756 25128 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:05.248413 25201 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:05.271140 18234 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:05.272117 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.277877 25038 consensus_queue.cc:1059] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:20:05.288058 25000 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:05.284584 25064 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.292029 25064 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:05.284722 25080 consensus_queue.cc:1059] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:20:05.293663 24803 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:05.294267 25080 raft_consensus.cc:3055] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:05.294632 25080 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:05.295542 25080 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.296829 25080 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:05.303956 24742 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:05.307953 25198 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:20:05.282183 25210 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.310567 25210 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:05.313817 25202 log.cc:927] Time spent T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:20:05.321419 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 77232.2us
I20260709 13:20:05.325278 25054 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:05.327080 25147 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:05.330273 25208 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:05.331703 25038 consensus_queue.cc:1243] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:20:05.332727 24742 raft_consensus.cc:3055] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:05.333122 24742 raft_consensus.cc:740] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:05.333915 24742 consensus_queue.cc:260] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:05.335098 24742 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:05.337165 18237 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:05.340808 25209 consensus_queue.cc:1175] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" responder_term: 16 status { last_received { term: 16 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 16 index: 10 } }
W20260709 13:20:05.341449 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 58049.2us
I20260709 13:20:05.332265 25038 consensus_queue.cc:1059] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:20:05.343811 25038 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:05.344192 25038 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:05.345163 25038 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:05.346411 25038 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:05.347446 25200 log.cc:927] Time spent T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:20:05.348282 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:05.265210 24964 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:05.349452 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.355960 18233 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:05.348971 18961 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 7.
I20260709 13:20:05.357722 18234 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:20:05.358350 18235 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:05.359411 25163 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:05.360031 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:05.361500 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:05.362341 18959 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:20:05.364115 25064 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:05.365886 24924 raft_consensus.cc:3055] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:05.366288 24924 raft_consensus.cc:740] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:05.367179 24924 consensus_queue.cc:260] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.348651 25186 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:05.369843 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.371759 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:05.372085 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:05.284479 25206 raft_consensus.cc:3055] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:05.373080 25206 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:05.373505 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:05.374169 18381 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 10.
I20260709 13:20:05.374218 25206 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:05.375769 25206 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:05.276046 25185 raft_consensus.cc:697] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:05.376911 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46128 (request call id 1091) took 1077 ms. Trace:
I20260709 13:20:05.377204 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:05.377965 18378 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:05.377614 25185 consensus_queue.cc:237] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:05.379782 25130 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:05.381652 24964 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.384044 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:05.369877 25186 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:05.372753 18383 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
W20260709 13:20:05.388552 25204 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.169s	user 0.002s	sys 0.000s
I20260709 13:20:05.389436 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:05.389822 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:05.390317 18382 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:05.377349 18228 rpcz_store.cc:276] 0709 13:20:04.299376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.329020 (+ 29644us) service_pool.cc:224] Handling call
0709 13:20:05.376654 (+1047634us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b540029d6d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:05.376818 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1743163136}
I20260709 13:20:05.391556 18308 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:20:05.391713 18275 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:05.393906 18960 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:20:05.394289 18349 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:05.395836 18349 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:05.363735 24818 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.397871 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.400170 18230 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:05.368327 24924 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:05.402776 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.409751 18237 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 22.
I20260709 13:20:05.410066 18234 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:05.408453 24377 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:05.413457 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.414737 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.417562 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:05.421398 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.425078 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:05.425951 18384 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 6.
I20260709 13:20:05.427337 18230 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 18: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:20:05.430864 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 144669us
I20260709 13:20:05.431483 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.432183 18234 raft_consensus.cc:2376] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14. Re-sending same reply.
I20260709 13:20:05.433598 24377 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:05.435654 18953 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 13: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:05.435823 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:05.397610 25147 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.438032 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:05.440033 18961 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:05.412887 25054 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:05.438306 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:05.445572 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:05.447849 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.448525 18234 raft_consensus.cc:2376] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19. Re-sending same reply.
I20260709 13:20:05.450480 25209 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.449865 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.451052 25209 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.430308 25210 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:05.464953 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:05.473413 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:05.475772 18381 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:05.477455 25128 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:05.446950 25147 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:05.480010 18233 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:05.480468 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.475910 24939 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:05.445859 25212 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:05.482241 18276 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:05.483964 18927 leader_election.cc:400] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 16. Current term is 17.
I20260709 13:20:05.491394 18927 leader_election.cc:403] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:05.492547 25133 consensus_meta.cc:287] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.005s
I20260709 13:20:05.492743 25128 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:05.493273 25147 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:05.481159 18235 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 19.
I20260709 13:20:05.495282 25136 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.486027 24939 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.497013 24939 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:05.462716 25054 raft_consensus.cc:697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:05.500825 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:05.501407 25054 consensus_queue.cc:237] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.503243 25209 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:05.493337 25128 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.504753 25128 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:05.506273 24818 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:05.504420 18927 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:05.514577 18230 raft_consensus.cc:2376] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18. Re-sending same reply.
I20260709 13:20:05.537451 18961 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:05.534170 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:05.515990 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:05.585343 18233 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:05.583961 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:05.594883 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.595989 18233 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:05.472465 25201 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19.
I20260709 13:20:05.583756 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:05.613628 18200 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:05.584545 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.507099 25212 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.627264 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:05.612486 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:05.628254 18304 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:05.517409 24818 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:05.613888 25070 consensus_meta.cc:287] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.003s
I20260709 13:20:05.579340 25078 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:05.583710 25080 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 16. Current term is 17.
W20260709 13:20:05.626358 25081 consensus_meta.cc:287] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.000s
I20260709 13:20:05.640951 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:05.642575 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.622761 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.635726 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.624423 25185 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:05.646015 18230 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:20:05.635859 25114 consensus_meta.cc:287] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.000s
I20260709 13:20:05.627576 25212 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:05.651842 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:05.545414 25089 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:05.658236 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.659739 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.661098 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.662173 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.662866 18233 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:05.663591 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.664775 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.665848 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.667781 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.669492 18233 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 23: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:05.672091 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.676612 18233 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:20:05.666586 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.679927 18231 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:05.684206 18231 raft_consensus.cc:1240] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:20:05.685470 18230 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 22: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:05.647212 25136 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:05.689874 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:05.690801 18384 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:05.691612 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:05.693485 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:05.694113 18385 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:05.694293 18378 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 6.
I20260709 13:20:05.694602 25208 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:05.693548 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:05.695590 18307 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:05.696142 24377 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:05.696542 24377 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.645597 25081 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.696866 24377 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:05.653194 25185 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:05.701030 25185 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.703153 18384 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:20:05.703719 24377 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:05.708985 25038 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.709975 25038 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:05.713230 25038 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:05.721906 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:05.722944 25133 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:05.724320 24377 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:05.727913 25147 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.728557 25147 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:05.730748 25147 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:05.735913 25150 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:05.736557 25150 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:05.642127 25078 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.746132 18926 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:05.749938 25184 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:05.750538 25184 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.750941 25184 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:05.752256 18959 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 15: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:05.646478 24818 raft_consensus.cc:697] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 14 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:05.759055 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:05.760214 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:05.760241 18202 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.513s (SENT)
I20260709 13:20:05.763537 18378 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:20:05.764050 18236 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
W20260709 13:20:05.766300 18202 leader_election.cc:336] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.513s (SENT)
W20260709 13:20:05.767954 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.774380 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.775767 18378 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:05.777163 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:05.778555 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:05.779718 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:05.780260 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:05.781123 18311 raft_consensus.cc:2393] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:05.781276 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:05.781930 18310 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:05.782226 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:05.783247 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:05.783373 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:05.784011 18309 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:05.783937 18310 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:05.785630 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:05.785988 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:05.786465 18309 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:05.786695 18310 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:05.787417 25186 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:05.788612 18236 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:05.788040 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:05.636386 25070 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.798256 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.799360 18235 raft_consensus.cc:2368] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19.
I20260709 13:20:05.759238 25130 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:05.791112 18202 leader_election.cc:336] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.563s (SENT)
I20260709 13:20:05.655450 25114 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:05.808130 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.818972 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.816349 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:05.814603 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:05.859094 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.816788 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.844978 18378 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:05.862409 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.863986 18236 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:05.753299 25150 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:05.872576 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.876302 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:05.894762 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 89929us
I20260709 13:20:05.917317 18230 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:05.900738 18235 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
W20260709 13:20:05.887961 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 96928.7us
W20260709 13:20:05.830890 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.805557 25186 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:05.883630 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:05.921831 18200 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:20:05.919298 18202 leader_election.cc:336] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.595s (SENT)
I20260709 13:20:05.933471 18305 raft_consensus.cc:2368] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19.
I20260709 13:20:05.935379 18304 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:20:05.865064 25093 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.938463 18309 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:05.897357 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:05.943163 18236 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:05.937580 25064 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:20:05.862612 25130 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:05.884915 25089 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:05.882798 25147 consensus_queue.cc:1059] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:20:05.947206 25130 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:05.950639 25222 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:20:05.940532 25133 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:05.958554 25070 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:05.958974 25133 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.959564 25133 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:05.959743 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:05.960505 18961 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:05.972759 25150 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:05.876288 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:05.986300 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:05.987067 18384 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:05.988286 18310 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:05.991132 18961 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
I20260709 13:20:05.983930 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:05.992239 18304 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:05.992609 18200 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:05.993191 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:05.996011 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 76752.5us
W20260709 13:20:05.996783 18202 leader_election.cc:336] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.616s (SENT)
I20260709 13:20:05.997167 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:06.002187 18381 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:05.861014 25128 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:06.013504 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:06.016925 25184 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:05.994799 25195 log.cc:927] Time spent T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:05.891997 25212 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:06.025144 18384 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 11.
W20260709 13:20:06.022728 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 102221us
I20260709 13:20:06.026918 18304 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:06.028314 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:06.030292 18202 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.631s (SENT)
I20260709 13:20:05.920002 24939 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:06.035043 25128 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:06.034919 25114 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:06.002643 25230 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:20:05.976100 24818 consensus_queue.cc:237] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:05.984820 25093 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:06.042673 18308 raft_consensus.cc:2393] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:06.052902 18953 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:06.043874 25212 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:06.055754 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:06.057088 24377 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:06.047822 18306 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:06.059120 18382 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:06.041045 25091 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:06.067198 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.055217 24924 consensus_meta.cc:287] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.000s
I20260709 13:20:06.026610 25070 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:20:06.086040 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.088438 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.090305 18307 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:06.092092 18383 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:20:06.052963 25093 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:06.092770 18383 pending_rounds.cc:85] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 8
I20260709 13:20:06.093609 18384 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:06.094509 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:06.093168 18383 pending_rounds.cc:107] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:20:06.082197 18310 raft_consensus.cc:2368] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23.
I20260709 13:20:06.129297 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:06.082442 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 83652.5us
I20260709 13:20:06.096415 24377 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
W20260709 13:20:06.070254 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 176267us
I20260709 13:20:06.161190 18383 raft_consensus.cc:2889] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:06.121390 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.081174 18304 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:06.166507 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:06.167301 18237 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:06.168303 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:06.168838 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:06.170017 18275 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:06.167904 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:06.192108 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.114032 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.199021 18202 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:06.199404 18307 raft_consensus.cc:2393] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:06.204380 18304 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:06.219074 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.138494 25078 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:06.125005 24939 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:06.227816 18229 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:06.095037 25070 raft_consensus.cc:697] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:06.236799 18305 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:06.238626 25133 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:06.239444 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.239811 18228 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 15: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:06.240195 18306 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:06.240604 25184 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:06.209084 25150 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:06.241535 25133 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:06.211732 25212 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:06.199352 25131 consensus_queue.cc:1059] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:20:06.231300 18312 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:06.244061 25212 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:06.243481 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:06.244793 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.245162 18953 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:06.245447 18307 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:20:06.246160 25212 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:06.246352 18237 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 20.
I20260709 13:20:06.235828 25070 consensus_queue.cc:237] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:06.116968 25186 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:06.249511 25131 raft_consensus.cc:3055] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:06.249884 25131 raft_consensus.cc:740] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:06.250705 25131 consensus_queue.cc:260] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:06.253859 24377 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:06.257889 25091 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:20:06.259927 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 55652.2us
I20260709 13:20:06.260933 25081 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:06.261606 25081 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:06.127333 24964 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:06.264357 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 234076us
W20260709 13:20:06.266258 18202 leader_election.cc:336] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.633s (SENT)
I20260709 13:20:06.266680 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:06.268262 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:06.199747 25075 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.069s
I20260709 13:20:06.269302 18311 raft_consensus.cc:2393] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 8: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:06.274531 18953 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:20:06.288316 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:06.293464 18383 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:20:06.292253 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.306939 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.169904 25093 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.116s
I20260709 13:20:06.312234 18200 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:06.316179 24377 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:06.316764 24377 raft_consensus.cc:697] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:06.313723 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47490.9us
I20260709 13:20:06.276683 25091 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:06.276872 25212 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.315825 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.322443 18961 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 19 LEARNER]: Advancing to term 21
W20260709 13:20:06.317848 18202 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.924s (SENT) [suppressed 49 similar messages]
I20260709 13:20:06.329036 18311 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:20:06.322575 24377 consensus_queue.cc:237] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:06.280927 24783 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:20:06.339210 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.338546 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:06.343724 18304 raft_consensus.cc:2410] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
W20260709 13:20:06.344926 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.355824 18961 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 21 LEARNER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:06.358510 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:06.338781 25240 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:06.371914 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:06.371505 18927 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:06.357236 25147 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:20:06.330850 25212 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:06.389101 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.408043 18304 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:20:06.389933 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:06.408169 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 90365.9us
I20260709 13:20:06.376049 18383 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 8.
I20260709 13:20:06.404721 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:06.410777 18926 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:06.414830 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:06.387207 25054 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:06.409368 18311 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
W20260709 13:20:06.417307 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.436944 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.438192 18304 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:06.439616 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:06.414551 24939 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:06.438062 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:06.416774 24964 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:06.416610 25236 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:06.467327 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.445341 18202 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.604s (SENT)
I20260709 13:20:06.497692 18304 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 22. Ops: []
I20260709 13:20:06.497576 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:06.416733 24818 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:06.387755 25185 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:20:06.437700 25089 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:06.495245 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 57263.6us
I20260709 13:20:06.420957 24783 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:06.416469 24924 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:06.437372 24803 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:06.515817 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.407814 25240 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:06.436856 25081 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 13:20:06.496841 24939 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:06.532192 24924 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:06.535722 18961 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:06.530890 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:06.538036 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 98765.9us
W20260709 13:20:06.608983 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 169468us
W20260709 13:20:06.651329 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.606012 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 79228.4us
I20260709 13:20:06.527730 25070 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:20:06.661013 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 50290.3us
I20260709 13:20:06.573658 18383 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:06.665531 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:06.665678 18202 leader_election.cc:336] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.672s (SENT)
I20260709 13:20:06.671329 18310 raft_consensus.cc:1217] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 13.7->[15.8-15.8]   Dedup: 15.8->[]
I20260709 13:20:06.672163 18310 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:06.544682 25250 raft_consensus.cc:2764] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:20:06.677014 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:06.678627 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:06.688656 18307 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:06.689234 18310 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:06.679069 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:06.680019 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.680395 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:06.680774 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:06.681288 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:06.690959 18308 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:06.681445 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.542869 24803 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:06.503583 25054 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:06.690387 18306 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:06.693207 18309 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:20:06.691538 18303 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:06.545938 24818 raft_consensus.cc:697] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:06.701247 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.533376 25089 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:06.701284 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:06.666468 24783 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:06.686893 25150 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.715734 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:06.717029 18308 raft_consensus.cc:2376] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17. Re-sending same reply.
I20260709 13:20:06.719250 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.721854 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.722596 18303 raft_consensus.cc:2368] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19.
I20260709 13:20:06.723359 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.723887 18303 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:20:06.725775 24803 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:06.727059 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.727703 18308 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:06.727280 24783 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:06.728785 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.729575 18308 raft_consensus.cc:2410] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:20:06.730568 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.731429 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.733611 18303 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:06.734722 18308 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:06.737123 18309 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:20:06.754531 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.756994 18307 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
W20260709 13:20:06.765421 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.766306 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.721325 25264 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:06.768870 18304 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:06.755141 18306 raft_consensus.cc:2376] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17. Re-sending same reply.
I20260709 13:20:06.770789 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:06.767714 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 97746.9us
I20260709 13:20:06.777172 18307 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:06.778365 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:06.779053 18303 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:06.694114 25185 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:20:06.784134 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.784885 18304 raft_consensus.cc:2376] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22. Re-sending same reply.
I20260709 13:20:06.720402 24964 raft_consensus.cc:697] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:06.788180 18383 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:06.798727 18310 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:06.763151 25212 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:06.762863 25054 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:06.755110 25070 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:06.804853 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 140152us
I20260709 13:20:06.803408 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:06.811267 18228 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:06.774281 25147 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:06.820065 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:06.789868 25243 log.cc:927] Time spent T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
W20260709 13:20:06.810545 18202 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.691s (SENT)
I20260709 13:20:06.736780 25150 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:06.834249 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:06.835058 18310 raft_consensus.cc:2376] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22. Re-sending same reply.
I20260709 13:20:06.790699 25264 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:06.837566 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:06.828236 18351 connection.cc:256] RPC call timeout handler was delayed by -1.6973604919999161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2398s for a response
I20260709 13:20:06.841883 18232 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
W20260709 13:20:06.850937 18202 leader_election.cc:336] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.745s (SENT)
I20260709 13:20:06.851562 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:06.845332 25248 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.338s	user 0.002s	sys 0.000s
W20260709 13:20:06.858784 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.731753 24818 consensus_queue.cc:237] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:06.791642 24924 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:06.875458 24377 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:06.875341 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.876601 18310 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:06.898123 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.898921 18304 raft_consensus.cc:2368] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23.
I20260709 13:20:06.854969 25133 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.800570 24939 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:06.904762 25054 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:06.905818 25246 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.312s	user 0.002s	sys 0.000s
I20260709 13:20:06.829037 25070 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:06.911327 25070 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:06.872179 25241 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.323s	user 0.001s	sys 0.001s
I20260709 13:20:06.871568 18927 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:06.855500 25091 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:20:06.941692 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.942615 18310 raft_consensus.cc:2393] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:06.913240 25240 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:06.938966 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 85780.3us
W20260709 13:20:06.947566 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 75154.5us
I20260709 13:20:06.834033 25147 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:06.941075 25253 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:20:06.950125 18305 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
W20260709 13:20:06.959592 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 108692us
W20260709 13:20:06.960357 18202 leader_election.cc:336] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.776s (SENT)
W20260709 13:20:06.961021 25254 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.255s	user 0.001s	sys 0.001s
W20260709 13:20:06.964118 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.969625 25150 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:06.930583 25133 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:06.974787 25133 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:06.977329 25257 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
W20260709 13:20:06.979051 25258 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:20:06.980401 25089 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:06.980897 25131 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.981173 25271 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:06.954602 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:06.990414 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:06.994545 18312 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
W20260709 13:20:06.988443 18202 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.848s (SENT)
I20260709 13:20:06.999691 18312 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:07.001808 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.002501 18305 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
W20260709 13:20:07.003631 18349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.064s	user 0.013s	sys 0.016s
W20260709 13:20:07.004011 18349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.065s	user 0.013s	sys 0.016s
W20260709 13:20:07.004303 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 1.07252e+06us
I20260709 13:20:07.006228 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:07.007249 18960 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:07.021077 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:07.021795 18231 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:07.024689 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:07.021119 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:07.026933 18236 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:06.925536 24964 consensus_queue.cc:237] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:07.030619 18229 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:07.032457 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:07.032769 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:07.034224 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 45825.1us
I20260709 13:20:07.037256 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.040763 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:07.042182 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:07.045713 18305 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:20:07.046250 18232 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:20:07.044965 18962 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:06.993820 25266 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:07.000680 25250 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:07.001003 25089 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:07.043413 25249 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 13:20:07.000802 25070 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:07.073349 18303 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 20.
I20260709 13:20:07.029593 25186 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:07.107935 18202 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.891s (SENT)
I20260709 13:20:07.127266 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:07.119829 25251 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:20:07.001149 25271 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 13:20:07.119858 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:07.122609 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64173.1us
I20260709 13:20:07.142091 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.142458 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:07.147076 18312 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:07.146100 18305 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 21.
W20260709 13:20:07.146461 18351 connection.cc:256] RPC call timeout handler was delayed by -1.5722604919999412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2537s for a response
I20260709 13:20:06.958091 25264 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:07.149863 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:07.150481 18378 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:07.054195 25080 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:07.149236 18351 connection.cc:256] RPC call timeout handler was delayed by -1.4318604919999416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26930000000000004s for a response
W20260709 13:20:07.156550 18351 connection.cc:256] RPC call timeout handler was delayed by -1.0340604919999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3135s for a response
I20260709 13:20:07.158241 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:07.162050 18379 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 21: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:07.162926 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:07.164027 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:07.173707 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:07.177641 18377 raft_consensus.cc:2393] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 8: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:07.126302 25250 raft_consensus.cc:697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 20 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:07.176581 18385 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:07.183821 18378 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:07.186292 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.186908 18307 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:07.188954 18276 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:07.126698 25089 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:07.143563 25070 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:07.197962 18954 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:07.285887 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.286372 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4113) took 1202 ms. Trace:
I20260709 13:20:07.109750 25266 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:07.279496 25250 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:07.297431 18381 rpcz_store.cc:276] 0709 13:20:06.084440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.084605 (+   165us) service_pool.cc:224] Handling call
0709 13:20:06.088962 (+  4357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:06.103456 (+ 14494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:06.103496 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:06.115208 (+ 11712us) log.cc:844] Serialized 26 byte log entry
0709 13:20:06.409844 (+294636us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:06.409886 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.409962 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:07.286100 (+876138us) raft_consensus.cc:1685] finished
0709 13:20:07.286123 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.286292 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22165,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":2220,"thread_start_us":273240,"threads_started":1,"wal-append.queue_time_us":529721}
I20260709 13:20:07.311203 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4115) took 1144 ms. Trace:
I20260709 13:20:07.298051 25147 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:07.313561 18307 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:07.314690 18382 rpcz_store.cc:276] 0709 13:20:06.166850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.166963 (+   113us) service_pool.cc:224] Handling call
0709 13:20:06.209435 (+ 42472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:06.229917 (+ 20482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:06.229960 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:06.231771 (+  1811us) log.cc:844] Serialized 26 byte log entry
0709 13:20:06.491045 (+259274us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:06.491136 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.491272 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:07.310914 (+819642us) raft_consensus.cc:1685] finished
0709 13:20:07.310945 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.311124 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9088,"raft.queue_time_us":16011,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":27280,"thread_start_us":212334,"threads_started":1,"wal-append.queue_time_us":716951}
W20260709 13:20:07.325809 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.335563 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:07.338901 18305 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:07.349864 25285 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:07.366410 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.370708 18310 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:07.329747 25260 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:07.334707 25230 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:07.374202 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.374684 18305 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
W20260709 13:20:07.374979 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 186094us
I20260709 13:20:07.406880 18307 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:07.419507 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:07.420193 18310 raft_consensus.cc:2376] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21. Re-sending same reply.
W20260709 13:20:07.417768 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 309840us
I20260709 13:20:07.333994 25293 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:07.375587 25212 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:07.433547 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:07.434815 18202 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.908s (SENT)
I20260709 13:20:07.437341 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:07.438784 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:07.336093 25245 consensus_queue.cc:1059] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:20:07.441082 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.376186 25230 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:07.441918 18307 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:07.444676 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:07.463654 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.469766 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.470783 18307 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:07.476794 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:07.484958 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 63368us
W20260709 13:20:07.485986 18202 leader_election.cc:336] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.918s (SENT)
I20260709 13:20:07.486189 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.486948 18305 raft_consensus.cc:2376] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17. Re-sending same reply.
I20260709 13:20:07.488281 18307 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:20:07.476476 25256 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:20:07.468576 25259 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:07.493429 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.498518 18305 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:20:07.407852 25260 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:07.476091 25294 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:07.493458 18310 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:07.496325 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.510600 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.510883 18308 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:20:07.502406 18202 leader_election.cc:336] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.925s (SENT)
W20260709 13:20:07.494750 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 199572us
I20260709 13:20:07.512173 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:07.493999 25070 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:07.559057 25295 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:20:07.559592 25284 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:20:07.562594 25288 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:20:07.500938 25290 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.592461 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.593680 18310 raft_consensus.cc:2410] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:20:07.507371 25298 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:07.513374 25186 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.600606 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 1456) took 1327 ms. Trace:
W20260709 13:20:07.596776 25292 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:20:07.591208 25080 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.601056 18384 rpcz_store.cc:276] 0709 13:20:06.273627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:06.273744 (+   117us) service_pool.cc:224] Handling call
0709 13:20:06.274098 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:06.276214 (+  2116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:06.276251 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:06.276702 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:20:06.526192 (+249490us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:06.534912 (+  8720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.535240 (+   328us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:07.600324 (+1065084us) raft_consensus.cc:1685] finished
0709 13:20:07.600352 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:07.600534 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1714,"raft.queue_time_us":2430,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7154,"thread_start_us":201871,"threads_started":1,"wal-append.queue_time_us":709622}
I20260709 13:20:07.589882 25070 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:07.599882 25212 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:07.607725 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.598445 25298 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.503136 25259 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:07.510411 25230 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:07.607016 25089 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:07.618450 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.626359 18310 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:07.627686 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:07.628247 18308 raft_consensus.cc:2376] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19. Re-sending same reply.
I20260709 13:20:07.630173 25259 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:07.611649 25298 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:07.609452 25266 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:07.609002 25080 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:07.600725 25186 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:07.592012 25290 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:07.643887 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 141508us
W20260709 13:20:07.645177 18202 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.987s (SENT)
I20260709 13:20:07.645695 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:07.625275 25230 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:07.646674 25070 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:07.646911 25186 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:07.652454 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.653232 18310 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:07.662420 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:07.663220 18310 raft_consensus.cc:2376] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18. Re-sending same reply.
W20260709 13:20:07.666320 18202 leader_election.cc:336] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.092s (SENT)
W20260709 13:20:07.668531 18202 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.166s (SENT)
W20260709 13:20:07.676062 18202 leader_election.cc:336] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.688s (SENT)
I20260709 13:20:07.680769 25080 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:07.681201 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:07.682698 25296 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:20:07.684218 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:07.684881 18305 raft_consensus.cc:2376] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19. Re-sending same reply.
I20260709 13:20:07.685783 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:07.687482 18202 leader_election.cc:336] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.713s (SENT)
I20260709 13:20:07.688048 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:07.689491 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.690192 18307 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:07.691144 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.691748 18310 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:07.655500 25267 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:07.704742 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.711920 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:07.715479 18308 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 13:20:07.719190 18202 leader_election.cc:336] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.734s (SENT)
I20260709 13:20:07.719765 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:07.726155 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 287459us
W20260709 13:20:07.728223 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.689123 25186 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.734663 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:07.735569 18304 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:07.737537 25299 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:20:07.739650 25304 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:07.744721 25290 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:07.745741 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:07.746639 18307 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:07.747360 18312 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:07.747413 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.747807 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.748171 18306 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:07.749142 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.749490 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:07.749739 18307 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:07.750142 18306 raft_consensus.cc:2376] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17. Re-sending same reply.
I20260709 13:20:07.748399 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.748643 18309 raft_consensus.cc:2410] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:20:07.745728 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.751019 18312 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:07.747478 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:07.752182 18303 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:07.751353 18310 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:07.754026 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.754201 18305 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:07.709203 25070 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:07.756987 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:07.759469 18202 leader_election.cc:336] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.851s (SENT)
I20260709 13:20:07.759953 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:07.760975 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.756929 25304 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:07.761013 18307 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:07.775974 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:07.785305 18303 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:20:07.756245 25293 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:07.782588 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:07.789875 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.791061 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:07.791415 18307 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
I20260709 13:20:07.792567 18304 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:07.709631 25267 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:07.793846 18312 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:07.796557 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:07.798712 18384 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:20:07.816213 18306 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:07.816080 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.811919 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:07.816952 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 57659.7us
I20260709 13:20:07.816999 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.816984 18309 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
W20260709 13:20:07.817639 18202 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.869s (SENT)
I20260709 13:20:07.818029 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:07.776378 25308 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:07.822757 18308 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:20:07.780995 25236 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:07.693825 25212 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:07.756062 25186 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:07.829370 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:07.798806 24964 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:07.798254 25304 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:07.827544 25070 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:07.845028 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.830267 18927 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:07.846068 18308 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:07.815199 24783 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:07.841915 18202 leader_election.cc:336] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.127s (SENT)
I20260709 13:20:07.857686 18202 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:07.846999 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:07.849102 25260 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:07.850014 25264 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:20:07.851876 25307 log.cc:927] Time spent T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.067s	user 0.000s	sys 0.002s
W20260709 13:20:07.852185 25300 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
I20260709 13:20:07.822465 25310 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:07.827996 25308 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.852810 25078 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:07.844148 25250 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
W20260709 13:20:07.854414 25252 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.987s	user 0.002s	sys 0.000s
I20260709 13:20:07.844288 18307 raft_consensus.cc:2376] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13. Re-sending same reply.
I20260709 13:20:07.831817 25236 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:07.822127 25298 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:07.832381 25311 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:07.870311 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.844143 24964 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.870838 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.870975 18927 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:07.857571 24783 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.872359 25078 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:07.909037 18304 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:07.889871 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:07.888242 25298 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:07.894465 25267 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:07.869613 25310 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.870749 25308 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:07.896782 25272 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.003s	sys 0.011s
I20260709 13:20:07.898633 25186 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:07.900971 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:07.901571 18310 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:07.901633 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.924129 18382 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:20:07.903061 18303 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:07.904593 18308 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:07.905035 24964 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.905623 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.908921 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.909533 18384 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:07.893972 25264 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:07.952037 25264 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:07.954380 25264 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:07.911203 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 69295.2us
W20260709 13:20:07.955111 18202 leader_election.cc:336] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.217s (SENT)
I20260709 13:20:07.955229 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:07.955519 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:07.912562 25078 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:07.956360 25212 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:07.956795 25212 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:07.957093 18202 leader_election.cc:336] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.249s (SENT)
I20260709 13:20:07.913326 25080 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:20:07.912892 25313 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:20:07.958472 25186 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:07.959379 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:07.960569 18202 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.270s (SENT)
I20260709 13:20:07.960942 25186 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:07.962378 25235 raft_consensus.cc:3055] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:07.916797 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:07.920004 25184 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:07.963217 25184 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.963613 25184 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:07.964653 25186 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.965189 25186 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:07.967779 25186 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:07.904464 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.969031 18311 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:07.969826 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.970361 18311 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:07.971086 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.938897 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.923389 25310 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:07.972360 18304 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:07.941376 18383 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 13:20:07.941845 25312 log.cc:927] Time spent T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:20:07.942070 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:07.943070 18377 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:20:07.943266 25297 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.436s	user 0.001s	sys 0.000s
I20260709 13:20:07.943555 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:07.924988 25272 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.003s	sys 0.011s
I20260709 13:20:07.941874 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:07.936460 18309 raft_consensus.cc:2376] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15. Re-sending same reply.
I20260709 13:20:07.944167 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:07.947515 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:07.991909 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.950285 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.992547 18307 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:07.993026 18310 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:07.957156 25212 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:07.994573 18303 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 23: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:07.962802 25235 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:07.999327 25235 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:07.904021 25244 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:08.002331 25244 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:07.973189 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.004729 18308 raft_consensus.cc:2368] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22.
I20260709 13:20:07.973155 18311 raft_consensus.cc:2368] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21.
I20260709 13:20:07.881268 25070 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:07.985690 25185 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.008702 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.979110 18384 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:07.908543 24783 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:07.987047 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:07.988696 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:07.993176 18202 leader_election.cc:336] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.990s (SENT)
I20260709 13:20:07.994877 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:07.937167 25261 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:07.907102 25236 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:08.103236 18305 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:08.073797 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:08.140651 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:08.153071 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.153642 18307 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:20:08.155356 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:08.124871 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.042546 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:08.151980 18310 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:08.044196 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.158237 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:08.150928 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.160061 18228 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
I20260709 13:20:08.151358 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.161499 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:08.158525 18303 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:08.163628 18309 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 13: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:08.164132 18308 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 21: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:08.015671 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:08.006704 25235 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:08.165364 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:08.169516 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.170572 18305 raft_consensus.cc:2368] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22.
W20260709 13:20:08.167507 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 182032us
I20260709 13:20:08.173146 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.173879 18305 raft_consensus.cc:2368] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 7. Current term is 8.
I20260709 13:20:08.173678 25310 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:08.176041 25310 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:08.175995 18305 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:08.176939 18307 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:20:08.168689 18303 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:08.107681 25298 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:08.181037 18202 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.541s (SENT)
I20260709 13:20:08.181275 18308 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:08.181515 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:08.160310 25244 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:08.149142 25089 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:20:08.191140 18384 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:20:08.120837 25186 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:20:08.179179 25267 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.196759 18309 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:08.103492 25308 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:08.157128 25185 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:08.215617 18305 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:08.244325 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:08.246170 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.196501 25080 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:08.249579 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 84282.4us
W20260709 13:20:08.251291 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 89889us
I20260709 13:20:08.251559 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:08.252280 18384 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:08.257050 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:08.200922 25290 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:08.257871 18959 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:20:08.202607 25000 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.167213 25261 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:08.260798 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:08.202527 24803 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.186671 25298 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:08.270274 18384 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:20:08.276108 18349 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:08.283181 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.283916 18308 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 15: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:08.273149 25290 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:08.285763 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.285854 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.284667 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.261765 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:08.293289 25290 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:08.209723 25267 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:08.277230 25256 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:08.301885 18304 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:20:08.304337 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.309101 18309 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:08.310001 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.310587 18309 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:08.266517 25310 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:08.265511 25080 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:08.290700 25280 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:08.323844 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.267937 25000 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:08.275701 24803 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:08.328611 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.331523 18308 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 22: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:08.305431 25328 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:08.341588 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 169824us
I20260709 13:20:08.345937 25298 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:08.322697 25089 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:08.325290 25280 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:08.359748 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.360819 18303 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:08.363013 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.363974 18308 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:08.365597 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.368652 25326 raft_consensus.cc:2955] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:20:08.377861 25185 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:08.319532 25310 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:08.362372 25280 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:08.397163 25080 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:08.398159 25291 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.991s	user 0.005s	sys 0.004s
I20260709 13:20:08.400197 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.401264 18312 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:08.402590 18312 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:08.403859 24783 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:08.400009 25184 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:08.408972 25308 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:08.409415 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1108) took 1385 ms. Trace:
I20260709 13:20:08.409744 25261 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:08.410034 25310 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:08.410797 25267 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:08.411712 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.442234 18312 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:08.414415 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:08.443261 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.416949 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:08.418130 18954 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:20:08.418771 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:08.419305 25212 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:08.421241 24803 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:08.421358 25239 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:08.421912 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:08.423295 25000 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:08.361974 25236 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:08.423959 25131 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:08.425235 18384 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:08.490276 18305 raft_consensus.cc:2368] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18.
I20260709 13:20:08.428041 18309 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:08.491763 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.342572 25078 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:08.429203 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:08.430328 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.432359 18237 rpcz_store.cc:276] 0709 13:20:07.023833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.023986 (+   153us) service_pool.cc:224] Handling call
0709 13:20:07.024267 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:07.320653 (+296386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:07.320698 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:07.320753 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:07.320799 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:08.409128 (+1088329us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b540029bdd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:08.409187 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:08.409338 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681032448}
I20260709 13:20:08.452581 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:08.459228 24377 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.466552 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:08.498246 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:08.494818 18379 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:20:08.501267 18308 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:08.495187 18231 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:08.494846 24377 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:08.472146 25091 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.477959 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:08.478746 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.479460 18385 raft_consensus.cc:2393] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:08.481279 18377 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:20:08.485172 18953 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:08.493009 18309 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:08.515089 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.515539 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.512302 18312 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:08.516196 18309 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:08.472754 25293 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.482120 25089 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:20:08.505872 18956 raft_consensus.cc:2410] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:20:08.506767 18200 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:08.515756 18308 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 23: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:08.518545 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.519063 18237 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:08.519285 18308 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:08.520260 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.521540 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.522562 18229 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:08.522671 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.523301 18308 raft_consensus.cc:2376] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19. Re-sending same reply.
I20260709 13:20:08.524219 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.471225 18303 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:20:08.526100 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.526230 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.526690 18312 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:08.513692 18386 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 11.
I20260709 13:20:08.526820 18303 raft_consensus.cc:2368] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21.
I20260709 13:20:08.525255 18308 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:20:08.535750 18955 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:08.534282 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.538515 18311 raft_consensus.cc:2376] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21. Re-sending same reply.
W20260709 13:20:08.524003 24964 consensus_meta.cc:287] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.000s
I20260709 13:20:08.528134 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.544648 18309 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 13: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:08.542765 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:08.549666 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.551460 18309 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:08.553030 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.555274 24377 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:08.558281 18386 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:20:08.560943 18303 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:08.545608 25338 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:08.567256 25338 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:08.518944 25212 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:08.575294 18237 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:08.574856 18311 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:08.572625 18303 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:08.587128 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.589962 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.594420 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:08.597144 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.598157 18309 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:08.601435 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:08.604230 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.605341 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.535462 25091 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:08.535336 25293 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:08.607512 18310 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 21: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:08.607625 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:08.609441 18377 raft_consensus.cc:2410] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:20:08.610824 18312 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:08.607625 25280 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:08.612210 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.614058 25280 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:08.614778 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.621876 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.622609 18310 raft_consensus.cc:2376] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19. Re-sending same reply.
I20260709 13:20:08.623960 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:08.624617 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.624718 18310 raft_consensus.cc:2376] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17. Re-sending same reply.
I20260709 13:20:08.545825 24964 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:08.632977 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.637671 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.638903 18312 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 22: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:08.643117 18386 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:08.649796 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.650583 18308 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:08.652283 25293 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:08.653136 24783 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:08.652192 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:08.892410 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.682471 18955 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
W20260709 13:20:08.746089 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:08.772151 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.915729 18381 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:08.915745 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:08.916278 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:08.918792 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:08.846635 25342 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:20:08.924942 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.925582 18311 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:20:08.894841 25184 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:08.847703 24939 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.655210 24964 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:08.946648 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.947043 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:08.707839 25078 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:08.943670 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:08.949882 18383 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:20:08.947544 18311 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 13: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:08.908620 25338 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:08.700335 25290 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:08.959715 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 1629) took 1050 ms. Trace:
I20260709 13:20:08.925266 18310 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:20:08.960144 18307 rpcz_store.cc:276] 0709 13:20:07.909802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.163734 (+253932us) service_pool.cc:224] Handling call
0709 13:20:08.166715 (+  2981us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:08.177413 (+ 10698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:08.959449 (+782036us) spinlock_profiling.cc:243] Waited 9.97 ms on lock 0x7b54000cb2d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:08.959657 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22931712}
I20260709 13:20:08.966976 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:08.968700 18307 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:08.971589 18955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54020 (request call id 557) took 1061 ms. Trace:
I20260709 13:20:08.971982 18955 rpcz_store.cc:276] 0709 13:20:07.909802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.909934 (+   132us) service_pool.cc:224] Handling call
0709 13:20:08.971426 (+1061492us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54006f72d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:08.971534 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1317035264}
I20260709 13:20:08.971807 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:09.018077 25293 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:09.018735 25293 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:09.020123 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:09.021085 18312 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:09.021152 25293 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:09.016050 18311 raft_consensus.cc:2376] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17. Re-sending same reply.
I20260709 13:20:08.949586 24939 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:09.034328 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:09.035317 18383 raft_consensus.cc:2368] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 21. Current term is 22.
I20260709 13:20:09.035531 24939 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:09.027709 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:08.969894 25185 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:09.031447 25326 consensus_meta.cc:287] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.660s	user 0.007s	sys 0.004s
I20260709 13:20:09.038405 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:09.037712 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:09.040127 18312 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:09.039400 18307 raft_consensus.cc:2376] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21. Re-sending same reply.
I20260709 13:20:09.043627 18955 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 17 LEARNER]: Advancing to term 19
I20260709 13:20:09.045251 18276 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:20:09.047626 18229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.021s	sys 0.040s
W20260709 13:20:09.047964 18229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.021s	sys 0.040s
I20260709 13:20:09.049492 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:09.040645 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:09.050256 18234 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:20:09.050864 18311 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:09.027616 25345 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.027873 25091 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:09.056725 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.056599 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:09.056720 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:09.059742 18307 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:09.060379 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:09.061573 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:09.062333 18383 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:20:09.063792 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:09.066725 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:09.052805 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:08.964156 25290 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:09.120048 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:09.137303 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:20:09.101334 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.245203 18234 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:09.069139 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:09.248777 18381 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:09.249491 18307 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:09.285573 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.051829 25341 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:09.332844 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 86944.4us
I20260709 13:20:09.063429 25184 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.338125 18927 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:09.343297 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 4120) took 1352 ms. Trace:
I20260709 13:20:09.338235 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:09.366899 18381 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:20:09.365347 18927 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:09.348630 18312 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:09.350314 18351 leader_election.cc:336] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.583s (SENT)
I20260709 13:20:09.370926 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:09.365411 18385 rpcz_store.cc:276] 0709 13:20:07.990482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.992406 (+  1924us) service_pool.cc:224] Handling call
0709 13:20:09.343000 (+1350594us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54000ba9d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:09.343216 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718307200}
I20260709 13:20:09.336292 24803 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:20:09.394723 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 44444.8us
I20260709 13:20:09.420981 24803 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:09.395179 24939 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:09.421586 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.374825 25078 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:09.422523 25078 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:09.422996 25078 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:09.424391 25308 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.424633 25131 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:09.424932 25308 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:09.065892 25345 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:09.445955 18234 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:20:09.460913 18380 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:20:09.463205 24939 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:09.427838 25235 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.366214 25184 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:09.468557 18312 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:09.465276 18385 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:09.456378 24803 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:09.472231 18381 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:09.434507 25089 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:09.474731 18306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.013s	sys 0.049s
W20260709 13:20:09.477036 18306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.014s	sys 0.049s
W20260709 13:20:09.478647 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:09.484583 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.488019 18312 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:09.500927 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2938) took 1030 ms. Trace:
I20260709 13:20:09.501492 18229 rpcz_store.cc:276] 0709 13:20:08.470033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.523506 (+ 53473us) service_pool.cc:224] Handling call
0709 13:20:08.523845 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:08.533892 (+ 10047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:08.533931 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:08.534505 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:20:09.048302 (+513797us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:09.048344 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.048410 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:09.500605 (+452195us) raft_consensus.cc:1685] finished
0709 13:20:09.500636 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.500828 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15446,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":10503,"thread_start_us":513339,"threads_started":1,"wal-append.queue_time_us":926989}
I20260709 13:20:09.508150 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:09.509769 18379 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.012s	sys 0.041s
W20260709 13:20:09.511708 18379 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.012s	sys 0.041s
I20260709 13:20:09.473829 25235 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:09.522007 25235 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:09.482999 25089 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:09.528503 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:09.531419 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 2912) took 1271 ms. Trace:
I20260709 13:20:09.531893 18305 rpcz_store.cc:276] 0709 13:20:08.257654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.263653 (+  5999us) service_pool.cc:224] Handling call
0709 13:20:09.528694 (+1265041us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540013ea54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:09.528852 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464792960}
I20260709 13:20:09.541121 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:09.542016 18309 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:09.543707 18305 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:20:09.547195 18303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.011s	sys 0.018s
W20260709 13:20:09.574209 18303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.011s	sys 0.018s
W20260709 13:20:09.582763 25350 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:09.576037 25345 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:09.584216 18958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54004 (request call id 653) took 1155 ms. Trace:
I20260709 13:20:09.584765 25345 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.584717 18958 rpcz_store.cc:276] 0709 13:20:08.429062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.429308 (+   246us) service_pool.cc:224] Handling call
0709 13:20:08.429662 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:08.430050 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:08.430077 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:08.431913 (+  1836us) log.cc:844] Serialized 26 byte log entry
0709 13:20:08.951842 (+519929us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:08.952082 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:08.952395 (+   313us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:09.583828 (+631433us) raft_consensus.cc:1685] finished
0709 13:20:09.583848 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.584019 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":155,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":18309,"thread_start_us":451674,"threads_started":1,"wal-append.queue_time_us":1018892}
I20260709 13:20:09.587069 25089 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:09.587668 25308 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:09.588632 25184 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:09.539032 25290 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:09.585382 25345 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:09.600103 18953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53364 (request call id 671) took 1400 ms. Trace:
I20260709 13:20:09.573190 25185 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.600694 18953 rpcz_store.cc:276] 0709 13:20:08.199975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.200459 (+   484us) service_pool.cc:224] Handling call
0709 13:20:08.200847 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:08.514821 (+313974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.599773 (+1084952us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54004a9a54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:09.600024 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653312384}
I20260709 13:20:09.594064 25089 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.627678 18309 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
W20260709 13:20:09.604583 18304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.024s	sys 0.039s
W20260709 13:20:09.608342 18202 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.063s	sys 0.075s
W20260709 13:20:09.629196 18202 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.063s	sys 0.075s
I20260709 13:20:09.608773 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:09.629593 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 724168us
W20260709 13:20:09.630394 18202 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.648s (SENT)
I20260709 13:20:09.630810 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:09.631501 18304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.025s	sys 0.039s
I20260709 13:20:09.632583 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2965) took 1016 ms. Trace:
W20260709 13:20:09.634701 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:09.635210 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.633051 18304 rpcz_store.cc:276] 0709 13:20:08.615720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.032291 (+416571us) service_pool.cc:224] Handling call
0709 13:20:09.032626 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.032831 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:09.033150 (+   319us) log.cc:844] Serialized 14 byte log entry
0709 13:20:09.632087 (+598937us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:09.632167 (+    80us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:09.632247 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.632342 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.632494 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":673,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"thread_start_us":598424,"threads_started":1}
I20260709 13:20:09.646014 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:09.623473 25345 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:09.646860 18956 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:20:09.620340 25185 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:09.623835 25078 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:09.629457 25089 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:09.678578 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 313326us
W20260709 13:20:09.649420 25326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.022s	sys 0.063s
I20260709 13:20:09.672863 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:09.705587 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:09.707507 18135 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 122) took 12605 ms (client timeout 15000 ms). Trace:
W20260709 13:20:09.702450 25326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.023s	sys 0.064s
W20260709 13:20:09.737335 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:09.750298 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 60760.6us
W20260709 13:20:09.752045 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 69643.5us
W20260709 13:20:09.708036 18135 rpcz_store.cc:269] 0709 13:19:57.102607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.102913 (+   306us) service_pool.cc:224] Handling call
0709 13:20:09.707433 (+12604520us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:04.965832 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:04.966677 (+   845us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:04.966739 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:20:04.966761 (+    22us) tablet.cc:662] Decoding operations
0709 13:20:04.967730 (+   969us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:04.967865 (+   135us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:04.967893 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:20:04.968704 (+   811us) tablet.cc:701] Row locks acquired
0709 13:20:04.968762 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:20:04.968953 (+   191us) write_op.cc:270] Start()
0709 13:20:04.969091 (+   138us) write_op.cc:276] Timestamp: P: 1783603204968873 usec, L: 0
0709 13:20:04.969141 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 13:20:04.969920 (+   779us) log.cc:844] Serialized 2466 byte log entry
0709 13:20:05.976566 (+1006646us) op_driver.cc:464] REPLICATION: finished
0709 13:20:06.392365 (+415799us) write_op.cc:301] APPLY: starting
0709 13:20:06.392498 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:06.726045 (+333547us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b54002ae254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa18227032a 00007fa1821f5f14 00007fa1821f5ec3 00007fa1821f5e38 00007fa1821f5df3 00007fa1821f50dc 00007fa18221ee16 00007fa182206cbb 00007fa1821f139d 00007fa1821f4d75
0709 13:20:07.015558 (+289513us) spinlock_profiling.cc:243] Waited 7.29 ms on lock 0x7b180035bc60. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181fb20ec 00007fa181ffec0a 00007fa181ffe4f7 00007fa181ffe490 00007fa181fb5f48 00007fa185cca1bb 00007fa185cca532 00007fa185d11b93 00007fa185bbede3
0709 13:20:07.016313 (+   755us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:07.016367 (+    54us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:07.683322 (+666955us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:07.683656 (+   334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 13:20:07.683733 (+    77us) write_op.cc:312] APPLY: finished
0709 13:20:07.684127 (+   394us) log.cc:844] Serialized 65 byte log entry
0709 13:20:07.824811 (+140684us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:07.840759 (+ 15948us) write_op.cc:454] Released schema lock
0709 13:20:07.847796 (+  7037us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:07.848285 (+   489us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:07.848318 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":202749,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":393775,"apply.run_cpu_time_us":67255,"apply.run_wall_time_us":1455896,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29159,"num_ops":6,"prepare.queue_time_us":295786,"prepare.run_cpu_time_us":7298,"prepare.run_wall_time_us":86965,"raft.queue_time_us":383048,"raft.run_cpu_time_us":41452,"raft.run_wall_time_us":950530,"replication_time_us":843746,"spinlock_wait_cycles":50812928,"thread_start_us":912759,"threads_started":5,"wal-append.queue_time_us":327619,"wal-append.run_cpu_time_us":20655,"wal-append.run_wall_time_us":2632403}]]}
I20260709 13:20:09.753832 18926 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:09.761077 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2944) took 1344 ms. Trace:
I20260709 13:20:09.761533 18926 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:09.781100 25184 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:09.781589 25184 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.782008 25184 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:09.794620 25078 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:09.833515 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.796504 25185 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:09.837649 25185 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:09.838294 25359 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.190s	user 0.001s	sys 0.001s
W20260709 13:20:09.839545 25354 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:20:09.840680 25362 log.cc:927] Time spent T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:20:09.779940 24964 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:09.847276 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 423248us
W20260709 13:20:09.855445 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 340759us
I20260709 13:20:09.856088 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 2946) took 1372 ms. Trace:
I20260709 13:20:09.856460 18276 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:09.761540 18306 rpcz_store.cc:276] 0709 13:20:08.416495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.570902 (+154407us) service_pool.cc:224] Handling call
0709 13:20:08.571263 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:08.571520 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:08.592762 (+ 21242us) log.cc:844] Serialized 14 byte log entry
0709 13:20:09.760708 (+1167946us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:09.760777 (+    69us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:09.760826 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.760898 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.761008 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45885,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":106859,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":1123020,"threads_started":2,"wal-append.queue_time_us":1037375}
I20260709 13:20:09.856787 18303 rpcz_store.cc:276] 0709 13:20:08.483603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.577275 (+ 93672us) service_pool.cc:224] Handling call
0709 13:20:08.577676 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:08.577965 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:08.900439 (+322474us) log.cc:844] Serialized 14 byte log entry
0709 13:20:09.855549 (+955110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:09.855634 (+    85us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:09.855715 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.855820 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.856007 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18556,"prepare.queue_time_us":48210,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":15086,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"thread_start_us":1191935,"threads_started":3,"wal-append.queue_time_us":692611}
I20260709 13:20:09.873274 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:09.780187 24803 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:20:09.874569 18378 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
W20260709 13:20:09.862756 18277 connection.cc:256] RPC call timeout handler was delayed by -2.2124471110000741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
W20260709 13:20:09.875291 18277 connection.cc:256] RPC call timeout handler was delayed by -2.162947110999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 13:20:09.875663 18277 connection.cc:256] RPC call timeout handler was delayed by -2.143147110999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
W20260709 13:20:09.875968 18277 connection.cc:256] RPC call timeout handler was delayed by -2.06934711100007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 13:20:09.876276 18277 connection.cc:256] RPC call timeout handler was delayed by -2.0504471110000395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
I20260709 13:20:09.876554 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:09.877141 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:09.877264 18277 connection.cc:256] RPC call timeout handler was delayed by -2.0477471110000351s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:20:09.885257 18277 connection.cc:256] RPC call timeout handler was delayed by -2.009947110999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
W20260709 13:20:09.885689 18277 connection.cc:256] RPC call timeout handler was delayed by -2.0090471109999726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260709 13:20:09.886089 18277 connection.cc:256] RPC call timeout handler was delayed by -1.990147110999942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 13:20:09.886494 18277 connection.cc:256] RPC call timeout handler was delayed by -1.9793471109999246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:20:09.886868 18277 connection.cc:256] RPC call timeout handler was delayed by -1.97034711099991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 13:20:09.887251 18277 connection.cc:256] RPC call timeout handler was delayed by -1.8407471109999278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
W20260709 13:20:09.887630 18277 connection.cc:256] RPC call timeout handler was delayed by -1.8335471109999162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
W20260709 13:20:09.888005 18277 connection.cc:256] RPC call timeout handler was delayed by -1.8326471109999147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
I20260709 13:20:09.878415 18377 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:09.853036 24964 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:09.843655 25341 raft_consensus.cc:697] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:20:09.901105 25348 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.540s	user 0.002s	sys 0.004s
I20260709 13:20:09.897704 24964 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:09.912207 18276 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:09.872066 25345 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:09.913420 25345 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:09.915951 25345 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:09.894521 25089 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:09.917092 25089 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:09.917757 25089 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:09.918339 25089 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:09.874732 25290 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:09.921860 25290 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.922312 25290 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:09.927076 25360 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.164s	user 0.001s	sys 0.001s
I20260709 13:20:09.936054 25366 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:20:09.936369 25341 consensus_queue.cc:237] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:09.888386 18277 connection.cc:256] RPC call timeout handler was delayed by -1.7903471110000737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:20:09.937763 18277 connection.cc:256] RPC call timeout handler was delayed by -1.7786471110000548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
I20260709 13:20:09.899526 18132 catalog_manager.cc:5697] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 15 to 16, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 16 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:09.938763 25345 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:20:09.940065 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.941534 18132 catalog_manager.cc:5697] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 13 to 14, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 14 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:09.941944 18277 connection.cc:256] RPC call timeout handler was delayed by -1.7669471110000359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
W20260709 13:20:09.948627 18277 connection.cc:256] RPC call timeout handler was delayed by -1.765147111000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 13:20:09.949129 18277 connection.cc:256] RPC call timeout handler was delayed by -1.6958471109999209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
W20260709 13:20:09.949546 18277 connection.cc:256] RPC call timeout handler was delayed by -1.6778471109998918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
W20260709 13:20:09.949968 18277 connection.cc:256] RPC call timeout handler was delayed by -1.2395471110000926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25930000000000003s for a response
W20260709 13:20:09.950344 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:09.950549 18277 connection.cc:256] RPC call timeout handler was delayed by -1.0730471110000508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2778s for a response
I20260709 13:20:09.947448 18132 catalog_manager.cc:5697] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:09.955229 18132 catalog_manager.cc:5697] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 13 to 16, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 16 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:09.964767 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:20:09.968255 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 332461us
I20260709 13:20:09.962620 18132 catalog_manager.cc:5697] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 16 to 18, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 18 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:09.970696 18132 catalog_manager.cc:5697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 15 to 18, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 18 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:09.962563 25089 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:09.961237 25290 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:09.976529 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 294988us
I20260709 13:20:09.963281 25368 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:09.978804 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4131) took 1336 ms. Trace:
I20260709 13:20:09.975747 18200 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:09.984424 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:09.982590 18132 catalog_manager.cc:5697] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:09.985934 18132 catalog_manager.cc:5697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:09.984826 18379 rpcz_store.cc:276] 0709 13:20:08.642049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.914294 (+272245us) service_pool.cc:224] Handling call
0709 13:20:08.914674 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:08.914952 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:09.512173 (+597221us) log.cc:844] Serialized 14 byte log entry
0709 13:20:09.978345 (+466172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:09.978419 (+    74us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:09.978483 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.978576 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:09.978731 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":746831,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"thread_start_us":1062393,"threads_started":3}
W20260709 13:20:09.988260 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 357879us
I20260709 13:20:09.991710 18234 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:09.963274 24964 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:09.995421 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:10.000442 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 238989us
I20260709 13:20:10.000370 18234 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:10.001721 18926 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:10.003268 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:09.997750 18132 catalog_manager.cc:5697] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 14 to 15, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 15 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:20:10.006672 18237 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:10.009964 18236 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 16. Current term is 17. Ops: []
W20260709 13:20:10.010977 18202 connection.cc:256] RPC call timeout handler was delayed by -1.6313389340000413s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3256s for a response
I20260709 13:20:10.005141 18132 catalog_manager.cc:5697] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 18 to 19, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 19 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:10.012773 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:10.013415 18228 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:10.012616 18132 catalog_manager.cc:5697] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 16 to 17, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 17 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:10.014130 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:10.014709 18230 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:10.011759 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 59973.8us
I20260709 13:20:10.016139 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:10.015100 18132 catalog_manager.cc:5697] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:10.017424 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:10.017992 18926 leader_election.cc:400] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 21. Current term is 22.
I20260709 13:20:10.019868 18926 leader_election.cc:403] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
W20260709 13:20:10.011433 18202 connection.cc:256] RPC call timeout handler was delayed by -1.412123056999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
W20260709 13:20:10.022189 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 110071us
I20260709 13:20:10.024849 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:09.988593 25371 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:20:10.031028 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 252649us
I20260709 13:20:10.031387 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:10.027719 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:10.032264 18233 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:10.022894 18276 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:10.034893 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:10.036209 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 101890us
I20260709 13:20:10.036481 18235 raft_consensus.cc:2410] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:20:10.018013 18132 catalog_manager.cc:5697] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 20 to 21, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 21 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:10.035594 18231 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:20:09.999092 25365 raft_consensus.cc:2764] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:20:10.041919 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:10.018754 25368 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:10.017120 25078 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:10.043444 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:10.026363 25089 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:10.042759 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 180956us
I20260709 13:20:10.045976 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:10.045667 18231 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
W20260709 13:20:10.050072 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 65753.3us
I20260709 13:20:10.052901 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:10.040992 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:10.051913 18201 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:10.056317 18233 raft_consensus.cc:2410] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:20:10.036141 25371 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.058355 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:10.059866 18231 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:10.065943 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:10.066596 18232 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:10.066607 18231 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:10.066991 18230 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:10.067622 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:10.068181 18235 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:10.073452 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:10.074250 18236 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:20:10.021803 25364 consensus_queue.cc:1059] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
W20260709 13:20:10.095202 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 53017.5us
I20260709 13:20:10.095054 18201 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:10.022356 25369 consensus_queue.cc:1059] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:20:10.045306 25078 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.057586 25366 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:10.118814 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:10.119488 18237 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:10.095669 25384 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:10.099308 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:10.045439 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:10.124683 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:10.114856 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:10.059100 25345 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:10.122825 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:10.125649 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 109577us
I20260709 13:20:10.125972 18233 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:10.126461 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:10.128257 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:10.072587 25371 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:10.136981 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:10.140391 18229 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:10.146437 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:10.058400 25089 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:10.096946 25382 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 21. Current term is 22.
I20260709 13:20:10.122123 25078 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.170711 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:10.171365 18305 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
I20260709 13:20:10.164476 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:10.172772 18379 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.140105 25364 raft_consensus.cc:3055] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:10.187067 18235 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:10.191198 18233 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:10.193218 18232 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:10.140439 24803 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:10.142266 25380 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:10.134509 25345 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.169334 25366 raft_consensus.cc:2764] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:20:10.166015 25375 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.160785 25377 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:10.217255 25345 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:10.223837 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 97456.8us
I20260709 13:20:10.184860 25364 raft_consensus.cc:740] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:10.136554 25384 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:10.199258 25374 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.205420 25380 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:10.184405 25184 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:10.222558 24803 raft_consensus.cc:697] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 14 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:10.226833 25394 consensus_queue.cc:1059] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:20:10.169167 25368 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:10.225260 25375 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:10.256669 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:10.254029 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 68069.3us
W20260709 13:20:10.263361 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.272121 18228 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:10.368656 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:10.375197 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:10.375846 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:10.272532 25372 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 13:20:10.273027 25373 log.cc:927] Time spent T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:20:10.259203 25290 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:10.417788 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 322791us
I20260709 13:20:10.261669 24964 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:10.283712 25378 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 13:20:10.423224 18202 connection.cc:256] RPC call timeout handler was delayed by -1.1943230570000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
W20260709 13:20:10.275269 25370 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:20:10.273960 25089 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:10.259872 25380 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:10.255988 25377 raft_consensus.cc:2764] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:10.413280 25341 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:10.435694 18202 connection.cc:256] RPC call timeout handler was delayed by -1.0865916239999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
I20260709 13:20:10.289845 25184 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:10.444561 18202 connection.cc:256] RPC call timeout handler was delayed by -1.0080230569999458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23730000000000004s for a response
I20260709 13:20:10.257833 25389 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.204s
I20260709 13:20:10.260938 25185 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:10.425833 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.285480 25384 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:10.284998 25078 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:10.469130 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:10.430781 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 186026us
W20260709 13:20:10.418504 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 350059us
I20260709 13:20:10.423098 25369 raft_consensus.cc:3055] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:10.471195 25369 raft_consensus.cc:740] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:10.472131 25369 consensus_queue.cc:260] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:10.473439 25369 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:10.292656 25375 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:10.456868 18953 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:10.267674 25401 consensus_queue.cc:1059] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.172s
W20260709 13:20:10.482815 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.489326 18379 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
W20260709 13:20:10.502647 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 271730us
I20260709 13:20:10.504904 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:10.259768 25374 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:10.447021 25382 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:10.515764 18956 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:20:10.533463 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4127) took 1930 ms. Trace:
I20260709 13:20:10.533784 18955 raft_consensus.cc:2955] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 11 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:10.533986 18384 rpcz_store.cc:276] 0709 13:20:08.603091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.603218 (+   127us) service_pool.cc:224] Handling call
0709 13:20:08.615066 (+ 11848us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:08.615382 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:08.615410 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:08.615866 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:20:09.613150 (+997284us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x7b18003e35c0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:20:09.943311 (+330161us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:09.943379 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.943492 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.516161 (+572669us) raft_consensus.cc:1685] finished
0709 13:20:10.516186 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.533365 (+ 17179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4291,"raft.queue_time_us":4676,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":145,"spinlock_wait_cycles":17397120,"thread_start_us":329781,"threads_started":1,"wal-append.queue_time_us":1408819}
I20260709 13:20:10.507880 25375 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:10.537014 25375 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:10.493093 25377 raft_consensus.cc:3055] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:10.268174 24803 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:10.545342 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 67982.4us
W20260709 13:20:10.557264 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.480765 25341 raft_consensus.cc:697] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:10.493993 25367 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:10.566648 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 61875.9us
W20260709 13:20:10.570313 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 51069.5us
I20260709 13:20:10.458951 24964 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.081s
W20260709 13:20:10.580773 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 172164us
W20260709 13:20:10.589429 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.590567 18277 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:10.593081 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 88018.6us
I20260709 13:20:10.595175 18378 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:20:10.596235 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:10.596815 18383 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:10.557092 25377 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:10.542280 25384 raft_consensus.cc:2764] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:20:10.609638 18276 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:10.628536 25308 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:20:10.628688 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 70973.2us
W20260709 13:20:10.655418 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 49264.1us
I20260709 13:20:10.540424 25382 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:10.627411 25341 consensus_queue.cc:237] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:10.566222 25417 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:20:10.629151 25396 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:10.227854 25387 raft_consensus.cc:2955] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 11 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:20:10.627765 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 49522.1us
I20260709 13:20:10.637202 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:10.636482 18385 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:10.633214 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:10.654673 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 54774.5us
W20260709 13:20:10.653738 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64111.5us
W20260709 13:20:10.654273 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54847.8us
W20260709 13:20:10.675236 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 59177.5us
I20260709 13:20:10.656157 18383 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
I20260709 13:20:10.660524 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:10.676158 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:10.678251 18927 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:10.685068 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:10.678300 18956 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:10.685904 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 227945us
I20260709 13:20:10.689194 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:10.689785 18379 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:10.692580 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:10.668366 25290 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:10.665019 25368 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:10.697955 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:10.704255 18385 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:20:10.701491 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:10.584350 25367 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:10.739646 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63582.1us
I20260709 13:20:10.738680 25235 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:20:10.740118 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:10.654681 25184 consensus_queue.cc:1059] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:20:10.705400 25384 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
W20260709 13:20:10.748420 25426 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:20:10.748946 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:10.711992 18380 raft_consensus.cc:2393] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:10.750353 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:10.751084 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:10.755614 18384 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:10.702261 25386 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:10.753263 18385 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 21: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:10.693073 25410 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:10.701614 25365 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:10.706780 25375 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:10.660748 25395 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.111s
I20260709 13:20:10.754792 18926 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:10.675827 25418 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
W20260709 13:20:10.756776 25371 consensus_meta.cc:287] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.000s
I20260709 13:20:10.753811 25420 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:20:10.773274 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.774075 18277 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:10.785480 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:10.788741 25368 raft_consensus.cc:697] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:10.790082 25402 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:10.789793 25368 consensus_queue.cc:237] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:10.790608 25402 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:10.792786 25402 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:10.794914 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:10.795198 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 97798.9us
I20260709 13:20:10.797132 18955 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 12: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
W20260709 13:20:10.797991 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47017.9us
I20260709 13:20:10.801509 25425 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.674345 25308 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:10.764993 25410 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:20:10.806022 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 51564.6us
I20260709 13:20:10.772207 25366 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:10.753118 25326 consensus_queue.cc:1059] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:20:10.806171 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:10.802076 25425 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:10.816425 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:10.819584 18277 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:10.824730 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:10.829486 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:10.803856 25078 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:10.834048 18228 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:10.805470 25290 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:10.815346 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:10.836012 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:10.806468 25365 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:10.841735 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:10.840210 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:10.842875 18235 raft_consensus.cc:3060] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:10.842388 18228 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.854269 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:10.824717 25405 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 13:20:10.813755 25410 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:10.863184 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:10.978430 18956 raft_consensus.cc:2393] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 16: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:10.949249 25389 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:10.863555 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:10.810559 25374 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:10.814211 25089 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:10.927806 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:10.707716 25377 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:10.939615 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:10.828994 25184 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:10.941452 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 109445us
I20260709 13:20:10.993806 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:10.786669 25371 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:10.950294 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 129394us
I20260709 13:20:10.997476 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:10.828191 25185 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:10.948799 25418 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:11.003202 18235 raft_consensus.cc:2468] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
I20260709 13:20:10.824972 25423 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.151s
I20260709 13:20:10.816624 24964 raft_consensus.cc:2804] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:10.973519 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:10.989650 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:10.957625 25422 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:20:10.839077 25417 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.123s
I20260709 13:20:11.002717 18228 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:20:10.976882 25414 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:11.031780 18351 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:10.956496 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:11.054812 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 99474.5us
W20260709 13:20:11.021875 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.042467 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.993214 25184 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:11.056949 25184 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:11.030491 25185 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:11.062602 25185 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:11.055548 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:11.042768 25395 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:11.069231 25395 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:11.069814 25395 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:10.993793 25089 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:10.958561 25290 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:20:11.077687 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 45969.5us
I20260709 13:20:10.977181 25425 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:11.033318 25418 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:11.084793 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 283805us
I20260709 13:20:11.041623 25435 raft_consensus.cc:1064] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:20:10.987478 25389 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:11.081228 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:11.089300 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:10.953109 25433 consensus_queue.cc:1059] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.136s
I20260709 13:20:11.048275 25382 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:11.093421 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 96029.8us
I20260709 13:20:11.094269 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:11.099784 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:11.078912 25369 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:11.099920 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:11.101544 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 46092.1us
I20260709 13:20:11.080111 24964 raft_consensus.cc:697] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 15 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:11.085796 25367 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:11.105347 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:11.106949 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:11.104910 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:11.113317 18228 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:11.090278 25418 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:11.118834 24964 consensus_queue.cc:237] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:11.120838 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:11.128386 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:11.121515 25447 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:11.120548 18234 raft_consensus.cc:2955] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 11 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:11.122437 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:11.130307 18229 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:20:11.093039 25438 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:11.128171 25365 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:20:11.126519 18351 connection.cc:256] RPC call timeout handler was delayed by -1.7392575769999894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 13:20:11.110471 25402 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:11.136596 25417 raft_consensus.cc:1064] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:20:11.093407 25412 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:11.050072 25434 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.076s
W20260709 13:20:11.140059 18351 connection.cc:256] RPC call timeout handler was delayed by -1.7014575769999283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
I20260709 13:20:11.143810 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:11.151211 18351 connection.cc:256] RPC call timeout handler was delayed by -1.6915575769999123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 13:20:11.151587 18351 connection.cc:256] RPC call timeout handler was delayed by -1.6541292479998901s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
I20260709 13:20:11.101432 25440 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:11.104158 25392 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:11.149574 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:11.151897 18351 connection.cc:256] RPC call timeout handler was delayed by -1.6411575770000582s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
I20260709 13:20:11.108184 25439 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:11.085121 25414 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:11.157351 18351 connection.cc:256] RPC call timeout handler was delayed by -1.6253292479998436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
I20260709 13:20:11.165524 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:11.153247 25417 raft_consensus.cc:1068] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Unable to promote non-voter e016302b7e734d74833a2bf7bab44838: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:20:11.155526 25402 raft_consensus.cc:697] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:11.153155 25440 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.158720 25439 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.197842 18277 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:11.187260 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 66462.1us
I20260709 13:20:11.153280 25451 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:11.189114 25380 consensus_meta.cc:287] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.002s
I20260709 13:20:11.163242 25308 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:11.216813 18382 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:11.186019 25438 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:11.221668 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:11.180558 25392 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:11.222661 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:11.194504 25185 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:11.229663 18277 leader_election.cc:400] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19.
I20260709 13:20:11.186573 25450 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:11.155329 25410 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:11.232807 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:11.231154 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:11.232134 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:11.208033 25341 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:11.208829 25089 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:11.233511 18386 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:11.234706 25365 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:11.242107 25402 consensus_queue.cc:237] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:11.143831 25364 consensus_queue.cc:260] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:11.244799 25364 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:11.222571 25326 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:11.246624 25326 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:11.247171 25326 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:11.226929 25447 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:11.249251 25447 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:11.249784 25447 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:11.149466 25389 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:11.210458 25440 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:11.153786 25412 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:11.228045 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:11.258589 25396 raft_consensus.cc:3055] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:11.259470 25341 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:11.221623 25439 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:11.224076 25394 raft_consensus.cc:3055] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:11.255991 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:11.230335 25185 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.267530 18378 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:11.268045 25184 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:11.293321 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:11.304821 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 215621us
I20260709 13:20:11.307150 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:11.296592 25394 raft_consensus.cc:740] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:11.309338 25449 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:20:11.309691 25394 consensus_queue.cc:260] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:11.265015 25371 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:11.314438 18202 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:11.315424 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:11.230072 25380 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:11.277956 25396 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:11.306478 25185 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:11.330740 18953 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:11.311376 25394 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.331104 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:11.328118 18277 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:11.311882 25365 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:11.321772 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:11.367681 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:11.369743 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:11.371549 18232 raft_consensus.cc:2393] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 15: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:20:11.374107 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 46091.1us
I20260709 13:20:11.375069 18277 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:11.325309 25438 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:11.333627 25451 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:11.451510 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:11.428839 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 264959us
I20260709 13:20:11.382067 25438 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.328828 25392 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:11.494634 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 73645.7us
W20260709 13:20:11.529603 18351 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.567s (SENT)
I20260709 13:20:11.529965 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:11.369735 25430 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:11.530128 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:11.421852 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 52279.4us
I20260709 13:20:11.384100 25341 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:11.512501 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:11.544569 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.565747 18351 connection.cc:256] RPC call timeout handler was delayed by -1.6006575769999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 13:20:11.566195 18351 connection.cc:256] RPC call timeout handler was delayed by -1.5731292479999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 13:20:11.566731 18351 leader_election.cc:336] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.883s (SENT)
I20260709 13:20:11.392974 25451 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:11.505287 25473 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:20:11.398303 25464 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:11.455603 25433 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:11.446506 25434 raft_consensus.cc:2764] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:20:11.531329 25438 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:11.593021 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 60031.4us
I20260709 13:20:11.601471 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:11.422776 25365 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:11.541231 25341 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:20:11.595290 18351 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.955s (SENT) [suppressed 43 similar messages]
I20260709 13:20:11.510625 25414 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:11.566584 25371 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:11.389950 25326 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:11.606812 18351 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.973s (SENT)
I20260709 13:20:11.608064 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:11.578989 25430 raft_consensus.cc:697] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:11.591621 25410 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:11.472123 25395 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:11.579453 25451 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.597165 25385 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:11.617497 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:11.602914 25365 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.618913 25464 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:11.622087 25184 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:11.656818 18202 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:11.656854 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 50076us
W20260709 13:20:11.660720 18351 leader_election.cc:336] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.992s (SENT)
I20260709 13:20:11.619936 25472 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:11.661211 18202 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:11.666002 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:11.622771 25365 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:11.653754 25434 raft_consensus.cc:2764] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:20:11.672410 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:11.663273 25345 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 1.442s	user 0.014s	sys 0.002s
I20260709 13:20:11.662935 25414 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:11.693308 25463 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:20:11.700649 25430 consensus_queue.cc:237] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:11.705601 25395 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:11.709371 25467 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:20:11.711567 25475 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:11.674089 25474 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:11.459553 25396 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:11.683408 25462 log.cc:927] Time spent T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.263s	user 0.002s	sys 0.000s
I20260709 13:20:11.672123 25394 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:11.684218 25450 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:11.736147 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 75439.2us
W20260709 13:20:11.736795 18351 connection.cc:256] RPC call timeout handler was delayed by -1.5475575769999068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260709 13:20:11.737723 18351 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.387s (SENT)
I20260709 13:20:11.690506 25457 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
W20260709 13:20:11.736171 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 206280us
W20260709 13:20:11.744688 18351 connection.cc:256] RPC call timeout handler was delayed by -1.5106575769998472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
I20260709 13:20:11.743443 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:11.745258 18351 connection.cc:256] RPC call timeout handler was delayed by -1.4738803850000295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
W20260709 13:20:11.745610 18351 connection.cc:256] RPC call timeout handler was delayed by -1.4575575769999887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
W20260709 13:20:11.745890 18351 connection.cc:256] RPC call timeout handler was delayed by -1.4377575769999567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
W20260709 13:20:11.746152 18351 connection.cc:256] RPC call timeout handler was delayed by -1.3864575769998737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
W20260709 13:20:11.746403 18351 connection.cc:256] RPC call timeout handler was delayed by -1.3284435509999639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
W20260709 13:20:11.746661 18351 connection.cc:256] RPC call timeout handler was delayed by -1.3045575769999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
W20260709 13:20:11.746908 18351 connection.cc:256] RPC call timeout handler was delayed by -1.2982575769999585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260709 13:20:11.747159 18351 connection.cc:256] RPC call timeout handler was delayed by -1.1092575769998803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2398s for a response
I20260709 13:20:11.723726 25184 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.690064 25345 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:11.759685 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:11.685439 25443 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:20:11.761824 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:11.764672 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 77313.5us
W20260709 13:20:11.768076 18202 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.240s (SENT)
I20260709 13:20:11.768576 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:11.768643 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:11.766739 25479 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:11.729456 25469 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
W20260709 13:20:11.770974 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.759883 25396 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.775720 25416 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:20:11.776721 25416 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:11.777041 25457 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.777992 25457 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:11.779065 25374 raft_consensus.cc:3055] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:11.779471 25374 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:11.782986 25369 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:11.784535 25410 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:20:11.786242 25418 consensus_meta.cc:287] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.643s	user 0.012s	sys 0.002s
I20260709 13:20:11.786700 25418 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:11.787823 18235 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:20:11.780287 25457 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:11.777092 25416 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:11.772248 18277 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:11.769902 25387 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:20:11.774271 25341 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:11.797122 25341 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:11.796981 25416 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:11.773319 25371 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:20:11.798269 25416 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:11.797533 25435 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:11.769614 25384 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:11.759330 25395 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:20:11.762274 25482 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:11.757325 25184 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:11.772316 25450 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:11.804240 25482 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:11.771705 25326 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:11.805112 25364 consensus_meta.cc:287] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.559s	user 0.003s	sys 0.011s
I20260709 13:20:11.814775 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.815634 18303 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:11.817385 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.818733 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.819440 18303 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:11.821062 18958 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:20:11.821535 18958 pending_rounds.cc:85] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Aborting all ops after (but not including) 12
I20260709 13:20:11.821796 18958 pending_rounds.cc:107] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:20:11.822086 18958 raft_consensus.cc:2889] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:11.823197 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.797549 25341 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:11.827342 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:11.827889 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.828801 18304 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:11.804443 25384 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:11.784713 25385 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:20:11.863924 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 1645) took 1038 ms. Trace:
I20260709 13:20:11.829469 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.863116 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.820422 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:11.886857 18303 raft_consensus.cc:2376] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15. Re-sending same reply.
I20260709 13:20:11.829712 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.887706 18309 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:11.888149 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.841578 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.841132 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.889472 18303 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:11.840633 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.890542 18308 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
W20260709 13:20:11.890736 18202 leader_election.cc:336] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.816s (SENT)
I20260709 13:20:11.885535 18306 rpcz_store.cc:276] 0709 13:20:10.825361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.825521 (+   160us) service_pool.cc:224] Handling call
0709 13:20:10.825882 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.044378 (+218496us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:11.152549 (+108171us) log.cc:844] Serialized 14 byte log entry
0709 13:20:11.279401 (+126852us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:11.279992 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:20:11.280169 (+   177us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:11.280214 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.280321 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:11.863713 (+583392us) raft_consensus.cc:1685] finished
0709 13:20:11.863735 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.863865 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7958,"prepare.queue_time_us":191392,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":150335,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":21333,"thread_start_us":371870,"threads_started":3,"wal-append.queue_time_us":139074}
I20260709 13:20:11.891583 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:11.892266 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 108319us
I20260709 13:20:11.862788 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:11.892352 18303 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:11.889003 18305 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:11.806448 25379 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:11.915717 18351 leader_election.cc:400] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21.
I20260709 13:20:11.916203 18351 leader_election.cc:403] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:11.917124 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.918015 18309 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:11.840201 25450 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:11.808032 25482 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:11.919862 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.780329 25374 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:11.921205 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.922231 18311 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:20:11.922881 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.923612 18304 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:11.920495 18305 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:11.925493 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.926244 18308 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:11.867964 25390 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:11.892536 25366 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.827243 25371 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.099s
I20260709 13:20:11.929989 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.930265 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.931031 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.891523 25479 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.925709 25369 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:20:11.920157 25379 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:11.924751 25450 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:11.953374 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:11.997898 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.998029 18305 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 23: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:11.974432 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:11.984848 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:11.986013 18202 leader_election.cc:336] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.854s (SENT)
I20260709 13:20:12.011556 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:11.986687 18309 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 21: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:11.966279 18201 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:11.983356 18303 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
W20260709 13:20:12.013450 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 47227.2us
W20260709 13:20:12.033746 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47795us
W20260709 13:20:12.035188 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 81886.3us
I20260709 13:20:11.959159 25391 raft_consensus.cc:3055] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:20:11.971694 25447 consensus_meta.cc:287] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.721s	user 0.006s	sys 0.005s
W20260709 13:20:11.949175 25481 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:20:11.963330 25184 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.036243 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:12.035540 18202 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:11.980355 25380 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:12.043949 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.961086 25345 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:11.936502 25464 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:11.981914 25433 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:11.968642 25384 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.967515 25474 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:12.008905 25387 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:20:12.033089 25443 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:12.033288 25371 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:12.078162 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:11.969903 25385 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21.
W20260709 13:20:12.079291 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 43852us
I20260709 13:20:12.017818 25450 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:12.034389 24964 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:12.136288 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:12.081430 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 45287.9us
I20260709 13:20:12.037308 25430 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:11.980777 25374 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:12.038091 25391 raft_consensus.cc:740] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:11.963894 25390 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:12.044819 25410 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:12.042721 25368 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:12.005146 25479 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:11.977576 25341 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:12.015889 25438 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.138015 18305 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:12.318712 18380 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:20:11.972298 25451 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:12.090956 25439 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.772s	user 0.014s	sys 0.008s
I20260709 13:20:11.964210 25366 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.147888 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:12.084924 25433 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:12.080868 25392 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:12.085701 25380 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:12.269531 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 130167us
I20260709 13:20:12.271445 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:12.274087 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:12.344920 18383 raft_consensus.cc:2393] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:12.350024 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:12.139115 25443 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.082334 18311 raft_consensus.cc:2955] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:20:12.091514 25395 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:12.145226 25440 consensus_meta.cc:287] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.856s	user 0.013s	sys 0.009s
I20260709 13:20:12.135874 25377 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:12.142052 25441 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:12.396494 25441 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:12.397462 25441 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:12.269038 25425 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:12.398916 25425 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:12.399328 25425 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:12.047588 25447 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:12.401278 18307 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:20:12.278141 25483 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.319s	user 0.000s	sys 0.002s
I20260709 13:20:12.320853 18275 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:12.403209 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 82439.1us
I20260709 13:20:12.328334 18308 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:12.092394 25384 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:12.333904 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 186136us
I20260709 13:20:12.341153 18312 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:12.415057 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:12.144304 25371 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:12.375326 25369 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:12.379711 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46128 (request call id 1120) took 1559 ms. Trace:
I20260709 13:20:12.434367 18232 rpcz_store.cc:276] 0709 13:20:10.820171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.821800 (+  1629us) service_pool.cc:224] Handling call
0709 13:20:12.379445 (+1557645us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b54000d1e54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:12.379627 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1186932992}
I20260709 13:20:12.344038 25435 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:12.435989 25435 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:12.436564 25435 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:12.437588 25185 consensus_meta.cc:287] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.064s	user 0.011s	sys 0.002s
I20260709 13:20:12.438120 25185 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.387578 18310 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:12.395179 25387 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:20:12.286062 25385 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:20:12.354692 25391 consensus_queue.cc:260] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:12.390484 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.149037 24964 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:12.442732 25394 consensus_meta.cc:287] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.713s	user 0.012s	sys 0.000s
I20260709 13:20:12.443187 25394 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:12.443377 25390 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:12.445218 24964 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.286460 25368 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.447238 25384 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.447781 25368 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.413981 18275 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:12.344367 25380 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:12.448786 25380 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:12.445253 25396 consensus_meta.cc:287] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
I20260709 13:20:12.450287 25368 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:12.393687 25184 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.433570 25496 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:20:12.451864 25493 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:20:12.452121 25184 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:12.454141 25479 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.429874 25492 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:12.455336 25184 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.415246 25440 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.456750 25435 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.458082 25440 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:12.458840 25435 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.460354 25402 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:12.460772 25402 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:12.461556 25402 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.462710 25402 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:12.465752 25379 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.481074 25389 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:12.440398 25185 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:12.493788 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 78886.7us
I20260709 13:20:12.497632 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:12.351109 25439 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.431360 25443 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:12.477294 25434 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:12.510728 25451 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:12.526567 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 176616us
I20260709 13:20:12.353354 25392 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:12.505400 25184 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.483119 25369 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:12.545439 25443 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.547232 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:12.550490 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:12.557020 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:12.551327 25488 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:12.557964 18306 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:12.563060 25443 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.563380 18380 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:20:12.542686 25365 consensus_meta.cc:287] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.862s	user 0.019s	sys 0.010s
I20260709 13:20:12.565470 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:12.566227 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:12.569099 25506 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:12.540347 25371 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:12.537772 25341 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:12.528924 25379 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:12.572048 25487 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:12.572556 25487 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:12.574129 25439 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.574783 25439 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:12.575474 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1127) took 1735 ms. Trace:
I20260709 13:20:12.575857 25491 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:12.576071 18237 rpcz_store.cc:276] 0709 13:20:10.839619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.839762 (+   143us) service_pool.cc:224] Handling call
0709 13:20:10.840051 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.075757 (+235706us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:20:11.090589 (+ 14832us) log.cc:844] Serialized 14 byte log entry
0709 13:20:11.230794 (+140205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.230858 (+    64us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:11.230917 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.575169 (+1344252us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b540001c2d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:12.575239 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.575399 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13775,"prepare.queue_time_us":14748,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":4841,"raft.queue_time_us":12915,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6626,"spinlock_wait_cycles":541415680,"thread_start_us":133580,"threads_started":1,"wal-append.queue_time_us":171641,"wal-append.run_cpu_time_us":1325,"wal-append.run_wall_time_us":1006101}
I20260709 13:20:12.578768 18958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54020 (request call id 568) took 1641 ms. Trace:
I20260709 13:20:12.579180 18958 rpcz_store.cc:276] 0709 13:20:10.937380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.938568 (+  1188us) service_pool.cc:224] Handling call
0709 13:20:10.957021 (+ 18453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.822584 (+865563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.578475 (+755891us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b5400840154. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:12.578698 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961308800}
I20260709 13:20:12.543815 25479 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.580641 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:12.580992 25479 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:12.581683 25392 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:12.581732 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.584272 18303 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
W20260709 13:20:12.567417 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 57876.5us
I20260709 13:20:12.585383 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.586194 18303 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:12.586516 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:12.539016 25418 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.538683 25366 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.588783 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:12.587145 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:12.590760 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:12.557717 25434 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:12.560911 25402 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:20:12.599021 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:12.589823 25439 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:12.601636 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.576371 25491 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:12.601485 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:12.603863 18311 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:12.604941 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:12.605113 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.605579 18307 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:12.560899 25184 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:12.589309 25365 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.600639 25434 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:12.619881 25480 log.cc:927] Time spent T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.883s	user 0.016s	sys 0.021s
I20260709 13:20:12.603782 25418 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:12.623507 18306 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:12.599367 25487 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.629213 25487 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:12.641479 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:12.644249 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:12.645128 18955 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:12.601516 25503 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:12.606758 25389 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:12.649129 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:12.647825 18307 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:12.649689 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3669) took 1965 ms. Trace:
I20260709 13:20:12.609737 25392 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:12.651437 18305 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:12.650580 18378 rpcz_store.cc:276] 0709 13:20:10.684303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.684453 (+   150us) service_pool.cc:224] Handling call
0709 13:20:10.698704 (+ 14251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.306692 (+607988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.649403 (+1342711us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b540012a554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:12.649607 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307714816}
W20260709 13:20:12.621981 25482 consensus_meta.cc:287] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.673s	user 0.012s	sys 0.000s
I20260709 13:20:12.649808 18379 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:20:12.656150 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:12.662927 18379 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
I20260709 13:20:12.665931 18378 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:12.666144 18380 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:12.667532 18379 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:12.670490 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:12.671180 18379 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:20:12.670895 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:12.651914 25488 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:12.678256 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.628118 25450 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:12.678977 18307 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:12.687525 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:12.687680 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.678967 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:12.679560 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:12.664214 25489 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.508s	user 0.001s	sys 0.000s
I20260709 13:20:12.683434 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.690105 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:12.690272 18306 raft_consensus.cc:2393] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:12.686028 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:12.690670 18379 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:12.688166 18386 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:20:12.658607 25389 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:12.694553 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:12.695340 18312 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:12.695535 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:12.671522 25402 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:12.698859 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:12.701855 18308 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:12.702593 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:12.703308 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:12.698011 25503 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:12.705121 25503 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:12.705624 25503 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:12.708770 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:12.713824 25504 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:12.714303 25504 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:12.714682 25504 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.715387 18385 raft_consensus.cc:2410] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for term 23 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:20:12.715968 25411 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:12.716895 25491 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.718214 25491 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:12.718853 18953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54004 (request call id 663) took 1673 ms. Trace:
I20260709 13:20:12.719400 18953 rpcz_store.cc:276] 0709 13:20:11.045838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.046142 (+   304us) service_pool.cc:224] Handling call
0709 13:20:11.046650 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.364597 (+317947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.718540 (+1353943us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54007ae254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:12.718772 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648859008}
I20260709 13:20:12.722573 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.725472 18310 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:12.724145 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.726596 18304 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:12.700031 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.731171 18307 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:12.732851 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.699112 18202 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:12.729713 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:12.736503 18312 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:12.737460 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.738103 18312 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:12.736039 18385 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 8.
W20260709 13:20:12.743906 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 44861us
I20260709 13:20:12.744539 18304 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:20:12.746563 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.664203 25482 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.745582 18276 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:12.752389 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:12.704690 25443 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:12.682492 25380 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.754696 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:12.761394 18304 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:12.757089 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.759057 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:12.761583 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:12.763175 18308 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
I20260709 13:20:12.771288 18276 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:12.772197 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.768194 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:12.772933 18310 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:12.772980 18276 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:12.754294 25185 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:12.778307 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:12.779798 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.688481 25488 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.758685 25341 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:12.790975 25451 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:12.795053 25451 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.765617 25494 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:20:12.795567 25495 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.465s	user 0.002s	sys 0.000s
I20260709 13:20:12.767539 25443 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:12.800294 25494 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:12.791674 25410 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:12.801295 25494 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.801409 25443 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.793634 25440 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:20:12.765875 25444 consensus_queue.cc:1059] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 13:20:12.806037 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.791505 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:12.814761 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:12.787530 25185 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.820691 25385 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:12.790129 25501 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:12.827310 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:12.788350 25435 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.795564 25451 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:12.834654 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:12.834707 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:12.835814 18385 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:12.822893 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 120789us
I20260709 13:20:12.759783 25500 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:20:12.785662 25366 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:20:12.814580 25394 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.814050 25396 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.804451 25479 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:12.804734 25341 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:12.841140 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:12.847373 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:12.814267 25439 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:12.848767 18955 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:12.809877 25402 consensus_queue.cc:1059] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:20:12.825106 25185 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:12.824637 25184 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.826545 25444 consensus_queue.cc:1243] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer 8b4fbc44aa2649f0bcac5cd70f71951d log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:12.811110 25417 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:20:12.826337 25368 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:12.868580 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:12.827733 25501 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:12.880923 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:12.853684 25385 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:12.883473 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:12.883409 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.873622 18953 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 21 LEARNER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:12.887854 24964 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:20:12.891321 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 50304.5us
I20260709 13:20:12.839848 25365 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.892719 18955 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:12.881964 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.816150 25389 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.857391 25395 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:12.917652 25395 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:12.918042 25395 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:12.919420 18955 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:20:12.920871 25488 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:12.907455 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.909319 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:12.863680 25394 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.923622 25394 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.924099 25394 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:12.905884 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.925253 18306 raft_consensus.cc:2368] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20.
I20260709 13:20:12.864867 25396 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:12.924319 18310 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:12.927685 25396 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:12.927989 25371 raft_consensus.cc:2764] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:20:12.917053 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:12.907104 18927 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:12.928843 18309 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:12.914111 25492 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:12.929562 18927 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:12.925137 25380 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:12.935940 18237 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:12.931720 18310 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:20:12.839998 25435 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:12.892369 25368 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:12.942552 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:12.941218 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:12.932212 25514 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:12.945902 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 65067.4us
I20260709 13:20:12.947557 18955 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:20:12.948024 18202 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:12.902967 25501 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.872267 25439 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:12.950423 18202 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:12.977869 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:12.904930 25385 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:12.978793 25385 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:12.948894 18349 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:12.932385 25394 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:12.954263 25341 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:12.930949 25377 consensus_meta.cc:287] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.518s	user 0.004s	sys 0.005s
I20260709 13:20:12.959338 18309 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
W20260709 13:20:12.950867 25425 consensus_meta.cc:287] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260709 13:20:12.980202 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.982805 18202 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:12.988125 18310 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 16: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:20:12.973841 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.985219 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.910794 25369 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:12.946411 25423 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:12.990842 18231 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 18.
I20260709 13:20:12.951077 25368 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:12.994256 18232 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
I20260709 13:20:12.933286 25494 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:20:13.000948 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:12.976406 25380 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:12.980783 25345 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.959095 25375 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:13.008576 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:12.984228 25415 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:13.058032 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:13.059722 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:13.060441 18382 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 23: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:13.061282 18309 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16.
W20260709 13:20:13.062013 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 73182.5us
I20260709 13:20:12.986828 25514 raft_consensus.cc:697] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:12.984795 25492 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:20:12.994724 25425 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:12.980893 25503 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.062826 18381 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:13.010521 25410 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.065886 18200 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:12.984407 25450 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.056653 25482 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.070082 18382 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:13.071069 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:12.994547 25416 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:12.994120 25443 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:12.998127 25377 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:13.003046 25447 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.016176 25380 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:13.080948 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:13.085685 18310 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22. Ops: [21.12-21.12]
W20260709 13:20:13.067170 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 64557.5us
I20260709 13:20:13.096963 25412 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:13.086612 25478 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.106118 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:13.086668 25446 consensus_queue.cc:1059] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:20:13.147977 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:13.143337 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3842) took 1137 ms. Trace:
I20260709 13:20:13.161306 18385 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:13.162667 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:13.154282 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:13.160375 18303 rpcz_store.cc:276] 0709 13:20:12.005627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.602651 (+597024us) service_pool.cc:224] Handling call
0709 13:20:12.621168 (+ 18517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:12.621817 (+   649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:12.621852 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:12.659546 (+ 37694us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.794164 (+134618us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:12.794539 (+   375us) log.cc:844] Serialized 14 byte log entry
0709 13:20:12.794783 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.794872 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.143086 (+348214us) raft_consensus.cc:1685] finished
0709 13:20:13.143107 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.143272 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":180,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":2774,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":199,"thread_start_us":100697,"threads_started":1,"wal-append.queue_time_us":451157}
I20260709 13:20:13.125625 25380 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:13.116273 25416 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.114547 18309 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: [18.12-18.12]
W20260709 13:20:13.117527 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 51716.6us
I20260709 13:20:13.176415 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:13.177376 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:13.177439 18237 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:13.124992 18201 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:13.072494 25345 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.108870 18381 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:13.168432 18276 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:13.178468 18235 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:13.180002 18229 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:13.181648 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:13.197055 18230 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 22: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:13.198570 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:13.119982 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:13.182503 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 242081us
I20260709 13:20:13.183468 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:13.200019 18234 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:13.190061 18309 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:20:13.116794 25417 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:13.204007 25417 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:13.204545 25417 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:13.202128 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:13.205060 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:13.202852 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:13.208256 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:20:13.141470 25374 consensus_meta.cc:287] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.873s	user 0.011s	sys 0.003s
I20260709 13:20:13.121287 25451 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.213249 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:13.213894 18230 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:13.214704 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:13.215075 25451 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.215698 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:13.142984 25434 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:13.216776 25418 consensus_meta.cc:287] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.005s
I20260709 13:20:13.217182 25418 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:13.217393 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:13.147548 25425 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:13.217928 25434 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.126123 25482 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.218792 25482 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.143647 25394 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:13.193754 25416 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:13.221021 25482 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.125625 25377 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:13.138768 25395 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.225183 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:13.142127 25512 log.cc:927] Time spent T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:20:13.174661 25447 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
W20260709 13:20:13.174696 25433 consensus_meta.cc:287] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.821s	user 0.008s	sys 0.002s
I20260709 13:20:13.145982 25503 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:13.211011 25365 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.246168 25365 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.246727 25395 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:13.211927 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 105859us
I20260709 13:20:13.217933 18229 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:13.215556 25368 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:13.137739 25517 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:20:13.216326 18230 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:20:13.273411 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:13.121078 25450 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:13.237496 18385 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:13.228865 25375 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.238739 18236 raft_consensus.cc:2393] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:13.239053 18953 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:13.145890 25439 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.240408 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:13.115548 25410 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:13.239602 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:13.244200 18235 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
I20260709 13:20:13.285781 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:13.151278 25504 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:13.248870 18303 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 23. Current term is 24. Ops: [23.14-23.14]
W20260709 13:20:13.249245 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 124341us
I20260709 13:20:13.288942 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:13.289422 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:13.141661 25435 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:13.251960 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:13.273993 18962 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:20:13.271368 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:13.271845 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.275045 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:13.235936 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 67615.1us
I20260709 13:20:13.240190 25444 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:13.278266 18927 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:13.220428 25490 log.cc:927] Time spent T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.900s	user 0.001s	sys 0.001s
I20260709 13:20:13.290045 18380 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:13.254161 25530 raft_consensus.cc:2764] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:13.289711 18960 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 16: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:13.282204 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:13.289654 18201 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:13.280205 25487 consensus_meta.cc:287] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.650s	user 0.009s	sys 0.002s
I20260709 13:20:13.292826 25521 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:13.293267 25501 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:13.293892 25379 consensus_meta.cc:287] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.000s
I20260709 13:20:13.293819 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:13.250021 25443 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:13.252152 25374 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:13.176173 25478 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.286619 18235 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.304852 25364 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:13.301805 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:13.255242 25433 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.307049 25451 consensus_queue.cc:1059] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:13.310034 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:13.225227 25377 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.311451 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:13.307965 25402 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.297791 25450 raft_consensus.cc:697] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:13.323637 18303 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:13.248240 25365 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.288209 25375 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.328337 18235 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:13.142458 25514 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:13.331121 18230 raft_consensus.cc:2410] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:20:13.309675 25439 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:13.306356 25444 raft_consensus.cc:697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:13.336454 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:13.337591 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:13.349833 18378 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:13.349906 18379 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:13.321482 25379 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:13.351333 18379 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:13.340938 25410 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:13.341818 25501 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:13.336411 25184 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:13.338510 25423 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:20:13.345144 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:13.347018 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:13.322471 25435 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:13.329710 25345 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.307595 25479 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 13:20:13.328851 25524 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.354642 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:13.356158 18380 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:13.356379 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.329756 25374 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.378739 25374 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.343981 25450 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:13.328902 25511 consensus_queue.cc:1059] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.081s
I20260709 13:20:13.380034 25184 raft_consensus.cc:3055] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:13.380456 25184 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:13.381351 25184 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:13.382093 25482 raft_consensus.cc:3055] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:13.382721 25482 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:13.365172 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:13.383688 18960 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:20:13.369678 18378 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:13.384148 25482 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:13.385106 18349 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:13.385429 25482 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:13.385846 18378 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:20:13.386413 25395 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:13.386919 25395 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.387320 25395 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.387758 25387 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:13.388151 25387 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:13.389153 25387 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.390489 25387 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:13.393155 25412 raft_consensus.cc:3055] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:13.372380 25380 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.393674 25412 raft_consensus.cc:740] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:13.394284 18234 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 18: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:13.364837 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:13.395753 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.396752 18380 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:13.397158 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:13.382762 25184 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:13.399089 18379 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:13.400566 25412 consensus_queue.cc:260] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:13.403041 25368 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:13.403316 25380 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.404172 25504 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:13.404652 25524 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:13.404282 25538 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:20:13.416973 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.421986 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:20:13.423316 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 104526us
I20260709 13:20:13.427925 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:13.416582 25479 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.368263 25435 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.438163 18351 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:13.420096 25536 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.421686 25531 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.429394 25412 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:13.426116 25375 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.433917 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:13.447607 25536 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.450277 25536 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.453187 18229 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
W20260709 13:20:13.453837 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.455345 18235 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:20:13.458148 18305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 2981) took 1458 ms (client timeout 1572 ms). Trace:
W20260709 13:20:13.458632 18305 rpcz_store.cc:269] 0709 13:20:12.000125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.331768 (+331643us) service_pool.cc:224] Handling call
0709 13:20:13.457954 (+1126186us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54001bb554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:13.458068 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480054144}
I20260709 13:20:13.439445 25504 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:13.468282 18235 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:13.432451 25488 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:20:13.471374 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:13.473208 18229 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 20: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:13.463095 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:13.441077 25479 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:13.480944 25533 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:20:13.481171 18229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:20:13.481921 18229 raft_consensus.cc:606] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:13.482254 18229 raft_consensus.cc:614] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:13.483623 18229 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:13.462232 25531 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.487782 25531 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:13.489425 25539 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:20:13.464651 25504 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:13.474066 25185 consensus_meta.cc:287] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.576s	user 0.006s	sys 0.005s
I20260709 13:20:13.450531 25417 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.562783 25368 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:13.563566 25368 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.566013 25368 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.568712 25433 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.569181 25491 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:13.569818 25491 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:13.570778 25491 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.574206 25524 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:13.471810 25528 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:13.576625 25185 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:13.579083 25185 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:13.441596 25444 consensus_queue.cc:237] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:13.613114 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.626688 18229 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:20:13.644889 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:13.497571 25504 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:13.582866 25377 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:13.657121 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.645607 25478 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:13.778972 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.801884 18310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:60164
I20260709 13:20:13.802819 18310 raft_consensus.cc:606] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:13.806586 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:13.807608 18232 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:13.808760 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:13.812014 18229 raft_consensus.cc:2393] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:13.813896 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:13.815572 18233 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:13.623019 25416 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:13.831691 25402 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:13.832794 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.669348 25377 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:13.808315 25417 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:13.822994 25385 consensus_meta.cc:287] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.844s	user 0.010s	sys 0.003s
I20260709 13:20:13.875464 25377 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:13.876252 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.888543 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 375000us
I20260709 13:20:13.890287 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:13.981338 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:13.984521 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 94339.9us
W20260709 13:20:13.986723 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:13.989869 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.982520 18229 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
W20260709 13:20:14.031587 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.036569 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:14.041481 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 55045.6us
I20260709 13:20:14.047821 18232 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
W20260709 13:20:14.037396 25395 consensus_meta.cc:287] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.000s
I20260709 13:20:14.053313 18232 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:14.062674 18229 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:14.066161 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:14.066860 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.037065 25402 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:20:14.075646 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.076798 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:14.052337 25450 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.079380 25450 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.081480 18236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:20:14.082247 18236 raft_consensus.cc:606] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:14.082641 25450 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:14.082652 18236 raft_consensus.cc:614] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:13.871428 25385 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.045727 25435 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:14.091648 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:14.095402 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:14.098656 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:14.099360 18232 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:14.099987 18228 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.081s	sys 0.213s
W20260709 13:20:14.100528 18228 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.081s	sys 0.213s
I20260709 13:20:14.048305 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:14.047340 25417 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:20:14.120066 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:14.052661 25503 consensus_queue.cc:1059] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:20:14.123127 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:14.109970 25184 consensus_meta.cc:287] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.682s	user 0.004s	sys 0.008s
I20260709 13:20:14.125427 18228 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:14.108867 25454 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.060333 25395 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.116578 25511 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:14.096179 25479 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:14.131489 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:14.132279 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 84078.9us
W20260709 13:20:14.138486 25387 consensus_meta.cc:287] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.006s
I20260709 13:20:14.140969 25450 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:14.136384 25425 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:14.134369 25368 consensus_queue.cc:1059] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:20:14.143070 25089 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.141656 25450 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.147086 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:14.147801 18228 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:14.118893 25478 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:20:14.149010 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:14.151152 18229 raft_consensus.cc:2410] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:20:14.135033 25540 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:14.154927 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:14.156427 25395 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:14.157441 25433 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:14.157068 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:14.158828 18229 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:20:14.159158 25385 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:14.159401 25482 consensus_meta.cc:287] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.773s	user 0.013s	sys 0.000s
I20260709 13:20:14.164320 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:14.160073 25416 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:14.160255 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:14.130040 25454 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.145186 25089 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.140489 25417 consensus_queue.cc:1243] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 24.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:20:14.164566 18962 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.095s	sys 0.216s
W20260709 13:20:14.176481 18962 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.096s	sys 0.216s
W20260709 13:20:14.161688 25545 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:20:14.154307 25540 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.182658 18351 leader_election.cc:400] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20.
W20260709 13:20:14.164891 25444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.010s	sys 0.028s
I20260709 13:20:14.185355 25416 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:14.158063 25433 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:14.186038 25444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.010s	sys 0.028s
I20260709 13:20:14.181103 25540 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:14.187227 25417 consensus_queue.cc:1059] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:20:14.197494 25486 raft_consensus.cc:3055] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:14.210873 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:14.211675 18962 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.217331 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:14.218514 18958 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.212808 25486 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:20:14.220131 25491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.014s	sys 0.018s
I20260709 13:20:14.219705 25425 raft_consensus.cc:697] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:14.225059 25551 log.cc:927] Time spent T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:20:14.217334 25416 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:20:14.236917 25417 raft_consensus.cc:1064] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:20:14.241559 25454 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:14.233769 25491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.014s	sys 0.019s
W20260709 13:20:14.255860 25518 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 1.277s	user 0.009s	sys 0.007s
W20260709 13:20:14.174280 18237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.053s	sys 0.105s
W20260709 13:20:14.287832 18237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.054s	sys 0.105s
I20260709 13:20:14.291596 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3106) took 1110 ms. Trace:
I20260709 13:20:14.292415 18237 rpcz_store.cc:276] 0709 13:20:13.180901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.181077 (+   176us) service_pool.cc:224] Handling call
0709 13:20:13.181397 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:13.302512 (+121115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:13.302549 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:13.306702 (+  4153us) log.cc:844] Serialized 26 byte log entry
0709 13:20:14.289161 (+982459us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:14.290120 (+   959us) log.cc:844] Serialized 14 byte log entry
0709 13:20:14.290631 (+   511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.290843 (+   212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:14.290968 (+   125us) raft_consensus.cc:1685] finished
0709 13:20:14.291007 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.291434 (+   427us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68006,"raft.queue_time_us":89316,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5795,"thread_start_us":998192,"threads_started":2,"wal-append.queue_time_us":884720}
I20260709 13:20:14.169953 18229 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.297418 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:14.299463 18237 raft_consensus.cc:2410] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:20:14.159732 18232 raft_consensus.cc:2410] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:20:14.301689 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:14.302320 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:14.302691 18237 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
W20260709 13:20:14.306739 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:14.309245 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 199113us
W20260709 13:20:14.313731 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.316130 18232 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:14.317571 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:14.317517 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:14.322340 18927 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:14.330641 25089 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:14.325145 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2978) took 1134 ms. Trace:
I20260709 13:20:14.304108 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:14.335604 18237 raft_consensus.cc:2410] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
W20260709 13:20:14.336472 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.331682 18232 rpcz_store.cc:276] 0709 13:20:13.190876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.303626 (+1112750us) service_pool.cc:224] Handling call
0709 13:20:14.304248 (+   622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.324743 (+ 20495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.325046 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28032}
I20260709 13:20:14.327309 18958 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:14.352743 25078 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:14.353368 25444 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:14.353916 25454 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.354763 25444 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.355113 25454 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.356907 25556 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:14.357059 25425 consensus_queue.cc:237] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.245307 25486 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.362146 25486 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:14.349396 25491 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:14.369509 25412 consensus_meta.cc:287] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.916s	user 0.019s	sys 0.000s
I20260709 13:20:14.369642 25491 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.373569 25491 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:14.362222 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1136) took 1042 ms. Trace:
I20260709 13:20:14.374529 18232 rpcz_store.cc:276] 0709 13:20:13.320280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.345106 (+1024826us) service_pool.cc:224] Handling call
0709 13:20:14.361246 (+ 16140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.361718 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:14.361765 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:14.361849 (+    84us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:14.361906 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.361985 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.362149 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:14.378434 18349 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:14.379381 25433 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:14.380419 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 3117) took 1194 ms. Trace:
I20260709 13:20:14.408363 18235 rpcz_store.cc:276] 0709 13:20:13.185265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.396899 (+211634us) service_pool.cc:224] Handling call
0709 13:20:14.379736 (+982837us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b540005a354. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:14.380012 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132240256}
I20260709 13:20:14.405520 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 4159) took 1328 ms. Trace:
I20260709 13:20:14.391230 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:14.387601 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 3113) took 1203 ms. Trace:
I20260709 13:20:14.386339 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 3115) took 1201 ms. Trace:
W20260709 13:20:14.389546 18231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46128 (request call id 1130) took 3169 ms (client timeout 1897 ms). Trace:
I20260709 13:20:14.395149 18277 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:14.404347 18381 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46860 (request call id 3676) took 1745 ms (client timeout 2175 ms). Trace:
I20260709 13:20:14.419009 25560 raft_consensus.cc:476] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Not starting pre-election -- already a leader
W20260709 13:20:14.419301 18381 rpcz_store.cc:269] 0709 13:20:12.659051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.659184 (+   133us) service_pool.cc:224] Handling call
0709 13:20:14.403837 (+1744653us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b5400242554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:14.404089 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":899164928}
I20260709 13:20:14.411588 18385 rpcz_store.cc:276] 0709 13:20:13.076734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.162338 (+ 85604us) service_pool.cc:224] Handling call
0709 13:20:14.405073 (+1242735us) spinlock_profiling.cc:243] Waited 74.1 ms on lock 0x7b5400129654. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:14.405295 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170336128}
I20260709 13:20:14.425143 25390 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:14.425645 25390 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:14.427321 25390 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.428625 18229 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:14.430841 18229 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:14.431686 25391 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:14.432971 18237 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:14.433583 25392 raft_consensus.cc:3055] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:14.434033 25392 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:14.434947 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2980) took 1243 ms. Trace:
I20260709 13:20:14.375479 25444 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:14.400872 25491 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:14.438284 25491 raft_consensus.cc:697] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:14.441190 25433 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:14.415408 18230 rpcz_store.cc:276] 0709 13:20:13.184009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.273103 (+ 89094us) service_pool.cc:224] Handling call
0709 13:20:14.387039 (+1113936us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b5400270954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:14.387357 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129818368}
I20260709 13:20:14.442260 25433 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.444943 18230 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:14.445255 25555 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.445623 25433 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:14.446074 25555 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.448405 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:14.446650 18230 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:14.424386 25387 raft_consensus.cc:3055] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:14.453490 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:14.454878 18382 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:14.455958 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:14.456037 25441 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:14.456715 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:14.435683 25392 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.458242 25384 raft_consensus.cc:3055] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:14.459043 18232 raft_consensus.cc:1275] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:14.459493 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:14.414613 25454 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:14.460665 18201 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:14.461021 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:14.462344 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:14.417181 18234 rpcz_store.cc:276] 0709 13:20:13.184632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.201208 (+ 16576us) service_pool.cc:224] Handling call
0709 13:20:14.385616 (+1184408us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54000ae6d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:14.386040 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250265984}
I20260709 13:20:14.448771 25438 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:14.464804 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3109) took 1278 ms. Trace:
I20260709 13:20:14.462374 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:14.471920 18381 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:14.479751 18233 rpcz_store.cc:276] 0709 13:20:13.181989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.182151 (+   162us) service_pool.cc:224] Handling call
0709 13:20:13.182548 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:13.816169 (+633621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.384311 (+568142us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54000d1e54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:14.460106 (+ 75795us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1455181696}
W20260709 13:20:14.385841 25504 consensus_meta.cc:287] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.717s	user 0.011s	sys 0.011s
W20260709 13:20:14.417655 18231 rpcz_store.cc:269] 0709 13:20:11.219814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.321079 (+101265us) service_pool.cc:224] Handling call
0709 13:20:14.389098 (+3068019us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400059454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:14.389294 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3724837632}
I20260709 13:20:14.479423 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1137) took 1152 ms. Trace:
I20260709 13:20:14.477958 18229 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:14.480588 18385 raft_consensus.cc:2393] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 12: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:14.463907 18228 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:14.481717 18232 rpcz_store.cc:276] 0709 13:20:13.320587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.417844 (+1097257us) service_pool.cc:224] Handling call
0709 13:20:14.458384 (+ 40540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.473051 (+ 14667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.473274 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:14.455916 25390 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:14.435418 18237 rpcz_store.cc:276] 0709 13:20:13.191521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.336597 (+1145076us) service_pool.cc:224] Handling call
0709 13:20:14.432609 (+ 96012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.433491 (+   882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.434687 (+  1196us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b54001883d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:14.434844 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191990528}
I20260709 13:20:14.476814 18383 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:14.485482 25444 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.489790 18378 raft_consensus.cc:2410] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:20:14.467626 25387 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:14.472532 25384 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:20:14.493163 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.440023 25491 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.489228 25504 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.495920 25384 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.495998 25479 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:14.498667 25450 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:14.498988 25366 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:14.502174 18276 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:14.504809 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 154047us
I20260709 13:20:14.505895 25544 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:14.508677 25433 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.508049 25439 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:14.510268 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 294444us
I20260709 13:20:14.489600 25444 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.514959 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 1656) took 1559 ms. Trace:
I20260709 13:20:14.516053 25392 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:14.520797 18380 raft_consensus.cc:2393] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 13: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:20:14.526598 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 76595.2us
W20260709 13:20:14.539402 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.532702 25492 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:14.564043 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.574900 25366 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:14.576630 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 74738.1us
I20260709 13:20:14.577544 18276 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:14.577755 25366 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:14.578524 25438 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:14.578611 25366 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:14.579142 25438 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.579654 25438 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:14.579762 18276 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:14.582029 18230 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:14.582150 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:14.582968 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2990) took 1070 ms. Trace:
I20260709 13:20:14.583387 18230 rpcz_store.cc:276] 0709 13:20:13.512226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.473633 (+961407us) service_pool.cc:224] Handling call
0709 13:20:14.530962 (+ 57329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.582641 (+ 51679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.582884 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:14.583500 25439 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.586920 25439 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:14.587558 25433 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.592090 18381 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:20:14.563908 18309 rpcz_store.cc:276] 0709 13:20:12.955290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.212025 (+256735us) service_pool.cc:224] Handling call
0709 13:20:13.226949 (+ 14924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:13.227152 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:20:13.236864 (+  9712us) log.cc:844] Serialized 14 byte log entry
0709 13:20:14.513799 (+1276935us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b180043cde0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181e1b4bc 00007fa17f16948b 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e1323a
0709 13:20:14.514157 (+   358us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:14.514243 (+    86us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:14.514323 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.514447 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.514682 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":298,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":5472,"raft.queue_time_us":6158,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":228,"spinlock_wait_cycles":6983936,"thread_start_us":42825,"threads_started":1,"wal-append.queue_time_us":70098,"wal-append.run_cpu_time_us":1788,"wal-append.run_wall_time_us":1023138}
I20260709 13:20:14.601258 18962 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:20:14.603497 25494 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:14.605288 25433 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:14.606484 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:14.607342 18954 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:20:14.607622 18349 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:14.608350 18962 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:14.608883 25395 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:14.609153 25384 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.609555 25395 raft_consensus.cc:697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:14.610029 25504 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:14.561676 25544 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:20:14.611728 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.611989 25544 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.610996 25395 consensus_queue.cc:237] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.613315 25544 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:14.560194 25479 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:14.616740 25479 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:14.617806 25530 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.618741 18378 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:14.618516 25530 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.619145 18382 raft_consensus.cc:1240] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:14.619836 25290 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:14.620030 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:14.620289 18380 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 13:20:14.624339 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 102756us
I20260709 13:20:14.630993 18235 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:14.637907 25556 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:14.643309 18233 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:20:14.644845 18237 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:14.625012 25555 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:14.655247 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:14.648768 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:20:14.661373 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 79413.3us
I20260709 13:20:14.539556 25417 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.668170 18380 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:14.668653 18229 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:14.673760 25559 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:14.674230 25416 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:14.674991 25559 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:20:14.667829 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 53469.3us
I20260709 13:20:14.676608 25504 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:14.686030 25504 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:14.685876 25559 raft_consensus.cc:3055] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:14.686730 25559 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:14.687383 25504 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.688006 25559 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.690972 25559 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.689450 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:14.694366 25530 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:14.695847 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 105053us
I20260709 13:20:14.696964 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:14.697935 25540 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.700918 18386 raft_consensus.cc:2393] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 20: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:14.677253 25492 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.702873 25492 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:14.703554 25438 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.621201 25494 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.707037 18377 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:20:14.707131 25379 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:14.707944 25089 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:14.708740 25444 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:14.708221 25387 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.710088 25504 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.694365 25390 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:20:14.710124 25567 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:20:14.710893 18277 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:14.711723 18962 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
W20260709 13:20:14.712330 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 48127.6us
W20260709 13:20:14.719503 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.723767 18381 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:14.727511 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:14.703605 25492 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.719786 25416 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:14.733534 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.700453 25540 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:14.717114 25290 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:14.719079 25558 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:14.730559 18956 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:20:14.736788 25366 raft_consensus.cc:697] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:14.749996 18956 pending_rounds.cc:85] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: Aborting all ops after (but not including) 9
I20260709 13:20:14.752210 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:14.757167 25494 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:14.757933 25416 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.760041 25290 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:14.761600 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 181933us
W20260709 13:20:14.762024 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.761231 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:14.754070 18956 pending_rounds.cc:107] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:20:14.771099 18956 raft_consensus.cc:2889] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:14.824836 25379 consensus_queue.cc:1059] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:14.826278 25379 raft_consensus.cc:3055] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:14.826756 25379 raft_consensus.cc:740] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:14.828814 18927 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:14.829826 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:14.831539 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:14.832798 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:14.833845 25492 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.835525 25438 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:14.835788 25525 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.836066 25492 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:14.836419 25525 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.837764 25438 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:14.837507 25366 consensus_queue.cc:237] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.838078 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:14.838315 25438 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.838792 25438 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:14.762096 25387 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.839859 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:14.840410 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:14.840626 25089 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:14.841213 18385 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 12.
I20260709 13:20:14.760193 25416 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:14.841437 18378 raft_consensus.cc:3055] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:14.840500 18381 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:14.844262 18378 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:14.865260 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:14.751982 25558 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:14.870775 25415 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.787s	user 0.007s	sys 0.015s
I20260709 13:20:14.873073 18956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54020 (request call id 570) took 1645 ms. Trace:
W20260709 13:20:14.875684 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64473.2us
I20260709 13:20:14.861657 25390 raft_consensus.cc:697] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:20:14.880894 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.880636 18378 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:14.881628 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.880988 25390 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.881882 18378 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:14.883591 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:14.884670 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52196.1us
I20260709 13:20:14.886297 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:14.887457 25433 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:14.888160 25433 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.888813 25444 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.891161 25433 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:14.894300 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.878809 18956 rpcz_store.cc:276] 0709 13:20:13.227457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.236425 (+  8968us) service_pool.cc:224] Handling call
0709 13:20:13.245687 (+  9262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.830117 (+1584430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.872626 (+ 42509us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540047cf54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:14.872969 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3413369728}
I20260709 13:20:14.893215 25492 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:14.908618 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:14.841485 25089 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.909786 25416 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:14.910476 25416 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.911432 25089 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:14.915570 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:14.916242 18378 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:14.917130 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:14.877846 25415 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.796s	user 0.008s	sys 0.015s
I20260709 13:20:14.827963 25379 consensus_queue.cc:260] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:14.914608 18386 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:20:14.877396 25558 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:14.929807 18276 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:14.934929 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:14.938565 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 189381us
I20260709 13:20:14.940580 18927 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:14.941469 25364 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:14.933003 25416 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:14.936323 25479 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:14.944042 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.945184 25479 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:14.946161 25572 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:14.948737 25435 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.949375 25435 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:14.950696 25478 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.951943 18383 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:14.933970 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:14.952308 18383 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:20:14.977152 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 266555us
I20260709 13:20:14.930655 25415 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:14.988955 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:15.006945 25415 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.011917 25564 consensus_queue.cc:1059] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:15.012303 25184 consensus_queue.cc:1059] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:15.013841 18384 raft_consensus.cc:2410] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:20:14.990556 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 114908us
I20260709 13:20:14.991384 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.016490 18381 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:14.992208 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:15.022644 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.997746 25379 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:15.001444 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.002473 18383 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:15.004586 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64164.7us
I20260709 13:20:15.004701 25131 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.005553 25391 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:14.974236 25511 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:15.025839 25565 consensus_queue.cc:1059] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:15.026716 25364 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:15.027354 25479 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:15.055123 25479 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.056604 25131 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.057940 25435 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:15.058877 25131 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:15.059398 25503 raft_consensus.cc:1027] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: attempt to promote peer e016302b7e734d74833a2bf7bab44838: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:20:15.059950 25184 raft_consensus.cc:3055] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:15.062952 18960 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:15.065352 25416 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:15.065817 25416 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:15.066162 25416 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:15.028946 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 112984us
I20260709 13:20:15.069586 25559 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:15.029397 18380 raft_consensus.cc:2393] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:15.029743 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:15.073551 25479 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:15.073645 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 44024.7us
I20260709 13:20:15.073987 25581 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:15.074535 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:15.030349 25454 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.951330 25478 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.031028 25368 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:15.031275 18927 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:15.031030 25578 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:15.018903 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:15.035267 18385 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:15.060343 25184 raft_consensus.cc:740] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:20:15.040046 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.046185 25511 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.076491 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.030622 18383 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:15.081529 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 69696.9us
I20260709 13:20:15.037185 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:15.087651 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.089898 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.090945 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:15.091182 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:15.091331 25454 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.092290 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.074540 25581 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.090677 18380 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
W20260709 13:20:15.097970 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.100677 18378 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:20:15.088187 25368 raft_consensus.cc:697] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:15.114689 25577 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:15.115869 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:15.126778 25511 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:15.127665 25511 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.130972 25525 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:15.133740 25454 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:15.137228 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 106065us
I20260709 13:20:15.142132 18306 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:15.103775 25581 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:15.128183 25511 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.146718 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.154862 18380 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:15.156479 18382 raft_consensus.cc:2410] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
W20260709 13:20:15.157418 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.159418 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:15.104094 25364 consensus_queue.cc:1059] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
W20260709 13:20:15.165370 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 49600.8us
I20260709 13:20:15.166038 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.169140 18378 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 18.
I20260709 13:20:15.152122 25577 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:15.175253 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:15.184975 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.170499 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:15.184119 18926 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:15.168638 25454 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.190260 18277 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:15.192631 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.195271 18378 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:15.193948 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:15.146703 25368 consensus_queue.cc:237] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.192637 25573 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:20:15.128203 25184 consensus_queue.cc:260] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.239068 25184 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:15.216814 18380 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 22.
I20260709 13:20:15.242138 25078 raft_consensus.cc:3055] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:15.242720 25078 raft_consensus.cc:740] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:15.246220 18926 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:15.249832 25572 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:15.250675 18309 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:15.254674 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:15.255517 18386 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:15.257330 25569 raft_consensus.cc:3055] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:15.257840 25569 raft_consensus.cc:740] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:15.258608 25478 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:15.260474 25525 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.261201 25525 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.263680 25525 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:20:15.265309 25511 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:15.266073 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.224844 25454 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:15.268198 25454 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:15.271238 18384 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 22. Current term is 23. Ops: []
W20260709 13:20:15.215163 25520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.004s	sys 0.008s
W20260709 13:20:15.273131 25520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.004s	sys 0.008s
I20260709 13:20:15.274150 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2993) took 1126 ms. Trace:
I20260709 13:20:15.274631 18231 rpcz_store.cc:276] 0709 13:20:14.147626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.491773 (+344147us) service_pool.cc:224] Handling call
0709 13:20:14.526333 (+ 34560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.650055 (+123722us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:14.735921 (+ 85866us) log.cc:844] Serialized 14 byte log entry
0709 13:20:14.987713 (+251792us) log.cc:844] Serialized 14 byte log entry
0709 13:20:15.269534 (+281821us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b18000becc0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:20:15.273565 (+  4031us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b18000becc0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa18226b060 00007fa18227d716 00007fa18228e287 00007fa18228e208
0709 13:20:15.273768 (+   203us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:15.273819 (+    51us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:15.273871 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.273942 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.274069 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19080,"prepare.queue_time_us":54776,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":27912,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":76302976,"thread_start_us":195853,"threads_started":1,"wal-append.queue_time_us":285265}
I20260709 13:20:15.276901 25425 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.277537 25425 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:15.279547 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.280061 25435 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:15.281030 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.280735 25435 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.281441 25450 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:15.281797 25412 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.282128 25450 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.282294 25412 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.282779 25435 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:15.279776 25425 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:15.242174 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.226332 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:15.227710 25544 consensus_meta.cc:287] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.614s	user 0.012s	sys 0.000s
I20260709 13:20:15.231272 25438 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.296475 25131 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:15.296936 25131 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:15.297326 25131 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:15.297415 18201 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:15.298445 18379 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:20:15.298836 18379 pending_rounds.cc:85] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 11
I20260709 13:20:15.299100 18379 pending_rounds.cc:107] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:20:15.299309 18379 raft_consensus.cc:2889] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:15.170984 25558 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.301159 18380 raft_consensus.cc:2410] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:20:15.232787 18954 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 19 LEARNER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:15.301906 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:15.302099 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.233210 25565 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:15.302629 18235 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 18.
I20260709 13:20:15.234002 25578 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:15.303247 25578 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.303646 25578 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:15.304107 25391 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:15.284333 25450 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:15.237511 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:15.263723 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:15.293570 18383 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:15.205042 25390 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:15.201512 25384 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:15.297659 25438 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:15.232069 25588 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:20:15.233171 25290 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:15.302867 18380 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:15.284312 25412 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:15.313272 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:15.316331 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:15.320766 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.302937 25565 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:15.316624 25402 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
I20260709 13:20:15.327602 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.335201 25185 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:15.335784 25185 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:15.336179 25185 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:15.336242 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:15.337000 18200 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:15.338601 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:15.339558 25544 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:15.340117 25544 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.340613 25544 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:15.341068 25583 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:15.338825 18233 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:15.341622 25583 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.342527 25416 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.337225 18237 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:15.341085 25433 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:20:15.345047 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.340296 18232 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:15.345743 18380 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
W20260709 13:20:15.346391 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.346683 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.301921 25558 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:15.350207 18383 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 23: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:15.342971 25583 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.348132 18962 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 21 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
W20260709 13:20:15.348847 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 122593us
I20260709 13:20:15.243906 25078 consensus_queue.cc:260] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.312233 25390 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.316777 25573 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:15.389958 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.322952 25565 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:15.390841 18385 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:15.324455 25412 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.406258 18386 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:15.411520 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:15.392153 25504 consensus_meta.cc:287] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.005s
I20260709 13:20:15.414487 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:15.418747 18956 raft_consensus.cc:2393] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:15.407570 25290 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:15.401156 25384 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:15.443539 25290 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.446732 25384 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:15.447777 25290 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:15.469022 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:15.474148 25290 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.474993 25290 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.479727 25290 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:15.489166 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 251774us
I20260709 13:20:15.491642 25387 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:15.492028 25559 consensus_queue.cc:1059] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:15.394222 25433 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.493294 25559 raft_consensus.cc:3055] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:15.493062 25433 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.493664 25559 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:15.494652 25559 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.495347 25433 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:15.495790 25559 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:15.495980 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 198727us
I20260709 13:20:15.498086 18201 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:15.504853 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.506860 18383 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:15.510730 18378 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:20:15.513577 18235 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:20:15.515494 18229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d03313400e274f83883c84395905b4cd"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:20:15.516713 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:15.518080 18231 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:15.518811 18230 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:15.522501 18228 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:15.525987 18229 raft_consensus.cc:606] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:15.393076 25390 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:15.533185 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:15.533996 18962 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:15.411111 25416 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:15.544137 18236 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:15.544261 25556 raft_consensus.cc:993] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:20:15.546305 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 2977) took 2357 ms. Trace:
I20260709 13:20:15.546808 18236 rpcz_store.cc:276] 0709 13:20:13.188472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.084136 (+895664us) service_pool.cc:224] Handling call
0709 13:20:14.084439 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.544780 (+1460341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.545941 (+  1161us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400329454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:15.546234 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3329594624}
W20260709 13:20:15.551406 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.552629 25415 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:15.553371 25415 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.413321 25438 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:20:15.557734 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.422327 25454 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.529109 25433 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:15.569320 18377 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
W20260709 13:20:15.568679 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 334333us
W20260709 13:20:15.574273 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 328113us
W20260709 13:20:15.415870 25444 consensus_meta.cc:287] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.008s
I20260709 13:20:15.575060 18200 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:20:15.580849 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.581233 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:15.526399 25578 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.423703 25412 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.591253 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.591320 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.566869 25559 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.597669 18380 raft_consensus.cc:2410] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:20:15.565382 25433 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.573393 25078 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:15.596623 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.598690 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.599893 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:15.604972 18382 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:15.603039 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:15.561924 25504 consensus_queue.cc:1059] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:20:15.608875 18386 raft_consensus.cc:2393] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 22: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:15.583108 25444 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:15.612692 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 205927us
I20260709 13:20:15.582746 25387 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 13:20:15.609193 25555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.031s	sys 0.046s
I20260709 13:20:15.613624 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:15.613936 25555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.031s	sys 0.047s
I20260709 13:20:15.614564 25444 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:15.615113 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:15.615965 25444 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:15.567231 25525 consensus_queue.cc:1048] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:20:15.620684 25482 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:15.621248 18382 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
I20260709 13:20:15.621309 25482 raft_consensus.cc:697] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:15.621826 25592 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:20:15.622524 25482 consensus_queue.cc:237] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.612385 25556 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:15.626106 25556 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:15.626435 25556 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:15.627311 25556 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.627645 25185 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.628757 25556 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:15.629321 18201 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:15.632289 18276 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:15.605535 25433 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:15.600258 25577 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:15.603228 25573 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:15.602763 25290 raft_consensus.cc:1081] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
W20260709 13:20:15.645128 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 70139.6us
W20260709 13:20:15.641310 18960 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.010s	sys 0.077s
W20260709 13:20:15.651726 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.583314 25520 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 13:20:15.662498 18960 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.010s	sys 0.077s
I20260709 13:20:15.589071 25454 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.596189 25438 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.667797 18380 raft_consensus.cc:1240] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:15.642976 25368 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:20:15.670646 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.606861 25379 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:20:15.677073 25590 raft_consensus.cc:3055] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:15.682606 25578 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:15.685696 25185 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:15.642663 25384 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:20:15.642874 25387 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:20:15.710474 25387 raft_consensus.cc:3055] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:15.710891 25387 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:15.711347 25412 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:15.670162 25564 raft_consensus.cc:2764] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 13:20:15.689401 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.711799 25387 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.611447 25559 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.659451 25089 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:15.700604 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:15.659844 25558 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:15.661252 25574 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.699079 25590 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:15.702608 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:15.657516 25573 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:15.714249 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:15.673888 25444 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:15.718421 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:15.734102 18958 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:20:15.721603 18382 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:15.722806 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:15.745550 18382 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:15.745364 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:15.717036 25577 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:15.706575 25572 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.721287 25089 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.718623 25368 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:15.754626 18200 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:15.756606 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:15.731148 25573 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:15.728487 25558 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:15.719169 25565 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.754626 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:15.729097 18380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46860
I20260709 13:20:15.773787 18380 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:15.774142 18380 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:15.775215 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:15.757992 18201 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:15.757223 25578 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:15.764153 25089 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:15.791898 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 99628.1us
I20260709 13:20:15.795028 18229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:20:15.766299 25441 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:15.765771 25185 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:15.801620 18229 raft_consensus.cc:606] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:15.773178 25558 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:15.799297 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 44762.2us
I20260709 13:20:15.765897 25415 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:15.769465 25435 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:15.851864 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:15.809438 18229 raft_consensus.cc:614] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:15.770149 25412 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:15.858887 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 86029us
I20260709 13:20:15.798359 25387 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:15.768342 25504 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 13:20:15.769351 25577 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:15.883316 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.853487 25379 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:15.851418 25290 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:15.805474 25555 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.855867 25435 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.891434 18954 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:15.852846 25578 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:15.900846 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:15.901307 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:15.929278 25595 log.cc:927] Time spent T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:20:15.901561 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 55484.7us
I20260709 13:20:15.907199 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:15.907456 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:15.908396 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.908614 25520 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.966176 18927 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:15.919070 25438 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:15.920887 25412 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.964955 18304 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16.
W20260709 13:20:15.908638 25601 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:20:15.855072 25572 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.926561 25435 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:15.953617 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 195721us
I20260709 13:20:15.794567 25594 consensus_queue.cc:1059] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.252s
I20260709 13:20:15.776206 25574 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.895092 25379 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.922947 25555 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.983238 18201 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:15.806687 25590 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:15.969985 25504 raft_consensus.cc:2764] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:20:15.993110 25594 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:15.993605 25185 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:15.995347 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 4177) took 1160 ms. Trace:
I20260709 13:20:15.996927 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:20:15.997731 25599 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:20:15.998207 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.974654 25290 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:16.009786 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:15.972925 25078 consensus_queue.cc:1059] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
W20260709 13:20:16.028184 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.033274 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.033154 18201 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:16.034840 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:16.028206 18377 rpcz_store.cc:276] 0709 13:20:14.834621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.837786 (+  3165us) service_pool.cc:224] Handling call
0709 13:20:15.995164 (+1157378us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b5400129b54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:15.995283 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611061120}
I20260709 13:20:16.030874 25590 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:15.973899 25520 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:15.975658 25482 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:20:15.991214 25379 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:15.999346 25559 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:16.042868 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:15.965227 25368 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.047426 18377 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:16.043310 25391 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:16.069475 18310 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:16.030470 25185 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.063570 18307 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:16.071676 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:16.078862 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:16.057663 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.050416 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.057276 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:16.074074 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.080860 18304 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:16.049911 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:16.082017 18309 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:16.048878 18275 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:16.010989 25594 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:16.075127 25611 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:16.084615 25611 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.084422 25594 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:16.085055 25611 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:16.085950 25594 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:16.065198 25131 consensus_meta.cc:287] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.767s	user 0.010s	sys 0.003s
I20260709 13:20:16.049593 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.053189 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:16.117156 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.124607 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 94363us
W20260709 13:20:16.125434 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 53817.7us
I20260709 13:20:16.126197 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:16.127954 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 49186.7us
I20260709 13:20:16.069819 25391 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.129222 18310 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:16.068328 25416 raft_consensus.cc:3055] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:16.132429 18312 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:16.137372 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4189) took 1140 ms. Trace:
I20260709 13:20:16.137910 18381 rpcz_store.cc:276] 0709 13:20:14.990159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.079280 (+ 89121us) service_pool.cc:224] Handling call
0709 13:20:15.086542 (+  7262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:15.109128 (+ 22586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.109181 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:15.116632 (+  7451us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.286900 (+170268us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b18003b3980. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:20:15.561360 (+274460us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:15.561400 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.561464 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:16.097791 (+536327us) raft_consensus.cc:1685] finished
0709 13:20:16.097825 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.130572 (+ 32747us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":836,"raft.queue_time_us":4677,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":7149,"spinlock_wait_cycles":14697728,"thread_start_us":274236,"threads_started":1,"wal-append.queue_time_us":570439}
I20260709 13:20:16.058473 25412 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.079833 25185 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.074976 25578 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.131944 25610 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:16.125597 25544 consensus_meta.cc:287] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.784s	user 0.011s	sys 0.001s
I20260709 13:20:16.048717 25504 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:16.126708 25608 log.cc:927] Time spent T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:20:16.041605 25415 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.091s
I20260709 13:20:16.056790 25597 consensus_queue.cc:1059] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
W20260709 13:20:16.158002 25604 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:20:16.160669 18303 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 22. Current term is 23. Ops: []
W20260709 13:20:16.162683 25184 consensus_meta.cc:287] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.923s	user 0.007s	sys 0.005s
I20260709 13:20:16.137375 25416 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:16.086975 25131 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:16.164050 25441 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:16.165452 25415 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:16.166780 25555 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.167973 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:16.170333 25089 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:16.150039 25544 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:16.152997 25504 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.145479 25565 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.178380 25574 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.146224 25412 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:16.180377 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.181806 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.140678 25391 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.197522 18305 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:16.155524 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.264411 18307 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:16.202481 18309 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
W20260709 13:20:16.205662 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.143236 25444 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:16.213779 18304 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
W20260709 13:20:16.209980 25556 consensus_meta.cc:287] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.001s
W20260709 13:20:16.214608 25390 consensus_meta.cc:287] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.003s
I20260709 13:20:16.129259 25559 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:20:16.220909 25415 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.256681 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:16.257346 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:16.257714 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 215951us
W20260709 13:20:16.258024 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 131900us
I20260709 13:20:16.217900 18380 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:16.266677 18385 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: [13.14-13.14]
I20260709 13:20:16.266836 18311 raft_consensus.cc:2410] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:20:16.375938 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:16.378842 18228 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:20:16.303100 18229 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:16.378497 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:16.378551 18201 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:16.380555 18304 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:16.322438 18312 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
W20260709 13:20:16.291571 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.376967 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.290477 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:16.382187 18962 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.378854 18232 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:16.375970 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:16.294701 18235 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:16.377156 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:16.299780 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3714) took 1200 ms. Trace:
I20260709 13:20:16.278426 18308 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:16.399610 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:16.397403 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.432379 18305 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:16.278604 18306 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
W20260709 13:20:16.384253 25581 consensus_meta.cc:287] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 1.241s	user 0.010s	sys 0.017s
I20260709 13:20:16.434938 25425 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:16.399120 25450 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:16.289469 25416 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.286383 25504 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:16.436825 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.400036 25572 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.439438 18307 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:16.438591 18312 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:16.440971 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:16.441717 25411 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:16.226109 25290 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.446193 25185 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.448886 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:16.455093 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 55767.2us
I20260709 13:20:16.456591 25379 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.457784 18380 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:16.491720 18304 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:16.443483 25611 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:16.289944 25402 raft_consensus.cc:3055] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:16.302661 25565 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.463515 18229 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
W20260709 13:20:16.467128 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 79871.5us
I20260709 13:20:16.432782 18384 rpcz_store.cc:276] 0709 13:20:15.099360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.272371 (+173011us) service_pool.cc:224] Handling call
0709 13:20:15.289648 (+ 17277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:15.289926 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.289962 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:15.308804 (+ 18842us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.714269 (+405465us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:15.714342 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.714510 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:16.299455 (+584945us) raft_consensus.cc:1685] finished
0709 13:20:16.299489 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.299701 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":404938,"threads_started":1,"wal-append.queue_time_us":620770}
I20260709 13:20:16.470847 18234 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:16.476069 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.290483 25520 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:16.384873 25415 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:16.377434 25390 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.289882 25089 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:16.480744 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.507359 18962 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:16.506887 25565 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:16.509924 25433 consensus_meta.cc:287] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.876s	user 0.007s	sys 0.006s
I20260709 13:20:16.510406 25433 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.512486 18200 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:16.492985 18305 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:16.493703 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.284667 25610 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:20:16.498008 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.504774 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:16.292487 25544 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:16.515180 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.515244 18236 raft_consensus.cc:2368] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 22. Current term is 23.
I20260709 13:20:16.498557 25402 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:16.518947 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:16.531613 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:16.520218 25618 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.524808 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:16.525326 25387 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.525326 25433 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.541827 25618 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.542713 25433 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:16.544531 25618 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:16.545343 25402 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.546536 25402 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:16.527448 25573 consensus_meta.cc:287] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.734s	user 0.010s	sys 0.000s
W20260709 13:20:16.551618 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.552111 25603 log.cc:927] Time spent T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.655s	user 0.002s	sys 0.002s
I20260709 13:20:16.552341 18201 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:16.554811 18132 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39284 (request call id 214) took 8555 ms. Trace:
I20260709 13:20:16.545390 25131 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.528858 25619 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:16.529405 25583 consensus_meta.cc:287] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.135s	user 0.012s	sys 0.001s
I20260709 13:20:16.572127 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:16.530810 25185 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.502552 25416 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:16.473884 25581 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.293725 25569 consensus_queue.cc:260] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:16.539837 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: true dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:16.540479 25387 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.579761 18960 raft_consensus.cc:2393] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 23: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:16.580291 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:16.541354 25450 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:20:16.518292 18351 connection.cc:256] RPC call timeout handler was delayed by -1.0068106800001715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
I20260709 13:20:16.561553 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:16.568938 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.584278 18305 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:16.557825 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:16.533030 18308 raft_consensus.cc:2376] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20. Re-sending same reply.
I20260709 13:20:16.571995 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:16.532192 25435 consensus_meta.cc:287] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.009s
I20260709 13:20:16.574034 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:20:16.575023 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.573135 25433 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:16.537653 25611 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:16.531913 18312 raft_consensus.cc:2376] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20. Re-sending same reply.
I20260709 13:20:16.515954 25559 consensus_queue.cc:1243] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer b52e2477fc524694967c4a16afa983e3 log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:20:16.582042 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.585960 18306 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:16.574903 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.593673 18311 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:16.594218 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:16.594672 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:16.595541 18383 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:16.598616 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:16.599444 18305 raft_consensus.cc:2376] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19. Re-sending same reply.
I20260709 13:20:16.600629 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:16.603502 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:16.604110 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:16.604750 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:16.606654 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:16.551636 25573 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.605257 18311 raft_consensus.cc:2376] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18. Re-sending same reply.
W20260709 13:20:16.610670 18926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.610669 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:16.611487 18308 raft_consensus.cc:2376] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23. Re-sending same reply.
I20260709 13:20:16.614521 25379 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:16.617228 25600 log.cc:927] Time spent T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.757s	user 0.003s	sys 0.000s
I20260709 13:20:16.617784 25425 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.618428 25425 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.619194 25565 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.620065 25433 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:16.621302 25454 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.621215 25433 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.624763 25423 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.625298 25423 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:16.626049 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:16.626633 18379 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:16.627573 25423 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.606017 25450 raft_consensus.cc:697] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:16.629112 25450 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:16.633510 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:16.633611 25577 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.634706 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.635879 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.636664 25618 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.636803 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 1506) took 1532 ms. Trace:
I20260709 13:20:16.637230 25618 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:16.637480 18385 rpcz_store.cc:276] 0709 13:20:15.104261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.407874 (+303613us) service_pool.cc:224] Handling call
0709 13:20:15.526619 (+118745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:16.397682 (+871063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.636397 (+238715us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b540019b754. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:16.636721 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1701316992}
I20260709 13:20:16.639523 18385 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:16.639674 25544 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:16.640095 18385 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:16.576045 25583 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:16.645288 25425 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.641341 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:16.641599 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:16.648872 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.642515 18234 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:16.678812 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.679474 18312 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:16.681454 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.682019 18305 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:16.649128 25581 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.588948 25412 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:16.648872 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:16.690037 18229 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:16.690438 18310 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:16.667315 18380 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:16.692116 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:16.669715 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.692840 18380 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:16.671990 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:16.636394 18351 leader_election.cc:336] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.572s (SENT)
I20260709 13:20:16.693321 18309 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 16: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:16.674124 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.693884 18962 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:16.694583 18306 raft_consensus.cc:2410] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:20:16.677903 18228 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:16.695612 18349 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:16.616300 25387 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:16.679838 18308 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:20:16.574712 25619 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.700160 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:16.686385 25613 log.cc:927] Time spent T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:20:16.701005 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:16.591300 25435 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:16.701098 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:16.639520 25618 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:16.708370 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.710719 18384 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:16.703990 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.640337 25544 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:16.696807 25558 consensus_meta.cc:287] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.808s	user 0.014s	sys 0.021s
I20260709 13:20:16.713886 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:16.723078 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:16.733893 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.706338 18385 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.727752 18926 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:16.728430 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.735229 18306 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:16.729275 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:16.739892 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:16.741369 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:16.555161 18132 rpcz_store.cc:276] 0709 13:20:07.999860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.000658 (+   798us) service_pool.cc:224] Handling call
0709 13:20:16.554599 (+8553941us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:10.675732 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:10.825834 (+150102us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:10.831769 (+  5935us) write_op.cc:435] Acquired schema lock
0709 13:20:10.834056 (+  2287us) tablet.cc:662] Decoding operations
0709 13:20:11.136993 (+302937us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:11.137076 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:11.137108 (+    32us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:20:11.477722 (+340614us) tablet.cc:701] Row locks acquired
0709 13:20:11.492939 (+ 15217us) write_op.cc:260] PREPARE: finished
0709 13:20:11.509931 (+ 16992us) write_op.cc:270] Start()
0709 13:20:11.510110 (+   179us) write_op.cc:276] Timestamp: P: 1783603211509851 usec, L: 0
0709 13:20:11.510141 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:20:11.644324 (+134183us) log.cc:844] Serialized 5267 byte log entry
0709 13:20:11.969475 (+325151us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b54002ae254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa18226ee28 00007fa185ca9581 00007fa185ca8d58 00007fa185cad9f1 00007fa185cad9a9 00007fa185cad939 00007fa185cad901 00007fa185cacb2d 000000000038f354 000000000038f199
0709 13:20:12.522620 (+553145us) op_driver.cc:464] REPLICATION: finished
0709 13:20:12.527162 (+  4542us) write_op.cc:301] APPLY: starting
0709 13:20:12.527265 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:13.180695 (+653430us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:13.180725 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:13.201519 (+ 20794us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:13.201842 (+   323us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 13:20:13.201891 (+    49us) write_op.cc:312] APPLY: finished
0709 13:20:13.202255 (+   364us) log.cc:844] Serialized 121 byte log entry
0709 13:20:13.202450 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:13.202612 (+   162us) write_op.cc:454] Released schema lock
0709 13:20:13.202667 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:13.206905 (+  4238us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:13.206936 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":828543,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":4230,"apply.run_cpu_time_us":29992,"apply.run_wall_time_us":679710,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58363,"num_ops":13,"prepare.queue_time_us":421866,"prepare.run_cpu_time_us":24214,"prepare.run_wall_time_us":1334027,"raft.queue_time_us":119824,"raft.run_cpu_time_us":4170,"raft.run_wall_time_us":19815,"replication_time_us":1012282,"spinlock_wait_cycles":73538304,"thread_start_us":453597,"threads_started":4,"wal-append.queue_time_us":141386,"wal-append.run_cpu_time_us":7025,"wal-append.run_wall_time_us":2402390}]]}
I20260709 13:20:16.742339 18308 raft_consensus.cc:2368] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23.
W20260709 13:20:16.743001 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 47498.2us
I20260709 13:20:16.746520 18305 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:20:16.747187 18228 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:16.749357 25619 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:16.749523 25423 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:16.750907 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.751811 18306 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:20:16.753265 25544 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:16.689867 25610 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:16.753353 18130 catalog_manager.cc:5697] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 14 to 17, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 17 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:16.755060 18130 catalog_manager.cc:5697] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:16.758332 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:16.715346 25387 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:16.759130 25387 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.740322 25558 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.759533 25387 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:16.761082 25558 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.761819 25435 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:16.765802 25605 log.cc:927] Time spent T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.787s	user 0.002s	sys 0.001s
I20260709 13:20:16.767170 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.767802 18304 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:16.751185 18385 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:16.771628 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.772616 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:16.773447 18962 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 21 LEARNER]: Advancing to term 23
I20260709 13:20:16.779206 18236 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:16.774750 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:16.782145 18380 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:16.782869 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:16.783646 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:16.778239 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:16.786968 18305 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 23. Ops: []
I20260709 13:20:16.787225 18303 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:20:16.792131 18378 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:16.795982 18201 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:16.796823 25558 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:16.797214 25558 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.797554 25558 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:16.797703 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:16.798389 18237 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 19.
I20260709 13:20:16.786398 18233 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:16.803845 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:16.804467 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:16.806488 18229 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:20:16.807215 18228 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 13. Current term is 14. Ops: [13.14-13.14]
W20260709 13:20:16.810282 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 173929us
I20260709 13:20:16.810810 18306 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:16.811504 18311 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:16.813493 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:16.816097 18309 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:16.836221 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:16.800397 25511 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:16.885788 18378 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:16.888087 18380 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 9.
I20260709 13:20:16.808300 25435 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:16.901652 18303 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:20:16.903438 18201 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:16.903067 18351 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.630s (SENT) [suppressed 27 similar messages]
W20260709 13:20:16.910470 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 107330us
I20260709 13:20:16.910738 18309 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:16.911398 18201 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:16.911855 25628 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:16.912348 25425 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:16.912477 25628 raft_consensus.cc:697] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:16.913015 25425 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:16.913673 25628 consensus_queue.cc:237] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.914049 25425 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:16.914991 18379 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:16.918865 18926 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:16.919028 18927 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:16.903532 18962 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 23 LEARNER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:16.807288 25596 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.125s
I20260709 13:20:16.924741 25596 raft_consensus.cc:3055] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:16.925107 25596 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:16.926045 25596 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:16.926462 18130 catalog_manager.cc:5697] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 14 to 17, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 17 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:16.927498 25596 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:16.917443 25597 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:16.929188 25631 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.201s	user 0.000s	sys 0.002s
I20260709 13:20:16.929106 25597 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:16.931247 25511 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:16.931584 25597 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:16.932050 25131 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:16.932446 25131 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.932792 25131 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:16.905220 25391 consensus_meta.cc:287] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.526s	user 0.016s	sys 0.001s
I20260709 13:20:16.852975 25390 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:16.937415 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.931648 25511 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.947278 18200 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:16.959381 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:16.960081 25583 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:16.970204 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:16.971092 18380 raft_consensus.cc:2368] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23.
I20260709 13:20:16.960289 18231 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:16.962878 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:16.973589 18378 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.901775 25412 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:16.984032 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:16.986799 18130 catalog_manager.cc:5697] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 15 to 16, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 16 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:16.989383 18309 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: [17.11-19.12]
I20260709 13:20:16.990957 18303 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:20:16.991356 18303 pending_rounds.cc:85] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 10
I20260709 13:20:16.991566 18303 pending_rounds.cc:107] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:20:16.991823 18303 raft_consensus.cc:2889] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:16.966271 25511 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:16.969508 25185 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:16.999387 18130 catalog_manager.cc:5697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 19 to 21, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 21 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:17.004652 18378 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:20:17.001642 18130 catalog_manager.cc:5697] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 9 to 11, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 11 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:17.007301 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.008265 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:17.008960 18380 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 13: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:17.009435 25416 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:17.009930 25416 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.010248 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.010687 18304 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:17.011650 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.011704 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.012319 25416 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:17.012362 18311 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:17.013192 18304 raft_consensus.cc:2393] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:17.014729 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:17.015610 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.015547 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.017361 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.018390 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.021194 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.022521 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.023589 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:17.024109 18230 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:17.024900 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:17.025610 18311 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:17.012683 18305 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 19. Ops: []
I20260709 13:20:17.012970 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.026803 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.026923 18312 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:20:17.028118 18309 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:20:17.030541 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.031811 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.032985 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.033821 18235 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:20:17.034153 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.034744 18306 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:17.035019 18306 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:17.034957 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:17.030800 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.966711 25391 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.032980 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.040035 18233 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:17.038319 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.038801 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:16.993810 25559 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:17.042428 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.043016 18311 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:17.045550 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.045863 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.046608 18309 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:17.046489 18385 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:20:17.047082 18385 pending_rounds.cc:85] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 9
I20260709 13:20:17.007383 25573 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:17.045457 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.048975 18312 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:17.049549 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.050479 18237 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 20: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:17.036094 18306 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.047361 18385 pending_rounds.cc:107] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:20:17.051594 18385 raft_consensus.cc:2889] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:17.052258 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.055262 18233 raft_consensus.cc:2393] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:17.056248 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.053812 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.057991 18306 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:17.041846 25185 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:17.061905 25185 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.049100 25559 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:17.066915 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.067770 18233 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 20: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:17.069484 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.070219 18303 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:20:17.071188 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.071775 18303 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:17.073024 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:17.073734 18237 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:17.053100 25415 consensus_meta.cc:287] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.534s	user 0.017s	sys 0.000s
I20260709 13:20:17.076934 25415 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.079164 25415 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:17.079767 25415 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.080860 18234 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:17.081830 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.082486 18312 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:17.085906 25391 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:17.086712 18960 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:17.087349 25387 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.091259 18303 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:17.092728 18384 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:16.986096 25412 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.092926 18303 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:17.052806 18304 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
W20260709 13:20:17.100416 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 197372us
I20260709 13:20:17.093493 18311 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:20:17.100629 18304 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:17.094476 18130 catalog_manager.cc:5697] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 16 to 18, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 18 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:17.110026 18303 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:20:17.110782 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.111671 18309 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:17.112783 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.116503 18235 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:17.116393 18311 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
W20260709 13:20:17.115569 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 140486us
I20260709 13:20:17.118127 18305 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:20:17.121809 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.122570 18305 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:17.080067 25131 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.080264 25415 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:17.130369 18304 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:17.115015 25578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.006s	sys 0.006s
I20260709 13:20:17.135407 18231 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:17.132824 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:17.137354 18233 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:17.138099 18305 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:20:17.138712 18309 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:17.139689 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:17.140079 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.143064 18235 raft_consensus.cc:2393] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 23: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:17.134757 18130 catalog_manager.cc:5697] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 20 to 21, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 21 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:17.129046 25590 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.127032 25391 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.149303 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:17.155120 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.155398 18237 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:17.156498 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:17.156963 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:17.157414 18237 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:17.158996 25387 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:17.159634 25506 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:17.160187 25506 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.147361 25646 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:17.161686 25646 raft_consensus.cc:697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 17 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:17.162382 25506 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:17.162664 25646 consensus_queue.cc:237] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.167502 25415 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:17.168083 25590 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.171746 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:17.172374 18962 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:17.177423 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:17.177796 25412 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:17.178130 18384 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16.
I20260709 13:20:17.179443 18230 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:17.180970 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.179530 25590 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:17.182598 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.184872 18230 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:17.185334 25391 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.200158 25391 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:17.185786 18962 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:17.204993 18926 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:17.206985 25078 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:17.209092 18349 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:17.210232 25520 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:17.210839 25520 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:17.211920 25520 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.214406 18201 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:17.215471 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:17.215546 18201 leader_election.cc:400] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23.
I20260709 13:20:17.216409 18201 leader_election.cc:403] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:20:17.218479 25415 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:17.218988 25415 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:17.219867 25415 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:17.218145 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:17.224834 25425 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:17.225414 25425 raft_consensus.cc:697] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:17.226490 25425 consensus_queue.cc:237] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.226514 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.184828 25558 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:17.244086 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.245039 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.216244 18231 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:17.245743 18962 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:17.246129 18304 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:20:17.246706 18306 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:17.247941 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:17.186941 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.187489 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:17.188118 25620 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.659s	user 0.001s	sys 0.003s
I20260709 13:20:17.188879 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.190039 25131 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:17.192040 25559 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:17.195339 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:17.142016 25578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.006s	sys 0.006s
I20260709 13:20:17.196807 25635 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:17.197118 25402 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:17.310576 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:17.311357 18384 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:20:17.195881 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:17.302055 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54459.3us
I20260709 13:20:17.313447 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.314632 18237 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:17.304489 18927 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:17.299789 18234 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16.
W20260709 13:20:17.301417 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 51874.8us
I20260709 13:20:17.300077 18309 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
I20260709 13:20:17.327782 18305 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16.
I20260709 13:20:17.324647 18201 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:17.331373 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 79583.5us
W20260709 13:20:17.336910 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 139296us
I20260709 13:20:17.247532 25511 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.272197 25387 consensus_queue.cc:1059] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
I20260709 13:20:17.378034 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:17.378311 25635 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:17.383019 25185 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:17.380927 18233 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
W20260709 13:20:17.381390 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.378511 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54198.3us
W20260709 13:20:17.385831 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.335363 25565 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:17.402275 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:17.387389 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 49745.6us
I20260709 13:20:17.406319 18927 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:17.385434 18234 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:17.383059 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.390776 25185 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:17.412828 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.329056 25615 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:20:17.394626 25387 raft_consensus.cc:3055] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:17.403792 25412 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23.
I20260709 13:20:17.387288 25564 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:17.389175 25635 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:17.407755 25565 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.424238 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.417541 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:17.417958 25590 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:17.441973 18235 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:20:17.444844 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.419976 25387 raft_consensus.cc:740] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:17.417953 25506 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:17.426970 25564 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:17.456084 18234 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:17.438045 25565 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:17.421912 25185 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:17.456940 25402 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:17.472934 25402 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.473356 25402 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:17.459503 25506 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.463500 25416 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.475775 25416 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:17.477828 25416 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:17.465910 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3868) took 1298 ms. Trace:
W20260709 13:20:17.467082 25625 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.722s	user 0.002s	sys 0.000s
I20260709 13:20:17.467132 25558 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:17.468972 25564 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:17.441648 25590 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.469906 25387 consensus_queue.cc:260] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:17.464701 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.503052 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.503571 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.421681 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:17.484221 18310 rpcz_store.cc:276] 0709 13:20:16.167922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.180950 (+ 13028us) service_pool.cc:224] Handling call
0709 13:20:16.181290 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.690792 (+509502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.465606 (+774814us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54002233d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:17.465839 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1170519808}
I20260709 13:20:17.503211 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:17.461091 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:17.562211 18233 raft_consensus.cc:1275] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:20:17.562817 18233 pending_rounds.cc:85] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 9
I20260709 13:20:17.563103 18233 pending_rounds.cc:107] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:20:17.563406 18233 raft_consensus.cc:2889] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:17.505510 25416 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.566141 25416 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:17.505810 25590 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:17.568261 25504 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:20:17.568857 25387 raft_consensus.cc:3060] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:17.573256 25511 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:17.574046 25612 log.cc:927] Time spent T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 1.537s	user 0.002s	sys 0.002s
I20260709 13:20:17.575943 18958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54020 (request call id 584) took 1820 ms. Trace:
I20260709 13:20:17.575977 25078 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:17.576727 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.577242 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.576565 18958 rpcz_store.cc:276] 0709 13:20:15.755516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.755664 (+   148us) service_pool.cc:224] Handling call
0709 13:20:15.768886 (+ 13222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:15.776205 (+  7319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.776242 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:15.776791 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 13:20:16.011530 (+234739us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:16.266841 (+255311us) log.cc:844] Serialized 14 byte log entry
0709 13:20:16.316862 (+ 50021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.316980 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:17.573712 (+1256732us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b24002f5058. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f00c9c4 00007fa17f00aacb 00007fa17f1c5dc9 00007fa17f1c5a55 00007fa17f1c509d 00007fa181df710e 00007fa181e0e88c 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221
0709 13:20:17.575626 (+  1914us) raft_consensus.cc:1685] finished
0709 13:20:17.575739 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.575874 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49575,"prepare.queue_time_us":466639,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":2860,"raft.queue_time_us":122707,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":25885,"spinlock_wait_cycles":10704256,"thread_start_us":356634,"threads_started":2,"wal-append.queue_time_us":239320}
I20260709 13:20:17.587965 25635 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:17.590240 18231 raft_consensus.cc:2468] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 20.
W20260709 13:20:17.592419 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.568358 25416 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:17.598217 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.598827 18311 raft_consensus.cc:2376] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19. Re-sending same reply.
I20260709 13:20:17.600123 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.600643 18309 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:20:17.600814 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.602293 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.600989 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.603816 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.604568 18311 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:17.606961 18958 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:17.612712 18311 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:17.613297 18380 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:17.613935 18311 raft_consensus.cc:3055] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:17.614331 18311 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:17.615825 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:17.601258 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.615206 18311 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.618944 18311 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:17.619557 18379 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:17.620488 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.620533 18308 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:20:17.623086 18303 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:17.624259 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.624442 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.625065 18305 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:17.625141 18310 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:17.626072 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.630110 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.632706 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.634766 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.636016 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:17.637140 18380 raft_consensus.cc:2410] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:20:17.637377 25390 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.637990 25390 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:17.638793 18231 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:17.640877 18954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53364 (request call id 704) took 1263 ms. Trace:
I20260709 13:20:17.641271 18954 rpcz_store.cc:276] 0709 13:20:16.377105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.379767 (+  2662us) service_pool.cc:224] Handling call
0709 13:20:16.525505 (+145738us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:16.526089 (+   584us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:16.526516 (+   427us) log.cc:844] Serialized 14 byte log entry
0709 13:20:16.590191 (+ 63675us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:16.800760 (+210569us) log.cc:844] Serialized 572 byte log entry
0709 13:20:16.843808 (+ 43048us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:16.882739 (+ 38931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.906321 (+ 23582us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:17.466452 (+560131us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:17.640551 (+174099us) raft_consensus.cc:1685] finished
0709 13:20:17.640675 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.640806 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":176,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":7992,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":5416,"spinlock_wait_cycles":16969088,"thread_start_us":46109,"threads_started":1,"wal-append.queue_time_us":85829}
I20260709 13:20:17.653223 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:17.654911 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:17.655495 18380 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:17.656780 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:17.657534 18309 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:17.658931 18954 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:17.707052 25416 consensus_queue.cc:1059] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:17.659049 18958 raft_consensus.cc:1240] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:17.659770 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:17.709046 18380 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:17.662129 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:17.664141 18379 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:20:17.665568 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.667491 18305 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:17.673306 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:17.677352 18383 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:20:17.678364 25627 log.cc:927] Time spent T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.912s	user 0.004s	sys 0.001s
W20260709 13:20:17.685829 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 306010us
W20260709 13:20:17.716248 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.698961 18311 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:20:17.706341 25660 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.707794 25559 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:17.711711 18384 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 21: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:17.719614 18311 pending_rounds.cc:85] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 13
W20260709 13:20:17.720191 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 232739us
I20260709 13:20:17.714430 25662 raft_consensus.cc:3055] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:17.732008 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:17.715158 25387 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.741611 18380 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
I20260709 13:20:17.721410 25559 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:17.721925 18311 pending_rounds.cc:107] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:20:17.747323 18311 raft_consensus.cc:2889] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:17.750885 25402 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:17.751250 25669 consensus_queue.cc:1059] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:17.752784 18378 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:20:17.745682 18351 leader_election.cc:400] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 22. Current term is 23.
I20260709 13:20:17.746327 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:17.744853 18202 connection.cc:256] RPC call timeout handler was delayed by -1.2877188389998082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3012s for a response
W20260709 13:20:17.755148 18202 connection.cc:256] RPC call timeout handler was delayed by -1.1604733979997945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2371s for a response
W20260709 13:20:17.755743 18202 connection.cc:256] RPC call timeout handler was delayed by -1.1553078139997979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
W20260709 13:20:17.756220 18202 connection.cc:256] RPC call timeout handler was delayed by -1.0881331699997645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 13:20:17.756616 18202 connection.cc:256] RPC call timeout handler was delayed by -1.0657115379997322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 13:20:17.757234 18202 connection.cc:256] RPC call timeout handler was delayed by -1.0450629239999216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260709 13:20:17.748270 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.729756 25594 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.729382 25662 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:17.757817 18351 leader_election.cc:403] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:20:17.765692 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:17.766140 18233 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:17.748962 25504 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:17.773586 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:17.729514 25660 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:17.783219 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.756989 25390 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:17.780874 25402 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:17.776849 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 52780.4us
I20260709 13:20:17.741003 25387 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:17.779512 25565 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:17.794237 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 70927.9us
I20260709 13:20:17.771503 25520 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 22. Current term is 23.
I20260709 13:20:17.775292 25504 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.774528 25416 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:17.771445 25594 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.789783 25573 raft_consensus.cc:3055] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:17.799961 25416 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.800105 25504 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:17.825928 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:17.826428 25658 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:20:17.827539 18304 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:20:17.838681 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 49448.5us
W20260709 13:20:17.830152 25661 log.cc:927] Time spent T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:20:17.829371 25594 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:17.812027 25402 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:17.793071 25590 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.809527 25573 raft_consensus.cc:740] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:20:17.842310 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 68842.8us
I20260709 13:20:17.840605 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.854709 18304 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 23.
I20260709 13:20:17.835515 25416 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:17.855494 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.855895 18927 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:17.856334 18311 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:17.839583 25615 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:17.858915 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.859685 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.814383 25185 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:20:17.793064 25559 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.863523 18234 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 23.
I20260709 13:20:17.849335 25402 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.815233 25564 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.867187 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.913971 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:17.914351 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 107172us
I20260709 13:20:17.868468 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.869204 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.915390 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.915791 18305 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:17.869213 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.916203 18311 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:17.916805 18309 raft_consensus.cc:2376] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23. Re-sending same reply.
I20260709 13:20:17.918058 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.918917 18309 raft_consensus.cc:2368] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 22. Current term is 23.
W20260709 13:20:17.919720 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.872929 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.873442 25425 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:17.809737 25662 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:17.874038 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:17.875885 25590 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:17.878057 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.926596 18312 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:17.878183 25660 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:17.930241 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:17.930670 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 56716.4us
I20260709 13:20:17.880955 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:17.855875 25435 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:20:17.881359 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.843566 25674 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:20:17.933020 18230 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
W20260709 13:20:17.916913 25675 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:20:17.906324 25565 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:17.885061 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.885677 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.937275 18310 raft_consensus.cc:2376] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17. Re-sending same reply.
I20260709 13:20:17.887275 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.887841 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.892253 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46128 (request call id 1149) took 1235 ms. Trace:
I20260709 13:20:17.938802 18236 rpcz_store.cc:276] 0709 13:20:16.656473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.714128 (+ 57655us) service_pool.cc:224] Handling call
0709 13:20:17.892038 (+1177910us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b5400104fd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:17.892193 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64500480}
I20260709 13:20:17.893388 18231 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:17.886263 25416 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:17.898954 18381 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43098 (request call id 1514) took 1522 ms (client timeout 1620 ms). Trace:
I20260709 13:20:17.941277 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:17.941473 18381 rpcz_store.cc:269] 0709 13:20:16.376538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.376702 (+   164us) service_pool.cc:224] Handling call
0709 13:20:17.898773 (+1522071us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b5400081954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:17.898897 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986480000}
I20260709 13:20:17.862001 25594 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:17.856266 25415 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:20:17.902182 25387 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:17.904835 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:17.907968 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.949208 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.911319 18351 connection.cc:256] RPC call timeout handler was delayed by -1.1875990440000805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
I20260709 13:20:17.923977 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:17.923977 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:17.950624 18234 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:17.951797 18233 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:17.925413 18235 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
W20260709 13:20:17.925637 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.929330 18309 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:20:17.925014 18276 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:17.882175 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:17.916266 25402 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:17.934816 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:17.882344 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:17.957612 18237 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 19: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:17.936738 18308 raft_consensus.cc:2376] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20. Re-sending same reply.
I20260709 13:20:17.941934 18230 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:17.864248 25678 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.944011 18306 raft_consensus.cc:2393] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 12: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:17.942301 25662 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:17.946349 18311 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:20:17.936619 25611 raft_consensus.cc:993] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:20:17.934307 18954 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:17.955899 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.934391 25615 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:17.964955 25615 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:17.965401 25615 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:17.963979 25660 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:17.966130 25660 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.966531 25660 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:17.959007 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:17.969156 18237 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:20:17.959769 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1150) took 1289 ms. Trace:
I20260709 13:20:17.969513 25678 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:17.969935 18228 rpcz_store.cc:276] 0709 13:20:16.670573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.747827 (+ 77254us) service_pool.cc:224] Handling call
0709 13:20:16.806956 (+ 59129us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:16.807890 (+   934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.959586 (+1151696us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b540001b3d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:17.959712 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42814336}
W20260709 13:20:17.971024 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.945551 25559 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:17.971940 25678 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:17.946863 25594 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.975098 25594 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:17.963989 18927 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:17.973553 18236 raft_consensus.cc:1240] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:17.962391 18229 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:17.980971 25678 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:17.986209 18312 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
W20260709 13:20:17.989504 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 58229.2us
I20260709 13:20:17.990680 18202 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:17.992699 18230 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:20:17.994251 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:17.996371 25390 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:20:17.996594 25634 log.cc:927] Time spent T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 1.084s	user 0.006s	sys 0.003s
I20260709 13:20:17.997008 25390 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:17.998092 25390 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:17.983830 25450 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:18.003140 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:17.982298 25558 raft_consensus.cc:1081] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:20:17.963194 25590 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:20:18.009632 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:18.017004 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.988478 25598 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:17.982038 25674 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:20:18.022333 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:18.023602 25425 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:18.018594 25435 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:18.024013 25425 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:18.024870 25425 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:18.025058 25564 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:18.024370 25435 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:18.026517 25435 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.028899 25415 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:18.029317 25415 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:18.029661 25415 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:18.012768 25450 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:18.033309 25450 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:18.035163 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4206) took 1445 ms. Trace:
W20260709 13:20:18.035454 25683 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:20:18.045815 18927 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:18.048305 25590 raft_consensus.cc:2804] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:18.048420 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:18.049479 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:18.050482 18378 raft_consensus.cc:2410] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 19 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:20:18.023973 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:18.067291 18234 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:18.035557 18382 rpcz_store.cc:276] 0709 13:20:16.589865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.604951 (+ 15086us) service_pool.cc:224] Handling call
0709 13:20:16.605253 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:16.727844 (+122591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.727873 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:16.776902 (+ 49029us) log.cc:844] Serialized 26 byte log entry
0709 13:20:16.989945 (+213043us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:16.990004 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.034739 (+1044735us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540004d3d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:18.034786 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.034832 (+    46us) raft_consensus.cc:1685] finished
0709 13:20:18.034845 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:18.035096 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12001,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5922,"spinlock_wait_cycles":281090432,"thread_start_us":107975,"threads_started":1,"wal-append.queue_time_us":327344}
I20260709 13:20:18.069137 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:18.069782 18378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d03313400e274f83883c84395905b4cd"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46844
I20260709 13:20:18.084242 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:18.084668 18378 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:18.085059 18378 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:18.071376 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:18.086086 18380 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:18.072857 18377 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:18.013235 25569 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:18.094004 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 92717.4us
I20260709 13:20:18.095048 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:18.095913 18312 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:18.079798 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 57535.3us
I20260709 13:20:18.096993 18379 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:18.080008 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:18.012452 25416 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:18.081303 18385 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:20:18.093254 18960 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:18.093354 18955 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:18.101372 18380 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:18.102911 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:18.105278 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:18.106113 18379 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
W20260709 13:20:18.113600 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.117941 18228 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:20:18.123076 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54028.4us
I20260709 13:20:18.124862 18377 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:18.130609 18962 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 13.
I20260709 13:20:18.124634 18927 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:18.044308 25660 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.068436 25590 raft_consensus.cc:697] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 20 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:18.071345 25598 raft_consensus.cc:697] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 14 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:18.007513 25685 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.099s
I20260709 13:20:18.121733 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:18.135609 18276 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:18.078631 25674 consensus_queue.cc:1059] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:20:18.181406 18312 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16.
I20260709 13:20:18.182142 18378 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.134939 25411 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:18.197940 18384 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:18.173218 25565 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:18.115660 25558 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:20:18.206806 18378 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:18.197830 25651 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:20:18.179121 25677 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.214326 18378 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:20:18.217281 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 98375.1us
I20260709 13:20:18.221184 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:18.224867 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 103228us
I20260709 13:20:18.225759 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:18.174147 25564 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:20:18.243983 25558 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:18.248621 25558 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:18.249328 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:18.250244 18236 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 17: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:18.249823 25558 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.251639 25558 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:18.241333 25688 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:18.253074 25688 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.253443 25688 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.255602 25694 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:20:18.267153 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 131613us
I20260709 13:20:18.259727 25573 consensus_queue.cc:260] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:18.205230 25504 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.218254 25565 raft_consensus.cc:697] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 17 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:18.244743 25450 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:20:18.297839 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:18.291473 25693 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.066s	user 0.003s	sys 0.000s
W20260709 13:20:18.304044 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.307564 25660 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:18.313876 25660 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:18.314383 25660 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.315057 25504 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:18.316596 25450 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:18.227032 25677 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.219633 25689 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:20:18.299540 25573 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:18.315145 25687 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:18.276980 25583 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:20:18.248656 25415 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.292061 25684 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:20:18.300084 25685 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
W20260709 13:20:18.358673 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 408476us
W20260709 13:20:18.359854 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:18.360272 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:18.360646 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:18.361109 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.361932 25622 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.362421 25622 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.365866 25415 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:18.317590 25660 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:18.374758 25622 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:18.375370 25610 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.378799 25610 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.380811 25610 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:18.290349 25590 consensus_queue.cc:237] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:18.366010 25677 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:18.267143 25598 consensus_queue.cc:237] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:18.393430 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 167778us
I20260709 13:20:18.395519 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:18.367830 25578 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.409291 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:18.361948 25565 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:18.411136 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.385694 25504 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:18.399566 25691 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:20:18.421622 18202 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:18.443529 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:18.418145 25435 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:18.443872 25695 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:18.448104 25506 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:18.449978 25692 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:20:18.451743 25594 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:18.470342 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.493065 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:18.494905 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:18.495862 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:18.498207 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:18.498728 25615 consensus_meta.cc:287] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.002s
I20260709 13:20:18.498867 25425 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.501098 25594 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:18.502542 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.417433 25578 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:18.504657 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:18.506027 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.506070 25578 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:18.506201 25685 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.507025 25685 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.499151 18378 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:18.496317 18385 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:18.418887 25504 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:18.510478 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:18.386567 25450 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:18.500365 25559 consensus_meta.cc:287] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.529s	user 0.002s	sys 0.007s
I20260709 13:20:18.513002 25390 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:18.513314 25402 consensus_meta.cc:287] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 13:20:18.513765 25415 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:18.516782 25520 consensus_queue.cc:1059] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:18.560985 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:18.561748 18231 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:18.517151 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:18.518674 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:20:18.563953 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 45364.3us
I20260709 13:20:18.520955 25680 raft_consensus.cc:3055] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:18.525585 25712 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:18.567850 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:18.526270 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.529053 18926 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:18.569851 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.570899 18926 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:18.576171 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:18.529736 25504 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:18.533660 25685 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:18.535185 25662 consensus_meta.cc:287] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.000s
I20260709 13:20:18.539143 18201 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:18.595350 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 56347.4us
I20260709 13:20:18.541245 25425 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:18.540485 18385 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:20:18.603077 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:18.603684 18385 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:18.542237 25578 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:18.543224 18380 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:18.545383 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:18.605044 18276 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:18.608443 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63165.9us
I20260709 13:20:18.557325 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:18.558755 18234 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:18.559170 18378 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
W20260709 13:20:18.562988 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 45932.3us
I20260709 13:20:18.525686 18958 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 12.
I20260709 13:20:18.577729 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:18.499205 25615 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.614205 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:18.614701 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:18.615460 18312 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:18.568573 25680 raft_consensus.cc:740] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:18.571043 25559 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:18.561427 25520 raft_consensus.cc:3055] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:18.613150 18381 raft_consensus.cc:2410] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:20:18.576676 25564 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:18.613996 18377 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 20: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:18.578171 25592 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:18.583171 25569 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:18.613847 25364 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.593580 25676 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:18.619407 25669 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:18.637447 18378 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:20:18.565900 25402 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.639655 18312 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 24.
I20260709 13:20:18.633306 25520 raft_consensus.cc:740] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:18.558917 25390 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.621917 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:18.613370 25506 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.613684 25685 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:18.607399 25185 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:18.630558 25590 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.658150 25676 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:18.576880 25712 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.639950 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:18.691825 18377 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 23: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:18.668776 18378 raft_consensus.cc:1240] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:20:18.639993 25695 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:18.673115 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51294.9us
W20260709 13:20:18.671742 25705 log.cc:927] Time spent T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:20:18.648854 25677 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.702536 25677 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.619197 25708 consensus_queue.cc:1059] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:20:18.706547 25708 raft_consensus.cc:3055] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:18.707010 25708 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:18.633224 25573 consensus_queue.cc:1059] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:20:18.710181 25573 raft_consensus.cc:3055] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:18.710637 25573 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:18.710741 25390 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:18.712312 25715 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:20:18.687404 25688 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:18.714633 25698 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.268s	user 0.002s	sys 0.000s
I20260709 13:20:18.715433 25688 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:18.628836 25611 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:20:18.682770 18384 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:20:18.723860 18384 pending_rounds.cc:85] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 11
I20260709 13:20:18.661206 25564 raft_consensus.cc:697] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 16 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:18.663599 25669 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.637408 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:18.697078 18277 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:18.660782 25364 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:18.685348 25185 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:18.678102 25578 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:18.725224 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:18.731110 18962 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:18.740360 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:18.740788 18349 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:18.738870 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:18.747035 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:18.735193 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 130246us
I20260709 13:20:18.748385 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:18.724241 18384 pending_rounds.cc:107] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 19.12
I20260709 13:20:18.749830 18384 raft_consensus.cc:2917] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Aborting config change with OpId 19.12: Aborted: Op aborted by new leader
I20260709 13:20:18.749904 25622 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:18.750706 25622 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:18.751073 25622 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:18.751418 25622 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:18.754381 25615 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:18.756865 25699 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:18.756970 25663 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:18.757529 25663 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.711783 25573 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.757903 25663 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:18.758796 25573 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:18.691125 25680 consensus_queue.cc:260] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.759732 25680 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:18.760630 25685 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:18.735271 25669 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:18.765616 25663 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:18.750295 18384 raft_consensus.cc:2889] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:18.758260 25520 consensus_queue.cc:260] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.677459 25506 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:18.772297 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:18.768909 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:18.770709 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:18.773756 18962 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:18.771106 18277 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:18.772799 18927 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:18.777675 18382 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:18.792505 18277 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:18.798799 18962 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:18.690191 25590 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:18.732112 25559 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:20:18.757997 25712 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:18.814029 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 389464us
I20260709 13:20:18.814010 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:18.836620 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:18.840193 18386 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.835798 18349 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:18.777916 25685 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:18.770284 25677 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:18.777635 25610 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:18.866294 25610 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:18.866773 25610 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:18.867224 25615 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:18.840131 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:18.868944 25185 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.869549 25450 raft_consensus.cc:3055] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:18.870050 25450 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:18.779222 25663 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:18.844991 18953 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:18.708181 25708 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:18.801379 25411 raft_consensus.cc:2804] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:18.851001 25506 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:20:18.835938 18954 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:20:18.854278 25364 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:18.854352 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:18.857344 25402 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:18.859994 25504 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:18.860714 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:18.898808 18310 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 18.
I20260709 13:20:18.864919 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:18.872047 18958 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:18.878178 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 294463us
I20260709 13:20:18.873483 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:18.905781 18377 raft_consensus.cc:2368] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21.
I20260709 13:20:18.866854 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:18.834919 25670 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:18.885049 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:18.911630 18312 raft_consensus.cc:2393] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 13: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:18.835039 25684 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:18.879813 25520 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:18.908406 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.909196 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:18.920804 18962 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.887171 25435 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:18.916337 18386 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
W20260709 13:20:18.911530 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 71476.2us
I20260709 13:20:18.965730 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:18.871353 25695 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.871032 25450 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.940232 18962 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 13.
I20260709 13:20:18.772815 25676 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:18.945902 25590 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:18.910451 25504 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:19.006668 25504 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:18.893286 25663 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:20:19.009290 25720 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:20:18.890506 25411 raft_consensus.cc:697] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 24 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:19.010035 25669 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.010447 25411 consensus_queue.cc:237] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:18.913460 25622 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:18.963333 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 96553.9us
I20260709 13:20:19.013360 25622 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:19.013772 18201 leader_election.cc:400] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21.
I20260709 13:20:18.966518 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:19.014036 18382 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:20:19.014590 18382 pending_rounds.cc:85] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 14
I20260709 13:20:19.014875 18382 pending_rounds.cc:107] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:20:19.015172 18382 raft_consensus.cc:2889] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:19.015417 25583 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:18.969111 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:18.882740 25712 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:20:18.917083 25708 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:19.020609 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.022352 25558 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.022876 25558 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:19.027050 25558 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:19.030746 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.005009 25694 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:19.005779 25719 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:18.881319 25564 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:18.986779 25723 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:19.034632 25663 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:19.014729 18385 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
W20260709 13:20:19.041633 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 72656.2us
I20260709 13:20:19.042665 18275 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:19.044122 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:19.045115 18953 raft_consensus.cc:2410] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 15 because replica has last-logged OpId of term: 13 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 13:20:19.035568 18201 leader_election.cc:403] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:20:19.045255 18926 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:19.046808 18927 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:19.049578 25558 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:19.049741 25565 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:19.050272 25565 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.055691 18386 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:19.056402 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:19.057211 18377 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 14.
I20260709 13:20:19.078099 18312 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:20:19.067034 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 63524.2us
W20260709 13:20:19.080394 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:19.077405 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 241684us
I20260709 13:20:19.039863 25663 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:19.060294 25670 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:19.047912 25364 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:18.982544 18958 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:20:19.050655 25565 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:19.066264 25590 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:19.093384 18958 pending_rounds.cc:85] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Aborting all ops after (but not including) 11
I20260709 13:20:19.100163 18958 pending_rounds.cc:107] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 19.12
I20260709 13:20:19.100610 18958 raft_consensus.cc:2917] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Aborting config change with OpId 19.12: Aborted: Op aborted by new leader
I20260709 13:20:19.101270 18958 raft_consensus.cc:2889] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 20 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:19.103389 18202 leader_election.cc:400] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23.
I20260709 13:20:19.042240 25694 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
W20260709 13:20:19.107954 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 337337us
I20260709 13:20:19.048869 25610 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.097465 25364 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.076048 25391 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:20:19.102530 25670 raft_consensus.cc:697] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:19.121794 25662 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:19.013943 25390 consensus_queue.cc:1175] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" responder_term: 23 status { last_received { term: 20 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 22. Current term is 23. Ops: [22.14-22.14]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:20:19.093436 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 256045us
I20260709 13:20:19.112386 25583 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.135077 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:19.102366 25592 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:20:19.140090 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:19.114210 25364 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:19.147547 18277 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:19.157829 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:19.162088 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:19.164132 25573 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:19.165086 25573 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:19.165526 25610 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:19.120344 25719 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:20:19.166237 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:19.167153 25573 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:19.167532 25573 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:19.167892 25573 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:19.175707 25573 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:19.177070 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:19.178866 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:19.151628 25680 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:19.143908 25685 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:20:19.162854 25712 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:19.161777 25425 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:19.140399 25435 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:20:19.191035 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:19.194487 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:19.152284 25583 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.182163 25684 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:19.191951 25701 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.020s	sys 0.030s
W20260709 13:20:19.252239 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 57861us
I20260709 13:20:19.229926 18277 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:19.188997 25573 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:19.258950 25701 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.020s	sys 0.030s
I20260709 13:20:19.185202 25719 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:20:19.209554 25425 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:19.212066 25728 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:19.212292 25735 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:19.310163 18962 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 24 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:19.254106 25712 raft_consensus.cc:697] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:20:19.304752 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 45471.2us
I20260709 13:20:19.251828 25684 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:19.300385 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 142585us
I20260709 13:20:19.204622 25736 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 13:20:19.251466 25688 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:20:19.309288 25425 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:19.331352 25676 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:19.337831 25669 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:19.345068 25622 raft_consensus.cc:2764] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 LEADER]: Leader election decision vote started in defunct term 23: won
I20260709 13:20:19.322695 25684 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:19.308573 25573 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:19.370102 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:19.204602 25670 consensus_queue.cc:237] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:19.383651 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:19.325829 25662 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.376001 18202 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:19.326608 25734 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.379767 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:19.393759 18385 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:19.351079 25423 raft_consensus.cc:670] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:19.385179 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:19.397938 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:19.377308 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:19.404241 18306 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:20:19.371227 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 141442us
W20260709 13:20:19.391727 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.410943 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:19.387034 25663 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:19.392729 25737 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:19.418509 18306 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:19.416306 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:19.414227 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:19.402730 25677 raft_consensus.cc:2764] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:20:19.402864 25723 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:20:19.411922 25731 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:20:19.429169 18351 leader_election.cc:400] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 22. Current term is 23.
I20260709 13:20:19.381059 25435 consensus_queue.cc:1059] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:20:19.434651 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:19.442847 18385 raft_consensus.cc:2468] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:19.450083 25750 raft_consensus.cc:3055] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:19.450824 25578 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:19.451942 25411 consensus_queue.cc:1059] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:19.461958 25750 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:19.462668 25411 raft_consensus.cc:3055] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:19.452275 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:19.463176 25435 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:19.463074 25750 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.464497 25750 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:19.453351 25573 consensus_queue.cc:1048] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:19.466090 25573 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:19.453747 25728 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:19.464710 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:19.463097 25411 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:19.469836 25435 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:19.469702 25411 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:19.471243 25411 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:19.422219 25558 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21.
I20260709 13:20:19.423935 25719 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:19.476583 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:19.473750 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:19.435511 25520 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:19.423429 25737 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:19.483079 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 54113.1us
I20260709 13:20:19.400535 25662 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:19.406072 25504 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.436735 25415 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:19.489696 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:19.495183 18202 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:19.427017 25712 consensus_queue.cc:237] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.497854 25615 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:19.498749 25615 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:19.500327 25573 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.443796 25592 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:20:19.500999 25573 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.503767 25689 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:19.506096 25611 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:19.507109 25750 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:19.514372 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:19.514871 18385 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:19.481585 25578 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:19.516909 25578 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:19.517128 25623 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:19.517462 25578 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:19.485041 25723 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:19.518672 25723 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.491721 25669 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:20:19.523087 25504 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:19.523394 25583 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:19.492274 25728 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.524490 25728 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:19.526876 25728 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:19.527889 25753 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:20:19.516932 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.529368 25520 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:19.530838 25520 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.532230 18231 raft_consensus.cc:1275] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:19.533464 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:19.534134 18233 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
W20260709 13:20:19.534319 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.536340 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:19.536975 18307 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:19.537936 18310 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:20:19.538833 25719 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:20:19.539795 25740 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:20:19.539521 25719 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.488168 25737 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:19.541893 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:19.542469 18308 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:19.536859 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:19.542759 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:19.543879 18962 raft_consensus.cc:2393] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 24: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:19.544951 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:19.536167 25450 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:19.400238 25734 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:19.556443 18381 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:19.556427 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:19.559516 18306 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:19.492506 25435 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:19.560617 18236 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:19.562129 18306 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:20:19.568681 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:19.570145 18304 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:19.570700 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:19.571590 18309 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 23: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:19.573237 18306 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:19.574450 18309 raft_consensus.cc:1240] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:19.503641 25573 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:19.532114 25425 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.590147 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:19.590022 25694 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.570055 25504 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:20:19.598663 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 82158.1us
I20260709 13:20:19.615702 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:19.598111 25716 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
W20260709 13:20:19.601052 25743 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.167s	user 0.001s	sys 0.001s
I20260709 13:20:19.600894 25694 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.601500 25752 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:19.601845 25755 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:20:19.598590 25611 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:19.581190 25525 consensus_queue.cc:1048] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:20:19.623687 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:19.649319 18386 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:19.651202 18383 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:19.653694 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:19.626035 18276 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:19.630000 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:19.631693 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:19.601540 25425 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:19.667160 18234 raft_consensus.cc:3055] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:19.667639 18234 raft_consensus.cc:740] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:19.638546 25559 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:19.668395 18234 consensus_queue.cc:260] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:19.681823 18234 raft_consensus.cc:3060] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:19.683171 18307 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:19.684337 18309 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:19.646572 25611 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.619767 25423 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 13:20:19.702798 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 76881.5us
I20260709 13:20:19.699586 18303 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:19.692675 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:19.713905 18303 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:20:19.656698 25185 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
W20260709 13:20:19.720077 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 104439us
I20260709 13:20:19.694592 25558 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:19.738989 25402 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:19.699074 25611 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:19.744709 25755 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:20:19.655958 25752 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:19.663607 25598 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:20:19.781924 25734 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:19.777221 25719 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:19.669932 25583 consensus_queue.cc:1059] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:20:19.697312 25685 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:19.972707 25763 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.257s	user 0.001s	sys 0.003s
I20260709 13:20:19.964483 25520 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.716560 25689 raft_consensus.cc:2804] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:19.684772 25674 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:19.928941 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 298987us
W20260709 13:20:19.955986 25684 consensus_meta.cc:287] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.556s	user 0.012s	sys 0.000s
W20260709 13:20:19.941157 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.954576 18305 raft_consensus.cc:2955] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 11 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:20:19.955840 25751 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.223s	user 0.004s	sys 0.000s
I20260709 13:20:19.972606 25558 raft_consensus.cc:3055] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:19.927629 18308 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:19.987429 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:19.988137 18308 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:19.946278 25402 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:19.989068 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:19.990319 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:19.990968 18308 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
W20260709 13:20:19.955487 25708 consensus_meta.cc:287] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.936s	user 0.011s	sys 0.012s
I20260709 13:20:19.972903 25685 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.932039 18234 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
W20260709 13:20:19.954031 25565 consensus_meta.cc:287] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.848s	user 0.018s	sys 0.004s
W20260709 13:20:19.983558 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:20.005128 25364 consensus_meta.cc:287] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.860s	user 0.014s	sys 0.000s
I20260709 13:20:20.005609 25364 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:20.006855 18953 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:20:20.000901 25689 raft_consensus.cc:697] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:20.009593 25689 consensus_queue.cc:237] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.013094 25402 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.986369 25684 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.991899 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:19.997306 18234 pending_rounds.cc:85] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 16
I20260709 13:20:19.999280 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:20.016590 18234 pending_rounds.cc:107] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 13:20:20.017278 18234 raft_consensus.cc:2889] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:20.018570 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:20.016326 18351 connection.cc:256] RPC call timeout handler was delayed by -1.243928275999906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
I20260709 13:20:20.019832 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:20.026191 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:19.973500 25520 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:20.034469 25622 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:19.986699 25695 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:19.986542 25558 raft_consensus.cc:740] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:20.033936 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:19.997604 25662 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:19.971489 25578 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:20.028447 25411 consensus_meta.cc:287] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.000s
I20260709 13:20:20.049954 25364 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:20:20.001310 25415 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:20:20.050431 25685 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:20.050956 25622 raft_consensus.cc:697] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:20.052750 25694 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:20.053157 25695 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:19.986943 25674 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.054589 25752 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:20.043236 25185 consensus_queue.cc:1059] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:20:20.059309 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:20.025447 25565 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:20.060981 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:20.114526 18312 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
I20260709 13:20:20.115547 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:20.061175 25684 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:20.062348 25676 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.687s	user 0.011s	sys 0.000s
I20260709 13:20:20.031896 25708 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:20.062183 25558 consensus_queue.cc:260] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.024633 25435 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:20:20.065156 25578 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:20.069656 18308 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:20:20.077548 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 43694.1us
W20260709 13:20:20.111647 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 406977us
I20260709 13:20:20.112413 18305 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:20.117004 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:20.118053 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:20.108814 25737 consensus_meta.cc:287] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.004s
W20260709 13:20:20.124218 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 98305.1us
I20260709 13:20:20.084161 25559 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:20.142684 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:20.148605 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:20.152340 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:20.143236 25694 raft_consensus.cc:3055] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:20.153683 25694 raft_consensus.cc:740] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:20.154383 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:20.155038 18312 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:20:20.156946 25674 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:20.157788 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:20.158399 25450 consensus_meta.cc:287] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.004s
I20260709 13:20:20.158882 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:20.154675 25694 consensus_queue.cc:260] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.147668 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:20.150369 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:20.166767 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:20.167021 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:20.181826 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:20.164966 25662 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:20.198909 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:20.197337 25662 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:20.150709 25737 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.168747 25450 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:20:20.189397 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:20.196806 25787 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:20.185118 25415 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:20.224223 25787 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:20.225297 25787 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.230145 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:20.230894 18954 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 10.
I20260709 13:20:20.221866 25677 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:20.233779 18275 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:20.235338 25674 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:20.235831 25674 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.236231 25674 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:20.245361 25565 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:20.247375 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:20.249038 25776 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:20:20.250594 25767 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:20:20.252431 25768 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:20:20.253096 25778 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:20.252914 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:20.254201 18311 raft_consensus.cc:2410] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:20:20.198729 25694 raft_consensus.cc:3060] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:20.188488 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:20.184190 25622 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:20.193560 18305 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:20.187043 25734 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:20.185119 25708 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:20:20.216702 18304 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:20.259222 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:20.260766 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 72555.1us
I20260709 13:20:20.263173 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:20.263768 18305 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:20.219291 25662 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:20.240181 25559 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:20.251559 25674 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:20.271896 25674 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:20.274327 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:20.275019 18954 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:20.275136 25761 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 13:20:20.262835 25450 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:20.279837 25450 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:20.280232 25450 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:20.282846 25726 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 1.336s	user 0.000s	sys 0.012s
I20260709 13:20:20.284837 18380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3758) took 1715 ms. Trace:
I20260709 13:20:20.285188 18380 rpcz_store.cc:276] 0709 13:20:18.569321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.619618 (+ 50297us) service_pool.cc:224] Handling call
0709 13:20:18.619977 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.620402 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.620439 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:18.622450 (+  2011us) log.cc:844] Serialized 26 byte log entry
0709 13:20:18.801646 (+179196us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:18.801694 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:18.801821 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:18.951303 (+149482us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b48001e0258. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18719caa1 00007fa187193b37 00007fa1871939ca 00007fa18728b26f 00007fa18728af37 00007fa18729f55c 00007fa18729f508 00007fa18729f488 00007fa18729f443 00007fa18729e6ec 00007fa1861c8a96
0709 13:20:20.282251 (+1330948us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:20.284609 (+  2358us) raft_consensus.cc:1685] finished
0709 13:20:20.284632 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.284772 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12499,"raft.run_cpu_time_us":3665,"raft.run_wall_time_us":312948,"spinlock_wait_cycles":59178240,"thread_start_us":140509,"threads_started":1,"wal-append.queue_time_us":245319}
I20260709 13:20:20.285799 18954 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:20:20.288156 18275 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:20.261538 25578 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:20.289072 25573 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:20.289501 25402 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:20.289584 25573 raft_consensus.cc:697] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:20.290589 25573 consensus_queue.cc:237] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:20.291940 25781 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:20:20.297878 25737 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:20.306154 18305 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:20.309291 18380 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:20.310212 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:20.310863 18307 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:20.311262 18953 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:20:20.311225 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:20.268312 25734 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:20.325150 18307 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:20.345116 18305 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:20.345846 18308 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:20.361159 18307 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:20:20.362382 18308 raft_consensus.cc:1275] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:20:20.362805 18307 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:20.346264 18304 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:20.365464 18305 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:20:20.366928 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 146506us
I20260709 13:20:20.313472 25415 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.342870 25441 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.377600 25441 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:20.379751 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.379824 25441 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:20.380275 25788 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:20:20.313254 25708 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.373095 25737 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:20.376564 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:20.376474 25415 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.352831 25695 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:20.357833 25734 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:20.363098 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:20.385878 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 63062.7us
I20260709 13:20:20.398020 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:20.388728 18311 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:20.382282 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:20.384863 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:20.402078 18311 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:20:20.403960 18311 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:20.395192 18958 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:20.357700 25565 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:20:20.400851 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:20.385725 25435 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:20.420269 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:20.370309 25611 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:20.393790 25695 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.411141 25622 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:20.388183 25708 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.435010 25786 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.054s
I20260709 13:20:20.424829 25435 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.436579 25622 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.458596 25622 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:20.464196 25750 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:20.464731 25750 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:20.465641 25750 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:20.439343 25785 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:20:20.466382 25670 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:20.467306 18201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.008s	sys 0.030s
I20260709 13:20:20.467072 25670 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:20.468019 25797 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:20.468649 25797 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.472239 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:20.442238 25415 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:20.442572 25441 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:20.443208 25775 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:20.448763 25695 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.421268 25402 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:20.411343 18954 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:20.456804 25450 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.457978 25435 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:20.438275 25783 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.053s
W20260709 13:20:20.467658 18201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.008s	sys 0.030s
W20260709 13:20:20.501816 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 846458us
I20260709 13:20:20.423328 25390 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
W20260709 13:20:20.476588 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 56408.8us
I20260709 13:20:20.433624 25559 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:20.480679 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:20.474658 25670 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:20.478101 25441 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.492753 25402 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.510294 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:20.508041 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:20.524420 18231 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:20.504365 25750 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:20.527760 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:20.531193 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:20.531523 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:20.531800 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:20.532183 18230 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:20.532621 18229 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:20.505251 25592 consensus_queue.cc:1048] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 13:20:20.512245 25797 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:20.519577 25441 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:20.525902 25402 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:20.552804 18231 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
W20260709 13:20:20.554522 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 155006us
W20260709 13:20:20.557583 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:20.558637 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.568215 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:20.569773 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:20.572741 18231 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:20.572314 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:20.575903 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:20.577517 18237 raft_consensus.cc:2393] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 15: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:20.577665 18230 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:20.549719 25762 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:20.580904 18201 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:20.586975 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:20.590657 18231 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:20.593969 25792 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.084s
W20260709 13:20:20.595760 25794 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:20:20.578450 25737 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:20.587849 25728 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.623813 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:20.618144 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:20.596218 25804 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:20:20.584028 25762 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.642203 25799 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:20.642462 25737 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.653041 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:20.655576 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 147622us
W20260709 13:20:20.655620 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 184029us
I20260709 13:20:20.663869 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:20.641851 25611 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:20.652701 25762 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:20.678159 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 91422.1us
I20260709 13:20:20.687013 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:20.687760 18381 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 9.
I20260709 13:20:20.689282 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:20.689402 18385 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:20.661231 25708 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:20.691664 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:20.695294 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:20.696046 18927 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:20.647727 25728 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.664709 25737 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:20.698201 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:20.677516 25559 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:20.675165 25695 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:20.708823 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:20.709550 18231 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:20.709434 25817 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:20.710606 25817 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:20:20.693013 25450 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:20.717140 25805 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:20:20.724361 18232 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:20.699369 25364 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:20.697476 25594 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:20:20.757789 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:20.740348 25364 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:20.762277 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:20.766911 25670 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.767467 25670 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:20.768699 25504 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:20.769078 25504 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:20.769644 25670 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:20.769948 25504 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.771341 25520 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:20.772152 25504 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:20.774721 25441 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.776001 18229 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:20.718688 25559 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:20.725561 25728 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:20.779537 18384 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 21: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:20.778651 18381 raft_consensus.cc:1240] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:20.706436 25737 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:20:20.782886 18382 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:20:20.746038 25565 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:20.795533 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:20.797325 18382 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 24: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:20.797529 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3936) took 1214 ms. Trace:
I20260709 13:20:20.783994 25364 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:20.797870 18309 rpcz_store.cc:276] 0709 13:20:19.583152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.594355 (+ 11203us) service_pool.cc:224] Handling call
0709 13:20:19.683990 (+ 89635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.684723 (+   733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.797353 (+1112630us) spinlock_profiling.cc:243] Waited 89.3 ms on lock 0x7b54000bc2d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:20.797477 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205402496}
I20260709 13:20:20.799437 25364 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:20.802353 25441 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:20.778900 25622 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.810825 25622 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:20.781036 25694 consensus_meta.cc:287] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:20:20.813678 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:20.815670 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:20.840687 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:20.851166 18386 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:20.841523 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:20.841923 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:20.853619 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:20.853713 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:20.814288 25766 log.cc:927] Time spent T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.537s	user 0.004s	sys 0.000s
I20260709 13:20:20.854610 18235 raft_consensus.cc:2410] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:20:20.856791 18386 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:20.859438 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:20.857350 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:20.853212 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:20.812502 25662 consensus_meta.cc:287] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.001s
I20260709 13:20:20.813123 25559 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.871352 18383 raft_consensus.cc:1240] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:20.871501 18378 raft_consensus.cc:1240] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:20.874836 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:20.875888 18232 raft_consensus.cc:2410] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:20:20.877882 18378 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:20.879818 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:20.880698 18378 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:20.884029 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:20.890605 18237 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 13:20:20.891148 18237 pending_rounds.cc:85] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 13
I20260709 13:20:20.891435 18237 pending_rounds.cc:107] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:20:20.891719 18237 raft_consensus.cc:2889] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:20.892184 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:20.896031 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:20.898973 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:20.898885 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:20.900281 18232 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
I20260709 13:20:20.901858 25615 consensus_queue.cc:1059] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:20:20.903169 25798 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.467s	user 0.004s	sys 0.000s
I20260709 13:20:20.909857 18229 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:20.916134 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:20.916725 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:20.917094 18237 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 20: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:20.919417 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:20.920331 18383 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 23: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:20.917939 25594 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:20.922276 18229 raft_consensus.cc:2410] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:20:20.922417 25594 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:20.923650 25750 consensus_queue.cc:1059] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:20.924842 25807 raft_consensus.cc:3055] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:20.925115 25415 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:20.921412 25695 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:20.917207 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:20.925285 25807 raft_consensus.cc:740] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:20.925477 25594 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:20.926795 18377 raft_consensus.cc:2410] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:20:20.927631 25807 consensus_queue.cc:260] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.928234 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:20.929066 18377 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 24: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:20.930096 18201 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:20.930318 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:20.931222 25695 consensus_queue.cc:1059] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:20.932018 25695 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:20.932394 25695 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:20.932559 25415 raft_consensus.cc:3055] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:20.932904 25695 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:20.932976 25415 raft_consensus.cc:740] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:20.934192 25415 consensus_queue.cc:260] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.935408 25415 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:20.854283 25734 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.937201 18380 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:20.938477 25734 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:20.932360 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:20.940924 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:20.941762 25402 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.943081 18381 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:20:20.947490 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:20.948204 18378 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:20:20.947682 25402 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:20.962425 25723 consensus_queue.cc:1059] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:20.963596 25558 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:20.944360 25762 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.970278 25762 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:20.971692 25723 raft_consensus.cc:3055] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:20.972273 25723 raft_consensus.cc:740] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:20.973312 25723 consensus_queue.cc:260] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.974385 25583 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.974521 25723 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:20.974979 25583 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:20.977388 25583 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:20.979293 25435 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:20.979658 25435 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:20.980443 25435 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.995896 25435 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:20.876641 25662 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:20.997345 18386 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:20.998391 25662 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:20.998891 25795 log.cc:927] Time spent T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.555s	user 0.000s	sys 0.008s
I20260709 13:20:21.001875 25450 raft_consensus.cc:3055] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:21.002367 25450 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:21.003120 25450 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:21.003960 18378 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 11.
I20260709 13:20:21.008929 25520 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:21.009382 25520 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:21.010257 25520 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:21.011441 25520 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:21.015977 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:21.016810 18232 raft_consensus.cc:2410] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:20:21.018361 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:21.019261 18386 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:20:21.020612 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:21.023957 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:20.414067 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:21.024672 18232 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
W20260709 13:20:21.017894 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 457679us
W20260709 13:20:21.027679 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.035794 18926 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:21.004321 25450 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:21.047495 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:21.049108 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:21.054721 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:21.023572 25660 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:21.059293 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.049398 25423 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:21.067471 18386 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:21.051255 25573 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:21.046834 25735 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:21.070426 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:21.046922 25750 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:21.077649 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:21.094051 18383 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:20:21.051209 25670 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:21.073385 25423 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:21.102310 25670 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:21.103113 25750 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:21.058992 25669 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:21.049741 25415 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:21.050076 25748 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:20:21.128597 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:21.129477 18379 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:21.130820 18234 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:21.100091 25390 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.064935 25558 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:20:21.118137 25423 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.126593 25676 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:21.172322 18349 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:20:21.149381 18233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.033s
I20260709 13:20:21.164908 18379 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:21.069444 25660 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:21.177495 18233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.000s	sys 0.033s
I20260709 13:20:21.191797 25750 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:21.191023 25773 raft_consensus.cc:2955] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Committing config change with OpId 21.15: config changed from index 13 to 15, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:21.199133 25660 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:21.201699 25695 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:21.204061 25695 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:21.168677 25762 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.208992 25762 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:21.210345 25670 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:21.211136 25762 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:21.119007 25735 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:21.171876 25748 raft_consensus.cc:3055] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:21.270395 25735 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:21.232112 25676 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:20:21.185817 25402 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:21.278170 25402 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.278667 25402 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:21.133072 25415 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:21.283751 25415 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:21.284083 25748 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:21.284602 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.165388 25390 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:21.314284 18232 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:21.315927 18232 raft_consensus.cc:1275] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:20:21.239596 25660 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
W20260709 13:20:21.235810 25810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.004s	sys 0.048s
W20260709 13:20:21.318131 25810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.004s	sys 0.049s
W20260709 13:20:21.324286 18385 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.024s	sys 0.029s
W20260709 13:20:21.325017 18385 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.025s	sys 0.029s
I20260709 13:20:21.316318 18232 pending_rounds.cc:85] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 9
I20260709 13:20:21.327296 18232 pending_rounds.cc:107] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:20:21.327708 18232 raft_consensus.cc:2889] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:21.337010 18230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.003s	sys 0.018s
W20260709 13:20:21.337440 18230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.003s	sys 0.018s
I20260709 13:20:21.238539 25669 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:20:21.398797 18351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.003s	sys 0.022s
W20260709 13:20:21.399437 18351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.003s	sys 0.022s
W20260709 13:20:21.399833 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 722001us
I20260709 13:20:21.400787 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:21.405555 18925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.004s	sys 0.025s
W20260709 13:20:21.406068 18925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.004s	sys 0.025s
W20260709 13:20:21.427776 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.473897 18232 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:21.482873 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:21.465273 18305 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.012s	sys 0.032s
I20260709 13:20:21.485657 18953 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:21.484817 18305 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.012s	sys 0.033s
W20260709 13:20:21.491923 18310 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.019s	sys 0.033s
W20260709 13:20:21.492623 18310 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.020s	sys 0.033s
W20260709 13:20:21.457222 25712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.001s	sys 0.016s
I20260709 13:20:21.497721 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3948) took 1229 ms. Trace:
I20260709 13:20:21.457121 25520 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:21.462458 25662 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.507946 18305 rpcz_store.cc:276] 0709 13:20:20.267823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.366246 (+ 98423us) service_pool.cc:224] Handling call
0709 13:20:20.366545 (+   299us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:20.369484 (+  2939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.369544 (+    60us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:20.370151 (+   607us) log.cc:844] Serialized 78 byte log entry
0709 13:20:20.625742 (+255591us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:21.495243 (+869501us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.497132 (+  1889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.497268 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.497346 (+    78us) raft_consensus.cc:1685] finished
0709 13:20:21.497383 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.497633 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20173,"prepare.queue_time_us":76367,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":7563,"raft.queue_time_us":2710,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":1981,"thread_start_us":1054541,"threads_started":2,"wal-append.queue_time_us":675221}
I20260709 13:20:21.468247 25415 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:21.497635 25787 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.261s	user 0.008s	sys 0.057s
I20260709 13:20:21.561513 25390 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:21.576303 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 521622us
I20260709 13:20:21.467521 25699 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:21.551514 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:21.482761 25676 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:21.686465 25792 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:21.507864 25712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.002s	sys 0.016s
I20260709 13:20:21.457500 25762 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:20:21.460816 25669 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:21.509995 25695 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:21.794211 18384 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.020s	sys 0.029s
I20260709 13:20:21.565487 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:21.511821 25809 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:21.558627 25425 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.013s	sys 0.012s
W20260709 13:20:21.570966 18382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.035s	sys 0.101s
W20260709 13:20:21.571190 18927 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.004s	sys 0.029s
W20260709 13:20:21.799191 18927 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.004s	sys 0.029s
W20260709 13:20:21.798996 18382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.035s	sys 0.101s
I20260709 13:20:21.459141 25748 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:21.558236 25782 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.008s	sys 0.018s
W20260709 13:20:21.678009 18378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.026s	sys 0.008s
W20260709 13:20:21.814733 18378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.027s	sys 0.013s
W20260709 13:20:21.713052 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.606657 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:21.685173 18237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.016s	sys 0.018s
W20260709 13:20:21.816565 18237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.019s	sys 0.021s
I20260709 13:20:21.701851 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:21.556336 25662 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:21.741740 18276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.001s	sys 0.027s
W20260709 13:20:21.881067 18276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.001s	sys 0.027s
W20260709 13:20:21.881513 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 713496us
W20260709 13:20:21.573078 25559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.024s	sys 0.034s
I20260709 13:20:21.693499 18955 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 23 LEARNER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:20:21.745050 18235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.010s	sys 0.017s
W20260709 13:20:21.883370 18235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.010s	sys 0.023s
W20260709 13:20:21.745594 18236 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.012s	sys 0.016s
W20260709 13:20:21.884192 18236 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.017s	sys 0.017s
W20260709 13:20:21.736884 25694 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.009s	sys 0.028s
W20260709 13:20:21.741123 25787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.512s	user 0.009s	sys 0.057s
W20260709 13:20:21.744544 25423 consensus_meta.cc:287] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.003s
I20260709 13:20:21.485847 25677 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.068s
I20260709 13:20:21.795221 18958 raft_consensus.cc:2393] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:21.794900 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:21.956009 18953 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
W20260709 13:20:21.795644 18384 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.021s	sys 0.029s
W20260709 13:20:21.798605 18377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.019s	sys 0.029s
W20260709 13:20:21.957291 18377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.019s	sys 0.029s
I20260709 13:20:21.736204 25415 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:21.892413 18228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.047s	sys 0.080s
W20260709 13:20:21.960403 18228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.048s	sys 0.080s
W20260709 13:20:21.891645 25559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.025s	sys 0.034s
W20260709 13:20:21.800025 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 1.10397e+06us
I20260709 13:20:21.959129 18200 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:20:21.880084 25821 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 13:20:21.814594 25782 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.008s	sys 0.019s
I20260709 13:20:21.961748 18232 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 22. Current term is 23. Ops: []
W20260709 13:20:21.891785 25694 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.016s	sys 0.028s
I20260709 13:20:21.892596 25804 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.967554 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 3072) took 2004 ms. Trace:
W20260709 13:20:21.971432 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.971587 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:21.789206 25676 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:21.799311 25425 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.013s	sys 0.013s
W20260709 13:20:22.011139 18229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.015s	sys 0.070s
I20260709 13:20:22.000332 25712 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:22.011415 18201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.020s	sys 0.076s
W20260709 13:20:22.078142 18201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.020s	sys 0.084s
I20260709 13:20:21.961061 25423 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:22.052799 25670 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:22.000612 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 118160us
W20260709 13:20:22.053206 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 446670us
I20260709 13:20:22.073137 25804 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.005587 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:21.776270 25699 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:21.959568 25819 log.cc:927] Time spent T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.425s	user 0.001s	sys 0.000s
W20260709 13:20:22.123665 25824 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.565s	user 0.001s	sys 0.000s
I20260709 13:20:21.885706 25825 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.007740 18380 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:21.800954 25809 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.162914 25423 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:22.069015 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:22.165696 25826 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:20:22.167191 18130 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39270 (request call id 223) took 12630 ms (client timeout 15000 ms). Trace:
W20260709 13:20:22.168111 25849 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:20:22.169411 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3182) took 1300 ms. Trace:
I20260709 13:20:22.169787 18236 rpcz_store.cc:276] 0709 13:20:20.869434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.198366 (+328932us) service_pool.cc:224] Handling call
0709 13:20:21.198759 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.199205 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.199242 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.199767 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.884638 (+684871us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:21.884695 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.884793 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.169146 (+284353us) raft_consensus.cc:1685] finished
0709 13:20:22.169172 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.169333 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1207,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":684436,"threads_started":1,"wal-append.queue_time_us":870233}
I20260709 13:20:22.170990 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1197) took 1476 ms. Trace:
I20260709 13:20:22.171922 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:22.171528 18230 rpcz_store.cc:276] 0709 13:20:20.695079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.696833 (+  1754us) service_pool.cc:224] Handling call
0709 13:20:20.704362 (+  7529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.704812 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.704849 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:20.705345 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.337856 (+632511us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:21.337909 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.337992 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.170693 (+832701us) raft_consensus.cc:1685] finished
0709 13:20:22.170726 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.170910 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2491,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":6826,"thread_start_us":632200,"threads_started":1,"wal-append.queue_time_us":1251002}
I20260709 13:20:22.173740 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:22.174146 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:22.174795 18236 raft_consensus.cc:2410] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:20:22.175743 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:22.176322 18236 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:22.177181 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:22.071727 18229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.015s	sys 0.078s
I20260709 13:20:22.179204 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:22.064986 18310 rpcz_store.cc:276] 0709 13:20:19.962930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.346205 (+383275us) service_pool.cc:224] Handling call
0709 13:20:20.346508 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:20.346901 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.346942 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:20.359449 (+ 12507us) log.cc:844] Serialized 52 byte log entry
0709 13:20:20.646925 (+287476us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:21.502936 (+856011us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.504741 (+  1805us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.966794 (+462053us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b180021a240. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa18226b060 00007fa18227d716 00007fa18228e287 00007fa18228e208
0709 13:20:21.967045 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.967152 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.967302 (+   150us) raft_consensus.cc:1685] finished
0709 13:20:21.967322 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.967487 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":466398,"prepare.queue_time_us":410157,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":86,"raft.queue_time_us":456025,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":19344,"spinlock_wait_cycles":13352704,"thread_start_us":1097104,"threads_started":2,"wal-append.queue_time_us":320546}
I20260709 13:20:21.802309 25695 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:21.886246 25801 log.cc:927] Time spent T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:20:22.000643 18231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.127s	user 0.041s	sys 0.055s
W20260709 13:20:22.181541 18231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.308s	user 0.041s	sys 0.065s
W20260709 13:20:22.101595 18351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.029s	sys 0.016s
W20260709 13:20:22.182533 18351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.029s	sys 0.017s
I20260709 13:20:22.072438 25735 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:22.133332 25694 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:22.134907 25847 consensus_queue.cc:1059] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:22.133351 25804 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:22.100322 25828 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.399s	user 0.000s	sys 0.001s
I20260709 13:20:22.071296 25390 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:22.100997 25831 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.423s	user 0.000s	sys 0.001s
I20260709 13:20:21.800248 25792 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.141059 18960 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:22.087728 25712 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:22.233829 18234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.012s	sys 0.020s
W20260709 13:20:22.234180 18234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.012s	sys 0.020s
I20260709 13:20:22.226706 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:22.127256 25670 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:22.167681 18130 rpcz_store.cc:269] 0709 13:20:09.536913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.580244 (+ 43331us) service_pool.cc:224] Handling call
0709 13:20:22.167099 (+12586855us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:17.702351 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:17.703219 (+   868us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:17.703279 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:20:17.703298 (+    19us) tablet.cc:662] Decoding operations
0709 13:20:17.704230 (+   932us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:17.704327 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:17.704355 (+    28us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:20:17.834480 (+130125us) tablet.cc:701] Row locks acquired
0709 13:20:17.843460 (+  8980us) write_op.cc:260] PREPARE: finished
0709 13:20:17.850104 (+  6644us) write_op.cc:270] Start()
0709 13:20:17.850293 (+   189us) write_op.cc:276] Timestamp: P: 1783603217850006 usec, L: 0
0709 13:20:17.850343 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 13:20:17.853211 (+  2868us) log.cc:844] Serialized 3267 byte log entry
0709 13:20:18.494411 (+641200us) op_driver.cc:464] REPLICATION: finished
0709 13:20:18.870984 (+376573us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa17f1690ac 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa185ca9ef0
0709 13:20:19.390978 (+519994us) write_op.cc:301] APPLY: starting
0709 13:20:19.403307 (+ 12329us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:19.745256 (+341949us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:19.953806 (+208550us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:20.058441 (+104635us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:20.058785 (+   344us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 13:20:20.058876 (+    91us) write_op.cc:312] APPLY: finished
0709 13:20:20.059315 (+   439us) log.cc:844] Serialized 81 byte log entry
0709 13:20:20.122315 (+ 63000us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:20.122514 (+   199us) write_op.cc:454] Released schema lock
0709 13:20:20.122603 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:20.123170 (+   567us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:20.123212 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":29617,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":829386,"apply.run_cpu_time_us":31580,"apply.run_wall_time_us":747659,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37503,"num_ops":8,"prepare.queue_time_us":328177,"prepare.run_cpu_time_us":48498,"prepare.run_wall_time_us":244361,"raft.queue_time_us":190531,"raft.run_cpu_time_us":52355,"raft.run_wall_time_us":890267,"replication_time_us":592698,"spinlock_wait_cycles":36189312,"thread_start_us":1285120,"threads_started":5,"wal-append.queue_time_us":274707,"wal-append.run_cpu_time_us":40492,"wal-append.run_wall_time_us":2582845}]]}
I20260709 13:20:22.239708 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:20:22.240072 18349 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.000s	sys 0.017s
I20260709 13:20:22.183645 25677 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:20:22.240578 18349 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.001s	sys 0.017s
I20260709 13:20:22.184804 25676 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:22.253873 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 1545) took 1479 ms. Trace:
I20260709 13:20:22.255330 18385 rpcz_store.cc:276] 0709 13:20:20.774838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.776459 (+  1621us) service_pool.cc:224] Handling call
0709 13:20:20.776800 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.777106 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.777131 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:20.777595 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.325995 (+548400us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:21.326115 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.326204 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.253623 (+927419us) raft_consensus.cc:1685] finished
0709 13:20:22.253654 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.253803 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34280,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":547586,"threads_started":1,"wal-append.queue_time_us":790771}
I20260709 13:20:22.212738 25817 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:22.216336 25843 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:22.250382 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.250809 18962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54020 (request call id 605) took 1652 ms. Trace:
I20260709 13:20:22.229130 25695 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:22.262633 25844 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:22.273205 25844 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:22.275728 25844 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:22.276459 25845 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.276999 25845 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:22.278764 25773 consensus_meta.cc:287] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.086s	user 0.012s	sys 0.000s
I20260709 13:20:22.279029 25845 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:22.159070 25825 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.261811 18962 rpcz_store.cc:276] 0709 13:20:20.598137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.598334 (+   197us) service_pool.cc:224] Handling call
0709 13:20:20.598735 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.599187 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.599228 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:20.600083 (+   855us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.048262 (+448179us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:21.048304 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.048374 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.250608 (+1202234us) raft_consensus.cc:1685] finished
0709 13:20:22.250630 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.250751 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1190,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":18720,"thread_start_us":395730,"threads_started":1,"wal-append.queue_time_us":846087}
I20260709 13:20:22.227607 25669 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:22.244059 25847 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:22.282711 25817 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.258553 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:22.227327 25390 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:22.238333 25735 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
W20260709 13:20:22.267917 25832 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:20:22.249032 25809 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:22.357585 25840 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:20:22.358263 25762 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:22.239959 25839 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
W20260709 13:20:22.298125 25846 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:20:22.252764 25677 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:22.297441 25662 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:22.287125 25847 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:22.266881 25843 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:22.303025 25415 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:22.374889 25809 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:22.376328 25423 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.408344 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:22.409795 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:22.394565 25592 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.397833 25843 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:22.445145 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4271) took 1410 ms. Trace:
I20260709 13:20:22.446579 25712 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:22.447424 25670 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:22.417029 25423 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:22.448964 25792 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:22.469810 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:22.453083 25836 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:20:22.454541 25825 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:22.455216 25847 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.458444 25817 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:22.411283 25809 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:22.460259 25390 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:22.441777 25676 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.504411 25676 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.507236 25676 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:22.465480 18378 rpcz_store.cc:276] 0709 13:20:21.035081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.035204 (+   123us) service_pool.cc:224] Handling call
0709 13:20:21.035543 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.036025 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.036063 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.055119 (+ 19056us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.815299 (+760180us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:21.815357 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.815454 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.444897 (+629443us) raft_consensus.cc:1685] finished
0709 13:20:22.444927 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.445078 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5926,"raft.queue_time_us":100,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4110,"thread_start_us":714483,"threads_started":1,"wal-append.queue_time_us":1088658}
W20260709 13:20:22.403053 25520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.014s	sys 0.014s
I20260709 13:20:22.449595 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3179) took 1583 ms. Trace:
I20260709 13:20:22.509217 18235 rpcz_store.cc:276] 0709 13:20:20.866032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.944073 (+ 78041us) service_pool.cc:224] Handling call
0709 13:20:20.954262 (+ 10189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.954617 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.954644 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.073703 (+119059us) spinlock_profiling.cc:243] Waited 91.1 ms on lock 0x7b2c000014c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:20:21.099947 (+ 26244us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.883848 (+783901us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:22.243935 (+360087us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.257815 (+ 13880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.257894 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.443423 (+185529us) raft_consensus.cc:1685] finished
0709 13:20:22.449381 (+  5958us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.449528 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89228,"raft.queue_time_us":35928,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":214,"spinlock_wait_cycles":209444608,"thread_start_us":975914,"threads_started":2,"wal-append.queue_time_us":967448}
I20260709 13:20:22.512190 18235 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:22.513350 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 3066) took 1034 ms. Trace:
I20260709 13:20:22.513808 18235 rpcz_store.cc:276] 0709 13:20:21.478437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.511520 (+1033083us) service_pool.cc:224] Handling call
0709 13:20:22.511945 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.513046 (+  1101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.513279 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.515343 18235 raft_consensus.cc:3055] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:22.515762 18235 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:22.516767 18235 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.518167 18235 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:22.524664 25520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.014s	sys 0.014s
I20260709 13:20:22.525163 25520 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:22.526511 25520 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.531075 18955 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:22.541949 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3181) took 1672 ms. Trace:
I20260709 13:20:22.551335 18228 rpcz_store.cc:276] 0709 13:20:20.869213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.104175 (+234962us) service_pool.cc:224] Handling call
0709 13:20:21.104591 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.119852 (+ 15261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.119900 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.125824 (+  5924us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.960791 (+834967us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:22.502070 (+541279us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.541508 (+ 39438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.541617 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.541672 (+    55us) raft_consensus.cc:1685] finished
0709 13:20:22.541690 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.541874 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95908,"raft.queue_time_us":29699,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":20360,"thread_start_us":1265990,"threads_started":2,"wal-append.queue_time_us":1006650}
I20260709 13:20:22.554225 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:22.551230 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 421423us
W20260709 13:20:22.556716 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 457570us
I20260709 13:20:22.557477 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:22.500129 18379 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:22.474539 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:22.559238 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:22.566191 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.444018 25851 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.132s
I20260709 13:20:22.532073 25809 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:22.529655 25699 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:22.497640 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3177) took 1590 ms. Trace:
I20260709 13:20:22.503036 25750 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:22.465292 25592 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:22.540650 25792 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:22.584160 18237 rpcz_store.cc:276] 0709 13:20:20.855342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.920089 (+ 64747us) service_pool.cc:224] Handling call
0709 13:20:20.920420 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.920831 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.920863 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.058618 (+137755us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b2c000014c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:20:21.060597 (+  1979us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.817034 (+756437us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:22.369880 (+552846us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.415819 (+ 45939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.415912 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.415962 (+    50us) raft_consensus.cc:1685] finished
0709 13:20:22.445731 (+ 29769us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.445884 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":742138,"raft.queue_time_us":658,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":28289,"spinlock_wait_cycles":287537536,"thread_start_us":1126465,"threads_started":2,"wal-append.queue_time_us":1128075}
I20260709 13:20:22.587190 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:22.596567 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4254) took 1761 ms. Trace:
W20260709 13:20:22.596824 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.597631 18200 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:22.597018 18384 rpcz_store.cc:276] 0709 13:20:20.834839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.835435 (+   596us) service_pool.cc:224] Handling call
0709 13:20:20.862381 (+ 26946us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.862775 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.862818 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:20.870336 (+  7518us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.957333 (+1086997us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:21.957389 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.957479 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.596275 (+638796us) raft_consensus.cc:1685] finished
0709 13:20:22.596305 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.596486 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"thread_start_us":1051775,"threads_started":1,"wal-append.queue_time_us":1340239}
W20260709 13:20:22.595676 18203 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.007s	sys 0.008s
I20260709 13:20:22.563402 25847 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:22.558974 25845 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:22.610083 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54063.3us
I20260709 13:20:22.595340 25415 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.617697 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:22.599287 25185 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:22.589323 25402 consensus_meta.cc:287] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 1.303s	user 0.011s	sys 0.004s
I20260709 13:20:22.608762 25857 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:20:22.611840 18203 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.007s	sys 0.008s
I20260709 13:20:22.600334 25851 consensus_queue.cc:1243] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer e016302b7e734d74833a2bf7bab44838 log is divergent from this leader: its last log entry 13.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:22.600081 25390 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:22.604591 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:22.607637 25728 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:22.606974 25708 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.614207 25844 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:22.616873 25695 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:20:22.609143 25699 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:20:22.599707 25750 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:22.597862 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:22.628024 25792 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:20:22.660360 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 62625.8us
I20260709 13:20:22.661373 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:22.621505 25845 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.643234 25390 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.629262 25415 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.631712 25402 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:22.637933 25853 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:22.658299 25728 raft_consensus.cc:697] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:22.653861 25712 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:22.632912 25185 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:22.676959 18202 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.770s (SENT) [suppressed 11 similar messages]
I20260709 13:20:22.636620 25857 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:22.676328 25390 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:22.658437 18927 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.004s	sys 0.020s
I20260709 13:20:22.661708 25677 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:22.687839 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 383843us
W20260709 13:20:22.708555 18927 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.004s	sys 0.021s
I20260709 13:20:22.693398 25845 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:22.669737 25844 consensus_queue.cc:1059] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:20:22.658466 25676 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:20:22.656416 25708 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:22.710199 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 574001us
I20260709 13:20:22.688709 25762 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:22.719029 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:22.719306 25402 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:22.706090 25670 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:22.721410 25868 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:22.722779 25415 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:22.724457 25792 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.698772 25853 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.727945 25185 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:22.697942 25712 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.656582 18235 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:20:22.728535 18954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53364 (request call id 726) took 1257 ms. Trace:
I20260709 13:20:22.715026 25423 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:20:22.732049 18927 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:22.732935 25879 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:22.733129 25859 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:20:22.733482 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.733579 25592 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:22.769104 25592 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:22.736194 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3174) took 1921 ms. Trace:
I20260709 13:20:22.772207 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 3058) took 1298 ms. Trace:
I20260709 13:20:22.771405 18231 rpcz_store.cc:276] 0709 13:20:20.815214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.868497 (+ 53283us) service_pool.cc:224] Handling call
0709 13:20:20.869275 (+   778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.869472 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.869495 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:20.872803 (+  3308us) log.cc:844] Serialized 26 byte log entry
0709 13:20:22.181973 (+1309170us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:22.665206 (+483233us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.735819 (+ 70613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.735913 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.735964 (+    51us) raft_consensus.cc:1685] finished
0709 13:20:22.735978 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.736124 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29638,"prepare.queue_time_us":473194,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":2793,"thread_start_us":1841244,"threads_started":3,"wal-append.queue_time_us":1495398}
I20260709 13:20:22.772581 18232 rpcz_store.cc:276] 0709 13:20:21.474075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.474924 (+   849us) service_pool.cc:224] Handling call
0709 13:20:21.475283 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.058957 (+583674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.771952 (+712995us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b5400059e54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:22.772147 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1116748032}
W20260709 13:20:22.669433 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 410963us
I20260709 13:20:22.774031 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:22.721050 25857 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:22.743474 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:22.750134 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:22.733393 25750 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:22.758311 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 97026.2us
I20260709 13:20:22.780001 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:22.761771 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 262521us
I20260709 13:20:22.763209 18235 pending_rounds.cc:85] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 11
I20260709 13:20:22.780928 25868 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:22.757313 25662 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.766079 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3178) took 1902 ms. Trace:
I20260709 13:20:22.780959 18235 pending_rounds.cc:107] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:20:22.791641 25670 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:22.793677 18235 raft_consensus.cc:2889] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:22.785674 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:22.763307 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 145732us
I20260709 13:20:22.788661 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:22.755002 25862 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:22.760442 25712 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:22.801637 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:22.791178 18229 rpcz_store.cc:276] 0709 13:20:20.861816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.922908 (+ 61092us) service_pool.cc:224] Handling call
0709 13:20:20.923221 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:20.935018 (+ 11797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.935054 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:21.281692 (+346638us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b2c000014c8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:20:21.282343 (+   651us) log.cc:844] Serialized 52 byte log entry
0709 13:20:22.178578 (+896235us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:22.606599 (+428021us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.613862 (+  7263us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.754071 (+140209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.754187 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.754399 (+   212us) raft_consensus.cc:1685] finished
0709 13:20:22.754417 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.754562 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66212,"prepare.queue_time_us":527117,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":228450,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":19003,"spinlock_wait_cycles":254868224,"thread_start_us":1463215,"threads_started":3,"wal-append.queue_time_us":1076442}
I20260709 13:20:22.797734 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 3067) took 1319 ms. Trace:
I20260709 13:20:22.799329 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:22.774678 25879 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.782848 25844 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.799988 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:22.779692 25728 consensus_queue.cc:237] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.800583 18379 raft_consensus.cc:2410] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:20:22.798462 25852 log.cc:927] Time spent T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:20:22.825083 18235 rpcz_store.cc:276] 0709 13:20:21.478756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.514779 (+1036023us) service_pool.cc:224] Handling call
0709 13:20:22.515102 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.794893 (+279791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.797677 (+  2784us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:22.806386 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:22.826005 18305 raft_consensus.cc:2410] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:20:22.825641 18958 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:22.816710 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:22.851989 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 45713.1us
I20260709 13:20:22.817101 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:22.811463 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:22.803718 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:22.801162 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 124174us
I20260709 13:20:22.807945 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:22.857543 18960 raft_consensus.cc:2393] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:22.859261 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:22.861091 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 60174us
I20260709 13:20:22.814600 25708 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:22.818428 25402 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:22.802150 25677 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:22.806985 25851 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:22.807497 25573 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:22.795377 25662 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.887959 25402 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:22.895175 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:22.763609 18954 rpcz_store.cc:276] 0709 13:20:21.471137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.471263 (+   126us) service_pool.cc:224] Handling call
0709 13:20:21.550269 (+ 79006us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.571250 (+ 20981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.572926 (+  1676us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.960651 (+387725us) log.cc:844] Serialized 26 byte log entry
0709 13:20:22.583136 (+622485us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:20:22.588837 (+  5701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.607353 (+ 18516us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:22.728296 (+120943us) raft_consensus.cc:1685] finished
0709 13:20:22.728321 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.728453 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25615,"raft.queue_time_us":2064,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":3593,"thread_start_us":488199,"threads_started":1,"wal-append.queue_time_us":748919}
I20260709 13:20:22.897897 25879 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:22.891582 18955 raft_consensus.cc:2955] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 13 to 15, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:22.865583 25817 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:22.923172 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:22.923307 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:22.923995 18309 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:22.865880 25670 consensus_queue.cc:1048] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:20:22.914700 25520 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:20:22.930405 25830 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 1.117s	user 0.005s	sys 0.000s
I20260709 13:20:22.910954 25843 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:22.807927 25853 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:22.934393 25843 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:22.936846 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:22.937546 18305 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:22.938199 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:22.860844 25699 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:20:22.851207 25844 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:22.942535 18201 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:22.809026 25862 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:22.944636 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.911800 25402 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:22.943617 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 84418.9us
I20260709 13:20:22.807914 25762 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:22.949998 18958 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:22.950253 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:22.954329 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:22.951829 18201 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:22.935000 25843 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.915750 25892 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:22.961105 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:22.932878 25887 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:22.971089 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:22.963974 18310 raft_consensus.cc:2410] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:20:22.971906 18308 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:22.941943 25695 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.965808 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:22.960705 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:23.000254 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.948027 25185 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.892897 25677 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:23.003479 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.003688 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:23.004398 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.961963 25750 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:22.953568 25890 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.012913 18311 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:23.015753 18308 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:23.021283 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:23.022109 18308 raft_consensus.cc:2393] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 21: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:23.018136 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:20:23.014195 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 48831.6us
W20260709 13:20:23.026800 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.029620 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:22.973179 25817 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:23.031625 18304 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:23.025863 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:22.970468 25891 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:23.038079 18311 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:23.032224 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:23.048619 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:23.007539 25415 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.050750 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:23.058715 18927 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:22.971781 25843 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.026605 25880 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:23.026436 25520 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:23.068432 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:23.083088 18235 raft_consensus.cc:2410] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:20:23.042163 25879 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:22.975250 25892 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:23.047854 25856 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:23.019018 25185 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.011683 25695 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.036448 25853 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:20:22.995780 25887 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.041837 25792 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.081s
I20260709 13:20:23.098922 25783 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:23.123183 25611 raft_consensus.cc:1064] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:20:23.122051 25423 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.127588 25851 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:23.146111 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 87472.8us
I20260709 13:20:23.060699 18311 raft_consensus.cc:2955] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 13 to 15, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:23.123451 25856 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:23.064456 25415 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.030158 25890 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.160408 25423 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:23.104444 25885 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:23.161741 25885 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:23.162701 25423 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:23.163825 25885 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:23.149278 25865 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:20:23.114177 25809 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:23.159703 25888 log.cc:927] Time spent T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:20:23.159970 25856 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:23.165340 25896 log.cc:927] Time spent T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:20:23.166147 25809 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:23.140375 25879 raft_consensus.cc:697] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:23.167300 25879 consensus_queue.cc:237] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.165360 18958 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:20:23.173219 25856 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.173797 25712 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.175527 25856 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:23.176043 25712 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:23.177630 25677 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:23.162074 25520 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:23.154245 25902 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:20:23.133329 25881 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:20:23.191470 25390 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.178001 25851 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.192911 25662 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:23.193778 25390 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:23.194149 25851 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:23.179854 25520 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:23.195459 25520 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.196678 25520 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:23.191903 25892 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:23.201617 18307 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
I20260709 13:20:23.221457 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:23.222307 18961 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:23.222750 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:23.222354 18229 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 25.
I20260709 13:20:23.229200 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:23.229926 18229 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:23.230896 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:23.234740 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:23.235366 18232 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:23.234948 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:23.236707 18231 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:23.238291 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:23.239014 18231 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 24.
I20260709 13:20:23.239140 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:23.239969 18235 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
I20260709 13:20:23.241009 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:23.241657 18235 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:23.232144 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:23.243548 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:23.244350 18232 raft_consensus.cc:2410] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:20:23.244957 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:23.251142 18956 raft_consensus.cc:1240] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:23.233590 25712 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.253180 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:23.252946 25712 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.254281 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:23.255708 25712 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:23.257993 25669 raft_consensus.cc:3055] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:23.258509 25669 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:23.259562 25669 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.262324 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:23.263150 18231 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:23.268637 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:23.271991 18277 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:23.273065 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:23.277637 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:23.280292 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:23.294283 18277 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:23.314433 18307 raft_consensus.cc:2393] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 21: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:23.322991 18231 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:23.315064 18235 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 24.
W20260709 13:20:23.339201 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.284169 25402 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.341831 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:23.342438 18235 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:23.343806 25402 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:23.349506 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:23.350999 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:23.326359 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:23.279712 25712 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.353868 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:23.379206 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:23.288442 25810 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:23.288496 25670 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:23.316663 25669 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.319109 25844 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:23.400004 25390 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:23.435725 25390 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.436260 25390 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:23.437503 25842 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 1.209s	user 0.007s	sys 0.001s
I20260709 13:20:23.439792 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4266) took 2521 ms. Trace:
I20260709 13:20:23.440270 18377 rpcz_store.cc:276] 0709 13:20:20.918437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.941744 (+ 23307us) service_pool.cc:224] Handling call
0709 13:20:20.942074 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.942648 (+   574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.942676 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:20.943155 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.957750 (+1014595us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:22.376273 (+418523us) log.cc:844] Serialized 14 byte log entry
0709 13:20:22.394068 (+ 17795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.394341 (+   273us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.376146 (+981805us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:23.439398 (+ 63252us) raft_consensus.cc:1685] finished
0709 13:20:23.439518 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.439696 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":631037,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1723,"raft.queue_time_us":164018,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":16308,"spinlock_wait_cycles":14822784,"thread_start_us":1425383,"threads_started":2,"wal-append.queue_time_us":1195444}
I20260709 13:20:23.391988 25670 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.442777 25670 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:23.403092 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:23.446164 18954 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
W20260709 13:20:23.447407 25847 consensus_meta.cc:287] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.828s	user 0.010s	sys 0.013s
I20260709 13:20:23.399356 25810 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.463424 25810 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:23.448459 25699 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:23.464998 25699 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.465364 25699 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:23.466164 25847 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:23.466727 25847 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 24 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:23.471222 25390 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.476958 25670 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.483196 25862 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:23.468333 25847 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.490511 25669 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:23.390287 25712 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:23.495472 25185 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:23.499091 25390 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:23.557264 18307 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 23: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:20:23.563410 18309 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.015s	sys 0.033s
I20260709 13:20:23.550436 25712 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:23.556595 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:23.565033 18309 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.015s	sys 0.033s
I20260709 13:20:23.531442 25891 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:23.530639 25669 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.575376 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:23.576656 18957 raft_consensus.cc:2410] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 25 because replica has last-logged OpId of term: 24 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
W20260709 13:20:23.524678 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:23.589115 18306 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.010s	sys 0.026s
W20260709 13:20:23.591475 18306 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.010s	sys 0.026s
I20260709 13:20:23.581985 25669 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:23.583827 25814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.013s	sys 0.022s
W20260709 13:20:23.586737 25660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.040s	sys 0.058s
I20260709 13:20:23.593046 25889 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:23.592756 25862 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:23.599413 25862 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:23.601070 25390 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:23.601670 25390 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:23.602034 25862 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:23.603967 25390 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:23.584477 25699 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.606369 25699 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:23.606881 25699 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.607120 25901 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.607611 25901 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.610145 25901 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:23.611085 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.611929 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:23.613370 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:23.616071 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:23.616780 18385 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 24.
I20260709 13:20:23.607317 25699 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:23.612116 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.624899 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:23.629902 18380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4272) took 2594 ms. Trace:
I20260709 13:20:23.630007 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:23.630338 18380 rpcz_store.cc:276] 0709 13:20:21.065703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.065878 (+   175us) service_pool.cc:224] Handling call
0709 13:20:21.069909 (+  4031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.144218 (+1074309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.629689 (+1485471us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b540004c4d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:23.629850 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2156139392}
I20260709 13:20:23.630755 18381 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:23.631669 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:23.632642 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:23.633340 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.634003 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:23.635288 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:23.636924 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:23.637645 18384 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 25: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:23.638590 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:23.639173 18377 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:23.633297 18383 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:23.639986 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:23.612890 25814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.013s	sys 0.022s
I20260709 13:20:23.640112 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:23.640623 18312 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:23.612747 25660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.040s	sys 0.058s
I20260709 13:20:23.644053 18379 raft_consensus.cc:2410] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:20:23.626675 25390 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:23.641424 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:23.646780 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:23.637918 25669 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.650796 25887 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:23.651229 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:23.654906 25899 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.592s	user 0.000s	sys 0.006s
I20260709 13:20:23.626370 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:23.688720 18312 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:23.689175 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:23.594899 25891 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.690848 25887 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:23.694480 25415 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:23.690482 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64236us
I20260709 13:20:23.697518 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:23.687489 25670 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:23.698726 25854 raft_consensus.cc:3055] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:23.699020 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:23.704741 18304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.015s	sys 0.010s
W20260709 13:20:23.705113 18304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.015s	sys 0.010s
I20260709 13:20:23.707485 18200 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:23.699187 25854 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:23.710071 18200 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:23.712256 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:23.713578 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:23.714175 18312 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:23.720300 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:23.720952 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:23.721683 18383 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:23.726627 18377 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:23.728121 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:23.743649 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:23.743741 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:23.722857 25887 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:23.746419 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:23.749346 18306 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:23.752619 18351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.015s	sys 0.032s
W20260709 13:20:23.754860 18351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.015s	sys 0.032s
I20260709 13:20:23.711290 25415 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:23.663244 25390 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.747428 25185 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:23.710952 25723 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:23.758314 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:23.747534 25862 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.741611 25719 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:23.766098 18927 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:23.744465 25870 raft_consensus.cc:3055] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:23.722746 25814 consensus_queue.cc:1059] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.045s
W20260709 13:20:23.778298 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 727325us
I20260709 13:20:23.771502 25862 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.784780 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:23.786846 25862 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:23.787021 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:23.769024 25719 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.787920 25719 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:23.787961 18377 raft_consensus.cc:2410] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:20:23.769363 25185 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:23.793457 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:23.793779 25185 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:23.765136 25887 raft_consensus.cc:697] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:23.798619 25887 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:23.799947 25807 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:23.782943 25820 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 1.803s	user 0.007s	sys 0.009s
I20260709 13:20:23.770062 25854 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:23.802044 25854 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:23.802309 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1193) took 3288 ms. Trace:
I20260709 13:20:23.803475 18233 rpcz_store.cc:276] 0709 13:20:20.514219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.514335 (+   116us) service_pool.cc:224] Handling call
0709 13:20:20.514592 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.600149 (+ 85557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.600205 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:20.600680 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.183494 (+582814us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:21.183553 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.187841 (+  4288us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.695298 (+2507457us) spinlock_profiling.cc:243] Waited 98.8 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:23.801969 (+106671us) raft_consensus.cc:1685] finished
0709 13:20:23.801999 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.802223 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62228,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":7014,"spinlock_wait_cycles":227256064,"thread_start_us":619382,"threads_started":2,"wal-append.queue_time_us":1049197}
I20260709 13:20:23.755568 25810 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:20:23.769289 25844 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:23.815338 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:23.812077 18276 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:23.816006 18384 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:20:23.772099 18383 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 25.
W20260709 13:20:23.819199 18311 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.011s	sys 0.031s
W20260709 13:20:23.819782 18311 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.012s	sys 0.031s
I20260709 13:20:23.782644 25423 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:23.824465 18276 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:23.783425 25870 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:23.851656 18349 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:20:23.868268 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 43906.8us
I20260709 13:20:23.869015 18276 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:20:23.873687 18229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.009s	sys 0.026s
W20260709 13:20:23.874416 18229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.010s	sys 0.027s
I20260709 13:20:23.874572 18312 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:23.847200 18306 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:23.878660 18276 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:23.884876 18232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.011s	sys 0.031s
W20260709 13:20:23.886092 18232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.011s	sys 0.032s
I20260709 13:20:23.832891 25868 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:23.902030 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:23.903291 18306 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 21: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:23.904065 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:23.907239 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:23.910010 18311 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:23.907385 18203 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.044s	sys 0.033s
W20260709 13:20:23.911923 18203 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.045s	sys 0.033s
I20260709 13:20:23.918071 18384 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
W20260709 13:20:23.920110 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.905519 18276 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:23.873652 25559 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:23.873534 25879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.000s	sys 0.035s
I20260709 13:20:23.873172 25889 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:23.895375 25762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.009s	sys 0.032s
I20260709 13:20:23.927127 18955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54004 (request call id 708) took 1313 ms. Trace:
I20260709 13:20:23.928035 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:23.925830 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:23.940924 18276 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:23.901317 25670 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:23.937764 18955 rpcz_store.cc:276] 0709 13:20:22.613909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.614068 (+   159us) service_pool.cc:224] Handling call
0709 13:20:22.625567 (+ 11499us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:22.729703 (+104136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.729782 (+    79us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:22.765974 (+ 36192us) log.cc:844] Serialized 598 byte log entry
0709 13:20:22.891437 (+125463us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:22.955789 (+ 64352us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.041251 (+ 85462us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.044708 (+  3457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.044788 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.654042 (+609254us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:23.926855 (+272813us) raft_consensus.cc:1685] finished
0709 13:20:23.926886 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.927057 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53917,"prepare.queue_time_us":23711,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":7611,"raft.queue_time_us":165076,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":20365,"spinlock_wait_cycles":80442624,"thread_start_us":161605,"threads_started":2,"wal-append.queue_time_us":186065}
I20260709 13:20:23.944098 18306 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:23.926191 25423 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:20:23.962632 18277 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.005s	sys 0.031s
I20260709 13:20:23.926719 25901 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:23.972232 18231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.016s	sys 0.024s
W20260709 13:20:23.967386 18277 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.005s	sys 0.031s
W20260709 13:20:23.973366 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 594233us
I20260709 13:20:23.929929 25699 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:23.928992 25879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.000s	sys 0.036s
W20260709 13:20:23.971843 18303 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.004s	sys 0.036s
W20260709 13:20:23.986568 18303 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.024s	user 0.004s	sys 0.036s
W20260709 13:20:23.979750 18231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.017s	sys 0.024s
W20260709 13:20:23.960637 25762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.009s	sys 0.033s
W20260709 13:20:23.945237 25583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.015s	sys 0.024s
I20260709 13:20:23.932037 25890 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:23.943537 25670 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:23.966974 25889 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:23.970037 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:24.009636 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.009943 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.016706 25583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.015s	sys 0.025s
W20260709 13:20:24.019276 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 49370.5us
W20260709 13:20:24.003674 25441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.005s	sys 0.026s
I20260709 13:20:24.024940 25441 raft_consensus.cc:3055] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:24.025358 25441 raft_consensus.cc:740] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:23.929430 25870 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.026194 25441 consensus_queue.cc:260] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:23.999073 18312 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:24.029991 25748 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:24.029862 25441 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.034358 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.035123 18381 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:24.014963 25829 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:24.058719 25889 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:24.013921 25559 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:24.064946 18311 raft_consensus.cc:2410] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:20:24.013942 25902 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:24.019416 25670 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:24.079810 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:23.980890 25423 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:24.007488 25914 raft_consensus.cc:2804] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:24.100622 18377 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:24.055655 25901 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:24.066877 25390 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:24.115366 18381 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 21: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:24.126856 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.128829 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.135586 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.138772 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.141884 18383 raft_consensus.cc:2393] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 23: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:24.145035 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.149273 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.161692 18383 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 25.
W20260709 13:20:24.159989 18309 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.014s	sys 0.031s
W20260709 13:20:24.164906 18309 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.014s	sys 0.032s
I20260709 13:20:24.117306 25914 raft_consensus.cc:697] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 25 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:24.103266 25902 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.166126 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.141156 25901 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:20:24.164352 25845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.068s	user 0.010s	sys 0.030s
I20260709 13:20:24.173866 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3953) took 1238 ms. Trace:
I20260709 13:20:24.249992 18309 rpcz_store.cc:276] 0709 13:20:22.935814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.935922 (+   108us) service_pool.cc:224] Handling call
0709 13:20:22.937282 (+  1360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.937467 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:20:23.566610 (+629143us) log.cc:844] Serialized 14 byte log entry
0709 13:20:24.173141 (+606531us) log.cc:844] Serialized 14 byte log entry
0709 13:20:24.173320 (+   179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:24.173377 (+    57us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:24.173441 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.173631 (+   190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.173780 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8275,"prepare.queue_time_us":710308,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":80,"thread_start_us":1219436,"threads_started":2}
I20260709 13:20:24.170717 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.252885 18383 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:24.254117 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.254863 18383 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
W20260709 13:20:24.197628 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.249857 25845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.168s	user 0.011s	sys 0.030s
W20260709 13:20:24.169680 25909 log.cc:927] Time spent T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.193s	user 0.001s	sys 0.001s
I20260709 13:20:24.174844 25573 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:24.175030 25390 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:24.276782 25926 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:20:24.278343 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3203) took 1050 ms. Trace:
W20260709 13:20:24.278661 25925 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:20:24.280548 25923 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:20:24.278889 18232 rpcz_store.cc:276] 0709 13:20:23.227463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.295061 (+ 67598us) service_pool.cc:224] Handling call
0709 13:20:23.304929 (+  9868us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.318316 (+ 13387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.318353 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.318860 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.887246 (+568386us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:23.887900 (+   654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.888459 (+   559us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.277985 (+389526us) raft_consensus.cc:1685] finished
0709 13:20:24.278016 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.278263 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12883,"raft.queue_time_us":97784,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":25580,"thread_start_us":537992,"threads_started":1,"wal-append.queue_time_us":701952}
W20260709 13:20:24.282799 25924 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:20:24.297115 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3202) took 1069 ms. Trace:
I20260709 13:20:24.297629 18229 rpcz_store.cc:276] 0709 13:20:23.227184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.243667 (+ 16483us) service_pool.cc:224] Handling call
0709 13:20:23.244166 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.269649 (+ 25483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.269685 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.270309 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.874839 (+604530us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:23.922659 (+ 47820us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.923154 (+   495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.923276 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.296775 (+373499us) raft_consensus.cc:1685] finished
0709 13:20:24.296817 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.297026 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24978,"prepare.queue_time_us":29020,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":72902,"raft.run_cpu_time_us":375,"raft.run_wall_time_us":74181,"thread_start_us":604177,"threads_started":1,"wal-append.queue_time_us":785596}
I20260709 13:20:24.300294 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3204) took 1072 ms. Trace:
I20260709 13:20:24.303471 18235 rpcz_store.cc:276] 0709 13:20:23.227729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.343052 (+115323us) service_pool.cc:224] Handling call
0709 13:20:23.343339 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.343636 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.343664 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.344181 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.817845 (+473664us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:23.817951 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.818090 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.300005 (+481915us) raft_consensus.cc:1685] finished
0709 13:20:24.300036 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.300222 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8806,"raft.queue_time_us":83955,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":27669,"thread_start_us":473038,"threads_started":1,"wal-append.queue_time_us":735737}
W20260709 13:20:24.307101 18305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.013s	sys 0.013s
I20260709 13:20:24.309145 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:24.214241 18230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.017s	sys 0.018s
W20260709 13:20:24.311091 18230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.017s	sys 0.018s
W20260709 13:20:24.312131 18386 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.025s	sys 0.036s
I20260709 13:20:24.272275 25868 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:24.319121 18308 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.008s	sys 0.034s
W20260709 13:20:24.315539 18378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.005s	sys 0.025s
W20260709 13:20:24.322160 18386 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.027s	sys 0.037s
W20260709 13:20:24.336884 18308 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.008s	sys 0.034s
I20260709 13:20:24.329820 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.167053 25889 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:24.336746 18378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.005s	sys 0.025s
I20260709 13:20:24.342955 25423 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:24.349093 25927 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:20:24.352782 25878 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.353609 25878 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.249011 25559 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:24.357697 25902 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:24.313683 25914 consensus_queue.cc:237] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:24.363818 25719 consensus_meta.cc:287] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.575s	user 0.005s	sys 0.004s
I20260709 13:20:24.301923 25390 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.366942 25390 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:24.371057 18201 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:24.373751 25913 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:24.341109 25901 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.376581 25884 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.377337 25884 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.373200 18201 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:24.380261 18383 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:24.381565 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:24.383416 18201 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:24.391011 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.382047 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.398831 18383 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:24.400115 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.401417 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.404816 18236 raft_consensus.cc:2410] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:20:24.318291 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 3059) took 2843 ms. Trace:
W20260709 13:20:24.310142 18305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.013s	sys 0.013s
I20260709 13:20:24.405149 18201 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:24.418869 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:24.406756 18230 rpcz_store.cc:276] 0709 13:20:21.474631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.180820 (+706189us) service_pool.cc:224] Handling call
0709 13:20:22.181237 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.181479 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:23.587449 (+1405970us) spinlock_profiling.cc:243] Waited 7.53 ms on lock 0x7b180047c6e0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181e1b4bc 00007fa17f16948b 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f183455 00007fa185c6b3c7 00007fa18227d9a7 00007fa18228d0bf
0709 13:20:23.590045 (+  2596us) log.cc:844] Serialized 14 byte log entry
0709 13:20:24.311755 (+721710us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:24.311848 (+    93us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:24.311914 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.312981 (+  1067us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.318214 (+  5233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":309,"prepare.queue_time_us":452258,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":111,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":21414,"spinlock_wait_cycles":17310080,"thread_start_us":1186993,"threads_started":2}
W20260709 13:20:24.424654 18304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.047s	sys 0.063s
W20260709 13:20:24.425303 18304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.048s	sys 0.063s
W20260709 13:20:24.382265 25867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.303s	user 0.034s	sys 0.009s
I20260709 13:20:24.364248 25719 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:24.373783 25807 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.003s
I20260709 13:20:24.427528 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.307124 25929 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:20:24.452662 18383 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
W20260709 13:20:24.455495 18228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.012s	sys 0.027s
W20260709 13:20:24.457708 18228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.012s	sys 0.028s
I20260709 13:20:24.460089 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.458824 18201 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:24.405498 25423 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:24.424331 25748 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:24.443393 25845 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:24.416313 25441 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:24.417008 25913 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:24.451648 25867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.390s	user 0.034s	sys 0.019s
I20260709 13:20:24.472383 18383 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 24: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:24.443127 25583 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:24.455624 18310 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.022s	sys 0.031s
I20260709 13:20:24.494635 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3956) took 1553 ms. Trace:
I20260709 13:20:24.465868 25694 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:24.501849 25185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.032s	sys 0.068s
I20260709 13:20:24.488102 25807 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:24.509445 18310 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.022s	sys 0.032s
W20260709 13:20:24.512506 18351 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.007s	sys 0.024s
I20260709 13:20:24.510213 18303 rpcz_store.cc:276] 0709 13:20:22.941181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.941326 (+   145us) service_pool.cc:224] Handling call
0709 13:20:22.941609 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:22.941817 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:24.011739 (+1069922us) log.cc:844] Serialized 14 byte log entry
0709 13:20:24.494223 (+482484us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:24.494288 (+    65us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:24.494339 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.494419 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.494571 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":704696,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":77,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5321,"thread_start_us":1531407,"threads_started":2}
I20260709 13:20:24.487387 25748 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.519150 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.538702 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.539973 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.492723 25845 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.503082 25676 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:24.531875 18351 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.008s	sys 0.024s
W20260709 13:20:24.542366 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 635719us
I20260709 13:20:24.543118 18383 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:24.501417 25441 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.502610 25878 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:24.512939 25883 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:24.509114 25583 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.551537 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.509346 25907 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:24.492110 25423 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:24.542004 25748 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:24.549222 25845 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:24.551290 25441 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:20:24.522936 25185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.033s	sys 0.068s
I20260709 13:20:24.531066 25807 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.516942 25694 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.556988 25583 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:24.552832 25887 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.002s	sys 0.026s
I20260709 13:20:24.566610 25807 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:24.576303 25928 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:20:24.557905 25907 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:24.610849 25854 consensus_meta.cc:287] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.808s	user 0.010s	sys 0.005s
I20260709 13:20:24.517290 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 3057) took 3043 ms. Trace:
I20260709 13:20:24.650988 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1200) took 2109 ms. Trace:
I20260709 13:20:24.650203 18234 rpcz_store.cc:276] 0709 13:20:21.473502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.473620 (+   118us) service_pool.cc:224] Handling call
0709 13:20:21.473933 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.474261 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.474289 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.485682 (+ 11393us) log.cc:844] Serialized 26 byte log entry
0709 13:20:22.234553 (+748871us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:24.025151 (+1790598us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b180038af40. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181e1b4bc 00007fa17f16948b 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f183455 00007fa185c6b3c7 00007fa18227d9a7 00007fa18228d0bf
0709 13:20:24.025325 (+   174us) log.cc:844] Serialized 14 byte log entry
0709 13:20:24.511109 (+485784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.511396 (+   287us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.511449 (+    53us) raft_consensus.cc:1685] finished
0709 13:20:24.517019 (+  5570us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.517216 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36781,"prepare.queue_time_us":424354,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":613,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":18827,"spinlock_wait_cycles":5032320,"thread_start_us":1576882,"threads_started":3,"wal-append.queue_time_us":1597341,"wal-append.run_cpu_time_us":4279,"wal-append.run_wall_time_us":1403361}
W20260709 13:20:24.657390 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.517949 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 368406us
I20260709 13:20:24.665210 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:24.670598 18201 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:24.671360 18277 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.000s	sys 0.019s
W20260709 13:20:24.676419 18380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.009s	sys 0.021s
I20260709 13:20:24.677260 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3806) took 1070 ms. Trace:
I20260709 13:20:24.678508 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3815) took 1054 ms. Trace:
I20260709 13:20:24.680398 18386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3817) took 1056 ms. Trace:
I20260709 13:20:24.681059 18377 raft_consensus.cc:2410] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for term 16 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 14.
I20260709 13:20:24.674350 18308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3967) took 1650 ms. Trace:
I20260709 13:20:24.651801 18228 rpcz_store.cc:276] 0709 13:20:22.540913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.564332 (+ 23419us) service_pool.cc:224] Handling call
0709 13:20:22.564923 (+   591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.565370 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.565406 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.582759 (+ 17353us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.712782 (+1130023us) spinlock_profiling.cc:243] Waited 7.52 ms on lock 0x7b180049ef40. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:20:24.458159 (+745377us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:24.458217 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.458311 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.649534 (+191223us) raft_consensus.cc:1685] finished
0709 13:20:24.649658 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.650600 (+   942us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8995,"raft.queue_time_us":110,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":13777,"spinlock_wait_cycles":17293056,"thread_start_us":745129,"threads_started":1,"wal-append.queue_time_us":2016920}
W20260709 13:20:24.713346 18277 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.000s	sys 0.020s
I20260709 13:20:24.570327 25670 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:24.720839 25660 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:24.699420 18379 rpcz_store.cc:276] 0709 13:20:23.623397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.661277 (+ 37880us) service_pool.cc:224] Handling call
0709 13:20:23.661710 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.662147 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.662178 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.662825 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.111230 (+448405us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:24.111277 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.111377 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.677792 (+566415us) raft_consensus.cc:1685] finished
0709 13:20:24.677836 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.678236 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6386,"raft.queue_time_us":7128,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":16898,"thread_start_us":425100,"threads_started":1,"wal-append.queue_time_us":817962}
I20260709 13:20:24.733166 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.734688 25423 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:24.699997 18308 rpcz_store.cc:276] 0709 13:20:23.023678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.023914 (+   236us) service_pool.cc:224] Handling call
0709 13:20:23.024171 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.024346 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:24.337327 (+1312981us) log.cc:844] Serialized 14 byte log entry
0709 13:20:24.673326 (+335999us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:24.673470 (+   144us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:24.673605 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.673784 (+   179us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.674071 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":614234,"prepare.queue_time_us":622615,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"thread_start_us":1033626,"threads_started":2,"wal-append.queue_time_us":264886}
W20260709 13:20:24.716287 18380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.013s	sys 0.022s
I20260709 13:20:24.699023 18378 rpcz_store.cc:276] 0709 13:20:23.606109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.614457 (+  8348us) service_pool.cc:224] Handling call
0709 13:20:23.630907 (+ 16450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.631280 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.631316 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.631842 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.340502 (+708660us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:24.340560 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.340633 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.676320 (+335687us) raft_consensus.cc:1685] finished
0709 13:20:24.676389 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.676866 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":383,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":91,"thread_start_us":708219,"threads_started":1,"wal-append.queue_time_us":867244}
I20260709 13:20:24.742555 25887 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:24.699764 18386 rpcz_store.cc:276] 0709 13:20:23.623908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.704330 (+ 80422us) service_pool.cc:224] Handling call
0709 13:20:23.713649 (+  9319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.741779 (+ 28130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.741816 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.742363 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.337035 (+594672us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:24.337080 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.337166 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.679735 (+342569us) raft_consensus.cc:1685] finished
0709 13:20:24.679801 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.680138 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31093,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":3577,"thread_start_us":568089,"threads_started":1,"wal-append.queue_time_us":748061}
I20260709 13:20:24.748860 25944 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:24.749403 25889 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:24.749821 25944 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:24.750293 25889 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:24.752971 25390 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:24.753911 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3962) took 1778 ms. Trace:
I20260709 13:20:24.754473 18310 rpcz_store.cc:276] 0709 13:20:22.975722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.983027 (+  7305us) service_pool.cc:224] Handling call
0709 13:20:22.983423 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.018909 (+ 35486us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:23.638285 (+619376us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b1800472840. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa185c6b3c7 00007fa18227d9a7 00007fa18228d0bf 00007fa18228d038
0709 13:20:24.534309 (+896024us) log.cc:844] Serialized 14 byte log entry
0709 13:20:24.753108 (+218799us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:24.753227 (+   119us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:24.753353 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.753500 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.753685 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91090,"prepare.queue_time_us":627779,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":46260,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":26499,"spinlock_wait_cycles":6813440,"thread_start_us":1059440,"threads_started":2,"wal-append.queue_time_us":175803}
I20260709 13:20:24.761623 25839 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:24.753912 25390 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:24.762548 25839 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.764585 18380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3816) took 1140 ms. Trace:
I20260709 13:20:24.765010 18380 rpcz_store.cc:276] 0709 13:20:23.623654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.701366 (+ 77712us) service_pool.cc:224] Handling call
0709 13:20:23.714366 (+ 13000us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:23.742785 (+ 28419us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:23.742823 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.743255 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:20:24.764019 (+1020764us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:24.764119 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.764239 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.764289 (+    50us) raft_consensus.cc:1685] finished
0709 13:20:24.764301 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.764495 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27988,"raft.queue_time_us":30455,"spinlock_wait_cycles":5337472,"thread_start_us":996306,"threads_started":1,"wal-append.queue_time_us":861438}
I20260709 13:20:24.774533 25847 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:24.775477 25847 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:24.776913 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 231149us
W20260709 13:20:24.768805 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 90235.8us
I20260709 13:20:24.782096 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:24.782498 18378 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:20:24.784037 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.784420 25944 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:24.785048 25944 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:24.785898 25944 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:24.786296 25748 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.788192 25944 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:24.785063 25951 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:24.764333 25390 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:24.788931 25748 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:24.790797 25719 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:24.796140 25695 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:24.796725 25670 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:24.808964 25951 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.814321 25951 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:24.789084 25887 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:24.815068 25887 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.815486 25887 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:24.802543 25845 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:24.828053 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.828794 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.829169 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.829237 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 51333.4us
I20260709 13:20:24.837625 25887 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.841256 25748 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:24.841678 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 59814.3us
I20260709 13:20:24.842170 25583 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.846359 25441 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.846833 25695 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.847805 25695 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.850423 25845 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:24.851691 25695 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:24.829595 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:24.855437 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.857887 25847 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:24.859706 25573 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:24.860349 25573 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:24.865546 25676 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:24.866218 25676 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:24.877061 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 398938us
W20260709 13:20:24.891772 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.877804 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:24.894369 25583 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:24.902293 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:24.903404 18228 raft_consensus.cc:3060] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:24.902308 25425 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:24.905438 25425 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:24.907976 25425 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:24.909402 25889 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:24.898012 25441 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:24.912446 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:24.736089 18379 raft_consensus.cc:2955] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 13 to 15, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:24.914422 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:24.916049 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:24.916976 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.917850 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:24.919593 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:24.921433 18386 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:24.926375 25669 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:24.930816 25694 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:24.938232 25787 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:24.938810 18378 pending_rounds.cc:85] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 11
I20260709 13:20:24.939173 18378 pending_rounds.cc:107] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:20:24.939565 18378 raft_consensus.cc:2889] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:24.939093 25787 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:24.941895 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64429.1us
I20260709 13:20:24.942684 25787 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:24.943369 25787 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:24.944774 25695 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:24.945206 25559 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:24.945441 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:24.946305 18234 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:24.946130 25559 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.944274 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:24.952917 25559 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:24.955451 18386 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:24.960793 18308 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 24 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:20:24.961212 18303 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21. Ops: [18.11-20.12]
W20260709 13:20:24.968327 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.968683 25847 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.944028 25787 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:24.976650 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.975310 25847 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.956241 25807 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.955825 25573 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:24.980590 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:24.981110 25425 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:24.983759 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:24.984869 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:24.985972 25787 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:24.985864 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:24.986445 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:24.987399 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:24.989634 18228 raft_consensus.cc:2468] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 25.
W20260709 13:20:24.990645 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.987830 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:24.995507 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:24.947163 25611 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:24.997653 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.999099 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:24.999893 18385 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:25.001535 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.003093 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.003895 18303 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:25.004355 25847 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:25.001456 25884 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:25.006139 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:25.007227 25907 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:25.009035 18312 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:25.007243 18386 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 23: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:25.010344 18230 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:25.015290 18386 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 23. Current term is 24. Ops: []
W20260709 13:20:25.019250 25922 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.914s	user 0.003s	sys 0.000s
I20260709 13:20:25.020859 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:25.021544 18382 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:25.035907 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:25.036846 18229 raft_consensus.cc:2368] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20.
I20260709 13:20:25.039309 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:25.001376 25968 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
I20260709 13:20:25.039923 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:25.043546 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:25.039851 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:25.050516 18386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:20:25.051426 18386 raft_consensus.cc:606] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:25.051905 18386 raft_consensus.cc:614] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:25.055603 18232 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:25.056977 25887 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:25.058112 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 113993us
I20260709 13:20:25.063470 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:25.064621 18306 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 21: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:25.067430 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.068423 25773 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:25.069204 25773 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:25.069308 25423 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:25.069703 25773 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:25.070433 25919 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.959s	user 0.000s	sys 0.001s
I20260709 13:20:25.075444 25948 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.076565 25948 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:25.078161 18236 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 3063) took 3600 ms (client timeout 2246 ms). Trace:
W20260709 13:20:25.078612 18236 rpcz_store.cc:269] 0709 13:20:21.477436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.176970 (+699534us) service_pool.cc:224] Handling call
0709 13:20:25.077714 (+2900744us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b540026a554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:25.077929 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5120904960}
I20260709 13:20:25.081485 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:25.082212 18236 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:25.082607 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:25.083348 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:25.083567 18229 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 22: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:25.066108 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.086035 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.087180 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:25.088178 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:25.089221 25967 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:20:25.093694 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:25.094465 18380 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:25.097424 25870 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:25.098026 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:25.099538 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.100504 18303 raft_consensus.cc:2410] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:20:25.101636 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:25.102481 18275 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:25.105319 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 62909.3us
I20260709 13:20:25.108481 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3963) took 2111 ms. Trace:
I20260709 13:20:25.109179 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.110363 18312 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:25.111475 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.115517 25662 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.116182 25662 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:25.117352 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:25.117425 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:25.116590 25807 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:25.097575 25573 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:25.102802 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.131814 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.133210 25839 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:25.108960 18305 rpcz_store.cc:276] 0709 13:20:22.996935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.997278 (+   343us) service_pool.cc:224] Handling call
0709 13:20:22.997752 (+   474us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:23.760535 (+762783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.760566 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:23.761245 (+   679us) log.cc:844] Serialized 52 byte log entry
0709 13:20:24.413339 (+652094us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:24.461157 (+ 47818us) log.cc:844] Serialized 14 byte log entry
0709 13:20:24.506940 (+ 45783us) log.cc:844] Serialized 14 byte log entry
0709 13:20:24.507139 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.094520 (+587381us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b1800492ee0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:20:25.106378 (+ 11858us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b540011d354. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:25.106436 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.108015 (+  1579us) raft_consensus.cc:1685] finished
0709 13:20:25.108036 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.108307 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59655,"prepare.queue_time_us":104790,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":103,"raft.queue_time_us":7620,"raft.run_cpu_time_us":517,"raft.run_wall_time_us":13515,"spinlock_wait_cycles":1763179392,"thread_start_us":628340,"threads_started":1,"wal-append.queue_time_us":796852}
I20260709 13:20:25.139050 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:25.140690 25827 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:20:25.145525 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 82262.8us
I20260709 13:20:25.147028 18234 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
I20260709 13:20:25.145565 18303 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:25.149947 18230 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 24.
I20260709 13:20:25.154246 18380 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:25.158367 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:25.157402 25942 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.057s	user 0.002s	sys 0.000s
I20260709 13:20:25.163362 18953 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:25.163297 18232 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:25.170867 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:25.175197 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.176637 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.180593 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:25.185109 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.188349 18311 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:25.194677 18310 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:25.204783 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:25.156399 25423 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:25.216828 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.219203 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:25.217185 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.220454 18312 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
W20260709 13:20:25.221339 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 43727.6us
I20260709 13:20:25.225093 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:25.229349 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:25.233479 18307 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 3972) took 2092 ms (client timeout 1917 ms). Trace:
W20260709 13:20:25.234164 18307 rpcz_store.cc:269] 0709 13:20:23.097506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.350714 (+253208us) service_pool.cc:224] Handling call
0709 13:20:25.150097 (+1799383us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54002233d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:25.189484 (+ 39387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472035712}
I20260709 13:20:25.239562 18380 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:25.241505 18229 raft_consensus.cc:2410] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:20:25.243201 18383 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 21. Current term is 22. Ops: []
W20260709 13:20:25.238947 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 68238.1us
I20260709 13:20:25.245515 18386 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:25.240643 18380 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:25.231729 18230 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:25.218950 25662 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:25.248167 18382 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
I20260709 13:20:25.251515 18385 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 25: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:25.182785 25827 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:25.236436 25901 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:25.284461 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3969) took 2251 ms. Trace:
I20260709 13:20:25.285013 18304 rpcz_store.cc:276] 0709 13:20:23.032888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.033160 (+   272us) service_pool.cc:224] Handling call
0709 13:20:23.053780 (+ 20620us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:23.550246 (+496466us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b48002619d8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18719caa1 00007fa187193b37 00007fa1871939ca 00007fa18728b26f 00007fa18728af37 00007fa18729f55c 00007fa18729f508 00007fa18729f488 00007fa18729f443 00007fa18729e6ec 00007fa1861c8a96
0709 13:20:23.705458 (+155212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.705491 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:23.743076 (+ 37585us) log.cc:844] Serialized 52 byte log entry
0709 13:20:24.428683 (+685607us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:24.506358 (+ 77675us) log.cc:844] Serialized 14 byte log entry
0709 13:20:24.506626 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.506733 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.099062 (+592329us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b180028bca0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:20:25.284080 (+185018us) raft_consensus.cc:1685] finished
0709 13:20:25.284100 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.284281 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40289,"prepare.queue_time_us":78464,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":59201,"raft.run_cpu_time_us":5821,"raft.run_wall_time_us":436262,"spinlock_wait_cycles":29780992,"thread_start_us":1307690,"threads_started":2,"wal-append.queue_time_us":781739}
I20260709 13:20:25.238202 25843 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:25.280746 25676 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:25.258668 25948 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:25.281325 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:25.258220 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:25.296788 18306 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:25.307585 25712 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:25.308192 18310 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:25.308435 25712 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:25.311757 18305 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:25.264585 25662 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.313218 25662 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:25.313402 25773 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:25.316989 18275 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:25.318332 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 61658.4us
I20260709 13:20:25.319069 25839 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:25.322655 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:25.322959 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:25.323542 18228 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:25.363361 18953 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:25.323571 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:25.396296 18382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4300927be0384401aa46050bd5996d2f"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:20:25.588243 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.757401 18382 raft_consensus.cc:606] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:25.579427 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.758039 18382 raft_consensus.cc:614] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:25.756299 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:25.557567 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.528435 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:25.663235 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:25.532819 18378 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:20:25.612792 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.570144 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.759289 18234 raft_consensus.cc:2393] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 21: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:25.553910 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43098 (request call id 1558) took 1437 ms. Trace:
I20260709 13:20:25.632663 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.556420 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.599682 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.595157 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:25.530388 18275 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:25.690946 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.766042 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.760206 18385 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:25.767362 18386 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:25.762238 18377 rpcz_store.cc:276] 0709 13:20:24.116721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.126498 (+  9777us) service_pool.cc:224] Handling call
0709 13:20:25.553610 (+1427112us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b540019b754. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:25.553824 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269247360}
I20260709 13:20:25.598253 18953 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:25.586378 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.527798 18383 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:25.733521 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:25.635634 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:25.760712 18379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.000s	sys 0.022s
I20260709 13:20:25.648666 18927 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:25.558760 18380 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:25.667752 18411 heartbeater.cc:646] Failed to heartbeat to 127.16.188.190:46739 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.16.188.190:46739 timed out after 15.000s (SENT)
W20260709 13:20:25.920253 18379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.000s	sys 0.023s
I20260709 13:20:25.920253 18233 raft_consensus.cc:2368] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22.
I20260709 13:20:25.501683 18231 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
I20260709 13:20:25.927433 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:25.929471 18237 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 25: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:25.955554 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:25.535279 25676 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:25.590600 25773 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:25.651832 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:25.506675 25423 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:25.529091 25662 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:26.115873 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:26.338553 25839 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.117823 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:26.373124 18304 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:25.585937 25827 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:25.636932 25712 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:26.373235 18236 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.021s	sys 0.067s
I20260709 13:20:26.144028 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:25.659875 18133 catalog_manager.cc:5697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 18 to 19, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 19 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:26.157120 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:26.192427 18311 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.027s	sys 0.053s
W20260709 13:20:26.377467 18311 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.027s	sys 0.053s
W20260709 13:20:26.195497 18202 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.008s	sys 0.032s
W20260709 13:20:26.378571 18202 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.008s	sys 0.032s
W20260709 13:20:26.379043 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 839620us
I20260709 13:20:25.953404 18381 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:26.328083 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 3080) took 1004 ms. Trace:
W20260709 13:20:26.042757 18957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.024s	sys 0.066s
I20260709 13:20:26.329205 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:26.380133 18957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.035s	sys 0.083s
W20260709 13:20:26.329779 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.330086 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 3079) took 1007 ms. Trace:
I20260709 13:20:25.760313 25901 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.429919 25879 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:25.581629 25558 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.381094 18233 rpcz_store.cc:276] 0709 13:20:25.322873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.323097 (+   224us) service_pool.cc:224] Handling call
0709 13:20:25.997920 (+674823us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:25.553185 25787 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:20:26.196990 18962 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.023s	sys 0.065s
I20260709 13:20:25.424165 25699 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:25.686729 25573 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.430s
I20260709 13:20:25.605677 25660 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:26.387765 18202 connection.cc:256] RPC call timeout handler was delayed by -1.0644686179998644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 13:20:26.315322 18384 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.032s	sys 0.075s
I20260709 13:20:26.337124 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:25.955857 25870 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.184s
I20260709 13:20:26.338042 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:26.338709 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:25.719257 25735 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.416s
I20260709 13:20:26.340683 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:26.335064 18312 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:26.351989 18380 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:26.335450 18958 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
W20260709 13:20:26.339856 25952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.002s	sys 0.006s
I20260709 13:20:26.364130 18235 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:20:26.370344 18308 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:26.116657 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:26.413839 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:26.129040 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:26.414167 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:26.381553 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.379908 18237 rpcz_store.cc:276] 0709 13:20:25.323273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.324000 (+   727us) service_pool.cc:224] Handling call
0709 13:20:25.954182 (+630182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35712}
W20260709 13:20:26.384034 18236 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.132s	user 0.021s	sys 0.067s
I20260709 13:20:25.927621 18306 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:26.383198 18311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46642 (request call id 1728) took 1154 ms. Trace:
I20260709 13:20:26.389991 18378 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:20:26.391161 18962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.023s	sys 0.068s
I20260709 13:20:26.375586 25423 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.335896 18234 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:26.420648 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:26.420819 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:26.399008 18384 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.033s	sys 0.075s
I20260709 13:20:26.398178 18377 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
I20260709 13:20:26.418848 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 3077) took 1096 ms. Trace:
W20260709 13:20:26.421690 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 891381us
I20260709 13:20:26.422079 18235 rpcz_store.cc:276] 0709 13:20:25.322179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.324634 (+  2455us) service_pool.cc:224] Handling call
0709 13:20:25.923104 (+598470us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5800002a98. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:20:26.335480 (+412376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:26.418572 (+ 83092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.418792 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537794432}
I20260709 13:20:26.426433 18962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53364 (request call id 737) took 1276 ms. Trace:
W20260709 13:20:26.432183 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 783712us
W20260709 13:20:26.408704 18351 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.011s	sys 0.009s
W20260709 13:20:26.435308 18351 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.011s	sys 0.009s
W20260709 13:20:26.435614 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 701329us
I20260709 13:20:26.441147 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:26.412346 25952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.003s	sys 0.007s
I20260709 13:20:26.448551 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:26.449849 18312 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:26.448666 18382 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:26.448400 18237 raft_consensus.cc:2410] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:20:26.452550 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:26.456594 18306 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:26.459514 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:26.460211 18377 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
I20260709 13:20:26.460582 25914 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.113s
I20260709 13:20:26.461675 18235 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:26.462114 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:26.462687 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.426913 18962 rpcz_store.cc:276] 0709 13:20:25.140197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.141553 (+  1356us) service_pool.cc:224] Handling call
0709 13:20:25.141872 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:25.142231 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:20:25.242930 (+100699us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.416765 (+1173835us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.416815 (+    50us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:20:26.416855 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.416917 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.417042 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":415962,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"thread_start_us":1253277,"threads_started":2,"wal-append.queue_time_us":1170282}
I20260709 13:20:26.463181 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:26.402930 25901 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:26.442768 18133 catalog_manager.cc:5697] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 18 to 22, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 22 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:26.469656 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 408355us
I20260709 13:20:26.471509 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:26.479379 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:26.397533 25558 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:26.480598 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4289) took 2308 ms. Trace:
I20260709 13:20:26.481139 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:26.485931 18312 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:20:26.492072 18231 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:26.414791 25839 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:26.457012 25662 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:26.497596 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.434616 25787 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:26.412564 25879 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:26.495744 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 3083) took 1171 ms. Trace:
I20260709 13:20:26.489013 18309 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:26.499658 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:26.493758 18305 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:26.502067 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:26.512473 18351 connection.cc:256] RPC call timeout handler was delayed by -1.02509893499996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260709 13:20:26.512908 18382 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:26.425007 25660 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:26.482551 25929 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:26.517150 18202 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.770s (SENT)
I20260709 13:20:26.521620 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:26.489419 25952 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:26.515190 18233 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:26.512981 18351 connection.cc:256] RPC call timeout handler was delayed by -1.02509893499996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260709 13:20:26.496150 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3836) took 1587 ms. Trace:
I20260709 13:20:26.433758 25423 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:26.478771 25735 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:26.511257 18231 rpcz_store.cc:276] 0709 13:20:25.324335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.453444 (+1129109us) service_pool.cc:224] Handling call
0709 13:20:26.488790 (+ 35346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.495416 (+  6626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.495655 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:26.518278 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:26.532682 18386 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 13.
I20260709 13:20:26.533560 18307 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:26.534474 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:26.535014 18307 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:26.535149 18386 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:26.535490 25879 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:26.531942 25735 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:26.536795 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:26.537441 18382 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:26.538048 25901 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:26.539919 25901 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:26.457135 25699 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:26.541533 18310 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:26.542549 25699 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:26.542725 25660 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:26.543749 25829 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:26.483296 25712 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 13:20:26.545491 25979 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:26.546538 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:26.524626 18351 connection.cc:256] RPC call timeout handler was delayed by -1.0205989349999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
I20260709 13:20:26.537762 25735 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:26.548386 18303 raft_consensus.cc:2468] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
I20260709 13:20:26.517472 18237 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:20:26.526954 25867 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.004s	sys 0.027s
I20260709 13:20:26.558248 18309 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:26.556157 25867 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.005s	sys 0.028s
I20260709 13:20:26.524695 18384 rpcz_store.cc:276] 0709 13:20:24.908831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.910077 (+  1246us) service_pool.cc:224] Handling call
0709 13:20:24.910545 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.944804 (+ 34259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.944842 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:25.206445 (+261603us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b2c0010dcf8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa180b6ca11 00007fa180b7c372 00007fa1822aea01 00007fa18227343a 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2
0709 13:20:25.248968 (+ 42523us) log.cc:844] Serialized 26 byte log entry
0709 13:20:26.421500 (+1172532us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:26.421540 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.421611 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:26.490733 (+ 69122us) raft_consensus.cc:1685] finished
0709 13:20:26.490763 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.496062 (+  5299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26227,"raft.queue_time_us":37043,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":155,"spinlock_wait_cycles":3934464,"thread_start_us":922294,"threads_started":1,"wal-append.queue_time_us":1204619}
I20260709 13:20:26.510455 25662 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:26.553136 25699 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:26.555393 18133 catalog_manager.cc:5697] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: config changed from index -1 to 13, term changed from 19 to 21, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129), NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 21 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:20:26.569834 25990 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:26.531790 25952 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:26.597198 18384 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:20:26.598176 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 3994) took 1004 ms. Trace:
I20260709 13:20:26.598675 18303 rpcz_store.cc:276] 0709 13:20:25.594289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.631420 (+ 37131us) service_pool.cc:224] Handling call
0709 13:20:26.597980 (+966560us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b54002a2454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:26.598107 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1806122240}
I20260709 13:20:26.603402 18312 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
W20260709 13:20:26.605499 25978 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:20:26.606769 18306 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 26.
I20260709 13:20:26.607894 18312 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:20:26.608295 25985 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:20:26.609426 25839 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:26.611147 25973 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.251s	user 0.004s	sys 0.000s
I20260709 13:20:26.612851 18133 catalog_manager.cc:5697] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 10 to 12, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 12 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:26.616299 25735 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:26.617553 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:26.618516 18232 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:26.625813 18228 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:20:26.626524 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:26.625782 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.627813 18229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 3075) took 1306 ms. Trace:
I20260709 13:20:26.626842 18228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 3082) took 1302 ms. Trace:
I20260709 13:20:26.630571 18228 rpcz_store.cc:276] 0709 13:20:25.324038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.324314 (+   276us) service_pool.cc:224] Handling call
0709 13:20:26.625156 (+1300842us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5800002a98. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:20:26.625449 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:26.626464 (+  1015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.626762 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538610048}
I20260709 13:20:26.634305 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:26.635244 18230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 3073) took 1379 ms. Trace:
I20260709 13:20:26.635558 18230 rpcz_store.cc:276] 0709 13:20:25.255586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.255757 (+   171us) service_pool.cc:224] Handling call
0709 13:20:26.634164 (+1378407us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5800002a98. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14eeee 0000000000375939 00007fa1871c21e0 00007fa18728b0c4 00007fa18728b131 00007fa1872390a0 00007fa187238984 00007fa1807b36d4 00007fa1807b3662
0709 13:20:26.635172 (+  1008us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536902912}
W20260709 13:20:26.649477 25981 log.cc:927] Time spent T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:20:26.653007 18957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54004 (request call id 717) took 1515 ms. Trace:
I20260709 13:20:26.628306 18229 rpcz_store.cc:276] 0709 13:20:25.321422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.321573 (+   151us) service_pool.cc:224] Handling call
0709 13:20:26.626323 (+1304750us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b5800002a98. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa1872390a0 00007fa187238984 00007fa1807b36d4 00007fa1807b3662
0709 13:20:26.627692 (+  1369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400346496}
I20260709 13:20:26.615196 18133 catalog_manager.cc:5697] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 14 to 16, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 16 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:26.656054 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 4000) took 1059 ms. Trace:
I20260709 13:20:26.654971 18962 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 20 LEARNER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:26.572382 25699 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:26.665378 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 211741us
I20260709 13:20:26.653570 18957 rpcz_store.cc:276] 0709 13:20:25.138115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.138305 (+   190us) service_pool.cc:224] Handling call
0709 13:20:25.138717 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:25.139019 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:25.244959 (+105940us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.643911 (+1398952us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b18000fcb80. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181e1b4bc 00007fa17f16948b 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e1323a
0709 13:20:26.644153 (+   242us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.644220 (+    67us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:26.644279 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.644356 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.644504 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":186417,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":14811,"raft.queue_time_us":3018,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":128,"spinlock_wait_cycles":12823680,"thread_start_us":1235465,"threads_started":2,"wal-append.queue_time_us":1127662}
I20260709 13:20:26.663494 18303 rpcz_store.cc:276] 0709 13:20:25.616333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.599645 (+983312us) service_pool.cc:224] Handling call
0709 13:20:26.599987 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.600338 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.600365 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.600404 (+    39us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:26.600435 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.600489 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.655981 (+ 55492us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9849,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129}
I20260709 13:20:26.585842 25990 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:26.710479 18307 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:26.711442 18307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 4004) took 1077 ms. Trace:
I20260709 13:20:26.711881 18307 rpcz_store.cc:276] 0709 13:20:25.633623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.534210 (+900587us) service_pool.cc:224] Handling call
0709 13:20:26.711236 (+177026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:26.684692 25699 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:26.583686 25901 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:26.722213 18386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 1573) took 1045 ms. Trace:
I20260709 13:20:26.725009 18386 rpcz_store.cc:276] 0709 13:20:25.676276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.557308 (+881032us) service_pool.cc:224] Handling call
0709 13:20:26.665059 (+107751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.721692 (+ 56633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.721748 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.721820 (+    72us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:26.721873 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.721964 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.722131 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:26.726840 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 393514us
I20260709 13:20:26.720680 18309 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 17. Current term is 18. Ops: [15.10-17.11]
I20260709 13:20:26.729482 18309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 3999) took 1133 ms. Trace:
I20260709 13:20:26.698396 25879 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.729918 18309 rpcz_store.cc:276] 0709 13:20:25.596159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.561137 (+964978us) service_pool.cc:224] Handling call
0709 13:20:26.673117 (+111980us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:26.729067 (+ 55950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.729402 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:26.708578 18232 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:26.736160 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 3081) took 1412 ms. Trace:
I20260709 13:20:26.738317 18380 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 15. (term mismatch)
I20260709 13:20:26.744071 18232 rpcz_store.cc:276] 0709 13:20:25.323667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.324143 (+   476us) service_pool.cc:224] Handling call
0709 13:20:26.617310 (+1293167us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5800002a98. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa1872390a0 00007fa187238984 00007fa1807b36d4 00007fa1807b3662
0709 13:20:26.736069 (+118759us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537246080}
I20260709 13:20:26.745082 18380 pending_rounds.cc:85] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 14
I20260709 13:20:26.754204 18380 pending_rounds.cc:107] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 23.15
I20260709 13:20:26.754571 18380 raft_consensus.cc:2889] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:26.750152 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 326867us
I20260709 13:20:26.763849 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:26.737649 18133 catalog_manager.cc:5697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:26.765264 18385 consensus_meta.cc:287] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.812s	user 0.017s	sys 0.001s
I20260709 13:20:26.766417 18385 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 26.
I20260709 13:20:26.739387 18234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 3084) took 1308 ms. Trace:
I20260709 13:20:26.741940 18386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
W20260709 13:20:26.769240 18385 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 4313) took 1508 ms (client timeout 1913 ms). Trace:
I20260709 13:20:26.769451 18386 raft_consensus.cc:606] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:26.769796 18386 raft_consensus.cc:614] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:26.770452 18234 rpcz_store.cc:276] 0709 13:20:25.453549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.452392 (+998843us) service_pool.cc:224] Handling call
0709 13:20:26.452751 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.738875 (+286124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.738923 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.738978 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:26.739061 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.739145 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.739294 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":279734,"threads_started":1}
I20260709 13:20:26.757799 18275 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:26.416385 18311 rpcz_store.cc:276] 0709 13:20:25.228365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.285631 (+ 57266us) service_pool.cc:224] Handling call
0709 13:20:25.286048 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:25.516035 (+229987us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:25.536980 (+ 20945us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.378024 (+841044us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.378114 (+    90us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:26.378189 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.378282 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.383129 (+  4847us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":222,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":206,"raft.queue_time_us":36157,"thread_start_us":840463,"threads_started":1}
W20260709 13:20:26.784905 25977 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.319s	user 0.002s	sys 0.000s
I20260709 13:20:26.791759 25558 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:26.797519 18133 catalog_manager.cc:5697] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 12 to 13, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 13 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:26.804206 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 3991) took 1246 ms. Trace:
I20260709 13:20:26.804649 18310 rpcz_store.cc:276] 0709 13:20:25.557510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.558011 (+   501us) service_pool.cc:224] Handling call
0709 13:20:26.804006 (+1245995us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b54000bd6d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:26.804145 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792405888}
I20260709 13:20:26.806068 25948 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.806666 25948 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:26.484915 18379 rpcz_store.cc:276] 0709 13:20:24.172362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.734611 (+562249us) service_pool.cc:224] Handling call
0709 13:20:24.735145 (+   534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.735716 (+   571us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:20:24.971984 (+236268us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.470937 (+1498953us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.471131 (+   194us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.471182 (+    51us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:26.480190 (+  9008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.480300 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.480493 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11091,"raft.run_cpu_time_us":438,"raft.run_wall_time_us":180428,"thread_start_us":1124304,"threads_started":2,"wal-append.queue_time_us":1255732}
W20260709 13:20:26.813187 25986 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
W20260709 13:20:26.814236 25980 log.cc:927] Time spent T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:20:26.799690 18133 catalog_manager.cc:5697] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 17 to 18, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 18 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:26.769574 18385 rpcz_store.cc:269] 0709 13:20:25.261100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.528132 (+267032us) service_pool.cc:224] Handling call
0709 13:20:26.769181 (+1241049us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:26.830055 18380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3849) took 1714 ms. Trace:
I20260709 13:20:26.830458 18380 rpcz_store.cc:276] 0709 13:20:25.119493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.159340 (+ 39847us) service_pool.cc:224] Handling call
0709 13:20:25.214854 (+ 55514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.829808 (+1614954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.829999 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:26.740234 25879 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:26.837577 18305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 4006) took 1203 ms. Trace:
I20260709 13:20:26.838063 18305 rpcz_store.cc:276] 0709 13:20:25.634206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.123349 (+489143us) service_pool.cc:224] Handling call
0709 13:20:26.837411 (+714062us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54002238d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:26.837518 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268093696}
W20260709 13:20:26.838361 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 80731us
W20260709 13:20:26.847752 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.845403 25929 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.843346 25914 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:26.857455 18133 catalog_manager.cc:5697] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 14 to 15, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 15 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:26.846058 25787 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:26.851884 25948 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:26.862926 25660 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:26.869683 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 321639us
I20260709 13:20:26.870095 25660 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:26.871325 18926 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:26.873493 25827 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:26.873746 25996 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:26.874001 25827 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:26.874511 25827 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:26.875061 25660 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:26.874547 25996 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:26.849838 25929 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:26.876135 25558 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:26.878721 25558 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:26.878810 25929 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:26.872320 18926 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:26.879884 25662 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:26.880616 25662 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:26.881222 25662 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:26.881747 25558 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:26.894670 18381 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
W20260709 13:20:26.897639 18381 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 4318) took 1313 ms (client timeout 1574 ms). Trace:
W20260709 13:20:26.896028 18304 consensus_meta.cc:287] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260709 13:20:26.898953 18304 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
W20260709 13:20:26.899834 18304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 4013) took 1263 ms (client timeout 1574 ms). Trace:
W20260709 13:20:26.900322 18304 rpcz_store.cc:269] 0709 13:20:25.636115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.954010 (+317895us) service_pool.cc:224] Handling call
0709 13:20:26.899752 (+945742us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:26.857585 25867 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:26.898183 18381 rpcz_store.cc:269] 0709 13:20:25.583768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.635252 (+ 51484us) service_pool.cc:224] Handling call
0709 13:20:26.897310 (+1262058us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:26.865322 25423 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:26.902899 25870 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:26.884864 25558 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:26.910027 25989 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:26.904731 25952 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:26.928580 18277 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.035s	sys 0.018s
W20260709 13:20:26.928906 18277 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.035s	sys 0.018s
W20260709 13:20:26.933979 18236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.032s	sys 0.057s
I20260709 13:20:26.884480 25662 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:26.935907 18236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.032s	sys 0.058s
W20260709 13:20:26.929226 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 594043us
I20260709 13:20:26.948763 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1207) took 1813 ms. Trace:
I20260709 13:20:26.945372 18349 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:26.961481 18133 catalog_manager.cc:5697] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 16 to 18, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 18 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:26.936673 25573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.001s	sys 0.024s
I20260709 13:20:26.928336 25989 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.925520 25870 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:26.969337 25573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.001s	sys 0.024s
I20260709 13:20:26.966003 18236 rpcz_store.cc:276] 0709 13:20:25.135678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.136890 (+  1212us) service_pool.cc:224] Handling call
0709 13:20:25.137228 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:25.137551 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:20:25.251970 (+114419us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.937691 (+1685721us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.937782 (+    91us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:26.948364 (+ 10582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.948475 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.948678 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":432521,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":415812,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":8279,"thread_start_us":1796202,"threads_started":3,"wal-append.queue_time_us":1270857}
I20260709 13:20:26.938211 25990 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:26.994973 18308 consensus_meta.cc:287] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
W20260709 13:20:26.996989 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 479869us
I20260709 13:20:26.977238 25989 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:26.977044 25901 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:27.021389 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:27.009321 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 66344.6us
I20260709 13:20:27.016248 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:26.934176 25867 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:27.020179 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.020200 18308 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
W20260709 13:20:27.025492 18308 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 4001) took 1393 ms (client timeout 1555 ms). Trace:
W20260709 13:20:27.027292 18308 rpcz_store.cc:269] 0709 13:20:25.632631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.953709 (+321078us) service_pool.cc:224] Handling call
0709 13:20:27.025418 (+1071709us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:27.034683 18379 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:27.035508 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:27.049911 18385 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:27.051397 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:27.055766 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:26.970167 25662 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.048s
W20260709 13:20:27.065268 18278 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.017s	sys 0.070s
W20260709 13:20:27.066000 18278 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.017s	sys 0.070s
I20260709 13:20:27.068717 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:27.073393 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:27.083957 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:27.085103 18380 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:27.068627 25573 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:27.087091 25573 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:27.089859 25573 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:27.090735 25914 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:27.057535 25879 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:27.099656 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:27.109577 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3856) took 1352 ms. Trace:
I20260709 13:20:27.058916 25996 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:27.104614 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:27.116664 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:27.117445 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.123279 18200 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:20:27.126780 18235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.006s	sys 0.026s
W20260709 13:20:27.128974 18235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.006s	sys 0.026s
I20260709 13:20:27.054977 25870 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:27.113626 18382 rpcz_store.cc:276] 0709 13:20:25.757595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.582326 (+824731us) service_pool.cc:224] Handling call
0709 13:20:26.591039 (+  8713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.732408 (+141369us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:26.743496 (+ 11088us) log.cc:844] Serialized 14 byte log entry
0709 13:20:27.107274 (+363778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:27.107322 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:27.107364 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.108824 (+  1460us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.109507 (+   683us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":622,"prepare.queue_time_us":13594,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"thread_start_us":335571,"threads_started":1}
I20260709 13:20:27.118214 25879 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:20:27.152452 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 49632.8us
W20260709 13:20:27.158463 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 394670us
I20260709 13:20:27.097066 25952 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.038s
W20260709 13:20:27.162319 18384 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.014s	sys 0.010s
I20260709 13:20:27.160970 18133 catalog_manager.cc:5697] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:20:27.228986 18233 consensus_meta.cc:287] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.000s
I20260709 13:20:27.258473 18233 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:27.259021 18386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3859) took 1328 ms. Trace:
I20260709 13:20:27.259274 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 3090) took 1610 ms. Trace:
I20260709 13:20:27.259784 18233 rpcz_store.cc:276] 0709 13:20:25.648910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.466812 (+817902us) service_pool.cc:224] Handling call
0709 13:20:26.489092 (+ 22280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:27.258956 (+769864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.259175 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:27.159839 18201 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:27.233146 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 86908us
I20260709 13:20:27.157195 25879 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:27.245390 18927 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.018s	sys 0.023s
W20260709 13:20:27.201053 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.158821 18957 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:27.163574 25991 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.255247 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 96255.6us
W20260709 13:20:27.255712 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 374058us
I20260709 13:20:27.259505 18386 rpcz_store.cc:276] 0709 13:20:25.930560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.772486 (+841926us) service_pool.cc:224] Handling call
0709 13:20:26.777376 (+  4890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.777667 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:26.777960 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 13:20:27.258617 (+480657us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:27.258688 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:27.258738 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.258807 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.258948 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57651,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":8001,"thread_start_us":474199,"threads_started":2}
W20260709 13:20:27.266152 18927 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.018s	sys 0.024s
I20260709 13:20:27.253983 25996 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:27.273083 25997 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:27.273017 18133 catalog_manager.cc:5697] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:27.264107 25825 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:20:27.276607 25735 consensus_meta.cc:287] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.002s
I20260709 13:20:27.289878 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3857) took 1532 ms. Trace:
I20260709 13:20:27.269217 25879 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:27.268815 25868 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:27.292294 25825 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:27.293656 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:27.294021 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 134253us
I20260709 13:20:27.294584 18133 catalog_manager.cc:5697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 13 to 15, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 15 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:27.309842 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:27.276443 25993 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.312835 25993 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:27.313696 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:27.296196 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:27.316092 18232 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:20:27.317080 18276 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:27.296892 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:27.285545 25997 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.297164 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:27.297888 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:27.290526 25662 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:27.324196 18231 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:27.300769 18384 rpcz_store.cc:276] 0709 13:20:25.757819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.598579 (+840760us) service_pool.cc:224] Handling call
0709 13:20:26.599043 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.599483 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:20:26.600068 (+   585us) log.cc:844] Serialized 14 byte log entry
0709 13:20:27.289453 (+689385us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:27.289525 (+    72us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:27.289582 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.289662 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.289811 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":287,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"thread_start_us":661829,"threads_started":1}
I20260709 13:20:27.274993 25558 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:27.269524 26003 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:27.304896 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:27.328951 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:27.304991 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:27.329891 18234 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 14.
I20260709 13:20:27.328174 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:27.317363 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:27.291038 25996 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:27.319370 18230 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:27.321197 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:27.331377 18201 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:27.315356 25993 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:27.338825 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:27.339619 18234 raft_consensus.cc:2368] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 25. Current term is 26.
I20260709 13:20:27.336324 18276 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:27.328413 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:27.334463 18277 leader_election.cc:400] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20.
I20260709 13:20:27.340821 18277 leader_election.cc:403] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:27.331149 18229 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:27.325127 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:27.327404 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:27.328246 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:27.305403 25868 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:20:27.347146 25699 consensus_meta.cc:287] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.000s
I20260709 13:20:27.347656 25699 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:27.349196 25558 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:27.349745 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47600.8us
I20260709 13:20:27.326107 25997 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:27.350845 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:27.302294 25867 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:27.302212 25998 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:27.352422 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 3087) took 1704 ms. Trace:
I20260709 13:20:27.323519 25929 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:27.365439 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:27.367529 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:27.285468 25991 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:27.359319 18235 rpcz_store.cc:276] 0709 13:20:25.647857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.463558 (+815701us) service_pool.cc:224] Handling call
0709 13:20:26.463890 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:26.567094 (+103204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.567138 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:26.589764 (+ 22626us) log.cc:844] Serialized 52 byte log entry
0709 13:20:27.131792 (+542028us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:27.132714 (+   922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.134001 (+  1287us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:27.352133 (+218132us) raft_consensus.cc:1685] finished
0709 13:20:27.352161 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.352353 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":393564,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":6398,"thread_start_us":626636,"threads_started":2,"wal-append.queue_time_us":681929}
I20260709 13:20:27.373013 18202 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:27.373059 18233 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:27.354569 25676 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:27.383394 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:27.351990 25558 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:27.384140 18231 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:27.384404 18236 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:27.364280 25929 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.343950 25868 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:27.391264 18927 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:27.373224 25573 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:27.362025 26025 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:27.423923 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:27.423167 18201 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:27.426167 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47676.3us
I20260709 13:20:27.429600 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:27.380645 25998 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:27.434791 25998 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:27.437032 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:27.437382 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 86673.7us
I20260709 13:20:27.422629 25929 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:27.428743 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3858) took 1513 ms. Trace:
I20260709 13:20:27.369400 25662 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:27.370165 25989 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:27.426677 25573 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:27.455808 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:27.466161 26026 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.466882 26026 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:27.468060 25989 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:27.425966 26017 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:27.448841 18383 rpcz_store.cc:276] 0709 13:20:25.915469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.650790 (+735321us) service_pool.cc:224] Handling call
0709 13:20:26.651212 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.651504 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:26.652458 (+   954us) log.cc:844] Serialized 14 byte log entry
0709 13:20:27.278519 (+626061us) log.cc:844] Serialized 14 byte log entry
0709 13:20:27.424856 (+146337us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:27.424937 (+    81us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:27.425013 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.425115 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:27.428656 (+  3541us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45034,"prepare.queue_time_us":3981,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":351855,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":11811,"spinlock_wait_cycles":3976576,"thread_start_us":737775,"threads_started":3,"wal-append.queue_time_us":779719}
I20260709 13:20:27.490036 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:27.500195 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 109026us
I20260709 13:20:27.471206 25868 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:27.500802 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 77737.2us
I20260709 13:20:27.490916 25558 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:27.471448 25573 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:27.485381 25660 raft_consensus.cc:2764] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:20:27.444135 26025 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:27.536397 18958 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:20:27.544377 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 95499.3us
I20260709 13:20:27.551725 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:27.483207 26006 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.241s
I20260709 13:20:27.516995 25558 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.504005 25995 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20.
I20260709 13:20:27.553318 25992 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:27.556069 26009 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.566443 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 59669.2us
I20260709 13:20:27.512383 25787 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:27.578298 18236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
I20260709 13:20:27.579067 18236 raft_consensus.cc:606] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:27.579481 18236 raft_consensus.cc:614] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:27.559224 25699 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:27.580749 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:27.581894 18231 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
W20260709 13:20:27.582464 26013 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:20:27.584156 18230 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:27.590159 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 237893us
I20260709 13:20:27.591693 25662 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:27.588433 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:27.562201 25558 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:27.562366 25996 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:27.572628 25992 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.565120 26038 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:27.611346 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:27.614503 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:27.614858 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:27.618700 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:27.629791 18958 raft_consensus.cc:2368] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20.
I20260709 13:20:27.576139 25423 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:27.632659 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:27.636790 25787 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:27.640157 25787 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:27.640872 25993 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:27.642397 25787 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:27.586309 26009 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:27.644480 18383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d88cda52389848d584c846a8597f4977"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:20:27.645128 18383 raft_consensus.cc:606] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:27.645510 18383 raft_consensus.cc:614] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:27.645887 26009 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:27.647902 26014 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:20:27.651942 18378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:20:27.652738 18378 raft_consensus.cc:606] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:27.621273 25992 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:27.655486 25825 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:27.658638 26012 log.cc:927] Time spent T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.272s	user 0.002s	sys 0.000s
W20260709 13:20:27.660492 26027 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 13:20:27.667865 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.668037 25991 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:27.668738 25991 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:27.672370 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:27.672991 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:27.673760 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.674278 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:27.678699 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:27.679620 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51710us
I20260709 13:20:27.700255 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:27.683049 18202 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.551s (SENT) [suppressed 29 similar messages]
W20260709 13:20:27.697659 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 384401us
I20260709 13:20:27.700193 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:27.711242 18927 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:27.722260 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:27.631527 26026 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:27.724251 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:27.725168 18351 leader_election.cc:400] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22.
I20260709 13:20:27.725495 18351 leader_election.cc:403] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
W20260709 13:20:27.726852 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 164741us
I20260709 13:20:27.718843 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:27.700030 25825 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:27.632071 25996 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:27.744303 18378 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:27.684074 18954 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:27.746531 18955 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
W20260709 13:20:27.766368 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 200266us
I20260709 13:20:27.767335 18201 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:20:27.772272 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 70022.2us
W20260709 13:20:27.750886 25827 consensus_meta.cc:287] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.876s	user 0.009s	sys 0.007s
W20260709 13:20:27.771347 18202 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.852s (SENT)
I20260709 13:20:27.701036 26009 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
I20260709 13:20:27.724133 25660 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:27.773115 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:27.778544 25402 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:27.778949 25402 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.779358 25402 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:27.774650 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:27.767935 25825 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:27.789093 25699 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:27.796645 26000 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:27.780786 26022 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:27.777360 26017 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:27.810671 18201 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:27.812830 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47055.9us
I20260709 13:20:27.776161 25996 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:27.767210 26003 raft_consensus.cc:697] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:27.704634 26038 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:27.774454 26030 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22.
W20260709 13:20:27.926800 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 164368us
W20260709 13:20:27.875980 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 109141us
I20260709 13:20:27.934362 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:27.934902 25870 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:20:27.935380 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 124818us
I20260709 13:20:27.935849 25870 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 26 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:27.821070 26008 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.116s
I20260709 13:20:27.784272 25660 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:27.933964 26017 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:27.925418 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 50558.2us
I20260709 13:20:27.936883 25870 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:27.938607 25660 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:27.935189 18927 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:27.939495 26011 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:27.939546 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:27.936268 18201 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:27.782054 25773 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:27.941921 18378 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
W20260709 13:20:27.943459 26041 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:20:27.943563 26050 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:27.973313 18926 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:27.974504 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:27.974601 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:27.929070 26025 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:27.975476 18229 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 14.
I20260709 13:20:27.822817 25825 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:27.777145 25827 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:27.996918 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 57493.2us
I20260709 13:20:27.970726 25773 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:27.992915 25423 raft_consensus.cc:2804] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:20:27.975853 26004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.020s
W20260709 13:20:28.001312 26004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.000s	sys 0.020s
I20260709 13:20:28.000860 25773 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:28.004530 26050 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:28.005528 26050 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.012892 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:28.016168 25929 consensus_meta.cc:287] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.522s	user 0.004s	sys 0.007s
I20260709 13:20:28.016754 25929 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.018968 25996 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:28.019467 25929 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:28.004182 18202 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.994s (SENT)
I20260709 13:20:28.020107 26003 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:28.041759 26038 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:28.042353 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:27.985116 25699 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:28.046150 25827 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:27.993659 26030 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:28.046924 26030 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:20:28.056493 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 122293us
I20260709 13:20:28.057184 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:28.057596 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:28.057850 18228 raft_consensus.cc:3060] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:28.061926 25997 consensus_meta.cc:287] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.711s	user 0.006s	sys 0.006s
I20260709 13:20:28.063576 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:28.064967 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:28.065949 18378 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:28.066133 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:27.876935 26044 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.198s
I20260709 13:20:28.066795 18228 raft_consensus.cc:2468] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
I20260709 13:20:28.066931 18236 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 20.
I20260709 13:20:28.068053 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:28.069262 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:28.066938 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:28.065157 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:28.073316 18386 raft_consensus.cc:2393] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:28.028934 26026 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:28.047847 26030 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.076917 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:28.076045 18384 raft_consensus.cc:2393] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:28.029029 25423 raft_consensus.cc:697] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 15 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:28.086323 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:28.095211 26045 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:28.073668 25699 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 24 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:28.097900 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:28.098125 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:28.098735 18381 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 17.
I20260709 13:20:28.099575 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:28.074715 26034 log.cc:927] Time spent T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:20:28.062431 25997 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.096673 25699 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.073997 26038 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:28.102670 18201 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:28.102137 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:28.139248 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:28.140816 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:28.146088 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 88626.9us
W20260709 13:20:28.146129 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 50855.3us
I20260709 13:20:28.149322 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:28.149736 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.154800 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:20:28.129109 25868 consensus_meta.cc:287] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.000s
I20260709 13:20:28.100598 25990 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:28.156345 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:28.160354 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:28.129630 26030 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:28.104693 26017 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:28.162177 18956 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
W20260709 13:20:28.162848 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.163335 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:28.165741 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:28.129246 26045 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:28.152946 26009 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:28.172185 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 168037us
I20260709 13:20:28.151273 25998 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:28.175159 18349 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:28.187440 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:28.160877 26051 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:28.158118 26026 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:28.146664 26002 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.072s
I20260709 13:20:28.171643 25712 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:28.179180 25573 consensus_meta.cc:287] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.002s
I20260709 13:20:28.173224 26054 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:28.178025 26009 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.185886 25868 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:28.212826 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.217355 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:28.217612 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:28.219223 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:28.220043 18381 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:28.222446 18380 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:20:28.224002 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:28.224620 18378 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.226459 18277 leader_election.cc:400] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 25. Current term is 26.
I20260709 13:20:28.226933 18277 leader_election.cc:403] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:20:28.230908 26045 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.231766 26019 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:28.232333 26019 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:28.232774 26019 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:28.205528 25712 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:28.246712 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:28.178601 26017 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.212574 26004 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:28.215363 26009 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.209637 26054 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:28.192200 26049 consensus_queue.cc:1059] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
W20260709 13:20:28.249194 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 74174.7us
I20260709 13:20:28.251400 26040 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:28.252213 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 81960.8us
I20260709 13:20:28.216110 25868 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:28.253013 18277 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:28.216980 26021 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:20:28.257690 18202 leader_election.cc:336] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.514s (SENT)
I20260709 13:20:28.299351 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:28.261883 18381 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 24.
I20260709 13:20:28.211568 25573 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.248971 25712 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:28.286113 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.250459 26008 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:28.248387 25867 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 25. Current term is 26.
I20260709 13:20:28.207019 25423 consensus_queue.cc:237] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:28.273809 25879 consensus_meta.cc:287] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.937s	user 0.011s	sys 0.003s
I20260709 13:20:28.241581 25676 consensus_queue.cc:1059] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 13:20:28.313918 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 61031.2us
I20260709 13:20:28.298147 25868 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:28.263041 26054 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:28.265013 25914 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:28.348822 25997 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:28.306423 26021 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.323412 18277 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:28.330133 26017 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:28.350696 25558 consensus_meta.cc:287] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.713s	user 0.011s	sys 0.000s
I20260709 13:20:28.351176 25558 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.319406 26003 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:28.311269 26008 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:28.358147 26008 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:28.360733 25879 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:28.363140 25879 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:28.365312 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 52850.4us
I20260709 13:20:28.368417 18379 raft_consensus.cc:2393] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 16: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:20:28.335786 25992 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.681s	user 0.007s	sys 0.005s
W20260709 13:20:28.336411 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 84130.8us
I20260709 13:20:28.342563 25573 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:28.373320 25992 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:28.375399 25402 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.000s
I20260709 13:20:28.375808 25402 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.317651 26004 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:28.345261 26060 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:20:28.370755 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:28.382071 18958 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:28.382171 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:28.371680 18202 connection.cc:256] RPC call timeout handler was delayed by -1.00011882900003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
I20260709 13:20:28.378917 18378 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:28.310729 26026 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.386096 25662 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:28.386530 25662 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:28.387499 25662 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.388993 26040 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:28.390522 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43098 (request call id 1576) took 1088 ms. Trace:
I20260709 13:20:28.390915 18379 rpcz_store.cc:276] 0709 13:20:27.302130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.302607 (+   477us) service_pool.cc:224] Handling call
0709 13:20:28.390321 (+1087714us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540019b754. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:28.390458 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2355596160}
I20260709 13:20:28.377063 26004 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:28.393129 26017 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.393216 26004 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:28.393716 26017 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.396709 25662 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:28.397437 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:28.399426 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 76093.4us
I20260709 13:20:28.400177 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:28.419670 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 50061.3us
I20260709 13:20:28.425216 18958 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:20:28.427672 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:28.427968 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:28.430372 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.414357 25573 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:28.328377 25773 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:28.437971 18349 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:28.438148 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:28.438783 18383 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:28.444303 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:28.433384 25914 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:28.444895 18381 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:28.434792 26033 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
W20260709 13:20:28.450215 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 52902.4us
I20260709 13:20:28.453537 18234 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:28.464702 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:28.465276 25929 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:28.445434 26025 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:28.467270 25558 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:28.469298 26017 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:28.473623 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:28.439703 26064 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:28.494551 18378 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:28.441550 25573 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:28.477447 25402 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:28.447722 26058 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:20:28.441346 25867 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:28.443746 25825 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.493613 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:28.489530 25879 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:28.521343 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:28.523519 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:28.524016 25402 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:28.525177 25402 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:28.528067 26070 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:20:28.502569 25868 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:28.529037 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:28.530572 25868 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:28.492902 26025 raft_consensus.cc:697] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:28.495702 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:28.493130 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:28.492182 18383 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:28.505262 25773 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:28.505908 26054 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:28.506951 26021 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:28.507161 26065 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:20:28.510715 25867 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 24 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:28.497772 25712 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:28.512667 25825 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:28.512781 18381 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
W20260709 13:20:28.513499 26062 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.087s	user 0.000s	sys 0.002s
I20260709 13:20:28.514518 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3873) took 1205 ms. Trace:
I20260709 13:20:28.500224 26019 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:28.543309 18231 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
I20260709 13:20:28.556149 18927 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:28.554229 18385 rpcz_store.cc:276] 0709 13:20:27.309401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.311160 (+  1759us) service_pool.cc:224] Handling call
0709 13:20:27.311520 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:27.771935 (+460415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:27.771970 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:27.772463 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:20:28.204619 (+432156us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:28.205021 (+   402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:28.205115 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:28.514283 (+309168us) raft_consensus.cc:1685] finished
0709 13:20:28.514315 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:28.514452 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55111,"raft.queue_time_us":125225,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":2305,"thread_start_us":741366,"threads_started":2,"wal-append.queue_time_us":466371}
I20260709 13:20:28.575258 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:28.576570 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 97111.7us
I20260709 13:20:28.576992 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:28.578055 18385 raft_consensus.cc:2410] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
W20260709 13:20:28.547081 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 106917us
I20260709 13:20:28.531488 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:28.543390 18237 raft_consensus.cc:2376] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15. Re-sending same reply.
I20260709 13:20:28.549571 18378 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:28.552693 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:28.600885 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:28.601148 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 48536.9us
I20260709 13:20:28.601775 18384 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:28.602608 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:28.602741 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:28.604080 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:28.604728 26021 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:28.532562 26004 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:28.604957 26030 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:28.529110 26009 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.605392 26030 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:28.605980 26030 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:28.607067 26009 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:28.607649 25879 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:28.608036 25867 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.531533 26008 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:28.545606 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 105182us
I20260709 13:20:28.596499 18378 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:20:28.597114 18955 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:28.597759 18200 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:28.585032 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:28.599195 26025 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:28.605461 26021 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:28.594341 26019 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:28.615193 18378 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:28.615191 26009 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:28.615603 26008 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:28.613147 18275 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:28.619642 25868 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:28.621188 18275 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:28.618472 18276 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:28.644210 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.644435 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:28.645538 18307 raft_consensus.cc:2368] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21.
W20260709 13:20:28.648072 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 44059.9us
I20260709 13:20:28.649122 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:28.653806 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.656772 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:28.657330 18304 raft_consensus.cc:2376] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18. Re-sending same reply.
I20260709 13:20:28.658160 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:28.620596 26039 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:28.653944 26080 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:28.662711 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:28.640426 26033 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:28.664707 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:28.616730 25660 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:20:28.666793 18377 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:28.667062 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.650609 25573 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:28.673311 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.667770 18307 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 21: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:28.665727 18303 raft_consensus.cc:2410] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:20:28.675853 18308 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:28.676965 18378 raft_consensus.cc:1240] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:28.681229 18305 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:28.682462 18310 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.686722 26030 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.687103 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:28.688083 18232 raft_consensus.cc:2410] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:20:28.689147 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:28.686738 18230 raft_consensus.cc:1275] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:20:28.667373 26021 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:28.673311 25573 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:28.706049 25573 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:28.698146 26021 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:28.706549 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:28.705819 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:28.707317 18229 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:28.706616 26021 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:28.712047 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:28.714250 25825 raft_consensus.cc:2764] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:20:28.714494 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:28.715647 26054 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:28.715986 25879 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:28.716498 25879 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:28.716985 25879 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:28.717525 26004 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:28.673589 26080 raft_consensus.cc:697] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:28.718806 26080 consensus_queue.cc:237] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.720243 26045 raft_consensus.cc:3055] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:28.720695 26045 raft_consensus.cc:740] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:28.722497 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:28.723047 25712 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:28.721465 26045 consensus_queue.cc:260] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.725219 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.724186 26045 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:28.730813 18303 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:28.731775 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:28.732544 18231 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:28.736644 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:28.739295 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:28.740742 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:28.739974 18231 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:28.734452 26044 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:20:28.748591 18236 raft_consensus.cc:2393] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 21: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:28.748998 18310 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:28.760742 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:28.760618 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:28.761899 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:28.762652 18957 raft_consensus.cc:2368] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20.
I20260709 13:20:28.763209 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:28.763818 18311 raft_consensus.cc:2368] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20.
I20260709 13:20:28.763778 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:28.762660 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:28.727481 26009 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:20:28.765985 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:28.772121 18232 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:20:28.776333 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:28.776939 18234 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.778684 18275 leader_election.cc:400] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20.
I20260709 13:20:28.779080 18275 leader_election.cc:403] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:20:28.780660 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:28.782409 18955 raft_consensus.cc:1240] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:28.785808 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:28.786912 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:28.795318 18275 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:28.780154 25662 consensus_queue.cc:1059] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:20:28.797135 25662 raft_consensus.cc:3055] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:28.797466 25662 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:28.797538 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:28.798223 25901 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:28.798394 18232 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:28.801755 18307 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:28.796341 18961 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:28.805734 18378 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:20:28.806202 18378 pending_rounds.cc:85] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 12
I20260709 13:20:28.806444 18378 pending_rounds.cc:107] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:20:28.806694 18378 raft_consensus.cc:2889] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:28.806862 18377 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:28.811342 18310 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:28.813840 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:28.813964 26024 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:28.814993 26024 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:28.815857 26024 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:28.817133 26024 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:28.819000 18307 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:28.821090 18303 raft_consensus.cc:1240] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:28.797694 25995 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20.
I20260709 13:20:28.836588 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:28.837219 18382 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:28.838610 18201 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:28.838959 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:28.839602 18233 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:28.840325 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:28.754501 26030 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:28.850517 18310 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:28.854358 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:28.857221 18310 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:28.858489 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:28.860081 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 80113.1us
I20260709 13:20:28.860285 18308 raft_consensus.cc:2376] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20. Re-sending same reply.
I20260709 13:20:28.861997 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.863098 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.863935 18303 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:28.840199 25879 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:28.867776 18386 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:20:28.869503 18384 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:28.871260 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.872169 18306 raft_consensus.cc:2393] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:28.842399 26006 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:20:28.873669 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.877174 18308 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:28.879722 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.880617 18308 raft_consensus.cc:2368] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21.
I20260709 13:20:28.842660 26003 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:28.884780 18234 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:28.885192 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.885614 18377 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:28.885959 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.886591 18308 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
I20260709 13:20:28.888190 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.892791 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.893215 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.893590 18306 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:28.893918 18304 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:28.894095 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.893163 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.901003 18233 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 21.
I20260709 13:20:28.901003 18310 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:28.912986 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.914852 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.915007 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.915814 18307 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:28.917888 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:28.918341 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.919220 18305 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:28.920231 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:28.921032 18304 raft_consensus.cc:2376] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20. Re-sending same reply.
I20260709 13:20:28.922485 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.923185 18306 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:28.923252 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:28.866699 25870 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:20:28.867002 26009 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:20:28.926329 18382 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:28.896705 26003 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:28.930397 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.932044 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.932924 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:28.934231 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:28.948082 18351 connection.cc:256] RPC call timeout handler was delayed by -2.2426841809999587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
W20260709 13:20:28.962407 18351 connection.cc:256] RPC call timeout handler was delayed by -2.1274841809997724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
I20260709 13:20:28.972172 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.973132 18306 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:28.974534 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:28.963745 18351 connection.cc:256] RPC call timeout handler was delayed by -2.0923841809999431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 13:20:28.975669 18351 connection.cc:256] RPC call timeout handler was delayed by -1.9965165020000768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:20:28.976248 18351 connection.cc:256] RPC call timeout handler was delayed by -1.9285841809999056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
W20260709 13:20:28.995620 18351 connection.cc:256] RPC call timeout handler was delayed by -1.9069841809998707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 13:20:28.996187 18351 connection.cc:256] RPC call timeout handler was delayed by -1.8988841809998576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 13:20:29.018292 18351 connection.cc:256] RPC call timeout handler was delayed by -1.8520841809997819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 13:20:29.018886 18351 connection.cc:256] RPC call timeout handler was delayed by -1.1995841809998637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29710000000000003s for a response
I20260709 13:20:29.019865 18351 leader_election.cc:400] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21.
I20260709 13:20:29.020185 18351 leader_election.cc:403] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:20:28.975548 18303 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
W20260709 13:20:28.955304 25423 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.003s	sys 0.011s
I20260709 13:20:29.024183 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:29.087846 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:29.091699 18307 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:29.021507 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:29.088341 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.089047 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:29.089529 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:29.030797 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:29.088578 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:29.097311 18308 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:20:29.095141 18237 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:29.104851 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:29.105499 18229 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:29.109129 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:29.112895 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:29.086604 25423 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.009s	sys 0.013s
I20260709 13:20:29.113786 18303 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:20:29.114122 18233 raft_consensus.cc:2393] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 25: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:29.112970 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:29.092634 26026 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.010s	sys 0.022s
I20260709 13:20:29.120846 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:29.124795 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:28.953258 25662 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:29.130189 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:29.130697 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:29.131429 18303 raft_consensus.cc:2376] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 26. Re-sending same reply.
I20260709 13:20:29.131367 25573 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:29.132652 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:29.132782 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:29.133594 18233 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 22: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:29.134055 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:29.111291 26030 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21.
I20260709 13:20:29.134829 18303 raft_consensus.cc:2376] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21. Re-sending same reply.
I20260709 13:20:29.136044 18303 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:29.131444 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:29.188992 18306 raft_consensus.cc:2376] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24. Re-sending same reply.
W20260709 13:20:29.137490 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 117830us
I20260709 13:20:29.190274 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:29.138137 25573 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:29.191915 18229 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
W20260709 13:20:29.138579 26087 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:20:29.138599 18307 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:29.195662 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:29.196377 18307 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:29.141113 18230 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21. Ops: [18.15-20.16]
I20260709 13:20:29.141299 18234 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:20:29.145460 26009 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:29.152379 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:29.153162 26088 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:20:29.122866 26026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.010s	sys 0.023s
I20260709 13:20:29.211519 18229 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:29.171398 18304 raft_consensus.cc:2410] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:20:29.097949 25879 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:29.119133 26003 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:29.210597 26021 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:29.221303 26021 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:29.224848 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:29.187390 18305 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:29.193462 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:29.198014 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.199774 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:29.169715 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:29.214282 18308 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:29.239593 18232 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:29.214545 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:29.216656 26030 raft_consensus.cc:2764] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:20:29.236287 18307 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:29.254922 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:29.267436 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:29.267935 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:29.267652 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:29.268882 18307 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:29.270365 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:29.270737 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:29.271004 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 101407us
I20260709 13:20:29.272096 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:29.273017 18277 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:29.273984 18377 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:29.275668 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:29.276321 18308 raft_consensus.cc:2376] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21. Re-sending same reply.
I20260709 13:20:29.276650 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:29.277139 18303 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 21: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:29.273855 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:29.284353 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 94135.9us
I20260709 13:20:29.293217 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:29.296785 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:29.298570 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:29.299702 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:29.300338 18307 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:29.269395 26009 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:29.307955 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:29.284363 25995 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:29.314615 18306 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 22: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:29.349267 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:29.349530 18307 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:29.301514 26030 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.353386 26030 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:29.356981 18306 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:20:29.304911 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 104725us
I20260709 13:20:29.317345 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:29.318957 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:29.366253 18307 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:20:29.366652 18955 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.320479 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:29.257041 25993 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:20:29.322643 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:29.291643 25573 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:29.283994 25952 consensus_queue.cc:1048] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:20:29.336207 25773 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:29.338148 25867 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:20:29.366341 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 49096.9us
I20260709 13:20:29.385929 18381 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:20:29.355356 26033 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.008s	sys 0.013s
I20260709 13:20:29.381477 18306 raft_consensus.cc:1240] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:20:29.385778 25867 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:29.392365 26051 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:29.392895 26051 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:29.393884 26051 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:29.395390 26051 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:29.375319 26045 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:29.392367 25867 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:29.403541 18306 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 24 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:29.384927 18384 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:29.394325 25992 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:29.390947 18277 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:29.387966 18303 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
W20260709 13:20:29.427089 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 67672.4us
I20260709 13:20:29.428192 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:29.429780 18307 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23. Ops: [21.12-22.13]
I20260709 13:20:29.434141 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:29.440778 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 49917.1us
W20260709 13:20:29.447294 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 295025us
I20260709 13:20:29.442318 18277 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:29.450891 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:29.452121 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:29.448906 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.459833 18351 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.979s (SENT)
W20260709 13:20:29.461262 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 231186us
I20260709 13:20:29.461350 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:29.420899 26033 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.008s	sys 0.014s
I20260709 13:20:29.461320 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:29.448478 25952 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:29.453058 26024 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:29.472926 18277 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:29.468888 18958 raft_consensus.cc:2955] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 9 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:29.462651 26080 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:29.483513 18276 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:29.487632 18927 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:29.491283 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:29.452831 25825 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:20:29.501853 18311 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:29.502522 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:29.502684 18307 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:29.465034 26009 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:20:29.463905 26026 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:20:29.526307 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:29.528754 18233 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:20:29.506336 25995 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:20:29.534035 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 74220.9us
W20260709 13:20:29.536154 18351 leader_election.cc:336] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 2.161s (SENT)
I20260709 13:20:29.536643 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:29.505410 26080 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:29.515841 25423 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:29.510299 25879 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:29.518608 25929 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:29.493213 26011 consensus_queue.cc:1059] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:20:29.493599 25827 consensus_queue.cc:1059] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:20:29.558359 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:29.551275 18228 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:29.561264 18228 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:29.562644 18233 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:29.555078 26021 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:29.509477 26018 consensus_queue.cc:1059] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
W20260709 13:20:29.580961 26100 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:20:29.590164 26112 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:20:29.600915 26080 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:29.577431 26030 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:29.609841 26009 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:29.555310 25929 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:20:29.647269 18202 leader_election.cc:336] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.605s (SENT)
I20260709 13:20:29.554319 25992 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:20:29.656803 18955 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:20:29.658483 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:29.659080 18233 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:20:29.657246 26085 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:20:29.657749 26030 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:29.687783 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:29.689285 18305 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:29.687132 25929 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:29.680752 26107 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 13:20:29.692761 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 229625us
I20260709 13:20:29.685750 26030 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:29.676000 26009 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:29.732249 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.773447 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 279237us
I20260709 13:20:29.696165 18201 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:29.776378 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 268524us
W20260709 13:20:29.783288 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 83061us
W20260709 13:20:29.788172 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 92115.6us
W20260709 13:20:29.791714 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 147363us
W20260709 13:20:29.792785 18202 leader_election.cc:336] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Timed out: RequestConsensusVote RPC to 127.16.188.130:34605 timed out after 1.628s (SENT)
I20260709 13:20:29.793319 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:29.703536 26003 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:29.805405 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 247113us
W20260709 13:20:29.784027 26107 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:20:29.791159 26123 raft_consensus.cc:3055] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:29.822316 18382 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:20:29.825136 18349 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:29.786588 26045 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:20:29.821349 26024 consensus_queue.cc:1059] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 13:20:29.821308 26040 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:29.823963 26021 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.822955 26123 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:20:29.925624 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 139041us
I20260709 13:20:29.944772 18955 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 13:20:29.943801 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 95221.2us
I20260709 13:20:29.925076 26040 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:29.929749 26117 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:20:29.965519 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:29.936220 26122 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:29.929914 26126 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:29.965525 25879 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:29.991202 26103 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 13:20:29.934399 26021 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:30.017836 26089 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 1.228s	user 0.007s	sys 0.002s
I20260709 13:20:29.990645 26128 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:20:30.031700 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 222592us
W20260709 13:20:30.021230 26108 log.cc:927] Time spent T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
W20260709 13:20:30.034858 26121 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
I20260709 13:20:30.031100 26026 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:30.007443 26131 consensus_queue.cc:1059] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:20:30.063252 26131 raft_consensus.cc:3055] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:30.063665 26131 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:30.004041 26126 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.067745 26126 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:30.069653 25423 raft_consensus.cc:3055] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:30.022078 26040 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.078830 26040 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:30.086659 18310 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:20:30.086792 26021 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:30.087981 26021 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.050287 26128 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.070140 25423 raft_consensus.cc:740] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
W20260709 13:20:30.088258 26051 consensus_meta.cc:287] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.001s
I20260709 13:20:30.014416 25879 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.121713 18237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 3107) took 1031 ms. Trace:
W20260709 13:20:30.136984 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 344212us
I20260709 13:20:30.055683 26009 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:30.103259 26126 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.141628 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:30.140758 26116 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:30.142897 26126 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.145462 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:30.145582 26126 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:30.146106 18231 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:30.137282 18237 rpcz_store.cc:276] 0709 13:20:29.089821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.103690 (+ 13869us) service_pool.cc:224] Handling call
0709 13:20:29.104075 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:29.121587 (+ 17512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:29.121627 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:29.135996 (+ 14369us) log.cc:844] Serialized 26 byte log entry
0709 13:20:29.446630 (+310634us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:29.447990 (+  1360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.448097 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.121380 (+673283us) raft_consensus.cc:1685] finished
0709 13:20:30.121410 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.121627 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8877,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":44832,"thread_start_us":310057,"threads_started":1,"wal-append.queue_time_us":437456}
I20260709 13:20:30.061461 26026 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:30.150570 18228 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:20:30.123983 26021 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.124199 25423 consensus_queue.cc:260] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.125088 26131 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.035460 26008 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:20:30.165477 26008 consensus_queue.cc:1243] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer e016302b7e734d74833a2bf7bab44838 log is divergent from this leader: its last log entry 13.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:20:30.166020 25867 consensus_meta.cc:287] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.767s	user 0.015s	sys 0.000s
I20260709 13:20:30.128731 26128 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:30.150390 26026 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:30.131332 26110 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:20:30.131690 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 342419us
I20260709 13:20:30.133013 25773 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:30.134864 25573 consensus_queue.cc:1059] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:20:30.138121 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.102065 25952 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.139358 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:30.161157 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 177907us
I20260709 13:20:30.013652 26123 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.166457 25867 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.179716 25773 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:20:30.201074 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:30.164199 26120 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.229s	user 0.006s	sys 0.000s
W20260709 13:20:30.164299 26117 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.113s	user 0.003s	sys 0.002s
W20260709 13:20:30.164047 26133 log.cc:927] Time spent T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.115s	user 0.005s	sys 0.000s
W20260709 13:20:30.163821 26097 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.071s	user 0.000s	sys 0.005s
I20260709 13:20:30.182461 26021 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:30.194897 26110 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:30.194981 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 201425us
I20260709 13:20:30.262321 18303 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:30.262440 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 4032) took 1372 ms. Trace:
W20260709 13:20:30.197963 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 58740.8us
I20260709 13:20:30.263725 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:30.208263 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 70651.4us
I20260709 13:20:30.174853 25423 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:30.217384 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:30.175127 26009 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:30.176054 26116 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:20:30.224700 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 189794us
W20260709 13:20:30.257045 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 291593us
I20260709 13:20:30.185489 25879 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:30.259397 18927 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:30.256567 26132 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.121s	user 0.006s	sys 0.004s
I20260709 13:20:30.263046 18312 rpcz_store.cc:276] 0709 13:20:28.889895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.925161 (+ 35266us) service_pool.cc:224] Handling call
0709 13:20:28.934128 (+  8967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:28.934367 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:28.934383 (+    16us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:28.953419 (+ 19036us) log.cc:844] Serialized 26 byte log entry
0709 13:20:29.020056 (+ 66637us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:30.091185 (+1071129us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b1800107920. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181e1b4bc 00007fa17f16948b 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f183455 00007fa185c6b3c7 00007fa18227d9a7 00007fa18228d0bf
0709 13:20:30.091386 (+   201us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.214717 (+123331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.214821 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.215512 (+   691us) raft_consensus.cc:1685] finished
0709 13:20:30.262271 (+ 46759us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.262386 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13803,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":76351,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":26793,"spinlock_wait_cycles":23395584,"thread_start_us":276258,"threads_started":3,"wal-append.queue_time_us":185203}
I20260709 13:20:30.274317 18202 leader_election.cc:400] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21.
I20260709 13:20:30.277681 18202 leader_election.cc:403] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:30.201506 25773 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:30.258961 26125 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.260s	user 0.011s	sys 0.004s
I20260709 13:20:30.197113 25952 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.287057 18958 pending_rounds.cc:85] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Aborting all ops after (but not including) 13
I20260709 13:20:30.308029 18958 pending_rounds.cc:107] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Aborting uncommitted NO_OP operation due to leader change: 13.14
I20260709 13:20:30.308367 18958 raft_consensus.cc:2889] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:30.279855 26122 raft_consensus.cc:697] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:30.264644 25573 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:30.266626 26123 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:30.334317 18382 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 23. Current term is 24. Ops: []
W20260709 13:20:30.331423 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 61323.9us
W20260709 13:20:30.343725 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 76532.7us
W20260709 13:20:30.345010 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 81375.2us
I20260709 13:20:30.283185 26131 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:30.346300 25879 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:20:30.346479 18925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.320575 26141 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:20:30.280740 26116 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:30.347496 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.340093 18382 raft_consensus.cc:2955] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 9 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:30.274637 26003 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 13:20:30.341140 26102 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.708s	user 0.003s	sys 0.000s
I20260709 13:20:30.318715 26113 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21.
I20260709 13:20:30.330698 26145 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.274484 26009 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:30.404892 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 138346us
I20260709 13:20:30.406068 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:30.410025 18377 raft_consensus.cc:1275] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:20:30.419631 25662 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:30.422911 26119 log.cc:927] Time spent T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.426s	user 0.003s	sys 0.000s
I20260709 13:20:30.426177 26135 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:30.426904 26135 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:30.351415 26143 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.361375 25879 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.435163 26031 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:30.436579 26153 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:30.437845 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 86371.8us
I20260709 13:20:30.439924 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:30.451071 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 108850us
I20260709 13:20:30.371331 26080 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:30.445420 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 80568us
I20260709 13:20:30.449306 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:30.470618 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 169674us
I20260709 13:20:30.478644 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:30.479377 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:30.480074 18231 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:30.479593 18230 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:30.439086 26113 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:30.488333 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 3141) took 1319 ms. Trace:
I20260709 13:20:30.373257 26008 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.110s
I20260709 13:20:30.408924 26145 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.437477 26140 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:30.475025 26102 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:20:30.491336 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:30.450662 26031 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:30.497109 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:30.357651 26139 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.128s
I20260709 13:20:30.504748 18956 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:30.506441 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:30.507079 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:30.428136 26135 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:30.489897 25827 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.021s	sys 0.030s
I20260709 13:20:30.375213 26147 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.126s
I20260709 13:20:30.488754 18306 rpcz_store.cc:276] 0709 13:20:29.169369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.404573 (+235204us) service_pool.cc:224] Handling call
0709 13:20:29.447131 (+ 42558us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:29.447559 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:29.447605 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:29.460048 (+ 12443us) log.cc:844] Serialized 52 byte log entry
0709 13:20:29.708783 (+248735us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:29.782530 (+ 73747us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.073325 (+290795us) spinlock_profiling.cc:243] Waited 7.58 ms on lock 0x7b18003f5fe0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:20:30.123697 (+ 50372us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b18003f5fe0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f186522 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:20:30.423640 (+299943us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b18003f5fe0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa17f188a40 00007fa17f1834e4 00007fa17f183455 00007fa185c6b3c7 00007fa18227d9a7 00007fa18228d0bf 00007fa18228d038
0709 13:20:30.423855 (+   215us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.488001 (+ 64146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.488086 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.488125 (+    39us) raft_consensus.cc:1685] finished
0709 13:20:30.488140 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.488268 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":391654,"prepare.queue_time_us":716837,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":101,"raft.queue_time_us":75491,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":6892,"spinlock_wait_cycles":46286720,"thread_start_us":215008,"threads_started":1,"wal-append.queue_time_us":332263}
I20260709 13:20:30.370913 25773 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.520303 26135 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:30.534188 18377 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:30.497361 26030 consensus_meta.cc:287] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.721s	user 0.014s	sys 0.000s
I20260709 13:20:30.486995 25992 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:30.533070 26136 raft_consensus.cc:3055] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:30.487694 25867 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:30.541189 18384 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:20:30.371047 26110 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:30.530849 25827 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.021s	sys 0.030s
I20260709 13:20:30.528065 26141 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:20:30.557025 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 46652.7us
W20260709 13:20:30.552279 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 76007.5us
W20260709 13:20:30.556499 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 53455.8us
I20260709 13:20:30.567602 18233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3267) took 1068 ms. Trace:
I20260709 13:20:30.549727 26051 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.489674 26150 consensus_queue.cc:1059] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:20:30.553752 26021 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:30.555783 26136 raft_consensus.cc:740] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:30.568156 18233 rpcz_store.cc:276] 0709 13:20:29.499632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.675451 (+175819us) service_pool.cc:224] Handling call
0709 13:20:29.682671 (+  7220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:29.696295 (+ 13624us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:20:29.786290 (+ 89995us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.131044 (+344754us) spinlock_profiling.cc:243] Waited 8.69 ms on lock 0x7b18003b7280. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f100c0a 00007fa188840219 00007fa18614758f 00007fa17f186571 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd
0709 13:20:30.144492 (+ 13448us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:30.145131 (+   639us) log.cc:844] Serialized 26 byte log entry
0709 13:20:30.145258 (+   127us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:30.145479 (+   221us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.145647 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.145714 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.567258 (+421544us) raft_consensus.cc:1685] finished
0709 13:20:30.567301 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.567516 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":240132,"prepare.queue_time_us":90641,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":3832,"raft.queue_time_us":231359,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":7189,"spinlock_wait_cycles":19988864,"thread_start_us":102801,"threads_started":1,"wal-append.queue_time_us":188488}
I20260709 13:20:30.557363 25992 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:30.573963 25773 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:30.553349 26003 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:20:30.553074 26053 consensus_queue.cc:1048] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:20:30.557149 26080 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:20:30.564079 26138 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:30.615005 26024 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.617992 18303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 3145) took 1115 ms. Trace:
W20260709 13:20:30.620707 26096 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.284s	user 0.003s	sys 0.000s
I20260709 13:20:30.629211 26142 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:30.634572 18382 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:30.656709 18303 rpcz_store.cc:276] 0709 13:20:29.502191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.502482 (+   291us) service_pool.cc:224] Handling call
0709 13:20:29.502832 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:30.269120 (+766288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.617759 (+348639us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b5400355054. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:30.617932 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1746148608}
I20260709 13:20:30.586264 25929 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.563306 26030 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:30.659233 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 251970us
W20260709 13:20:30.660493 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 81550us
I20260709 13:20:30.663661 18275 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:30.598258 25992 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:30.602219 26129 raft_consensus.cc:2764] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:20:30.670532 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 105237us
I20260709 13:20:30.670238 18202 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:30.589164 26051 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.630187 25952 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:30.528785 26140 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.481472 26153 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.450737 26143 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.441236 26122 consensus_queue.cc:237] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.709692 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:30.722111 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 149012us
W20260709 13:20:30.709141 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 45605.7us
W20260709 13:20:30.721547 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 49313us
I20260709 13:20:30.626415 26031 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.728969 18233 raft_consensus.cc:1240] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 17. Current term is 18. Ops: []
W20260709 13:20:30.731913 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.603684 26021 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.665848 26024 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.739634 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:30.742321 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:30.743914 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:30.671152 25929 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.733961 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:30.750981 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:30.751967 26006 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:30.737846 26111 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:30.763672 18378 raft_consensus.cc:1240] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:30.754592 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:30.660145 26138 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.770396 18383 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
W20260709 13:20:30.768443 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 92674.7us
I20260709 13:20:30.771795 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:30.773312 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:30.738138 26113 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.738408 25879 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:30.734488 26151 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:30.797346 26184 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:30.768939 26009 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:30.796357 26179 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:30.763391 26111 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:30.776441 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:30.754150 26166 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
W20260709 13:20:30.784657 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 220993us
I20260709 13:20:30.768599 26170 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:30.834726 18303 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:30.670508 26142 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.769697 25662 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:30.769582 26031 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:30.732815 25952 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 13:20:30.705287 26136 consensus_queue.cc:260] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.832494 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3254) took 2052 ms. Trace:
I20260709 13:20:30.755113 26006 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.839612 25558 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:30.830638 26111 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:30.780927 26178 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:30.828176 26040 consensus_meta.cc:287] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.749s	user 0.007s	sys 0.007s
I20260709 13:20:30.850719 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:30.826683 26141 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 21 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:30.832569 26151 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:30.840755 26145 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:30.847803 18236 rpcz_store.cc:276] 0709 13:20:28.779631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.787771 (+  8140us) service_pool.cc:224] Handling call
0709 13:20:28.788092 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:28.788449 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:28.788482 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:28.813176 (+ 24694us) log.cc:844] Serialized 26 byte log entry
0709 13:20:28.929298 (+116122us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:29.242329 (+313031us) log.cc:844] Serialized 14 byte log entry
0709 13:20:29.257891 (+ 15562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:29.257992 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.268741 (+1010749us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b180017c920. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:20:30.620008 (+351267us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:30.832178 (+212170us) raft_consensus.cc:1685] finished
0709 13:20:30.832210 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.832417 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15270,"prepare.queue_time_us":108924,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":117561,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":1965,"spinlock_wait_cycles":25692288,"thread_start_us":272236,"threads_started":2,"wal-append.queue_time_us":166113}
W20260709 13:20:30.863531 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 109015us
W20260709 13:20:30.856654 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 68188.9us
I20260709 13:20:30.838279 25573 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:30.855273 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 121386us
I20260709 13:20:30.864946 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:30.837314 25867 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:20:30.850950 25662 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:30.844050 26053 consensus_queue.cc:1059] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:20:30.803684 26113 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.886240 26173 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.886411 26171 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:30.886695 26177 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:20:30.887051 26154 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:30.868234 25573 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:30.887217 26156 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.887859 26165 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.888147 26006 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:30.888211 26144 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.158s
I20260709 13:20:30.889424 26140 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:30.889165 26141 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:30.890157 26159 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:20:30.843439 26170 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.894131 26145 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:30.826926 26184 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:30.908866 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 132504us
I20260709 13:20:30.912565 26030 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:30.915638 26142 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:30.854795 26115 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.230s
I20260709 13:20:30.892923 26172 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.891285 26143 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:30.925832 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:30.927647 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:30.931893 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 67012.2us
I20260709 13:20:30.934741 26128 raft_consensus.cc:3055] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:30.937053 25929 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:30.938548 25662 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.939098 26021 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:30.916926 26051 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:30.976867 26172 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:31.014431 26172 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:31.015693 26113 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:30.949651 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:30.950695 26116 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:30.951006 26184 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:30.923717 26040 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:20:30.909017 26173 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.917354 25573 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:30.875046 26130 consensus_queue.cc:1059] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.208s
I20260709 13:20:30.964272 18927 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:30.869483 26151 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:30.968025 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:30.976382 25995 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.014s
W20260709 13:20:30.982867 26180 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:20:30.983036 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:30.983513 26109 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:30.984359 26170 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:30.969178 26153 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:30.922261 26165 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:31.036800 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 53863.7us
I20260709 13:20:31.038281 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:31.038859 26165 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:31.039398 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:31.039414 26116 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:30.971164 26128 raft_consensus.cc:740] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:31.003377 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:31.003188 26143 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:31.040539 26116 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:31.041062 26143 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.043871 26143 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:31.040385 26113 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:31.024637 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 159737us
W20260709 13:20:31.020884 26131 consensus_meta.cc:287] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.635s	user 0.008s	sys 0.003s
W20260709 13:20:31.033953 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 69768.9us
I20260709 13:20:31.046640 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:31.048120 26113 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:31.035167 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 67251.3us
I20260709 13:20:30.978631 26006 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.036705 26109 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:30.911791 26171 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:30.922457 26156 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.045234 26128 consensus_queue.cc:260] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.049055 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:31.069856 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:31.071834 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:31.073648 25423 consensus_meta.cc:287] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.804s	user 0.008s	sys 0.004s
I20260709 13:20:31.076897 26156 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:31.078578 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:31.082123 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:31.087250 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:31.034863 26129 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:31.036217 26026 consensus_meta.cc:287] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.843s	user 0.014s	sys 0.000s
I20260709 13:20:31.049701 25995 consensus_queue.cc:1243] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer 8b4fbc44aa2649f0bcac5cd70f71951d log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:20:31.107317 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 57544.3us
I20260709 13:20:31.085148 26170 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:31.107250 26190 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:31.087785 26156 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:31.090022 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:31.109894 26011 raft_consensus.cc:3055] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:31.110347 26011 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:31.111905 26122 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:31.111459 26011 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.113008 26190 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:31.113399 26011 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:31.080417 26131 consensus_queue.cc:1059] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:20:31.084851 26153 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:31.115123 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:31.116034 26153 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:31.117545 26170 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:31.118120 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:31.119477 26126 raft_consensus.cc:3055] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:31.119884 26126 raft_consensus.cc:740] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:20:31.122207 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 386285us
I20260709 13:20:31.123546 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:31.124290 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:31.126524 26156 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.127051 26156 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.129082 26156 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:31.130419 26136 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.131345 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:31.133674 26138 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:31.134210 26190 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.135084 26024 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:31.134842 26190 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.135653 26024 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.136204 26024 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.137367 26190 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:31.138300 26024 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:31.138685 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:31.139426 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.139899 26190 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:31.140365 26190 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.140764 26190 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:31.141278 26127 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:31.141913 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:31.141846 26127 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.142645 18382 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 24: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:31.143977 26127 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:31.145306 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:31.145931 18954 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:31.150113 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:31.153190 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:31.154241 26190 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.154995 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:31.156630 26190 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:31.156782 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:31.158936 18958 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:20:31.157395 26138 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:31.159771 26138 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.160203 26138 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:31.159796 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:31.162338 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:31.163389 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:31.158123 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:31.165181 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:31.166208 18954 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:31.168619 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:31.165143 26122 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:31.172389 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.173974 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:31.174089 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.174430 26138 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.175731 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:31.177132 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.177750 18228 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 17.
I20260709 13:20:31.178896 26138 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:31.180405 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:31.175021 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:31.048877 26021 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:31.197072 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:31.198091 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 89555.6us
I20260709 13:20:31.198362 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.079753 26142 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:31.200151 18310 raft_consensus.cc:2393] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:31.200901 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.199147 18228 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
W20260709 13:20:31.094043 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47464.6us
I20260709 13:20:31.202639 18237 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
W20260709 13:20:31.193627 26180 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:20:31.209190 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.209949 18237 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:31.206923 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:31.206001 18202 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:31.193279 26139 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:31.216455 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.199296 26021 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:31.224059 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.226732 18276 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:31.230489 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.211714 26109 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.296212 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:31.298229 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 66522.2us
I20260709 13:20:31.298609 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.207875 26170 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:31.235349 18384 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:20:31.195137 26143 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
W20260709 13:20:31.307651 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.317414 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.335602 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:31.335685 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:31.336356 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:31.334993 26147 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:31.402185 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 59711.2us
I20260709 13:20:31.228440 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:31.305107 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 78429.8us
I20260709 13:20:31.413609 26126 consensus_queue.cc:260] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.414762 26126 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.414878 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:31.415649 18307 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:31.416188 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:31.416622 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:31.417304 18307 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:31.417688 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:31.418157 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:31.418326 18312 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:31.418643 26033 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.419410 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:31.420027 26166 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.420500 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:31.420620 26166 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.421890 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:31.422955 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:31.423930 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:31.424014 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:31.424988 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:31.223363 26181 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.430912 25993 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.227172 26151 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:31.433720 25993 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.413975 26147 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.330268 25827 raft_consensus.cc:3055] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:31.444126 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:31.294749 26021 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:31.419196 26033 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:31.429447 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 201065us
W20260709 13:20:31.222121 26191 log.cc:927] Time spent T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:20:31.432044 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.225319 25929 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.328426 26170 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:31.224362 26009 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:20:31.330435 26135 consensus_meta.cc:287] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.777s	user 0.000s	sys 0.013s
I20260709 13:20:31.333700 26184 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:31.223218 26171 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:31.416801 26192 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:31.405823 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:31.404873 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.442544 18307 raft_consensus.cc:2410] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 23 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:20:31.336781 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:31.328377 18228 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
W20260709 13:20:31.418291 26207 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:20:31.406459 25992 consensus_meta.cc:287] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.716s	user 0.011s	sys 0.000s
I20260709 13:20:31.214354 26026 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.292095 25867 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.450384 18386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:20:31.497408 18386 raft_consensus.cc:606] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:31.497956 18386 raft_consensus.cc:614] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:31.220006 26011 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:31.451920 18308 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 21: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:31.331166 26122 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:31.454555 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:31.227775 26165 consensus_queue.cc:1059] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.182s
I20260709 13:20:31.226157 26194 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:31.456874 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.293481 26173 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:31.330744 26109 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:31.329576 26153 consensus_queue.cc:1059] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.107s
I20260709 13:20:31.466500 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:31.443462 26131 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:31.479640 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:31.472386 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.450145 26166 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:31.485193 18231 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:31.484217 18311 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:31.443656 25827 raft_consensus.cc:740] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:31.484405 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:31.528214 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.465385 25929 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.469592 26170 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:31.478773 26009 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:31.556067 18385 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 24. Current term is 25. Ops: []
W20260709 13:20:31.572536 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 118049us
I20260709 13:20:31.710434 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:31.497669 26130 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.491362 26192 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.576357 18383 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:20:31.478977 25573 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.434049 26181 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.518833 26179 raft_consensus.cc:2764] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:20:31.554358 26024 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.575205 26114 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:31.516664 25992 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.643210 18386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35ee2a6512e24d10af3526398de71490"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:20:31.531072 26122 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.648815 18954 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:31.656657 26128 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.516278 26184 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.537503 26186 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.104s
I20260709 13:20:31.667136 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:31.752503 18230 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:31.687558 26194 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.670049 26033 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:31.671655 26205 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:20:31.672765 26026 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:31.673867 26111 consensus_meta.cc:287] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.813s	user 0.007s	sys 0.005s
W20260709 13:20:31.474097 26200 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:20:31.528687 25867 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.701643 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.704970 18236 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
W20260709 13:20:31.706815 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 222492us
I20260709 13:20:31.786427 18229 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:31.718488 26130 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:31.709870 26195 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 13:20:31.722607 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.726877 18309 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:31.729336 18386 raft_consensus.cc:606] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:31.668035 18381 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:31.752985 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.713495 26192 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:31.713708 26009 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:31.795004 18386 raft_consensus.cc:614] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:31.691146 26021 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.797894 18386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:20:31.798457 18386 raft_consensus.cc:606] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:31.799266 26021 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:31.800093 18384 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:31.719823 26115 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:31.763006 18235 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:31.801090 18386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:20:31.801681 18386 raft_consensus.cc:606] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:31.802023 18386 raft_consensus.cc:614] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:31.803660 26192 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.804170 18386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
mode: GRACEFUL
new_leader_uuid: "459e82ee6b564cc19be6f73186938e79"
 from {username='slave'} at 127.0.0.1:57770
I20260709 13:20:31.766256 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:31.804905 18312 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 23: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:31.696774 26131 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.805491 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.806118 18233 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:31.806914 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.807281 26131 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:31.807888 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.713577 26139 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:31.772343 18230 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:31.809182 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.774178 18234 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:31.809365 26139 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:31.809803 18386 raft_consensus.cc:606] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Received request to transfer leadership to TS 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:31.776240 18275 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:31.779287 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:31.810105 26139 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:31.717885 26003 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:20:31.736588 26158 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.811679 26158 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.720059 26157 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.049s
I20260709 13:20:31.788609 18231 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:20:31.681703 26129 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.813493 26129 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.814482 18386 raft_consensus.cc:614] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:31.753839 26147 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:31.778920 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 289858us
I20260709 13:20:31.767016 26185 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:31.809803 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.765450 26171 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:20:31.810771 26033 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:31.816459 26129 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:31.819705 18230 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:31.820899 18956 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:31.823407 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:31.828174 18378 raft_consensus.cc:2393] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 15: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:31.828951 18202 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:31.829523 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:31.830338 18378 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 24.
I20260709 13:20:31.830549 26040 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:31.831099 26040 raft_consensus.cc:697] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:31.831597 18378 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 24. Current term is 25. Ops: [22.14-24.15]
I20260709 13:20:31.831950 26040 consensus_queue.cc:237] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.817075 26185 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:31.833616 26185 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.787660 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:31.834777 26185 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:31.837124 26021 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:31.837618 26021 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.838040 26021 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:31.834973 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47399.4us
I20260709 13:20:31.843817 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:31.844988 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:31.844360 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:31.846045 26026 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:31.846679 26026 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.847101 26026 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:31.849040 18303 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:31.849965 26171 raft_consensus.cc:2764] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:20:31.855474 26026 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.857307 26003 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:31.858002 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:31.857323 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:31.858870 18304 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:31.814061 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.863013 18233 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:20:31.864276 18233 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:20:31.858069 26003 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:31.867774 26003 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.868611 26033 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.869130 26033 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.870311 26031 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:31.871474 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:31.871778 18304 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:31.861208 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:31.872807 26031 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:31.872941 25662 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:31.874132 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:31.875111 25662 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:31.875525 25662 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:31.875892 25662 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:31.879136 26155 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:31.879545 26155 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.880048 26155 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:31.880730 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:31.881687 26145 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:31.882125 26145 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.879492 26185 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:20:31.882777 26145 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:31.883497 26185 consensus_queue.cc:1243] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer 8b4fbc44aa2649f0bcac5cd70f71951d log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:31.884081 26150 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:31.884545 26150 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:31.885679 26150 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.887049 26150 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:31.890426 26145 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.896781 26145 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:31.881916 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:31.833603 18235 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 25.
I20260709 13:20:31.900041 26145 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:31.900676 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:31.901729 26156 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:31.902132 26156 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.902151 26031 consensus_queue.cc:1059] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:31.902654 26156 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:31.903620 26115 raft_consensus.cc:3055] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:31.904004 26115 raft_consensus.cc:740] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:31.903406 26139 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.904851 26115 consensus_queue.cc:260] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.905571 18378 raft_consensus.cc:1240] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:31.900724 26155 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.909502 18228 raft_consensus.cc:2410] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:20:31.892983 25662 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.778872 26166 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.911461 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.734272 26024 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.913707 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.781548 25993 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:31.921711 26173 raft_consensus.cc:3055] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:31.922115 26173 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:31.922360 25929 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:31.924317 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.927456 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:31.924492 18200 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:31.929986 18200 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:20:31.944682 26206 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 13:20:31.946877 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:31.914664 26199 log.cc:927] Time spent T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:20:31.948347 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:31.956192 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:31.957139 18961 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:31.965802 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:31.789872 26111 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.932319 26194 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:31.977582 18381 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:31.978523 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:31.782543 25827 consensus_queue.cc:260] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:31.981554 18232 raft_consensus.cc:1240] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:31.922936 26173 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.919764 26166 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.981303 26111 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:31.920075 26009 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.992420 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:31.991914 26021 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:31.993526 25993 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:31.992164 26040 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:31.977566 26139 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:32.009711 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:31.928411 26178 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
W20260709 13:20:32.003436 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 73520.4us
I20260709 13:20:31.987823 26190 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:31.977365 26138 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:20:32.010601 18304 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 25: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:32.011231 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:32.013999 18200 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:32.015951 18305 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:32.014816 25992 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:32.019930 26003 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.022261 26003 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.000422 26157 consensus_queue.cc:1059] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:20:32.010485 25993 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:32.027449 18200 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:32.034410 18277 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:32.037181 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:32.042177 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:32.042348 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:32.042856 18303 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:20:32.040496 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:32.042846 18377 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:32.047700 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:32.031363 26011 consensus_meta.cc:287] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.507s	user 0.004s	sys 0.007s
I20260709 13:20:32.052412 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:32.026531 26190 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:32.039426 25993 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:32.067670 26009 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:32.052595 26181 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:32.041834 25992 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:32.030916 26111 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:32.060698 26212 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:20:32.061167 26194 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:32.066426 26006 consensus_meta.cc:287] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 1.001s	user 0.012s	sys 0.000s
I20260709 13:20:32.045389 26139 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:32.065191 26214 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:32.065752 26021 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:32.066201 26122 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:32.039007 25573 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:32.043759 26026 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:32.066494 26166 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:32.066964 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:32.075950 26221 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:32.056399 26011 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:32.054476 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:32.069190 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:32.062364 25662 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:32.051929 26150 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.067088 26024 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:32.078680 26138 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:32.045692 26156 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.096320 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:32.108901 18955 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
W20260709 13:20:32.116351 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 61952.6us
I20260709 13:20:32.139968 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:32.140226 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:32.118716 26115 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:32.119642 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:32.153584 18230 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:32.087359 26006 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:32.116029 18377 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
I20260709 13:20:32.085974 26139 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:32.128882 18385 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3907) took 1392 ms. Trace:
I20260709 13:20:32.157970 18385 rpcz_store.cc:276] 0709 13:20:30.736997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.737194 (+   197us) service_pool.cc:224] Handling call
0709 13:20:30.747614 (+ 10420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.713893 (+966279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.128500 (+414607us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b540033d954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:32.128798 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1858727168}
I20260709 13:20:32.131557 18236 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 24. Current term is 25. Ops: [22.14-24.15]
I20260709 13:20:32.131875 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:32.120698 25573 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:32.120546 26221 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.120200 26190 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.148875 26011 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:32.151646 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.151948 18961 raft_consensus.cc:2393] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 16: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
W20260709 13:20:32.166714 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:32.153002 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.160835 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:32.160142 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 249938us
I20260709 13:20:32.170433 18230 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:32.172741 18237 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:32.165091 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:32.175712 18311 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:32.183641 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:32.184652 18303 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16.
I20260709 13:20:32.160040 26139 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:32.186515 18927 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:32.194505 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:32.164928 26135 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:32.195690 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:32.196357 18310 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 18.
I20260709 13:20:32.192718 18275 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:32.198694 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:32.199957 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:32.202366 26202 log.cc:927] Time spent T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.768s	user 0.005s	sys 0.000s
I20260709 13:20:32.203603 26215 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:32.204867 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3920) took 1083 ms. Trace:
I20260709 13:20:32.205284 18382 rpcz_store.cc:276] 0709 13:20:31.121889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.143202 (+ 21313us) service_pool.cc:224] Handling call
0709 13:20:31.143478 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.143793 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.143820 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.144264 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:20:31.307706 (+163442us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:20:31.307761 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.307848 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:32.161925 (+854077us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:32.204577 (+ 42652us) raft_consensus.cc:1685] finished
0709 13:20:32.204600 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.204810 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5177,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":40966400,"thread_start_us":163027,"threads_started":1,"wal-append.queue_time_us":284047}
I20260709 13:20:32.207899 26156 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:32.143033 26150 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.216734 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:32.218147 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 45394.8us
W20260709 13:20:32.190996 26109 consensus_meta.cc:287] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
I20260709 13:20:32.221088 18233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
new_leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:35652
W20260709 13:20:32.221796 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 181358us
I20260709 13:20:32.296033 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:32.222002 26033 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:32.244155 26181 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:32.175225 26011 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.195472 26194 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:32.247514 18229 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 24.
W20260709 13:20:32.245064 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 52444.5us
I20260709 13:20:32.194518 26018 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:32.294659 18233 raft_consensus.cc:606] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Received request to transfer leadership to TS 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:32.299798 18233 raft_consensus.cc:614] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:32.293593 18277 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:32.273743 26006 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:32.299273 18275 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:32.302866 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 80396.7us
I20260709 13:20:32.279114 26151 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:32.222160 26114 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.078s
I20260709 13:20:32.274487 26135 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.314872 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:32.317102 18351 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:32.267446 25573 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:20:32.329205 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:32.336282 18961 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:32.275208 26110 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:20:32.338464 18275 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:32.336339 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:32.303776 26033 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:32.339094 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:32.301079 26018 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.344727 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:32.341138 26181 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:32.348920 26181 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.349350 26181 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:32.349020 26139 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.350402 25867 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:32.351173 18385 raft_consensus.cc:1240] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:32.351794 26136 raft_consensus.cc:3055] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:32.354382 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:32.355559 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:32.356742 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:32.356918 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.316314 26151 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.318514 26144 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:32.322264 26011 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:32.306080 26226 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:20:32.361037 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.339725 26147 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:32.381349 26170 consensus_meta.cc:287] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.662s	user 0.003s	sys 0.009s
I20260709 13:20:32.381844 26170 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.382879 18380 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:32.383953 26170 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:32.352306 26136 raft_consensus.cc:740] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:20:32.385113 26203 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.605s	user 0.000s	sys 0.003s
I20260709 13:20:32.375347 26181 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.385248 26136 consensus_queue.cc:260] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.387107 26136 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:32.387311 26181 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:32.388815 18379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3916) took 1268 ms. Trace:
I20260709 13:20:32.389196 18379 rpcz_store.cc:276] 0709 13:20:31.120738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.125502 (+  4764us) service_pool.cc:224] Handling call
0709 13:20:31.165826 (+ 40324us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b5800050198. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:20:31.166037 (+   211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.166474 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.166518 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.167057 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:20:31.436697 (+269640us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:20:31.436765 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.436980 (+   215us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:32.360117 (+923137us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:32.388596 (+ 28479us) raft_consensus.cc:1685] finished
0709 13:20:32.388619 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.388743 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":139,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":47716096,"thread_start_us":269110,"threads_started":1,"wal-append.queue_time_us":540367}
I20260709 13:20:32.385208 26150 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:32.358295 26018 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:32.360883 25825 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:32.317535 26006 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.340112 26222 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:32.364966 18277 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:32.320214 26135 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.397444 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:32.364670 26230 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:32.374208 18228 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:32.376333 26221 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:32.367972 26145 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:32.365162 26109 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.379122 25993 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.360596 26156 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:20:32.393043 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.364578 18351 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:32.359297 25867 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:32.361155 26151 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:32.368697 26226 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.398031 18961 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:32.398545 25825 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:32.399410 26150 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:32.401731 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:32.409216 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 44727.6us
I20260709 13:20:32.395980 26222 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:20:32.415856 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.423195 18228 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:20:32.425123 18381 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:32.425938 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:32.428040 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:32.424250 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:32.407286 26109 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.426942 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:32.427587 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:32.410104 26156 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:32.433493 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:32.428066 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.426154 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:32.430397 18385 raft_consensus.cc:2368] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 24. Current term is 25.
I20260709 13:20:32.407370 26230 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:32.421183 26226 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:32.434602 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:32.420061 26145 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:32.407541 26116 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:20:32.441823 26006 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:32.442263 18310 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: [18.11-21.12]
I20260709 13:20:32.458696 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:32.442449 26158 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:32.428741 26222 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:32.447911 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:32.454356 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:32.462908 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4380) took 1033 ms. Trace:
I20260709 13:20:32.465034 18384 rpcz_store.cc:276] 0709 13:20:31.429082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.429219 (+   137us) service_pool.cc:224] Handling call
0709 13:20:31.429466 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.800493 (+371027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.462621 (+662128us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54003a57d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:32.462836 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":851896704}
I20260709 13:20:32.465653 18311 raft_consensus.cc:2368] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19.
I20260709 13:20:32.437419 26156 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:32.464345 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:32.470013 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:32.437554 26139 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:32.472915 18305 raft_consensus.cc:2393] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:32.467779 18309 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:32.464567 18304 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:32.467510 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:32.421834 25825 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.445166 26033 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.476357 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:32.477177 18310 raft_consensus.cc:2368] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 24. Current term is 25.
I20260709 13:20:32.472234 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:32.475350 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:32.475857 18381 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:32.480768 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:32.483136 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:32.483348 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:32.484201 18308 raft_consensus.cc:2393] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:32.485806 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:32.487299 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:32.488049 18228 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:32.491633 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:32.458549 26153 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:32.436564 26170 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:20:32.495291 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:32.496487 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:32.496022 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:32.497308 18228 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:32.497891 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:32.498504 18310 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:32.498625 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:32.466449 26145 raft_consensus.cc:697] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:32.466449 26221 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:32.509644 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:32.470579 25662 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:32.473408 26116 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:32.499738 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:32.529968 18309 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:32.513473 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:32.484797 26158 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.532788 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:32.533454 18308 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:32.519322 18202 leader_election.cc:400] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19.
I20260709 13:20:32.534384 18202 leader_election.cc:403] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:32.533185 18201 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:32.524736 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 45079.7us
I20260709 13:20:32.519968 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:32.512379 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:32.539556 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:32.484616 26228 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:32.544665 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:32.545861 18382 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 25: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:32.550853 18310 raft_consensus.cc:2468] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:32.551700 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:32.552127 18310 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:32.553893 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:32.554569 18228 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:20:32.555608 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:32.531497 26220 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:20:32.484154 26033 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.539263 26113 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:20:32.535326 26230 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.562327 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:32.560904 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.579195 18377 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 24.
I20260709 13:20:32.579574 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:32.564316 18303 raft_consensus.cc:2393] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 15: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:32.570914 18311 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:20:32.577600 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:32.586061 18308 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:32.508996 26178 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:32.589035 18310 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:32.501740 26139 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:20:32.591883 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:32.594832 26130 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:32.531491 26221 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.597980 26194 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:32.576112 25867 consensus_queue.cc:1059] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:20:32.568697 26147 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:20:32.566916 25993 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:32.573623 26113 raft_consensus.cc:3055] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:32.601642 26018 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.601931 26226 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:32.646222 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 43711.2us
I20260709 13:20:32.529750 26006 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:20:32.621063 18961 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:32.532173 25662 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.649135 18275 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:32.573242 26179 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:32.652890 18386 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:32.629318 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:32.621454 18381 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:32.579025 26026 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:32.535305 26116 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.658025 18383 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:32.622138 26178 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.663535 18309 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:32.632802 18228 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:32.633435 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:32.573925 26181 consensus_queue.cc:1059] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:20:32.569321 26109 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:32.543212 26158 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.573431 26186 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:20:32.602895 26135 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:32.564347 26213 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.833s	user 0.004s	sys 0.000s
I20260709 13:20:32.499825 26153 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.707647 26155 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:32.707939 26153 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:32.643127 26113 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:32.709223 26113 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.710857 26113 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:32.712399 26018 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:32.714104 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 3148) took 1380 ms. Trace:
I20260709 13:20:32.714653 18306 rpcz_store.cc:276] 0709 13:20:31.333549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.335951 (+  2402us) service_pool.cc:224] Handling call
0709 13:20:31.414073 (+ 78122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:31.451779 (+ 37706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:31.451813 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:31.458664 (+  6851us) log.cc:844] Serialized 26 byte log entry
0709 13:20:31.676909 (+218245us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:31.676950 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:31.677014 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:32.563635 (+886621us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:32.713608 (+149973us) raft_consensus.cc:1685] finished
0709 13:20:32.713643 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:32.713925 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66174,"raft.queue_time_us":37757,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7715,"spinlock_wait_cycles":12262272,"thread_start_us":148658,"threads_started":1,"wal-append.queue_time_us":189676}
W20260709 13:20:32.718820 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 66143.3us
I20260709 13:20:32.637310 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:32.725212 18959 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:32.667693 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:32.649091 26128 raft_consensus.cc:2764] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:20:32.673873 25662 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:32.655808 26011 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:32.678190 26221 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:32.669776 25867 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:32.687594 26222 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.688385 26181 raft_consensus.cc:3055] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:20:32.689592 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 56257.6us
I20260709 13:20:32.690300 26215 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:32.690429 26226 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:32.666556 26220 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19.
I20260709 13:20:32.642305 26145 consensus_queue.cc:237] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.693240 26178 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:32.695130 26158 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:32.696079 26241 log.cc:927] Time spent T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:20:32.698182 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:32.699905 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:32.704130 26116 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:32.758260 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:32.778067 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 244956us
I20260709 13:20:32.757051 18956 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 15.
I20260709 13:20:32.764371 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:32.768952 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:20:32.772867 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 235637us
I20260709 13:20:32.775398 18378 raft_consensus.cc:1240] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:32.803922 18351 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:20:32.772147 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 252997us
I20260709 13:20:32.802696 18228 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:20:32.768196 26181 raft_consensus.cc:740] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:32.805909 18276 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:32.807466 18234 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 3142) took 1491 ms (client timeout 1551 ms). Trace:
I20260709 13:20:32.806327 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:32.806360 18277 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:32.808262 18228 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:32.807912 18234 rpcz_store.cc:269] 0709 13:20:31.316324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.317055 (+   731us) service_pool.cc:224] Handling call
0709 13:20:32.807300 (+1490245us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b540001aed4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:32.807410 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1025594752}
I20260709 13:20:32.760428 26151 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.806756 18201 leader_election.cc:400] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 24. Current term is 25.
I20260709 13:20:32.809414 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:32.767186 26011 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.812985 18234 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:20:32.772318 25867 raft_consensus.cc:697] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:32.814239 18277 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:32.811564 18276 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:32.812011 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:32.816099 18201 leader_election.cc:403] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:20:32.817705 18228 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 25.
I20260709 13:20:32.819948 18202 leader_election.cc:400] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 24. Current term is 25.
I20260709 13:20:32.817022 26144 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:32.821346 26144 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.821713 26144 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:32.825284 25952 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:32.825767 25952 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.826118 25952 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:32.828640 26136 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:32.829159 26136 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.826133 18232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 3130) took 1654 ms. Trace:
I20260709 13:20:32.831341 18232 rpcz_store.cc:276] 0709 13:20:31.171596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.171714 (+   118us) service_pool.cc:224] Handling call
0709 13:20:31.171996 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.990544 (+818548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.825866 (+835322us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b540001ccd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:32.826069 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861347200}
W20260709 13:20:32.834431 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 55610.4us
I20260709 13:20:32.820712 18202 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:32.805116 26158 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:32.810806 26155 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:32.846418 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:32.849677 18382 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 25: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:32.813824 26147 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:32.814328 25825 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.829551 26136 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:32.861259 26009 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:32.863435 18351 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:32.854005 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:32.864455 26190 raft_consensus.cc:2804] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:32.836269 26109 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:32.865451 18351 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:32.839933 26006 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 24. Current term is 25.
I20260709 13:20:32.849390 26245 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:32.853456 26155 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.873863 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:32.837846 26156 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.865319 26248 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:32.872925 26245 raft_consensus.cc:493] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:32.878890 26226 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:32.884557 26245 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:32.884738 26226 raft_consensus.cc:697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:32.885666 26226 consensus_queue.cc:237] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.879029 26249 consensus_queue.cc:1059] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:20:32.890301 26156 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:32.865106 26190 raft_consensus.cc:697] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:32.890378 26173 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:32.891913 18381 raft_consensus.cc:1240] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:32.893572 26011 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
W20260709 13:20:32.914458 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 65531.1us
I20260709 13:20:32.878015 26155 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:32.920845 18202 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:32.911242 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:32.917989 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46128 (request call id 1245) took 1459 ms. Trace:
I20260709 13:20:32.854378 26158 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.898523 26153 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:32.897147 26222 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:32.922214 18231 rpcz_store.cc:276] 0709 13:20:31.458641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.706438 (+247797us) service_pool.cc:224] Handling call
0709 13:20:31.788152 (+ 81714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:31.812907 (+ 24755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.917774 (+1104867us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b540029d6d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:32.917920 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187191552}
W20260709 13:20:32.920142 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 68733.4us
I20260709 13:20:32.866385 25825 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.857745 26181 consensus_queue.cc:260] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.927177 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:32.926630 26006 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:32.939347 26157 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:32.940145 26150 raft_consensus.cc:3055] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:32.940637 26150 raft_consensus.cc:740] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:32.940259 25952 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:32.941676 26150 consensus_queue.cc:260] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.943208 25952 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:32.943327 26150 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:32.947378 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.953122 18926 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:32.956225 26157 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:32.965667 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:32.966331 18960 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:32.946336 26181 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:32.926945 26246 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.927254 26156 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:32.973891 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:32.976650 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43788 (request call id 3162) took 1637 ms. Trace:
I20260709 13:20:32.976495 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:32.976862 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:32.977906 18312 rpcz_store.cc:276] 0709 13:20:31.339228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.424762 (+ 85534us) service_pool.cc:224] Handling call
0709 13:20:32.976429 (+1551667us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b540013f454. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:32.976604 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871993600}
I20260709 13:20:32.973932 26256 consensus_queue.cc:1059] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:20:32.977064 25662 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:32.980317 25662 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:32.980712 25662 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:32.981328 26190 consensus_queue.cc:237] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:32.914882 25867 consensus_queue.cc:237] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:32.984617 26243 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:20:32.987587 26158 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:32.988004 26256 raft_consensus.cc:3055] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:32.988453 26256 raft_consensus.cc:740] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:32.960798 26153 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:20:32.989863 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.965103 26254 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:33.000908 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 69740.4us
I20260709 13:20:32.971433 26006 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:33.010125 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:33.010874 18382 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 21.
I20260709 13:20:33.011055 26192 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:33.011904 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:33.003111 26254 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:33.014842 26006 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.015877 26254 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:32.977169 26246 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:33.017620 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:33.018927 26246 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:33.019342 26033 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:33.019944 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.022881 26245 raft_consensus.cc:515] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:33.025147 18237 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 3139) took 1809 ms (client timeout 1514 ms). Trace:
W20260709 13:20:33.025588 18237 rpcz_store.cc:269] 0709 13:20:31.216033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.216175 (+   142us) service_pool.cc:224] Handling call
0709 13:20:33.024968 (+1808793us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b540001b8d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:33.025072 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197774720}
I20260709 13:20:33.026718 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:33.032282 18960 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:33.033974 18275 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:33.035341 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:33.036446 18382 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:33.039480 18962 raft_consensus.cc:2410] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:20:33.034718 26248 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:33.046085 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:33.049839 18957 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:20:33.048496 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:33.051862 18351 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.188.129:43781 timed out after 1.514s (SENT) [suppressed 20 similar messages]
I20260709 13:20:33.054333 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:33.055902 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:33.056499 18230 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 21.
I20260709 13:20:33.057606 18927 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:33.062039 25992 raft_consensus.cc:3055] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:33.062525 25992 raft_consensus.cc:740] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:33.062803 18382 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:20:33.043241 26165 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:32.989282 26256 consensus_queue.cc:260] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.042905 26248 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.063637 26158 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:32.989629 26153 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.076205 25992 consensus_queue.cc:260] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.063782 26111 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:33.068065 26252 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:20:33.093290 25825 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:33.096292 26248 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:33.079098 26165 raft_consensus.cc:697] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:33.104040 26245 leader_election.cc:290] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:33.103871 26165 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:33.079063 26158 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:33.098961 26256 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:33.099509 25992 raft_consensus.cc:3060] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:33.115630 18235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35ee2a6512e24d10af3526398de71490"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42512
I20260709 13:20:33.116467 18235 raft_consensus.cc:606] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Received request to transfer leadership
I20260709 13:20:33.110847 26158 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:33.110396 25827 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:33.117630 26259 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:20:33.138473 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:33.139642 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:33.125499 25993 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:33.144870 25993 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:33.145167 18384 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:20:33.145748 25993 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.146850 25993 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:33.112747 26215 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:33.149752 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:33.151356 18386 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:33.156108 26184 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:33.131881 26109 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:33.190409 18384 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:33.203440 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:33.206522 18237 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:20:33.206959 18235 raft_consensus.cc:2393] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:33.210444 18231 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:33.210620 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:33.211511 18957 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
I20260709 13:20:33.215526 18385 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:33.226094 26155 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.229327 26155 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:33.230674 26021 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.238540 26021 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.201121 26116 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:20:33.231647 26136 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.232591 26248 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.240867 26021 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:33.242678 26248 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:33.209846 25662 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.245676 26248 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:33.246977 26136 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:33.248459 18954 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:20:33.251559 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:33.253156 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:33.245731 25662 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:33.254557 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:33.256014 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:33.242743 26135 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:33.257323 26135 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:33.258212 26135 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.259274 26135 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:33.266639 18228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35ee2a6512e24d10af3526398de71490"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42512
I20260709 13:20:33.267478 18228 raft_consensus.cc:606] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Received request to transfer leadership
I20260709 13:20:33.205464 26144 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:33.274109 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3928) took 1451 ms. Trace:
I20260709 13:20:33.274541 18383 rpcz_store.cc:276] 0709 13:20:31.822612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.840636 (+ 18024us) service_pool.cc:224] Handling call
0709 13:20:32.393914 (+553278us) spinlock_profiling.cc:243] Waited 7.23 ms on lock 0x7b5800050198. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f14eb71 00007fa17f14ea22 00007fa188067c09 00007fa1871c1ee0 00007fa18728b0ab 00007fa18728b131 00007fa18724cfc0 00007fa187237929 00007fa1872373d2 00007fa1807aebd4
0709 13:20:32.394112 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.658591 (+264479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.273838 (+615247us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b540027fbd4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:33.274034 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623024384}
I20260709 13:20:33.275274 26144 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:33.282189 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:20:33.282536 18955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54004 (request call id 744) took 2127 ms (client timeout 1616 ms). Trace:
I20260709 13:20:33.282896 18956 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.287827 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:33.288697 18228 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:33.300292 18228 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:33.288046 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:33.301522 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.303459 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.304104 18309 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 15.
I20260709 13:20:33.304473 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:33.282965 18955 rpcz_store.cc:269] 0709 13:20:31.154708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.154799 (+    91us) service_pool.cc:224] Handling call
0709 13:20:33.282313 (+2127514us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b5400abac54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:33.282419 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2192299264}
I20260709 13:20:33.310603 18956 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:20:33.313331 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.317032 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:33.312083 18275 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:33.320660 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:33.321381 18309 raft_consensus.cc:3060] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:33.324761 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.329223 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.331022 18236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42530 (request call id 3288) took 1554 ms. Trace:
I20260709 13:20:33.331418 18236 rpcz_store.cc:276] 0709 13:20:31.777176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.962188 (+185012us) service_pool.cc:224] Handling call
0709 13:20:32.131188 (+169000us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:32.161715 (+ 30527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.330813 (+1169098us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54001888d0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:33.330958 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325049216}
I20260709 13:20:33.333189 18303 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 21: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:33.331981 18927 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:33.336676 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:33.344209 18309 raft_consensus.cc:2468] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:20:33.326000 26155 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:33.206589 26158 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:33.326123 26116 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:33.309552 26176 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 13:20:33.342283 26128 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:33.341205 26011 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:33.346400 18927 leader_election.cc:304] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:33.373523 26006 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:33.484764 18384 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: []
W20260709 13:20:33.487193 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 140906us
I20260709 13:20:33.456111 26128 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:33.478919 26155 raft_consensus.cc:697] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:33.482375 26179 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:20:33.501624 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.456825 26116 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.491436 26053 raft_consensus.cc:2804] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:33.495704 26128 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.482770 26006 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.507042 26136 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.504091 26003 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:33.541886 18232 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:33.541927 18236 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:20:33.542676 18236 pending_rounds.cc:85] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 12
I20260709 13:20:33.543001 18236 pending_rounds.cc:107] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:20:33.544479 18236 raft_consensus.cc:2889] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:33.581269 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:33.582734 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:33.583771 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:33.584812 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:33.586618 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 43649.5us
I20260709 13:20:33.586441 18379 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:33.534541 26053 raft_consensus.cc:697] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 17 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:33.504549 26179 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.589934 26155 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:33.590708 18955 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:20:33.592042 26277 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:20:33.592145 26179 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:33.593545 26276 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 13:20:33.589768 26273 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:20:33.539736 26136 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.596500 26136 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:33.599758 26275 log.cc:927] Time spent T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:20:33.600304 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:33.600986 18228 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:33.608563 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.620800 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:33.606112 18379 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 25.
I20260709 13:20:33.611549 18228 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:33.618963 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:33.625366 18234 raft_consensus.cc:2393] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 23: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:20:33.627094 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:33.606735 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 61314.3us
I20260709 13:20:33.589555 18276 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:33.609231 26006 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:33.632504 18958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53364 (request call id 775) took 1807 ms. Trace:
I20260709 13:20:33.642306 18958 rpcz_store.cc:276] 0709 13:20:31.825134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.825384 (+   250us) service_pool.cc:224] Handling call
0709 13:20:32.427852 (+602468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:32.428307 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:32.428353 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:32.429393 (+  1040us) log.cc:844] Serialized 26 byte log entry
0709 13:20:32.509163 (+ 79770us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:32.509203 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.509268 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:32.685270 (+176002us) raft_consensus.cc:1685] finished
0709 13:20:32.685301 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.629973 (+944672us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b540047cf50. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822728ad 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:33.632436 (+  2463us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":490,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":7250,"spinlock_wait_cycles":1384574720,"thread_start_us":65570,"threads_started":1,"wal-append.queue_time_us":152748}
I20260709 13:20:33.643600 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:33.644551 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:33.648100 18236 raft_consensus.cc:2410] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
W20260709 13:20:33.636031 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.649168 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:33.637524 18235 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:33.640865 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:33.650288 18228 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.651579 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
W20260709 13:20:33.630832 26274 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:20:33.645391 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 55885us
W20260709 13:20:33.635802 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:33.649698 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.636655 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:33.656855 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:33.656975 18382 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:33.652354 18234 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:20:33.657788 18304 raft_consensus.cc:1240] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:33.661600 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.661937 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.662783 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.663374 18306 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:33.663498 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.664137 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.664645 18306 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:33.664996 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.666148 18304 raft_consensus.cc:2410] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:20:33.667091 18236 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:20:33.667580 18236 pending_rounds.cc:85] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: Aborting all ops after (but not including) 10
I20260709 13:20:33.667963 18236 pending_rounds.cc:107] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:20:33.668267 18236 raft_consensus.cc:2889] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:33.668653 18236 pending_rounds.cc:107] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:20:33.668932 18236 raft_consensus.cc:2889] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:33.670966 18304 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: [18.11-21.12]
I20260709 13:20:33.671321 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.672361 26186 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:33.672678 18304 raft_consensus.cc:1240] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:20:33.672863 18312 raft_consensus.cc:1240] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:33.617369 26053 consensus_queue.cc:237] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:33.676608 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:33.666725 26135 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.678458 26135 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.645830 26147 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:33.681357 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.684544 18304 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:20:33.687338 18121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 231362us
I20260709 13:20:33.694691 26135 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:33.695407 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:33.697556 18234 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 25.
I20260709 13:20:33.694149 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:33.698179 18236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35ee2a6512e24d10af3526398de71490"
dest_uuid: "b52e2477fc524694967c4a16afa983e3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42512
I20260709 13:20:33.699914 18236 raft_consensus.cc:606] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Received request to transfer leadership
I20260709 13:20:33.704581 18228 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:20:33.707567 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:33.714761 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:33.718181 18379 raft_consensus.cc:1240] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:33.672923 26186 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.726219 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.727645 18312 raft_consensus.cc:2468] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:33.712803 26135 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:33.697397 26212 consensus_queue.cc:1059] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:20:33.724352 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:33.777220 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:33.742591 26135 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 25 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:20:33.827741 18385 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46844 (request call id 4393) took 1373 ms (client timeout 1614 ms). Trace:
W20260709 13:20:33.828408 18385 rpcz_store.cc:269] 0709 13:20:32.454502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.454635 (+   133us) service_pool.cc:224] Handling call
0709 13:20:33.827526 (+1372891us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54000ba9d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:33.827664 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712716032}
I20260709 13:20:33.837990 26248 raft_consensus.cc:993] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: : Instructing follower 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:20:33.838809 26248 raft_consensus.cc:1081] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Signalling peer 8b4fbc44aa2649f0bcac5cd70f71951d to start an election
I20260709 13:20:33.842555 26144 raft_consensus.cc:3055] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:33.843115 26144 raft_consensus.cc:740] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:33.846216 18378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43098 (request call id 1611) took 1345 ms. Trace:
I20260709 13:20:33.846625 18378 rpcz_store.cc:276] 0709 13:20:32.500381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.500551 (+   170us) service_pool.cc:224] Handling call
0709 13:20:32.532052 (+ 31501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.804158 (+272106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.845952 (+1041794us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b5400081954. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:33.846150 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558493952}
I20260709 13:20:33.848541 26176 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.849261 26176 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:33.856468 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:33.856953 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.858966 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:33.863564 18237 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:20:33.873152 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.874253 18311 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:33.876019 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:33.877553 26011 raft_consensus.cc:2764] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:20:33.881134 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:33.882196 18235 raft_consensus.cc:2393] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:33.844233 26144 consensus_queue.cc:260] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.885774 26176 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:33.891373 18927 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:33.892196 26011 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:33.898442 26151 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:33.898643 25827 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:20:33.902953 26272 log.cc:927] Time spent T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.403s	user 0.003s	sys 0.000s
I20260709 13:20:33.904296 25827 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:33.905372 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:33.905443 25827 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:33.906222 18384 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:20:33.906832 26176 consensus_queue.cc:1059] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:33.908339 26138 consensus_queue.cc:1059] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:33.909790 26138 raft_consensus.cc:3055] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:33.910144 26138 raft_consensus.cc:740] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:33.910979 26138 consensus_queue.cc:260] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.912127 26138 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:33.916328 18378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35ee2a6512e24d10af3526398de71490"
dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
 from {username='slave'} at 127.0.0.1:46844
I20260709 13:20:33.917017 18378 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:33.917390 18378 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:33.920157 18380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4391) took 1483 ms. Trace:
I20260709 13:20:33.920802 18380 rpcz_store.cc:276] 0709 13:20:32.437222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.438171 (+   949us) service_pool.cc:224] Handling call
0709 13:20:32.462417 (+ 24246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.716953 (+254536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:32.717010 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:32.717064 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:32.717111 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:33.919793 (+1202682us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b540027f6d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:33.919878 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:33.920074 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584807168}
I20260709 13:20:33.922111 18236 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 21.
I20260709 13:20:33.925452 18351 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:33.926328 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:33.948666 18384 raft_consensus.cc:2368] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 24. Current term is 25.
I20260709 13:20:33.951140 18351 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:33.808595 26116 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:33.954429 18382 raft_consensus.cc:3055] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:33.954836 18382 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:33.977674 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:33.976377 18382 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:33.979552 18382 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:33.958560 26170 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:33.986815 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:33.987541 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.978399 18311 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:20:33.995707 18382 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:33.996939 18200 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:34.001628 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:34.007174 18229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42530 (request call id 3279) took 2294 ms (client timeout 2143 ms). Trace:
I20260709 13:20:34.007496 18311 raft_consensus.cc:2368] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17.
W20260709 13:20:34.007599 18229 rpcz_store.cc:269] 0709 13:20:31.713078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.787085 (+ 74007us) service_pool.cc:224] Handling call
0709 13:20:34.006964 (+2219879us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b5400059e54. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:34.007101 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766161152}
I20260709 13:20:34.010617 18381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46860 (request call id 3951) took 1171 ms. Trace:
I20260709 13:20:34.011026 18381 rpcz_store.cc:276] 0709 13:20:32.839351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.839506 (+   155us) service_pool.cc:224] Handling call
0709 13:20:32.858176 (+ 18670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:32.912485 (+ 54309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.010390 (+1097905us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b5400277254. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:34.010559 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77093632}
W20260709 13:20:34.005702 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 70165.1us
I20260709 13:20:34.012549 18201 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:33.977437 26145 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:20:34.002442 26281 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:20:34.020164 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:34.023607 18311 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:34.025731 18200 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:34.019207 18378 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.034646 18380 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:34.036367 18201 leader_election.cc:400] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 24. Current term is 25.
I20260709 13:20:34.036821 18201 leader_election.cc:403] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:34.041316 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.986650 25662 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:20:34.014899 25992 raft_consensus.cc:2764] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:20:34.058542 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:34.021526 26221 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:34.015208 26135 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:34.022673 26145 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:34.064863 26051 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:34.070642 26051 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:34.075459 26115 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.076057 26115 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:34.078408 26115 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:34.082791 18386 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 24. Current term is 25. Ops: []
I20260709 13:20:34.083143 26156 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.083626 26156 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:34.084425 18386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4402) took 1039 ms. Trace:
I20260709 13:20:34.085011 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:34.084887 18386 rpcz_store.cc:276] 0709 13:20:33.045053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.184578 (+139525us) service_pool.cc:224] Handling call
0709 13:20:33.184904 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.083258 (+898354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.084187 (+   929us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b540027f1d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:34.084365 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2064480640}
I20260709 13:20:34.087796 26156 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:34.088076 25827 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:34.057770 26249 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:34.089043 26248 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:20:34.090202 18954 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54020 (request call id 646) took 2315 ms (client timeout 1702 ms). Trace:
W20260709 13:20:34.090621 18954 rpcz_store.cc:269] 0709 13:20:31.774465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:31.776297 (+  1832us) service_pool.cc:224] Handling call
0709 13:20:34.090016 (+2313719us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54006301d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1822772fa 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6 00007fa1805ad26f
0709 13:20:34.090123 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3306746112}
I20260709 13:20:34.092684 26186 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:34.096032 26212 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.096633 26145 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.096876 26155 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:34.096674 26212 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:34.088972 18231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42520 (request call id 3158) took 1647 ms. Trace:
I20260709 13:20:34.104555 18231 rpcz_store.cc:276] 0709 13:20:32.441180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.930305 (+489125us) service_pool.cc:224] Handling call
0709 13:20:32.930592 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.211000 (+280408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.088736 (+877736us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540037d7d4. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:34.088913 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643083648}
I20260709 13:20:34.107069 26212 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:34.051407 26110 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:34.122385 26011 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:34.067374 26221 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:34.124908 26221 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:34.130369 18303 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 13:20:34.130829 18303 pending_rounds.cc:85] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 12
I20260709 13:20:34.131054 18303 pending_rounds.cc:107] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:20:34.131302 18303 raft_consensus.cc:2889] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:34.022055 26021 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:20:34.048842 26114 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 24. Current term is 25.
I20260709 13:20:34.134158 18308 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:34.111640 18311 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:34.136256 18308 raft_consensus.cc:1275] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:20:34.136547 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.139796 18303 raft_consensus.cc:1275] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:20:34.158844 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 442574us
I20260709 13:20:34.194440 18303 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 15. (term mismatch)
I20260709 13:20:34.194945 18303 pending_rounds.cc:85] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 14
I20260709 13:20:34.195184 18303 pending_rounds.cc:107] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 24.15
I20260709 13:20:34.195459 18303 raft_consensus.cc:2889] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:34.210366 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:34.211279 18230 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 25.
I20260709 13:20:34.216995 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:34.052716 26227 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.081s
I20260709 13:20:34.222461 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:34.236181 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:34.224231 18311 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:34.237015 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:34.212471 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:34.237739 18231 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
I20260709 13:20:34.238399 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:34.238989 18382 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:34.239634 26212 consensus_queue.cc:1059] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:34.240288 18381 raft_consensus.cc:1240] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:20:34.241317 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:34.117956 26110 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:34.245128 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:34.243182 18230 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:34.244261 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:34.246940 18378 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:34.251235 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:34.252450 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:34.257879 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:34.203280 26051 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:34.256985 26248 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:34.257197 26031 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:20:34.281822 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.281994 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:34.258415 25992 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:34.251690 26114 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:34.305115 18306 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.020s	sys 0.021s
W20260709 13:20:34.308445 18306 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.020s	sys 0.021s
I20260709 13:20:34.244992 26158 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:34.265748 26249 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:34.280753 26166 raft_consensus.cc:3055] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:34.234272 26165 consensus_queue.cc:1059] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 13:20:34.294009 26115 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:34.294588 26031 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.299665 26051 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.299926 26186 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:34.300413 26190 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.326648 26128 consensus_meta.cc:287] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.788s	user 0.011s	sys 0.001s
I20260709 13:20:34.375434 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:34.379035 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.326229 26166 raft_consensus.cc:740] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:34.279788 26110 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:34.324056 26249 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:34.383862 18378 raft_consensus.cc:2393] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 21: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:34.354229 26031 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:34.361593 26158 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.329731 25992 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:34.398524 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 412542us
I20260709 13:20:34.400785 18311 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:34.410125 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:34.412472 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.413620 18311 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 21: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:34.414242 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: true dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:34.423707 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:34.424284 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:34.426962 18236 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:34.417985 26158 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.430806 26158 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:34.431532 26158 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:34.433343 26285 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:34.433107 26166 consensus_queue.cc:260] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:34.434661 26166 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:34.437273 26289 log.cc:927] Time spent T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:20:34.445252 26287 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:20:34.446100 18183 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:20:34.446717 18183 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 35ee2a6512e24d10af3526398de71490 already in progress
W20260709 13:20:34.447099 18183 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 35ee2a6512e24d10af3526398de71490 already in progress
I20260709 13:20:34.447847 26170 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:34.386013 26190 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:34.452695 18200 leader_election.cc:336] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Timed out: RequestConsensusVote RPC to 127.16.188.132:42479 timed out after 1.616s (SENT)
I20260709 13:20:34.453226 18200 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:34.454054 26009 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:34.381067 26128 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.457295 26128 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:34.457899 26128 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:34.458869 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.382922 26186 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.459630 26009 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.460152 26009 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.461468 26186 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:34.417120 26024 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:20:34.421518 26156 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:20:34.464112 26221 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:34.465381 26290 log.cc:927] Time spent T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:20:34.466483 26221 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:34.466004 26145 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.425384 26110 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:34.469719 18386 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:34.472632 26145 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:34.401443 26249 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:34.478747 18386 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
W20260709 13:20:34.488605 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 65000.2us
I20260709 13:20:34.397979 26115 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:34.494797 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:34.368412 26051 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:34.401171 26179 consensus_queue.cc:1059] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.095s
I20260709 13:20:34.505090 18351 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:34.506834 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:34.458443 26128 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.496928 26145 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:34.417408 26138 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 13:20:34.494385 26227 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:34.432168 26158 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.415294 26230 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:20:34.517972 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:34.554651 26153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.005s	sys 0.034s
I20260709 13:20:34.561458 18351 leader_election.cc:400] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17.
I20260709 13:20:34.566689 18351 leader_election.cc:403] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:20:34.567479 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:34.502131 26221 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:34.568845 26221 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:34.571072 26179 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.571617 26179 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:34.572467 26221 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:34.573278 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:34.513401 26156 raft_consensus.cc:2804] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:34.499419 26115 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:34.510999 26170 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:34.568265 26153 raft_consensus.cc:2749] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17.
W20260709 13:20:34.561828 18310 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.009s	sys 0.020s
I20260709 13:20:34.543262 26024 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:20:34.588234 18310 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.009s	sys 0.020s
I20260709 13:20:34.574671 26145 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:34.573894 26179 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:34.610225 26053 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.017s	sys 0.035s
I20260709 13:20:34.556452 26227 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.586855 26221 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:34.635563 26157 raft_consensus.cc:3055] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:34.644593 26115 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:34.622340 26286 log.cc:927] Time spent T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.233s	user 0.005s	sys 0.000s
I20260709 13:20:34.623581 26145 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.630934 26024 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:34.631527 26170 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:20:34.648795 26053 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.017s	sys 0.035s
I20260709 13:20:34.647544 26190 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:34.673859 26031 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.667207 26024 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.657781 26157 raft_consensus.cc:740] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:34.661026 26144 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:34.665781 26145 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:34.671195 25827 consensus_meta.cc:287] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.005s
I20260709 13:20:34.652307 26153 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:20:34.681286 26296 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:34.661140 26221 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:34.704802 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.690970 26024 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:34.745182 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:34.711577 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 429667us
I20260709 13:20:34.731839 26031 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:34.734545 26227 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:34.700794 26053 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.750887 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:34.786334 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 211248us
I20260709 13:20:34.757169 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:34.742854 26109 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:34.713086 26051 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:34.743129 26115 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:34.740883 26157 consensus_queue.cc:260] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.799242 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dea3366ee674017a0bbfc9bce0d9a73" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:34.801383 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:34.811859 18958 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:20:34.748039 25827 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.803210 18928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.815344 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: true dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:34.816175 18962 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:34.829559 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 153134us
I20260709 13:20:34.399197 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:34.834079 18927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.715286 26296 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.856621 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:34.857637 18237 raft_consensus.cc:2368] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19.
I20260709 13:20:34.862644 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:34.863401 18234 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:34.868408 18960 raft_consensus.cc:1240] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:34.748235 26176 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:34.849885 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:20:34.871019 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.873968 18956 raft_consensus.cc:2368] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19.
W20260709 13:20:34.835161 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 84373us
I20260709 13:20:34.875072 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:34.813802 26128 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:34.757346 26110 consensus_queue.cc:1059] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 13:20:34.834194 26158 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:34.885376 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:34.796106 26179 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:20:34.836019 26031 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:34.894361 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:34.901314 18953 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:34.901872 18958 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 15.
I20260709 13:20:34.836499 26156 raft_consensus.cc:697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:34.893342 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:34.883204 26176 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.900949 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:34.880944 26157 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:34.868692 26297 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:34.828586 26115 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:34.912550 18959 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:34.905359 18956 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:34.834774 25827 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.829172 26109 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:34.836805 26170 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:20:34.928823 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:34.851097 26190 consensus_queue.cc:1048] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.068s
I20260709 13:20:34.936879 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:34.868327 26171 consensus_queue.cc:1048] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:20:34.939850 18305 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 22.
I20260709 13:20:34.855974 26053 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.942991 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:34.944825 18959 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:34.913293 26318 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:34.926928 26301 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:34.953933 18961 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
W20260709 13:20:34.955088 26307 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:20:34.955749 26317 log.cc:927] Time spent T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:20:34.959890 26291 raft_consensus.cc:3055] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:34.960987 26115 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:34.961272 26302 log.cc:927] Time spent T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:20:34.961687 26298 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 13:20:34.970852 26305 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:20:34.967167 26221 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:34.972028 26312 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:20:34.969197 26301 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.983090 26301 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:34.975898 26156 consensus_queue.cc:237] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:34.970528 26291 raft_consensus.cc:740] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:34.988788 26296 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:34.935070 26297 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.992424 26291 consensus_queue.cc:260] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:34.994077 26297 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:34.963419 26318 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:34.994561 26291 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:34.996840 26318 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:35.033619 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:35.036005 18228 raft_consensus.cc:2393] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 23: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:35.038012 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:35.039021 18228 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16.
I20260709 13:20:35.058563 18277 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:35.063449 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:35.063737 18306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 3191) took 1311 ms. Trace:
W20260709 13:20:35.066834 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.067644 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 3193) took 1255 ms. Trace:
I20260709 13:20:35.068094 18304 rpcz_store.cc:276] 0709 13:20:33.812053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.812226 (+   173us) service_pool.cc:224] Handling call
0709 13:20:33.812703 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.812995 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:20:33.923479 (+110484us) log.cc:844] Serialized 14 byte log entry
0709 13:20:35.066960 (+1143481us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:35.067079 (+   119us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:35.067197 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.067296 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.067489 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":668986,"prepare.queue_time_us":165599,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2180,"thread_start_us":473690,"threads_started":1,"wal-append.queue_time_us":767742}
I20260709 13:20:35.069276 18275 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:34.946764 18349 leader_election.cc:400] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19.
I20260709 13:20:35.074934 18349 leader_election.cc:403] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:20:35.076480 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 129843us
I20260709 13:20:34.966361 18962 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:35.083318 18958 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:34.989567 26176 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.064404 18306 rpcz_store.cc:276] 0709 13:20:33.752084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.752266 (+   182us) service_pool.cc:224] Handling call
0709 13:20:33.752718 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.752998 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:34.310832 (+557834us) log.cc:844] Serialized 14 byte log entry
0709 13:20:35.062778 (+751946us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:35.062937 (+   159us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:35.063120 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.063262 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.063486 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":346901,"prepare.queue_time_us":25164,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":7865,"thread_start_us":968348,"threads_started":2,"wal-append.queue_time_us":623651}
I20260709 13:20:35.108176 26308 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.116300 26326 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:35.117031 26147 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.117532 26326 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.118340 18959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:35.118479 26147 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.123418 26151 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:35.127207 26155 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.141599 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:35.142347 26172 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:35.143136 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:35.144835 26318 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479) with higher term. Message: Invalid argument: T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19.
I20260709 13:20:35.147362 25827 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.148922 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:34.989984 26249 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.150084 18956 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 15.
I20260709 13:20:35.153204 26170 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:35.153822 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:35.154614 26170 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.157105 25662 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:35.157982 25662 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.161192 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:35.162364 18306 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:20:35.162899 26190 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.164039 26190 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.164438 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:35.168323 26303 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.168536 26147 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:35.168985 26319 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:35.169447 26115 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:35.170135 26319 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.170512 26115 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.171670 26109 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.128671 26031 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:35.172981 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 95802.5us
I20260709 13:20:35.172863 26031 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.176017 26031 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.176694 25867 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:35.176884 18310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 4087) took 1520 ms. Trace:
I20260709 13:20:35.178093 26184 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:34.951140 26138 consensus_queue.cc:1059] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:20:35.178685 26184 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:35.179323 18237 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 21.
I20260709 13:20:35.179486 26184 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:35.179709 26138 raft_consensus.cc:3055] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:35.180536 26138 raft_consensus.cc:740] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:35.160210 18235 raft_consensus.cc:3055] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:35.181643 18235 raft_consensus.cc:740] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:35.182169 26138 consensus_queue.cc:260] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.128178 26155 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.177537 25867 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.169198 26303 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.186816 26155 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.183594 18235 consensus_queue.cc:260] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.109431 26308 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.184268 26011 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:20:35.198172 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.187870 26138 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:35.129072 26165 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.192935 26190 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:35.208866 26230 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:35.141675 26166 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.208365 26153 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.248281 26166 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:35.233510 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 57299.1us
I20260709 13:20:35.202245 26053 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:35.245937 26031 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.225399 26151 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 25 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:35.266907 26151 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.200812 25827 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.274361 25827 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.213486 26155 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:35.277149 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:35.277040 26155 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.277904 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:35.279704 26155 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:35.242712 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 44967.9us
I20260709 13:20:35.262926 26031 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.253484 26230 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.263358 26319 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:35.264249 26009 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:35.263967 26165 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.256131 26153 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.294797 25827 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:35.297792 26179 raft_consensus.cc:3055] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:35.298528 26179 raft_consensus.cc:740] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:35.304639 26249 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.276119 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:35.308243 26336 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.297966 25867 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.299064 26031 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:35.225744 26011 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.338333 26011 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:35.252195 26166 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.342025 26115 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:35.277232 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:35.278043 18956 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:35.312796 26184 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.314674 18276 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:35.351449 26166 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:35.352063 26166 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.352555 26166 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:35.353425 26179 consensus_queue.cc:260] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.355214 26179 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:35.356992 25827 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:35.357947 25827 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.336925 26336 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.360996 18276 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:35.362715 26336 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.363615 26336 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:35.267675 26333 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.317611 26326 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.273734 18351 leader_election.cc:400] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Vote denied by peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781) with higher term. Message: Invalid argument: T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 18. Current term is 19.
W20260709 13:20:35.365200 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 91839.3us
I20260709 13:20:35.366264 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:35.366436 25827 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.368482 26319 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:35.369050 26319 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.369494 26319 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:35.177479 18310 rpcz_store.cc:276] 0709 13:20:33.655974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.658544 (+  2570us) service_pool.cc:224] Handling call
0709 13:20:33.658768 (+   224us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:33.679147 (+ 20379us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:33.679426 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:20:33.820761 (+141335us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:33.821490 (+   729us) log.cc:844] Serialized 52 byte log entry
0709 13:20:33.821676 (+   186us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:34.588907 (+767231us) log.cc:844] Serialized 14 byte log entry
0709 13:20:35.175516 (+586609us) log.cc:844] Serialized 14 byte log entry
0709 13:20:35.176053 (+   537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.176239 (+   186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:35.176330 (+    91us) raft_consensus.cc:1685] finished
0709 13:20:35.176341 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.176607 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":707548,"prepare.queue_time_us":217625,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":3903,"raft.queue_time_us":621648,"raft.run_cpu_time_us":463,"raft.run_wall_time_us":462,"thread_start_us":805495,"threads_started":2,"wal-append.queue_time_us":639832}
I20260709 13:20:35.318526 26153 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:35.319188 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:35.319913 18235 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:35.320811 25662 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:35.322476 26303 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:35.206421 26114 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:35.330169 18132 catalog_manager.cc:5697] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.331039 18954 raft_consensus.cc:2468] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:35.331579 26172 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:35.332252 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 84562.6us
I20260709 13:20:35.332932 26170 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:35.333112 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 140161us
I20260709 13:20:35.334398 26249 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:35.316390 26136 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:35.347481 26184 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:35.316879 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:35.394711 18958 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:35.394550 26333 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.266969 26308 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.382368 26336 raft_consensus.cc:697] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:35.415424 18927 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:35.415259 26136 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.396183 26172 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.419137 25827 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:35.419608 25827 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:35.420089 25827 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:35.422583 18200 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:35.422655 26166 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.424746 26335 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:35.424968 26308 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:35.425617 26308 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:35.412312 26114 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.426123 26308 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.426397 26136 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.425426 26336 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.428184 26114 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.434278 26172 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:35.434824 26011 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.436239 18955 raft_consensus.cc:2393] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 23: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:35.437131 26333 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.437463 26011 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:35.431337 26230 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:35.439544 26230 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.432806 18927 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:35.441938 26315 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:35.442392 26315 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:35.442464 26165 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.420166 26249 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.443516 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:35.446527 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:35.447798 26166 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.449002 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:35.449985 18233 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 18.
I20260709 13:20:35.452317 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:35.440294 26230 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.442831 26315 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.455161 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:35.455987 18236 raft_consensus.cc:2393] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 23: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:35.451737 18132 catalog_manager.cc:5697] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.451756 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:35.458798 18228 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 19.
W20260709 13:20:35.429781 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 360784us
I20260709 13:20:35.453802 26249 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:35.460378 18275 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:35.463407 18351 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:35.448999 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.470569 26190 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:35.443610 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 124583us
I20260709 13:20:35.471611 18927 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:35.475255 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:35.476126 18311 raft_consensus.cc:3060] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:35.477977 26295 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:35.478402 26295 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:35.478803 26295 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:35.480598 26301 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.485953 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.486225 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.486744 18380 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 25.
I20260709 13:20:35.486871 18386 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:35.488224 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.488790 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.489804 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:35.492125 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:35.466668 26230 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:35.491662 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:35.491511 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:35.505089 18235 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:35.513362 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:35.516705 18228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:35.532271 18235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42520 (request call id 3186) took 1110 ms. Trace:
I20260709 13:20:35.503444 18955 raft_consensus.cc:2376] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22. Re-sending same reply.
I20260709 13:20:35.534387 18235 rpcz_store.cc:276] 0709 13:20:34.412078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.413984 (+  1906us) service_pool.cc:224] Handling call
0709 13:20:35.159587 (+745603us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54003195a0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa1821eadc0 00007fa182276e18 00007fa187238b17 00007fa1807b36d4 00007fa1807b3662 00007fa1807b3591 00007fa1807b350c 00007fa1807b27c2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:35.522635 (+363048us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327072640}
I20260709 13:20:35.465626 18132 catalog_manager.cc:5697] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:20:35.538977 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 78756.3us
I20260709 13:20:35.544378 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:35.539841 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 65806.6us
I20260709 13:20:35.539620 18228 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:35.550218 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:35.558830 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:35.556198 18927 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:35.558454 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:35.533732 25662 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.568420 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:35.553570 26166 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:35.578151 26166 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:35.578612 26166 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:35.564564 26335 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:35.581065 26335 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.583496 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.584353 18276 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:35.585393 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:35.588047 26184 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:35.588531 26184 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:35.588855 26147 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:35.589109 26184 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:35.589639 26147 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.590351 26147 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:35.592916 26011 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:35.593518 26011 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.593933 26011 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.596688 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:35.581065 18312 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43788 (request call id 3190) took 1823 ms. Trace:
I20260709 13:20:35.597674 18230 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
W20260709 13:20:35.598634 26248 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
I20260709 13:20:35.567322 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:35.600965 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.577397 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:35.601735 18378 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:35.603425 18277 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:35.605298 26151 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:35.606288 26151 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:35.611434 18311 raft_consensus.cc:2468] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 23.
W20260709 13:20:35.584693 26024 consensus_meta.cc:287] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.009s
I20260709 13:20:35.613577 26335 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:35.615527 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.600674 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
W20260709 13:20:35.621488 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.597975 18312 rpcz_store.cc:276] 0709 13:20:33.734565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.734779 (+   214us) service_pool.cc:224] Handling call
0709 13:20:33.736544 (+  1765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.742419 (+  5875us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:20:33.750549 (+  8130us) log.cc:844] Serialized 14 byte log entry
0709 13:20:34.201713 (+451164us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b18002f5a80. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e1323a 00007fa18227da2a
0709 13:20:35.085756 (+884043us) log.cc:844] Serialized 14 byte log entry
0709 13:20:35.194929 (+109173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:35.224480 (+ 29551us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:35.234761 (+ 10281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.527075 (+292314us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b54002a1554. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa1821dc571 00007fa182273e01 00007fa18227283e 00007fa187237419 00007fa1807aebd4 00007fa1807aeb62 00007fa1807aea91 00007fa1807aea0c 00007fa1807adcc2 00007fa1805ae48c 00007fa1805ad8c6
0709 13:20:35.527130 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.557691 (+ 30561us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":504815,"prepare.queue_time_us":27079,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":4629,"raft.queue_time_us":688941,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":216,"spinlock_wait_cycles":18474112,"thread_start_us":482487,"threads_started":2,"wal-append.queue_time_us":1063435}
I20260709 13:20:35.621989 18958 raft_consensus.cc:2393] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:20:35.619796 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63669.5us
I20260709 13:20:35.568162 26138 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:35.633493 26308 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.634164 26335 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:35.635156 26335 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.635746 26308 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:35.624469 18234 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
I20260709 13:20:35.628525 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:35.640641 18349 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:35.638679 18237 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 25.
I20260709 13:20:35.659067 18380 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:35.670634 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:35.665092 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:35.668148 26138 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.674196 26138 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:35.673815 26011 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.685909 18927 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:35.629855 18132 catalog_manager.cc:5697] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 16 to 17, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 17 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.696707 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:35.697536 18231 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:35.698035 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 144171us
I20260709 13:20:35.709280 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.688151 26053 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:35.688578 26301 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:35.690238 26011 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.648183 25827 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:35.722332 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.638135 26024 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.733489 18380 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:35.668833 26319 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.667439 25662 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:35.748791 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.732048 26295 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.750504 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:35.756865 18958 raft_consensus.cc:2393] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:35.758833 18236 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:35.705825 26315 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.771152 18381 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 26: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:35.757222 26190 raft_consensus.cc:2804] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:35.775892 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.776580 26158 raft_consensus.cc:2804] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:20:35.776916 26145 consensus_meta.cc:287] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.940s	user 0.016s	sys 0.006s
W20260709 13:20:35.777007 26339 log.cc:927] Time spent T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:20:35.777344 26291 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:35.777853 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.780207 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:35.780725 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.781195 26176 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:35.777041 26151 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:35.781674 26144 consensus_meta.cc:287] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 1.067s	user 0.011s	sys 0.012s
I20260709 13:20:35.784895 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.838138 26295 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.786216 25662 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:35.786791 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.838828 26144 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:35.786194 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.839383 26144 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:35.794061 18133 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39288 (request call id 216) took 26092 ms (client timeout 15000 ms). Trace:
W20260709 13:20:35.798547 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 195256us
I20260709 13:20:35.841552 26144 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.842219 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:35.840204 18133 rpcz_store.cc:269] 0709 13:20:09.701445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.704268 (+  2823us) service_pool.cc:224] Handling call
0709 13:20:35.793727 (+26089459us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:27.948028 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:28.004780 (+ 56752us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:28.004849 (+    69us) write_op.cc:435] Acquired schema lock
0709 13:20:28.004909 (+    60us) tablet.cc:662] Decoding operations
0709 13:20:28.006571 (+  1662us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:28.006735 (+   164us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:28.006782 (+    47us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:20:28.060746 (+ 53964us) tablet.cc:701] Row locks acquired
0709 13:20:28.060811 (+    65us) write_op.cc:260] PREPARE: finished
0709 13:20:28.061053 (+   242us) write_op.cc:270] Start()
0709 13:20:28.061277 (+   224us) write_op.cc:276] Timestamp: P: 1783603228060964 usec, L: 0
0709 13:20:28.061338 (+    61us) op_driver.cc:348] REPLICATION: starting
0709 13:20:28.062255 (+   917us) log.cc:844] Serialized 5267 byte log entry
0709 13:20:29.094307 (+1032052us) op_driver.cc:464] REPLICATION: finished
0709 13:20:29.510204 (+415897us) write_op.cc:301] APPLY: starting
0709 13:20:29.524704 (+ 14500us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:30.715077 (+1190373us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:30.735478 (+ 20401us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:32.048933 (+1313455us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:32.066581 (+ 17648us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 13:20:32.066652 (+    71us) write_op.cc:312] APPLY: finished
0709 13:20:32.067097 (+   445us) log.cc:844] Serialized 121 byte log entry
0709 13:20:32.172446 (+105349us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:32.191677 (+ 19231us) write_op.cc:454] Released schema lock
0709 13:20:32.217459 (+ 25782us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:32.280816 (+ 63357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:32.280855 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54961,"reported_tablets":38,"spinlock_wait_cycles":16128,"child_traces":[["op",{"apply.queue_time_us":355142,"apply.run_cpu_time_us":52215,"apply.run_wall_time_us":2796382,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58363,"num_ops":13,"prepare.queue_time_us":439091,"prepare.run_cpu_time_us":107335,"prepare.run_wall_time_us":355622,"raft.queue_time_us":235422,"raft.run_cpu_time_us":9939,"raft.run_wall_time_us":361240,"replication_time_us":963998,"thread_start_us":919828,"threads_started":5,"wal-append.queue_time_us":373322,"wal-append.run_cpu_time_us":39359,"wal-append.run_wall_time_us":2621392}]]}
I20260709 13:20:35.786167 18383 raft_consensus.cc:1240] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:35.846589 26136 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.847193 26136 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.847965 26151 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:35.807024 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 188137us
I20260709 13:20:35.850744 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.851295 26151 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.818608 26335 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.813984 26176 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:35.853317 26176 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:35.854583 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.855208 18383 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 16.
I20260709 13:20:35.856118 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:35.859618 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.859859 26158 raft_consensus.cc:697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 23 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:35.860755 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.861626 26136 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.861970 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.861433 26158 consensus_queue.cc:237] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.862504 18378 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:35.828238 26166 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.831002 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.834209 25827 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.864135 26145 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.865726 26166 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:35.867061 26145 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:35.811914 18382 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 25.
W20260709 13:20:35.875170 26340 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:20:35.819576 18132 catalog_manager.cc:5697] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 17 to 19, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 19 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.856767 26291 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:35.881592 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 111558us
I20260709 13:20:35.882776 26291 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:35.857673 26331 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:35.825242 26319 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:35.883896 26331 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.859745 18379 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:35.892469 26331 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:35.896008 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.823470 26024 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:35.860838 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.836297 26315 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.898722 18132 catalog_manager.cc:5697] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 19 to 21, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 21 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.867884 18386 raft_consensus.cc:2368] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 15. Current term is 16.
I20260709 13:20:35.844677 26165 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:35.872671 18960 raft_consensus.cc:1240] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:35.810456 26190 raft_consensus.cc:697] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:35.901654 26190 consensus_queue.cc:237] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:35.800328 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.908938 18385 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:35.859167 18276 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:35.910451 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 51360.1us
I20260709 13:20:35.911087 26165 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:35.911558 26165 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.911898 26165 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.900296 18132 catalog_manager.cc:5697] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:35.918855 18132 catalog_manager.cc:5697] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.921308 26165 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.888032 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:35.889263 26184 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.955808 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.922106 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.924046 26179 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:35.856389 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:35.932891 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.928905 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.920348 18132 catalog_manager.cc:5697] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.963089 26318 consensus_queue.cc:1059] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 13:20:35.966588 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.966771 18958 raft_consensus.cc:1240] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:35.950873 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.950580 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:20:35.969875 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 284045us
I20260709 13:20:35.951236 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:35.982445 18381 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 25: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:35.982786 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:35.954725 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.927002 18379 raft_consensus.cc:2468] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:35.930294 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:35.985769 18960 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:35.976310 18955 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:35.985962 18236 raft_consensus.cc:3060] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:35.921594 18276 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:35.985009 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:35.959414 18231 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 19.
I20260709 13:20:35.988767 18954 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 16.
I20260709 13:20:35.990630 18233 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 25.
I20260709 13:20:35.991545 26179 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:35.992357 18201 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:35.992875 26170 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:35.993358 26170 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.993695 26170 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:35.994081 26179 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:35.995978 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:35.953920 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:35.996860 18956 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
W20260709 13:20:36.000386 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 363874us
I20260709 13:20:36.003512 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:36.003466 18384 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:36.003860 18234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:36.006305 18377 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 25: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:20:36.012115 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 90613.4us
I20260709 13:20:36.018553 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:36.017088 18200 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:36.025154 18380 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 18.
I20260709 13:20:36.003131 26179 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:36.034601 26248 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:36.034790 18351 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:36.035326 26248 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:36.035741 25662 raft_consensus.cc:2804] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:36.036237 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:36.036398 25662 raft_consensus.cc:697] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:36.037375 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:36.037701 25662 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:36.039887 26156 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:36.036437 26248 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:36.042127 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:36.043475 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:36.045010 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 188727us
I20260709 13:20:36.045948 18277 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:36.048184 26166 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.049013 26166 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.053251 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:36.053987 18310 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:36.056646 26331 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:36.040341 26156 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:36.057507 26156 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:36.058768 26319 raft_consensus.cc:3055] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:36.059191 26319 raft_consensus.cc:740] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:20:36.060863 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 64967.8us
I20260709 13:20:36.062301 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:36.062980 18377 raft_consensus.cc:3060] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:36.063613 18201 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:36.065300 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:36.067176 18384 raft_consensus.cc:1275] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:20:36.014747 26024 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:36.069263 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:36.070883 18237 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:20:36.072371 26301 consensus_queue.cc:1059] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:36.069263 18132 catalog_manager.cc:5697] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:36.074038 26301 raft_consensus.cc:3055] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:36.074469 26301 raft_consensus.cc:740] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:36.073859 18132 catalog_manager.cc:5697] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 11 to 14, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 14 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:36.075336 26301 consensus_queue.cc:260] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:36.075557 18132 catalog_manager.cc:5697] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:36.076613 26318 consensus_queue.cc:1059] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:36.027292 26144 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:36.077682 26144 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:36.077903 26138 raft_consensus.cc:3055] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:36.078141 26144 raft_consensus.cc:3060] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:36.078352 26138 raft_consensus.cc:740] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:36.078505 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:36.079381 26138 consensus_queue.cc:260] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:36.080621 26138 raft_consensus.cc:3060] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:36.080766 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.029731 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:36.077684 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:35.962942 26147 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.081925 25827 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.082512 25827 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:36.084597 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:36.016551 26176 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:36.084829 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:36.086767 26176 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:36.087389 26308 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:36.084726 25827 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:36.088004 26308 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:36.088774 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64956.8us
I20260709 13:20:36.090487 26308 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:36.091289 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:36.091969 18954 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:36.090514 18956 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:20:36.092397 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:36.093209 18132 catalog_manager.cc:5697] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:36.095463 18132 catalog_manager.cc:5697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 16 to 18, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 18 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:36.097456 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:36.097604 26184 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:36.030864 18200 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:36.103230 18955 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 16: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:36.099960 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:36.109586 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:36.076941 26301 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:36.114715 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 83934us
W20260709 13:20:36.117141 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.118436 18960 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:20:36.126856 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:36.129042 18236 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:36.125839 18275 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:36.117370 18132 catalog_manager.cc:5697] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 21 to 23, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 23 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:36.120005 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 82731.6us
I20260709 13:20:36.121469 18926 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:36.126557 18349 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:36.103837 26291 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:36.133499 26357 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:36.102229 26179 raft_consensus.cc:697] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:36.102710 26331 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:36.134570 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:36.134930 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.060106 26319 consensus_queue.cc:260] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:36.139394 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:36.123032 26333 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:36.133606 26024 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:36.138363 18276 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:36.146225 26184 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:36.148583 26116 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:36.149263 26021 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:36.149114 26155 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:36.150118 18926 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:36.152272 26308 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:36.122345 25867 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:36.162184 26170 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:36.162369 26156 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.163219 18237 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:36.164124 26319 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:36.147167 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:36.145478 26331 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:36.169992 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.173864 18310 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 18.
I20260709 13:20:36.177219 26179 consensus_queue.cc:237] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.122960 26136 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:36.184660 26176 consensus_queue.cc:1048] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:36.122346 26138 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:36.194274 18954 raft_consensus.cc:1240] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:36.195055 18381 raft_consensus.cc:2468] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 18.
W20260709 13:20:36.195190 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 56908.2us
I20260709 13:20:36.146431 18385 raft_consensus.cc:2468] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16.
I20260709 13:20:36.134459 26291 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:36.198815 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 48792us
W20260709 13:20:36.198742 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 152901us
I20260709 13:20:36.185551 26333 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:36.201659 18132 catalog_manager.cc:5697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:36.204397 18927 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:36.204892 26212 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.195915 26184 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.197108 26021 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.198302 26151 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:36.223169 18276 leader_election.cc:400] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 15. Current term is 16.
I20260709 13:20:36.221716 26212 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.223397 26151 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:36.223552 18276 leader_election.cc:403] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:20:36.223877 26151 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:36.224644 18276 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:36.225291 26212 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:36.225795 26021 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:36.227363 26155 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:36.200883 26295 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:36.222033 26184 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:36.228845 26172 raft_consensus.cc:2804] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:36.229439 26172 raft_consensus.cc:697] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:36.231009 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:36.213706 18382 raft_consensus.cc:2368] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 21. Current term is 22.
I20260709 13:20:36.199944 26116 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:36.205787 26331 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:36.232736 26336 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:36.229482 26138 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:36.233951 26138 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.234028 18926 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:36.234495 26138 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:36.230645 26172 consensus_queue.cc:237] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.208081 26136 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.216434 18377 raft_consensus.cc:2468] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 19.
I20260709 13:20:36.236407 26157 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:36.238579 26136 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:36.231999 26116 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.243602 26190 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.244153 26355 raft_consensus.cc:2804] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:36.244241 26190 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.244992 26355 raft_consensus.cc:697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 18 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:36.245285 25867 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.245903 25867 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.246618 26190 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:36.218144 26291 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:36.200371 26308 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.219961 26333 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:36.246249 26155 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for earlier term 15. Current term is 16.
I20260709 13:20:36.257352 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:36.285811 26337 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:36.278594 26144 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:36.365836 26116 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:36.366739 26308 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:36.381831 26291 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:36.368697 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.370672 26147 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:36.371677 26151 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:36.367682 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54958.3us
I20260709 13:20:36.387898 26184 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:36.389519 26170 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:36.374158 25867 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:36.399886 18305 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:36.394616 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.399215 18311 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 24. Current term is 26. Ops: []
I20260709 13:20:36.362053 26337 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.398864 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.399341 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:36.418149 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 318258us
I20260709 13:20:36.399817 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.416198 26184 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:36.431470 18304 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:36.434099 18201 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:36.441895 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 206124us
I20260709 13:20:36.420591 26337 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:36.397691 26147 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:20:36.425524 26156 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:36.447829 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:36.458972 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.459892 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:36.460500 18956 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:36.454309 26308 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:36.464092 26308 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.465945 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:36.465016 18927 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:36.470948 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:36.471001 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:36.473910 18926 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:36.475346 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:36.465085 18307 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:36.476356 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:36.477240 18384 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:20:36.489863 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:36.434799 26138 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.462886 26170 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.464550 26308 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:36.498657 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:36.502702 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 355583us
I20260709 13:20:36.420753 26355 consensus_queue.cc:237] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:36.477052 26176 raft_consensus.cc:2804] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:36.506289 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:36.511922 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:36.513494 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:36.513777 18236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:36.513001 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:36.521421 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.527237 18956 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:36.529402 18231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:36.530262 18231 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:36.533571 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:36.465523 26021 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.500283 26116 raft_consensus.cc:3060] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:36.534482 18960 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:36.477065 26024 raft_consensus.cc:697] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:36.549726 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:36.550606 18233 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:20:36.542004 25662 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:36.553862 18231 raft_consensus.cc:2468] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 20.
I20260709 13:20:36.553078 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:36.520993 26315 raft_consensus.cc:2804] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:36.561021 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.560972 26024 consensus_queue.cc:237] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:36.561753 18310 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:36.570488 26165 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:36.503947 26170 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.544029 26176 raft_consensus.cc:697] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 19 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:36.589217 18351 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:36.552268 25662 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:36.601177 26359 log.cc:927] Time spent T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:20:36.555075 26367 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:36.608949 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.619721 18378 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:36.594748 26190 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:36.585398 26368 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:36.589897 26179 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:36.622924 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 157528us
I20260709 13:20:36.633289 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:36.593986 26315 raft_consensus.cc:697] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 16 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:36.636186 18960 raft_consensus.cc:2468] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
I20260709 13:20:36.609432 25662 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:36.607470 26151 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:36.643678 18954 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:36.644451 18380 raft_consensus.cc:2468] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:20:36.644322 18310 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:36.611841 26291 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:36.612841 26144 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:36.625581 26319 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:36.625301 26190 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:36.669530 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.667358 26375 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:20:36.660151 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:36.674319 18305 raft_consensus.cc:2393] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 23: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:36.675530 18237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:36.677981 26170 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:36.678763 26176 consensus_queue.cc:237] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:36.683394 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:36.684233 18377 raft_consensus.cc:2368] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 21. Current term is 22.
I20260709 13:20:36.688781 18927 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:36.690620 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.697415 18926 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:36.699880 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:36.700655 18229 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:36.695864 18927 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:36.702581 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:36.672943 26190 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:36.703876 18926 leader_election.cc:400] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 21. Current term is 22.
I20260709 13:20:36.708751 18926 leader_election.cc:403] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:20:36.708091 18230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:36.707623 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.707593 26158 raft_consensus.cc:2804] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:36.711301 18305 raft_consensus.cc:2368] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23.
I20260709 13:20:36.680110 26319 raft_consensus.cc:697] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:36.759265 18230 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:20:36.764084 26319 consensus_queue.cc:237] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.704489 26295 raft_consensus.cc:2804] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:36.767028 18235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:36.767829 18235 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:36.700084 25827 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:36.771275 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.747246 26170 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.663908 26368 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.682273 26179 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.795126 18305 raft_consensus.cc:2393] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:36.704489 26248 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.649211 26367 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:36.794716 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.792440 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:36.760147 26138 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:36.801766 18232 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:36.814193 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:36.815296 18311 raft_consensus.cc:2368] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19.
I20260709 13:20:36.820166 18235 raft_consensus.cc:2468] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:36.799527 26170 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:36.831113 26170 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:36.821151 18232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:36.832839 18232 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:36.775770 26315 consensus_queue.cc:237] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:36.834038 26179 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:36.834242 26387 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:36.834903 26387 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:36.837090 26365 log.cc:927] Time spent T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:20:36.837885 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.839286 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.840776 18233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3"
I20260709 13:20:36.841359 18233 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:36.841946 26367 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:36.843755 18229 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 25.
I20260709 13:20:36.840421 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.845414 18303 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:36.846269 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.846800 18303 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:36.847615 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.848294 18303 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:36.849005 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.849776 18311 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:36.850670 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.851655 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:36.851765 26374 log.cc:927] Time spent T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:20:36.852259 18311 raft_consensus.cc:2368] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23.
I20260709 13:20:36.852870 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.853521 18305 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
W20260709 13:20:36.853600 26380 log.cc:927] Time spent T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:20:36.854396 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.854924 18305 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:36.855639 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.803975 26295 raft_consensus.cc:697] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 17 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:36.856771 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.857379 18307 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 25.
I20260709 13:20:36.794667 26158 raft_consensus.cc:697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 20 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:36.806960 25827 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:20:36.826725 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 124253us
I20260709 13:20:36.849097 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:36.822244 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 86777.3us
I20260709 13:20:36.863901 18303 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:36.857661 26295 consensus_queue.cc:237] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:36.912652 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:36.862846 26331 consensus_meta.cc:287] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.000s
I20260709 13:20:36.869704 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.887636 18229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b52e2477fc524694967c4a16afa983e3" is_pre_election: true
I20260709 13:20:36.977820 18229 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
W20260709 13:20:36.876086 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:36.890728 18230 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 26.
I20260709 13:20:36.898228 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:36.980346 18385 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 25.
I20260709 13:20:36.911386 18232 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 26.
I20260709 13:20:36.973819 18303 raft_consensus.cc:1240] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:36.963663 18304 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:36.823395 26248 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:36.950922 26392 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:20:36.977686 18312 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
W20260709 13:20:36.965351 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 67567.1us
I20260709 13:20:36.866153 25827 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:36.991547 18233 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:36.992568 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:36.995361 18311 raft_consensus.cc:2393] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 23: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:36.995270 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:36.983845 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:36.995759 18201 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:36.946035 26394 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 21. Current term is 22.
W20260709 13:20:37.010043 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 310971us
I20260709 13:20:37.002425 18229 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:20:36.995213 25827 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:37.029799 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.060915 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.070372 26387 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:36.996359 26397 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.982424 26331 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:37.006510 26337 consensus_meta.cc:287] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
I20260709 13:20:37.074337 26144 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.081768 18385 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:37.057284 26388 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.997495 26399 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:37.025820 26367 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:37.111125 18308 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
W20260709 13:20:37.076964 26116 consensus_meta.cc:287] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.002s
I20260709 13:20:37.115437 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:37.086789 26333 consensus_meta.cc:287] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.799s	user 0.012s	sys 0.000s
W20260709 13:20:37.085384 26301 consensus_meta.cc:287] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.961s	user 0.014s	sys 0.000s
I20260709 13:20:37.112900 26397 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:36.997679 26179 consensus_queue.cc:1059] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.090s
I20260709 13:20:37.125238 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.134253 18304 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 25.
I20260709 13:20:37.125736 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.135370 18312 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:37.138700 26166 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:37.139060 26397 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:20:37.150342 17138 tablet_server.cc:179] TabletServer@127.16.188.129:0 shutting down...
I20260709 13:20:37.154027 26179 raft_consensus.cc:3055] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:37.154518 26179 raft_consensus.cc:740] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:37.155272 26308 consensus_meta.cc:287] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.646s	user 0.009s	sys 0.001s
I20260709 13:20:37.155397 26179 consensus_queue.cc:260] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:37.155866 26308 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:37.130693 26144 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:37.135872 26333 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:37.164427 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.164892 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.126871 26367 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.164805 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.165999 18306 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:37.134608 26116 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:37.177019 26367 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:37.181288 18237 raft_consensus.cc:2393] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 20: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:37.181676 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:37.184875 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.186920 18312 raft_consensus.cc:2393] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 26: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:37.184521 26387 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.086712 26158 consensus_queue.cc:237] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:37.126490 26388 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:37.187556 26387 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:37.192080 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.126787 26337 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:37.128979 26399 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:37.212332 18231 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:20:37.182682 26179 raft_consensus.cc:3060] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:37.213531 18275 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:37.209931 18312 raft_consensus.cc:1275] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:20:37.211311 26248 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:37.226012 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:37.215476 26403 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.074s	user 0.003s	sys 0.000s
I20260709 13:20:37.224267 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:37.215227 26116 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:37.224577 26363 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.456s	user 0.000s	sys 0.001s
I20260709 13:20:37.218873 26335 raft_consensus.cc:2804] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:37.245223 18954 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:37.224581 26382 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.214557 26166 consensus_queue.cc:1059] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:20:37.216481 25827 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:37.268357 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:37.256100 25662 consensus_meta.cc:287] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.003s
I20260709 13:20:37.282720 26384 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:37.258335 26116 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:37.295255 26308 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:37.255184 26382 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:37.286983 26021 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:37.294644 26333 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:37.283442 25662 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:37.320101 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 102882us
I20260709 13:20:37.330653 26116 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:37.334734 25662 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:37.335188 26368 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:37.337949 26399 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:37.316591 26384 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:37.345000 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.346617 25827 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:37.353020 26337 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:37.359669 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:37.367924 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:37.397581 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:37.398542 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:37.401342 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:37.402164 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:37.412335 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:37.342008 26144 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:37.430069 18381 raft_consensus.cc:1275] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:37.434512 18384 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:37.433899 18385 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:37.432097 26390 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:37.438447 26390 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:37.443833 18954 raft_consensus.cc:1275] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:20:37.443917 18956 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 13:20:37.410961 26190 consensus_meta.cc:287] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.640s	user 0.014s	sys 0.000s
I20260709 13:20:37.448028 25662 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.464658 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:37.465423 18380 raft_consensus.cc:2468] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 18.
I20260709 13:20:37.373051 26308 consensus_queue.cc:1059] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:20:37.444618 26382 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:37.447551 26319 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:37.460850 26144 raft_consensus.cc:3055] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:37.479640 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:37.457080 26375 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:37.463551 25662 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:37.487898 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:37.495648 18378 raft_consensus.cc:2393] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 16: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:37.457532 26190 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:37.498621 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 237807us
I20260709 13:20:37.498621 18958 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:37.482970 26144 raft_consensus.cc:740] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:37.481185 26138 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 13:20:37.501360 26413 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.529121 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:37.530292 18380 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 19: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:20:37.520744 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 142526us
I20260709 13:20:37.524979 18377 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 26: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:37.495713 26116 raft_consensus.cc:3055] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:37.533507 18958 raft_consensus.cc:1240] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:37.479071 26021 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.038s
I20260709 13:20:37.498879 26319 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:37.498836 26335 raft_consensus.cc:697] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:37.545783 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:37.501287 26375 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:37.550659 18304 raft_consensus.cc:1240] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:37.548862 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:37.552819 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:37.555227 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.556895 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.558602 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.559314 18310 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 25.
I20260709 13:20:37.559875 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.534708 26116 raft_consensus.cc:740] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:37.558744 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:37.565033 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.565191 18303 raft_consensus.cc:3060] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:37.565603 18312 raft_consensus.cc:1275] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:20:37.559764 18276 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:37.567538 18306 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:37.567822 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.568586 18308 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:37.569701 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:37.570158 18379 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 25.
I20260709 13:20:37.573751 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:37.574589 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.575840 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:37.576335 18306 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:37.577015 18276 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:37.581003 26386 consensus_queue.cc:1059] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:37.580947 26166 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:37.581797 25662 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:37.582325 26386 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:37.582728 26386 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.583065 26386 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:37.584753 26116 consensus_queue.cc:260] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:37.585304 18305 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:37.585497 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:37.586166 26116 raft_consensus.cc:3060] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:37.586725 18305 raft_consensus.cc:1240] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:20:37.556242 26401 consensus_queue.cc:1048] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:20:37.588598 26418 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.589452 26190 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:37.589255 26418 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:37.589548 18309 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:37.598011 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.598245 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:37.601958 18310 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 26: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:37.591342 26166 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:37.603888 26331 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:37.605059 26384 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:37.557178 26413 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:37.605862 26382 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:37.606462 18304 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 23: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:37.607786 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.608497 18312 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:37.611085 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:37.613404 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.615252 18379 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 26: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:37.615406 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.616124 18312 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 19.
I20260709 13:20:37.620817 18384 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:37.601531 26190 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.624164 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:37.624831 18310 raft_consensus.cc:1275] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:37.624836 18309 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:20:37.627091 18384 raft_consensus.cc:1275] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:37.627314 26319 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:37.627704 26375 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:37.631263 26367 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:37.633179 18379 raft_consensus.cc:1240] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:37.643682 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:37.644613 18312 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:37.654760 18303 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:37.606523 26382 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:37.657122 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:37.574889 26144 consensus_queue.cc:260] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:37.669596 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.670612 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.671715 18303 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 25.
I20260709 13:20:37.675475 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:37.676352 18303 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:37.653925 26335 consensus_queue.cc:237] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:37.675860 26413 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:37.693045 26421 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:20:37.696749 26420 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.084s	user 0.000s	sys 0.002s
I20260709 13:20:37.633534 26190 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:37.699607 18303 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:37.692371 18309 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 25.
W20260709 13:20:37.702618 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.702289 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.703606 18309 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:37.707216 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.708487 18309 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:37.710244 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:37.711143 18309 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:37.713129 18277 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:37.705524 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.715529 18312 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 26.
I20260709 13:20:37.716377 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.714689 18277 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:37.745183 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:37.747424 18310 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:20:37.748221 18309 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:37.712144 26386 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:37.715261 26367 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:37.752079 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:37.751467 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:37.752159 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.753811 18309 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 26: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:37.757296 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.757893 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:37.760469 18303 raft_consensus.cc:2393] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 22: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:37.760948 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.751487 26382 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:37.752627 26416 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:37.763806 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.769855 18309 raft_consensus.cc:1240] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:37.768424 26190 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:37.787465 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:37.788851 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:37.789543 18958 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:37.789937 26158 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:37.766723 26416 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:37.795665 18306 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:37.790951 26158 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:37.808444 26386 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:37.815188 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:37.816044 26158 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:20:37.816201 26388 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:37.818152 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:37.816273 26116 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:37.819316 26388 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:37.814159 26418 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:37.820752 18202 leader_election.cc:400] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19.
I20260709 13:20:37.821154 18202 leader_election.cc:403] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:20:37.821731 26116 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:37.822916 26387 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:37.825340 18202 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:37.827114 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:37.824573 26390 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:37.828979 26387 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:37.829612 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:37.816612 26384 consensus_queue.cc:1059] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:20:37.830518 18954 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
I20260709 13:20:37.838675 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:37.841835 18958 raft_consensus.cc:2410] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:20:37.838124 26390 raft_consensus.cc:2764] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:20:37.844326 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:37.843534 26367 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:37.849795 26367 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:37.850214 26367 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:20:37.850641 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 146793us
I20260709 13:20:37.852351 26335 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:37.856161 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:37.868084 26384 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:37.860666 26390 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:37.870698 26384 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:37.871465 26384 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:37.875010 18926 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:37.875902 26158 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:37.877045 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:37.883643 18351 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.017s	sys 0.048s
W20260709 13:20:37.884155 18351 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.017s	sys 0.048s
W20260709 13:20:37.885016 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 707056us
W20260709 13:20:37.886364 18351 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.870370 26390 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:37.893428 26390 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:37.896199 18958 raft_consensus.cc:1240] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:37.899041 18377 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:37.901383 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:37.902760 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:37.904764 18202 leader_election.cc:400] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23.
I20260709 13:20:37.905644 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:37.876379 26157 consensus_queue.cc:1048] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:20:37.911059 18954 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:20:37.912461 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 61028.1us
I20260709 13:20:37.915326 26331 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:37.919067 26331 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:37.919502 26331 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:37.917407 26397 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:20:37.924850 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.926231 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:37.927294 26368 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:37.927804 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:37.913444 26315 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:20:37.928579 26368 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:37.915704 26375 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:20:37.928612 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:37.930476 18311 raft_consensus.cc:2393] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 21: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:37.928614 26179 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:37.931294 26179 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:37.932788 26179 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:37.934331 26179 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:37.935734 26144 raft_consensus.cc:3060] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:37.914357 26190 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:20:37.941213 26190 consensus_queue.cc:1243] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer 459e82ee6b564cc19be6f73186938e79 log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:37.942469 26190 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.942970 26190 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:37.943826 26319 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:37.944365 26319 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:37.908044 26248 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:37.910992 26388 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:37.948005 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:37.950062 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:37.960546 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:37.961427 26319 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:37.961848 18377 raft_consensus.cc:1240] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 13:20:37.946401 26248 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:37.961494 18378 raft_consensus.cc:2410] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 24 because replica has last-logged OpId of term: 22 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 13:20:37.962383 18311 raft_consensus.cc:1275] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:37.963507 18383 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:20:37.946507 26155 raft_consensus.cc:3055] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:37.947075 26116 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 18. Current term is 19.
I20260709 13:20:37.986268 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:37.981706 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:37.940358 26384 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:37.956652 26166 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:37.958451 26333 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:37.931284 26367 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:38.005424 18202 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:37.988909 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:38.017653 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:37.962615 26248 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:38.012938 26433 consensus_queue.cc:1059] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 13:20:37.989296 26417 consensus_queue.cc:1048] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:20:38.020095 26423 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:20:38.023344 26433 raft_consensus.cc:3055] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:38.023777 26433 raft_consensus.cc:740] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:37.986891 26388 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:38.003672 18955 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:38.048601 18383 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 22: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:38.048660 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:38.049871 18382 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:38.021975 18956 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 11.
I20260709 13:20:37.963337 26375 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:20:37.986143 26155 raft_consensus.cc:740] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:38.004567 26308 raft_consensus.cc:2764] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:20:38.024727 26433 consensus_queue.cc:260] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:38.058415 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 45016.4us
I20260709 13:20:38.022161 26166 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.021317 26138 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:38.057435 18277 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 66 similar messages]
I20260709 13:20:38.068099 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:38.050192 26368 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:38.058014 26116 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:38.075459 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:38.092145 18386 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:38.092106 26116 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:38.094997 26416 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:38.075184 26155 consensus_queue.cc:260] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:38.075619 26417 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:38.075184 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:38.099471 18384 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 26.
I20260709 13:20:38.077826 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:38.078282 26419 consensus_queue.cc:1059] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.120s
I20260709 13:20:38.076208 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:38.064667 26166 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:38.108680 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:38.112694 18277 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:38.073902 26368 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:38.109901 26308 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:38.122653 26308 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:38.127735 26384 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:38.130395 26333 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:38.104159 26433 raft_consensus.cc:3060] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:38.140236 18386 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 26.
I20260709 13:20:38.134861 26116 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:38.135509 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 69674.5us
I20260709 13:20:38.114959 26368 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:38.137698 26367 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:38.101400 26190 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:38.095685 26422 consensus_queue.cc:1059] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:20:38.073046 26138 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:38.113860 26416 raft_consensus.cc:3055] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:38.155773 26319 consensus_queue.cc:1048] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:38.119879 26390 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:38.156350 26416 raft_consensus.cc:740] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:38.169965 18349 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:38.169952 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:38.173079 18386 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 25. Current term is 26. Ops: [25.15-25.15]
I20260709 13:20:38.155151 26155 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:38.143193 26331 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:38.245956 18203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.265996 25827 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.281607 25827 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:38.282706 26331 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:38.266152 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:38.267405 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:38.268455 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:38.269769 18307 raft_consensus.cc:1275] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:20:38.287832 18201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.270045 26416 consensus_queue.cc:260] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:38.272857 26319 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:38.274888 26308 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:38.275538 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 74914.8us
I20260709 13:20:38.293882 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:38.294502 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:38.295073 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.279879 25662 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:38.172128 26190 consensus_queue.cc:1059] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:20:38.288568 26375 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.292101 26319 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:38.300926 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:38.157030 26157 consensus_queue.cc:1048] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.131s
I20260709 13:20:38.283856 25827 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:38.307719 26138 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:38.308638 26375 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:38.327953 18277 consensus_peers.cc:597] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:38.366501 18277 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:38.367609 18277 leader_election.cc:336] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:38.368031 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:38.332913 26417 raft_consensus.cc:3055] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:20:38.341558 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:38.345772 26390 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:38.370368 18955 raft_consensus.cc:1275] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:20:38.303493 26397 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.303488 25662 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:38.331199 26387 raft_consensus.cc:3055] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:20:38.369477 18277 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:38.387652 18277 leader_election.cc:336] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:38.388970 18277 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:38.389520 18277 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:38.344270 26248 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:38.353883 18382 raft_consensus.cc:2468] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
W20260709 13:20:38.360896 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 67075.6us
I20260709 13:20:38.355896 26319 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:38.370529 26308 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:38.385864 25662 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:38.377135 26155 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:38.397221 26248 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:38.376577 26417 raft_consensus.cc:740] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:20:38.404284 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 234392us
I20260709 13:20:38.410778 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:38.404897 18277 leader_election.cc:336] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:38.406212 18132 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39284 (request call id 215) took 17419 ms (client timeout 15000 ms). Trace:
I20260709 13:20:38.367130 26158 consensus_queue.cc:1048] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:20:38.408803 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:38.412830 18277 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:38.421293 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:38.439720 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:38.412382 18132 rpcz_store.cc:269] 0709 13:20:20.986571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.986782 (+   211us) service_pool.cc:224] Handling call
0709 13:20:38.406133 (+17419351us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:36.808786 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:36.829796 (+ 21010us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:36.829856 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:20:36.829874 (+    18us) tablet.cc:662] Decoding operations
0709 13:20:36.831425 (+  1551us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:36.831527 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:36.831554 (+    27us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:20:37.071619 (+240065us) tablet.cc:701] Row locks acquired
0709 13:20:37.071685 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:20:37.087233 (+ 15548us) write_op.cc:270] Start()
0709 13:20:37.123397 (+ 36164us) write_op.cc:276] Timestamp: P: 1783603237082368 usec, L: 0
0709 13:20:37.128356 (+  4959us) op_driver.cc:348] REPLICATION: starting
0709 13:20:37.256136 (+127780us) log.cc:844] Serialized 6385 byte log entry
0709 13:20:37.776792 (+520656us) op_driver.cc:464] REPLICATION: finished
0709 13:20:37.843118 (+ 66326us) write_op.cc:301] APPLY: starting
0709 13:20:37.853949 (+ 10831us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:37.981406 (+127457us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:37.981566 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:38.185183 (+203617us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:38.271319 (+ 86136us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 13:20:38.271392 (+    73us) write_op.cc:312] APPLY: finished
0709 13:20:38.271881 (+   489us) log.cc:844] Serialized 148 byte log entry
0709 13:20:38.273022 (+  1141us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:38.273290 (+   268us) write_op.cc:454] Released schema lock
0709 13:20:38.273410 (+   120us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:38.277234 (+  3824us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:38.277290 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":319312,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":58191,"apply.run_cpu_time_us":35321,"apply.run_wall_time_us":436970,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70879,"num_ops":16,"prepare.queue_time_us":197892,"prepare.run_cpu_time_us":28818,"prepare.run_wall_time_us":752538,"raft.queue_time_us":70439,"raft.run_cpu_time_us":16864,"raft.run_wall_time_us":41356,"replication_time_us":640230,"thread_start_us":326210,"threads_started":4,"wal-append.queue_time_us":319985}]]}
I20260709 13:20:38.406217 26414 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:38.409691 26337 consensus_queue.cc:1048] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.010s
I20260709 13:20:38.386544 26387 raft_consensus.cc:740] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:38.432555 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 262615us
I20260709 13:20:38.402503 26308 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:38.384881 26416 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:38.305354 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 242023us
I20260709 13:20:38.390439 26397 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:38.445011 18384 raft_consensus.cc:1275] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:20:38.420500 26138 raft_consensus.cc:2764] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:20:38.452445 18386 raft_consensus.cc:1275] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:38.440542 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:38.455582 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:38.460471 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 51805.5us
I20260709 13:20:38.465806 18201 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:38.469424 18201 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:38.470460 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 57662us
W20260709 13:20:38.472682 18277 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:38.473222 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:38.468564 26367 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:38.453341 26308 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:38.425628 26190 consensus_queue.cc:1048] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:20:38.481359 26190 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:38.481805 26190 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:38.482992 26414 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:38.475930 26417 consensus_queue.cc:260] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:38.485646 26447 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:38.485970 26021 raft_consensus.cc:3055] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:20:38.478305 18277 leader_election.cc:336] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:38.490844 18277 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:38.478958 26138 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:38.486402 26447 raft_consensus.cc:697] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:38.487066 26446 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:38.470793 26248 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:38.473809 26388 raft_consensus.cc:2804] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:38.478459 18201 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:38.491449 18277 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:38.479099 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:38.482683 26190 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:38.503592 18202 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:38.503947 25662 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:38.446245 18349 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:38.473413 26386 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:38.507535 18201 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:38.511891 18277 leader_election.cc:336] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:38.514782 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:38.518088 18277 consensus_peers.cc:597] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:38.521162 18277 consensus_peers.cc:597] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:38.523619 18277 leader_election.cc:336] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:38.493212 26021 raft_consensus.cc:740] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:38.525864 25662 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:38.527458 18202 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:38.494961 26138 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.496876 26417 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:38.528183 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:38.533497 18277 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:38.505779 26248 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:38.537153 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 90978.9us
I20260709 13:20:38.528944 26390 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:38.538484 26390 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 26 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:38.536641 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 59677.6us
I20260709 13:20:38.538385 26021 consensus_queue.cc:260] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:38.539546 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:38.539886 26021 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:38.506119 26388 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:38.530293 26116 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:38.540738 26388 raft_consensus.cc:3060] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:38.539557 26390 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:38.506366 26446 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:38.530510 26138 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:38.546834 26446 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:38.547477 26446 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:38.547951 26446 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:38.548265 26375 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:38.513227 26331 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:38.549190 26331 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.548892 26447 consensus_queue.cc:237] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:38.550429 26367 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:38.550876 26367 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:38.551265 26367 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:38.548939 26375 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:38.551996 26375 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.554435 26388 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:38.552341 26375 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:38.556761 26388 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:38.534979 18277 leader_election.cc:336] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:38.562865 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:38.526858 26414 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:38.549615 26331 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:38.525399 26144 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:38.528797 26176 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:38.567644 18277 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:38.577224 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:38.577490 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 50098.8us
I20260709 13:20:38.578263 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:38.581043 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.536355 26155 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:38.591461 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:38.580138 18276 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:38.592679 18202 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:38.563587 26248 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:38.592657 18277 consensus_peers.cc:597] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:38.595474 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:38.574151 26337 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:38.605398 18277 leader_election.cc:336] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:38.608227 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:38.608690 18277 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:38.610877 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:38.597764 26440 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:38.530900 26387 consensus_queue.cc:260] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:38.599908 26443 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:38.625545 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:38.622069 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 45624.1us
I20260709 13:20:38.636863 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:38.638166 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:38.639025 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:38.640367 18385 raft_consensus.cc:1240] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:38.641124 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:38.642055 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:38.642884 18385 raft_consensus.cc:2368] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22.
I20260709 13:20:38.642916 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:38.650116 26447 consensus_queue.cc:1059] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:20:38.652988 26333 raft_consensus.cc:3055] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:38.653427 26333 raft_consensus.cc:740] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:38.654495 26333 consensus_queue.cc:260] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:38.655828 26333 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:38.656576 18201 leader_election.cc:400] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22.
I20260709 13:20:38.657537 18201 leader_election.cc:403] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:20:38.659142 26447 raft_consensus.cc:3060] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:38.606953 26413 raft_consensus.cc:2804] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:20:38.682742 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 57658.1us
W20260709 13:20:38.685509 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.606629 26179 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:38.593484 26386 consensus_queue.cc:1059] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
W20260709 13:20:38.671730 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 66880.4us
W20260709 13:20:38.701442 18277 leader_election.cc:336] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:38.702644 18277 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:38.703398 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:38.692444 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 152977us
I20260709 13:20:38.597214 26176 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:38.718215 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:38.757925 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 72066.3us
I20260709 13:20:38.683686 26388 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:38.758833 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:38.781538 18202 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:38.767865 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.678643 26443 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:38.685052 26440 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:38.800974 18351 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:20:38.884176 18278 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:38.902043 26176 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:38.701749 26446 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:38.879263 26433 consensus_meta.cc:287] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.725s	user 0.007s	sys 0.002s
I20260709 13:20:38.803826 26333 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:38.845670 26382 consensus_queue.cc:1048] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:20:38.846931 26367 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:38.875934 26166 consensus_meta.cc:287] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: Time spent flushing consensus metadata: real 0.758s	user 0.007s	sys 0.002s
W20260709 13:20:38.882251 26368 consensus_meta.cc:287] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.001s
I20260709 13:20:38.788233 26384 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:38.811148 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:38.836621 26441 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.404s	user 0.004s	sys 0.002s
I20260709 13:20:38.814452 26445 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:38.879045 26116 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:20:38.792563 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 98274.7us
I20260709 13:20:38.704280 26390 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:38.794199 26179 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:20:38.826117 26144 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:38.880393 26388 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.798691 26387 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:38.788118 26443 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:38.939594 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:38.951752 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 140723us
I20260709 13:20:38.941850 26447 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22.
I20260709 13:20:38.967110 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:38.973711 26459 log.cc:927] Time spent T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:20:38.984714 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 203254us
I20260709 13:20:38.954980 26333 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:38.989262 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 286638us
W20260709 13:20:39.001626 18277 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:39.002218 18277 leader_election.cc:336] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.002621 18277 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:38.948720 26166 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:39.007551 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 206849us
I20260709 13:20:38.952857 26368 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:38.953959 26384 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:38.976047 26457 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:39.034361 18277 consensus_peers.cc:597] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:38.988911 26190 raft_consensus.cc:2804] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:39.036463 18277 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.036886 26190 raft_consensus.cc:697] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:39.036933 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:39.037935 26190 consensus_queue.cc:237] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.043076 26166 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.033509 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:20:39.049650 18277 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.050235 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79
W20260709 13:20:39.050602 18277 leader_election.cc:336] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.051007 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:39.054579 26319 consensus_meta.cc:287] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.004s
I20260709 13:20:39.054813 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:39.055163 26319 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:39.057663 26319 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:39.043812 26390 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:39.059785 26308 consensus_meta.cc:287] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.000s
I20260709 13:20:39.011726 26397 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.045957 26417 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:39.053146 26452 raft_consensus.cc:2764] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:20:39.062067 26452 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:39.062559 26452 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:39.063503 26452 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.064581 26375 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:39.048062 26457 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.067278 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.062086 26384 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:39.067988 18307 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16.
I20260709 13:20:39.058651 26390 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.070564 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.070940 26390 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.071198 18305 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 22.
I20260709 13:20:39.071581 26319 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:20:39.072376 26465 log.cc:927] Time spent T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:20:39.060214 26333 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:39.074015 26458 log.cc:927] Time spent T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:20:39.073870 26333 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:39.060235 26308 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.082334 18927 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:39.084386 18384 raft_consensus.cc:1240] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:39.086405 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:39.087155 18958 raft_consensus.cc:2393] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:39.087261 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:38.978696 26388 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:39.102856 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 52279.3us
W20260709 13:20:39.103855 18277 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.104636 18277 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:39.046069 26447 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:39.088464 26166 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:20:39.119679 18954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53364 (request call id 811) took 1165 ms. Trace:
I20260709 13:20:39.008035 26466 consensus_queue.cc:1048] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.118s
I20260709 13:20:39.092760 26390 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.120645 18954 rpcz_store.cc:276] 0709 13:20:37.948377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.948920 (+   543us) service_pool.cc:224] Handling call
0709 13:20:37.962430 (+ 13510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:37.962795 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:37.962827 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:37.988829 (+ 26002us) log.cc:844] Serialized 26 byte log entry
0709 13:20:38.102348 (+113519us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:38.102433 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:38.102603 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:38.122969 (+ 20366us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b48002613d8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18719caa1 00007fa187193b37 00007fa1871939ca 00007fa18728b26f 00007fa18728af37 00007fa18729f55c 00007fa18729f508 00007fa18729f488 00007fa18729f443 00007fa18729e6ec 00007fa1861c8a96
0709 13:20:38.561472 (+438503us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:39.113537 (+552065us) raft_consensus.cc:1685] finished
0709 13:20:39.113569 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:39.113757 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4278,"raft.run_cpu_time_us":1925,"raft.run_wall_time_us":138632,"spinlock_wait_cycles":8892672,"thread_start_us":40373,"threads_started":1,"wal-append.queue_time_us":271232}
I20260709 13:20:39.095983 26333 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:39.109416 26467 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:39.058939 26331 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.108369 26477 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:20:39.116968 26445 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:39.162102 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.162856 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.163755 18306 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 26.
I20260709 13:20:39.163087 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.165395 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.123075 26386 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:39.166181 18308 raft_consensus.cc:2410] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:20:39.166157 18306 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:39.175282 26445 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.127923 26447 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:39.181425 26447 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:39.182459 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:39.183600 18306 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:39.184854 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.185597 18308 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:39.190536 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.191126 18307 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:39.194020 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:39.194306 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.150373 26433 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:39.154413 26467 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:39.196731 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.196122 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.202410 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.201642 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.204645 18310 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:39.194514 26138 consensus_meta.cc:287] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.001s
I20260709 13:20:39.216566 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:39.207274 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.206403 18311 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 24: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:39.154246 26390 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.232499 18202 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:39.236809 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.239166 18304 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:39.240118 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.206192 26467 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:39.250373 18308 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:39.251626 26179 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:39.251642 18304 raft_consensus.cc:1240] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:20:39.252326 26447 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:39.274621 26308 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.275758 26331 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.276834 26368 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:39.276983 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.277386 18304 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:39.278512 18304 raft_consensus.cc:3055] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:20:39.278860 18304 raft_consensus.cc:740] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:39.242658 18310 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
I20260709 13:20:39.253558 26375 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:39.230275 26138 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.281757 26390 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.282349 26138 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:39.283077 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.237296 26485 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:39.287544 26416 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:39.288110 26447 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:39.288442 26179 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:39.288672 18304 consensus_queue.cc:260] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.289821 18304 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:39.290186 26447 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:39.289902 26179 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.292207 18309 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:39.261232 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:39.261874 26457 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:39.263615 26443 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.285794 18307 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:39.197690 26386 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:39.259742 26388 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:39.293536 18956 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:39.294736 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:39.283856 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 231460us
I20260709 13:20:39.224288 26367 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.306501 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:39.307319 18380 raft_consensus.cc:2368] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23.
I20260709 13:20:39.308156 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:39.297982 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 214554us
I20260709 13:20:39.308993 18385 raft_consensus.cc:2393] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 22: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:39.308846 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:39.310492 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:39.308914 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:39.311183 18201 leader_election.cc:400] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23.
I20260709 13:20:39.311620 18201 leader_election.cc:403] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:39.311684 18381 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:39.312791 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:39.318807 18381 raft_consensus.cc:2393] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 17: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:39.319859 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:39.300043 26248 consensus_meta.cc:287] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.693s	user 0.002s	sys 0.009s
I20260709 13:20:39.322129 18201 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:39.330504 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:39.300238 26413 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.015s	sys 0.008s
I20260709 13:20:39.330997 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:39.333142 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:39.342458 18379 raft_consensus.cc:2368] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 25. Current term is 26.
I20260709 13:20:39.325389 26457 consensus_queue.cc:1048] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:20:39.334542 26248 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.344236 26485 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:39.344796 26485 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.345150 26485 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:39.345358 26248 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.351091 26443 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.288131 26416 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.331532 26388 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 23
W20260709 13:20:39.353724 26413 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.015s	sys 0.008s
I20260709 13:20:39.375686 26416 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.376237 26413 raft_consensus.cc:697] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:39.391072 26413 consensus_queue.cc:237] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.411051 18200 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:39.416113 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.416587 26414 consensus_queue.cc:1059] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:39.417698 26494 raft_consensus.cc:3060] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:39.417909 26414 raft_consensus.cc:3055] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:39.418318 26414 raft_consensus.cc:740] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:39.434325 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:39.436007 18385 raft_consensus.cc:1240] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 25. Current term is 26. Ops: [25.15-25.15]
I20260709 13:20:39.436800 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:39.441627 18955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:20:39.445292 18277 leader_election.cc:336] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.430091 26386 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:39.437080 26475 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.445897 18277 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:39.446400 26475 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:39.447600 18277 consensus_peers.cc:597] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:39.448184 18277 leader_election.cc:336] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.448736 26386 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:39.449671 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:39.450469 18382 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 26: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:39.452616 26475 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:39.453109 18277 leader_election.cc:336] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.354314 26467 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:39.456192 18277 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:39.440475 26485 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.458714 26416 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:39.431726 26388 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 22. Current term is 23.
I20260709 13:20:39.462057 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:39.462648 18954 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:39.463222 26485 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.473784 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:39.474697 18386 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:39.473990 18201 leader_election.cc:400] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 25. Current term is 26.
I20260709 13:20:39.475780 18201 leader_election.cc:403] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:20:39.481451 18385 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:20:39.503600 18954 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:39.456914 26414 consensus_queue.cc:260] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:39.504817 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:39.505456 18382 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:20:39.504839 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:39.529541 18349 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:39.530928 18386 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
I20260709 13:20:39.508031 26494 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:39.510735 18955 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:39.511066 26467 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.515715 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:39.516463 18304 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 15. (term mismatch)
I20260709 13:20:39.541476 18304 pending_rounds.cc:85] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 14
I20260709 13:20:39.523428 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:39.539644 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:39.558434 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 99979.4us
W20260709 13:20:39.559304 18277 leader_election.cc:336] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.559830 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:39.560163 18276 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.461496 26457 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:39.569360 26335 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:20:39.573248 18277 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.541802 18304 pending_rounds.cc:107] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 25.15
I20260709 13:20:39.593825 18277 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:39.595022 26443 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:39.575261 26446 consensus_queue.cc:1059] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
W20260709 13:20:39.574514 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.596895 26335 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:39.598767 18277 leader_election.cc:336] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:39.599990 18277 leader_election.cc:336] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.600366 18277 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:39.604446 26335 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:39.605672 18277 consensus_peers.cc:597] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:39.608716 18277 leader_election.cc:336] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.609090 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:39.610160 18135 catalog_manager.cc:5697] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 11 to 13, term changed from 15 to 17, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132), e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:39.611721 26414 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:39.613332 26386 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:39.615463 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:39.617107 26443 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:39.617451 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:39.618268 26443 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:39.618628 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:39.619797 26457 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:39.594945 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 79308.8us
I20260709 13:20:39.622447 26457 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:39.630314 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:39.633672 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 60739.9us
I20260709 13:20:39.551213 26460 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:39.545405 26179 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:39.612222 18135 catalog_manager.cc:5697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 19 to 21, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 21 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:39.640089 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:39.593954 18304 raft_consensus.cc:2889] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:39.638239 18201 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:39.647068 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.651522 18306 raft_consensus.cc:2393] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 19: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:39.552667 26497 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.653896 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.658901 18308 raft_consensus.cc:2410] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:20:39.636312 26390 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:39.636803 26386 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.659904 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.660698 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.666704 18307 raft_consensus.cc:2410] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d for term 26 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 13.
I20260709 13:20:39.660902 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.661998 18304 raft_consensus.cc:1240] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 20. Current term is 21. Ops: [15.10-20.11]
I20260709 13:20:39.664500 18306 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:20:39.576709 26485 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.646900 26474 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.662261 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.676055 18311 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 23: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:39.656560 18135 catalog_manager.cc:5697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:39.669242 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.677757 18303 raft_consensus.cc:2376] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24. Re-sending same reply.
I20260709 13:20:39.646649 26116 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:39.652747 26248 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:39.672673 18305 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:20:39.665830 18202 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:39.674188 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.678272 18306 raft_consensus.cc:1275] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:20:39.649161 26460 raft_consensus.cc:697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:39.639209 26367 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
W20260709 13:20:39.670338 26422 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 26 current term: 26 is higher.
I20260709 13:20:39.687290 18135 catalog_manager.cc:5697] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:39.668879 26308 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:20:39.675132 18351 consensus_peers.cc:597] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:39.680414 18202 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:39.690876 26248 raft_consensus.cc:697] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:39.693266 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.693544 18202 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:39.683833 18307 raft_consensus.cc:1240] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 23. Current term is 24. Ops: []
I20260709 13:20:39.694446 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.694146 26248 consensus_queue.cc:237] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.695130 18305 raft_consensus.cc:2393] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 23: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:39.695923 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.696753 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.696933 26368 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:39.697549 26368 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:39.697861 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.698474 18311 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:39.698556 26368 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.701014 26331 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:39.701476 18303 raft_consensus.cc:1240] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 22. Current term is 23. Ops: []
I20260709 13:20:39.701591 26331 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:39.702461 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.702625 26331 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.683240 26388 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:39.703472 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.704128 26388 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:39.704200 18303 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:39.705871 18308 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
I20260709 13:20:39.684278 18304 raft_consensus.cc:1240] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 25. Current term is 26. Ops: [23.14-25.15]
I20260709 13:20:39.704962 18305 raft_consensus.cc:2368] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 25. Current term is 26.
I20260709 13:20:39.704849 26390 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.693089 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.695025 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.697116 26460 consensus_queue.cc:237] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:39.708062 18307 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:39.706825 18135 catalog_manager.cc:5697] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 21 to 24, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 24 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:39.679085 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 365494us
I20260709 13:20:39.709744 18312 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 19. Current term is 20. Ops: []
I20260709 13:20:39.656121 26494 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
W20260709 13:20:39.692022 18351 leader_election.cc:336] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.711920 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.713014 18305 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:39.720009 18311 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
W20260709 13:20:39.711064 18927 consensus_peers.cc:597] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:39.723569 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:39.725692 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.728664 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:39.713191 18351 consensus_peers.cc:597] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:39.672569 26386 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:39.735918 26447 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:39.736563 26447 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.737138 26386 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:39.738950 26333 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:20:39.712005 26308 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:39.741035 26308 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.746644 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:39.747504 18312 raft_consensus.cc:2393] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 26: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:39.734652 18135 catalog_manager.cc:5697] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 14 to 16, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 16 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:39.678675 26485 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:39.666366 26497 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:39.764350 18351 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.771166 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:39.766393 18310 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:20:39.762519 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:39.775154 18277 leader_election.cc:336] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:39.772388 18351 consensus_peers.cc:597] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:39.705282 26388 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:39.773236 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 46039.5us
I20260709 13:20:39.787439 18307 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 27.
I20260709 13:20:39.775862 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:39.682196 26474 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.721863 26390 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.769352 26387 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:39.813864 18927 leader_election.cc:336] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.766592 26367 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:39.780400 18351 consensus_peers.cc:597] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:39.835872 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 55528.4us
I20260709 13:20:39.821970 18303 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:39.805872 18386 raft_consensus.cc:1275] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:39.837363 18304 raft_consensus.cc:1240] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 22. Current term is 23. Ops: []
W20260709 13:20:39.824488 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.832271 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:39.838445 26416 consensus_queue.cc:1048] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:39.841518 26367 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.843578 26367 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.846361 26447 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.850374 26443 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:39.834558 26414 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.851773 26414 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.853435 26485 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:39.855756 26474 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.812901 26422 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:20:39.832858 26158 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:39.858107 26158 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:39.862845 18277 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:39.863402 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:39.863667 26497 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:39.864253 26497 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:39.853734 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:39.865069 18277 leader_election.cc:336] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:39.871598 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 178121us
I20260709 13:20:39.887941 18277 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:39.888386 18927 consensus_peers.cc:597] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:39.891927 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:39.893384 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:39.893385 18955 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:20:39.835362 26508 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:20:39.901789 18202 leader_election.cc:400] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 election: Vote denied by peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605) with higher term. Message: Invalid argument: T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 25. Current term is 26.
I20260709 13:20:39.902799 18202 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:39.891402 26386 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.908625 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:39.885300 26157 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:39.910382 25662 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:39.892139 26446 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:39.871704 18135 catalog_manager.cc:5697] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 17 to 19, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131), now has a pending config: VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129), VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130), VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131), VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 19 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } } pending_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:39.914670 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:39.917591 18303 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:39.918591 18351 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:39.905134 26443 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:39.892760 26485 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:20:39.920192 18202 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:39.926497 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:39.905954 26335 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:39.867146 26387 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:39.916939 26157 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:39.966851 26157 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.967801 26509 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:39.971210 25662 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:39.972719 18135 catalog_manager.cc:5697] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:39.911253 26138 consensus_queue.cc:1059] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:20:39.983935 26138 raft_consensus.cc:3055] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:39.984325 26138 raft_consensus.cc:740] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:39.985203 26138 consensus_queue.cc:260] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:39.986598 26138 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:39.990720 26387 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:39.993922 26179 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for earlier term 25. Current term is 26.
I20260709 13:20:39.921906 26445 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.065s
I20260709 13:20:39.976567 26474 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:39.961961 26116 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:39.997423 26116 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.997874 26116 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:40.002544 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:40.005709 26414 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:40.007534 26390 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:40.017387 26158 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.959515 26497 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.019229 26497 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.021765 26497 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:39.919025 26386 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:39.959980 26375 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:39.968873 26021 consensus_queue.cc:1048] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:20:40.010394 26116 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.055352 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:40.054647 26485 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.076290 26179 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:40.133550 26509 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.143200 26509 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.145936 26509 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:40.134151 26485 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.149856 26485 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:40.130883 26387 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.153093 26387 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.155573 26387 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:40.162226 26475 raft_consensus.cc:493] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:40.162910 26475 raft_consensus.cc:515] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.170254 18954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:40.177645 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:40.178442 18956 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:40.138738 26457 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:40.138173 26386 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:40.191744 18200 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:40.222779 26485 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:40.242542 26485 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.184614 26390 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:40.246121 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 323692us
I20260709 13:20:40.248250 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:40.183270 26497 raft_consensus.cc:493] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
W20260709 13:20:40.259802 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 295522us
I20260709 13:20:40.268247 18351 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:40.244607 26388 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:40.291587 18202 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:40.276296 26331 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:40.310273 26522 log.cc:927] Time spent T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:40.310406 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:40.311020 26331 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.311651 26452 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:40.297809 26368 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:20:40.313205 26452 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:40.304711 26509 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:40.314512 26488 raft_consensus.cc:3055] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:40.314935 26488 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:40.316067 26488 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.308789 26460 consensus_queue.cc:1059] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:40.309389 26485 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:40.317896 26460 raft_consensus.cc:3055] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:40.318368 26460 raft_consensus.cc:740] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:20:40.318570 26515 log.cc:927] Time spent T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:20:40.319478 26460 consensus_queue.cc:260] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.290411 26497 raft_consensus.cc:515] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.294687 26386 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.321518 26386 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.305622 26021 consensus_queue.cc:1059] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:20:40.309511 26190 consensus_queue.cc:1059] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:40.324663 26190 consensus_queue.cc:1243] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer 459e82ee6b564cc19be6f73186938e79 log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:40.325085 26021 raft_consensus.cc:3055] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:40.325254 26190 raft_consensus.cc:3055] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:20:40.325635 26021 raft_consensus.cc:740] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:40.325680 26190 raft_consensus.cc:740] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:40.326746 26021 consensus_queue.cc:260] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.326964 26190 consensus_queue.cc:260] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:40.325086 26512 log.cc:927] Time spent T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:20:40.328236 26190 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:40.330430 26386 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:40.332937 26511 log.cc:927] Time spent T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:20:40.256922 26390 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.290072 26138 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:40.294148 26475 leader_election.cc:290] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:40.290167 26388 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.344997 26388 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:40.405686 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.408731 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.409468 18308 raft_consensus.cc:2468] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:40.410488 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.411124 18308 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:40.412076 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.413493 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.414193 18308 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:40.415140 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:40.411492 18277 leader_election.cc:336] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:40.421586 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.422060 18305 raft_consensus.cc:1275] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:20:40.411000 18351 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:40.426455 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.427657 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:40.428929 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:40.434553 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.369933 26460 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:40.434211 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.433847 18311 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:20:40.448942 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.451334 18304 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:20:40.402073 26530 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:40.377219 26390 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:40.453831 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:40.460487 18960 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:40.460565 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:40.403067 26401 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:40.429790 26368 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 27 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:40.466841 18305 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:40.433032 26021 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:40.471449 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.426102 26138 consensus_queue.cc:1059] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.054s
W20260709 13:20:40.481902 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.478093 26368 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.448024 26497 leader_election.cc:290] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:40.426484 26446 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:20:40.538498 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:40.539425 18202 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:40.497061 26509 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:40.514739 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:40.515730 18962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:40.516077 18927 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:40.517091 18961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:40.528920 26534 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:40.533028 26513 log.cc:927] Time spent T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.350s	user 0.004s	sys 0.012s
W20260709 13:20:40.534286 26510 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.568s	user 0.006s	sys 0.003s
I20260709 13:20:40.528849 26331 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:40.535904 26375 raft_consensus.cc:3055] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:40.536959 26367 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.544363 18312 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:20:40.545003 18960 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 19.
I20260709 13:20:40.517112 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:40.546281 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:40.547317 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:40.550276 18275 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:40.559343 18311 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:40.556931 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.560206 18275 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:40.561232 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.479797 26388 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.566999 26536 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.528827 26526 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.486550 26401 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.551671 26190 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:40.570367 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.555914 26333 raft_consensus.cc:2804] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:40.555743 26158 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:40.547163 26534 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.555447 26375 raft_consensus.cc:740] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:40.608217 26375 consensus_queue.cc:260] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.609383 26375 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:40.580111 26333 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.613021 26333 raft_consensus.cc:3060] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:40.614409 26401 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:40.615767 26488 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:40.617985 26388 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:40.544214 26509 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.620666 18303 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:20:40.624619 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.576563 18312 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 25.
I20260709 13:20:40.626214 26116 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:40.580895 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.581425 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.562935 26422 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:40.565574 26386 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:40.565819 26535 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:40.630023 26535 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.629797 26386 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.630545 26535 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:40.630752 26386 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:40.583964 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.633882 18306 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:40.635200 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:40.636059 18957 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:20:40.639451 26386 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.640640 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:40.642035 26386 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:40.647640 26308 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:40.648370 26308 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.651265 26308 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:40.654706 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:40.695291 26535 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.703702 18383 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:20:40.708149 26333 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.596381 26443 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:40.594337 18311 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:40.575306 26390 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.578591 26331 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.570112 26457 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.567823 26532 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:40.575469 26536 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.577658 26526 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.606603 26534 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:40.709474 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 298500us
I20260709 13:20:40.711892 18957 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:40.622225 18303 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:20:40.716334 18277 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:40.565863 26367 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.736089 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.776582 18200 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
W20260709 13:20:40.776608 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 60319.3us
I20260709 13:20:40.736446 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:40.777639 18277 consensus_peers.cc:597] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:40.738004 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:40.723106 26541 log.cc:927] Time spent T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.089s	user 0.000s	sys 0.002s
I20260709 13:20:40.744374 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:40.726285 26514 log.cc:927] Time spent T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.759s	user 0.002s	sys 0.009s
I20260709 13:20:40.782835 26386 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:40.726836 26539 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.097s	user 0.002s	sys 0.000s
I20260709 13:20:40.783658 26386 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.784415 26526 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:40.785751 26523 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:40.786329 26523 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.787366 26386 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:40.747471 26331 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.791299 26331 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:40.726680 26518 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.504s	user 0.001s	sys 0.009s
I20260709 13:20:40.783341 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:40.777145 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 230927us
W20260709 13:20:40.778268 18277 leader_election.cc:336] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:40.781023 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb0f3b6bc6342f0bd5d2efc5d4f6463" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.774739 26529 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:40.793536 18378 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
W20260709 13:20:40.794886 18277 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:40.799434 26368 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:40.799741 18277 leader_election.cc:336] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:40.800834 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:40.802022 18277 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:40.800374 26485 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.802945 26485 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.806247 26530 raft_consensus.cc:3055] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:40.806672 26530 raft_consensus.cc:740] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:40.807590 26530 consensus_queue.cc:260] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.810032 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:40.812546 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.813761 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.814149 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.815083 18377 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:40.816069 18386 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:40.814725 18383 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 19.
I20260709 13:20:40.820544 18380 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:20:40.821857 18202 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:40.822446 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 45979us
I20260709 13:20:40.824987 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.825615 18384 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 26.
I20260709 13:20:40.825767 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.826793 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafcec4c722f49fa90d23d1326870a82" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.830585 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.796298 26523 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:40.736972 26390 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:40.840322 18277 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.747918 26457 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.850219 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.809974 26526 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:20:40.797426 26331 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 13:20:40.851455 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.852149 18309 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:20:40.857592 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 81876us
I20260709 13:20:40.858076 18381 raft_consensus.cc:2393] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 23: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:40.837792 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:40.853897 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.828557 26443 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:40.851141 18305 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:40.862135 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.862732 18306 raft_consensus.cc:2468] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
W20260709 13:20:40.863049 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:40.833554 26387 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:40.854521 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.774447 26532 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.864471 18308 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 26.
I20260709 13:20:40.835366 26368 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:40.857010 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:40.866298 18303 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:40.860006 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:40.860314 26549 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:20:40.860563 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.856745 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:40.869524 18304 raft_consensus.cc:2393] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 18: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:40.842784 26530 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:40.810276 26529 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.869724 18957 raft_consensus.cc:1240] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:40.870517 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:40.875876 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.861697 26443 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.876889 18202 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:40.881727 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.883351 18381 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:40.866029 26368 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.887414 18276 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:40.884696 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:40.872427 26416 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:40.894731 18276 leader_election.cc:304] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:40.888005 18303 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:40.892190 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.888706 26550 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:20:40.896164 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.886072 26443 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:40.906425 26497 raft_consensus.cc:2749] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:40.889631 26414 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:40.873603 26387 raft_consensus.cc:697] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:40.899533 26509 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:40.913044 26509 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.913481 26509 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:40.886021 26485 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:40.917829 26532 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:40.919293 26390 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:40.924863 26535 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:40.925806 26367 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:40.903569 26536 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:40.891429 26368 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:40.894053 26523 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:40.904841 26475 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:40.929328 26333 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:40.885499 26517 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:20:40.929351 26475 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:40.929416 26555 log.cc:927] Time spent T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:20:40.889248 26179 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:40.933022 26179 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.933422 26179 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:40.911604 26387 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.929195 26529 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:40.911504 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 46443.5us
I20260709 13:20:40.927223 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:40.932600 26475 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:40.927578 26457 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:40.937565 18351 leader_election.cc:336] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:40.948295 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:40.948662 26532 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:40.949170 26532 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:40.949498 26532 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:20:40.950764 18351 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:40.951229 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:40.954612 18351 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:40.955029 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:40.956094 18351 leader_election.cc:336] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:40.949493 26457 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:40.957392 26457 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:20:40.958032 26457 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:40.958995 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:40.938187 26542 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:20:40.947259 26368 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:40.959116 18384 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:20:40.961144 26549 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:40.961696 26549 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:40.963907 26368 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:40.966322 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:40.966594 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:40.967257 18957 raft_consensus.cc:2410] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:20:40.967489 18956 raft_consensus.cc:2393] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 19: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:40.969254 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:40.969465 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.974767 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:40.978181 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.978911 18384 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:40.939622 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:40.979763 18201 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:40.980201 18303 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:40.983110 18379 raft_consensus.cc:2393] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 12: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:40.976109 18200 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:40.987895 18926 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:40.997831 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:40.998819 18378 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 26.
I20260709 13:20:41.000969 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:41.001701 18378 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:20:41.003794 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
W20260709 13:20:40.977383 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 148363us
W20260709 13:20:41.014670 18927 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.015488 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:41.015957 18201 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:41.016795 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:41.013629 18276 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:41.019325 18351 consensus_peers.cc:597] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:41.020190 18351 leader_election.cc:336] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.020709 18351 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:41.022181 18351 leader_election.cc:336] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.022763 18351 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:41.023756 26138 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:41.018085 18926 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:41.024231 18351 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.028275 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:41.029394 18351 leader_election.cc:336] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.029786 18351 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:41.032011 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:41.025540 18927 leader_election.cc:336] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.033424 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:41.034271 18351 consensus_peers.cc:597] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:41.034987 18927 consensus_peers.cc:597] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:41.024771 18277 leader_election.cc:336] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.038160 18380 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:41.040944 18303 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
W20260709 13:20:41.035689 18927 consensus_peers.cc:597] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:41.046243 18927 leader_election.cc:336] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.039696 18201 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:41.039373 17138 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 18262)
I20260709 13:20:41.046907 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:41.037009 18277 leader_election.cc:336] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.014983 26116 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:40.973361 26549 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:41.024441 26138 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:41.032498 26529 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:41.053618 18277 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:41.026739 26333 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:41.025861 26157 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:20:41.055846 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:41.056389 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:41.057039 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.046556 26548 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:41.036029 26474 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 13:20:41.046386 26158 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:41.031929 26464 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:41.064677 26535 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:41.078380 26529 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.086544 26443 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.087083 26529 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:41.081090 26416 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:41.036306 26530 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:41.068836 26382 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:41.055634 18201 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:41.025374 26547 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:41.096736 26368 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:41.097216 26535 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:41.054453 18351 leader_election.cc:336] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:41.099839 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51521.2us
W20260709 13:20:41.055562 18927 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.100857 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:41.076614 18378 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
I20260709 13:20:41.047761 26536 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:41.081135 18377 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.097500 26368 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:20:41.102108 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 46572.1us
W20260709 13:20:41.104622 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:41.105346 18927 consensus_peers.cc:597] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:41.079277 18277 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.106240 18277 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:41.103142 18351 leader_election.cc:336] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.107227 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:41.109792 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:41.112397 18351 leader_election.cc:336] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.113015 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:41.072233 26509 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.103881 26547 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:41.117013 18927 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.124240 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:41.121340 18927 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:41.125362 18351 consensus_peers.cc:597] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:41.127882 18202 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:41.115613 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 76519.8us
I20260709 13:20:41.117384 18201 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:41.118186 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:41.118846 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:41.130541 18927 leader_election.cc:336] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.131309 18308 raft_consensus.cc:2410] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:20:41.115135 26475 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:41.114917 26530 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:41.133426 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:41.116367 26548 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:20:41.131021 18927 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:41.154487 18303 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.154572 18201 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:41.166251 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:41.128433 26536 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:41.124533 26443 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:41.131620 26382 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:41.131793 26474 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:41.152894 26494 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:20:41.175791 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 45265.2us
I20260709 13:20:41.181670 18377 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:41.182847 18201 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:41.208896 18201 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:41.209769 18201 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:41.211387 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:41.183763 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:41.191226 18303 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 20.
I20260709 13:20:41.212749 18311 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:41.214819 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:41.123059 26248 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:20:41.230614 18275 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:41.169094 26367 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:41.192929 26547 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:41.161007 26488 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 13:20:41.192438 26021 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.157662 26460 consensus_queue.cc:1048] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:20:41.215543 26523 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.255716 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:41.200344 26517 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:41.216552 26443 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:41.163542 26179 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.226665 26308 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:41.201406 26532 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.200296 26331 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:41.216229 26447 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:41.269922 18303 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
W20260709 13:20:41.217885 26539 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:20:41.237360 26536 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:41.200569 26485 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.242970 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:41.304490 18957 raft_consensus.cc:3060] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:41.251216 26116 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:41.309136 26116 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.311297 26116 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:41.265168 26414 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.285152 26308 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.312134 26414 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.312772 26308 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:41.288908 26509 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:41.289188 18310 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 27: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:41.289820 26570 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:20:41.314872 26570 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.289619 26331 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.315286 26414 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:41.315325 26570 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.290010 26532 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:41.269968 26021 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.226815 26550 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:20:41.226809 26526 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:20:41.287827 26386 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:41.317909 26485 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.327540 26550 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:41.311326 26529 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.328523 18309 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
W20260709 13:20:41.299947 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 88620us
I20260709 13:20:41.284528 26523 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.333482 18275 leader_election.cc:304] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:41.328421 26485 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:41.336439 26532 raft_consensus.cc:2749] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:41.342304 18351 consensus_peers.cc:597] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:41.342816 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 155574us
W20260709 13:20:41.343360 18351 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.343705 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:41.336087 18201 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:41.348909 18957 raft_consensus.cc:2468] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 18.
I20260709 13:20:41.351941 18311 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 26.
I20260709 13:20:41.328500 26550 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:41.369684 18311 raft_consensus.cc:1240] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 25. Current term is 26. Ops: [25.15-25.15]
I20260709 13:20:41.342330 26021 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:41.372401 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:41.330627 26386 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:41.372561 18277 leader_election.cc:336] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.377058 18275 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:41.354952 26485 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:41.365820 26488 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:41.355189 26331 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:41.424806 18927 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:41.426740 26158 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:41.427148 26158 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:41.427569 26158 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:41.382035 18311 raft_consensus.cc:1240] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 22. Current term is 23. Ops: [20.13-22.14]
I20260709 13:20:41.376796 18277 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:41.387514 26550 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:41.387964 26422 raft_consensus.cc:2804] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:41.388588 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:41.369848 26532 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:41.388218 26475 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:41.393289 26571 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:20:41.394567 26333 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:41.395586 26308 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.405433 18308 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 26. Current term is 27. Ops: []
I20260709 13:20:41.410302 26529 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:41.413187 26179 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:41.415345 26386 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:41.441054 18351 consensus_peers.cc:597] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:41.456290 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 110548us
W20260709 13:20:41.441684 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:41.373229 26494 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:41.376325 26576 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:20:41.447625 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 75123.1us
W20260709 13:20:41.458029 18351 consensus_peers.cc:597] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:41.437834 26485 raft_consensus.cc:697] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:41.458719 18277 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.459962 18378 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:20:41.461426 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:41.467681 18378 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:41.468849 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:41.469521 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:41.469798 18379 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 26.
I20260709 13:20:41.462208 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:41.464218 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:41.465408 18383 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:20:41.466912 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:41.472325 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:41.473459 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:41.474442 18382 raft_consensus.cc:2410] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 27 because replica has last-logged OpId of term: 25 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 13:20:41.468725 18378 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.478119 18378 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:41.478652 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:41.479220 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:41.479799 18381 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:41.478024 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:41.481057 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:41.486363 18378 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 16. (term mismatch)
I20260709 13:20:41.486795 18378 pending_rounds.cc:85] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 15
I20260709 13:20:41.487030 18378 pending_rounds.cc:107] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 26.16
I20260709 13:20:41.487268 18378 raft_consensus.cc:2889] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:41.472361 26576 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.491951 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:41.492676 18385 raft_consensus.cc:3060] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:41.494194 26576 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:41.495370 26570 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:41.490233 18351 consensus_peers.cc:597] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:41.507692 18351 consensus_peers.cc:597] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:41.455792 26422 raft_consensus.cc:697] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:41.514215 26422 consensus_queue.cc:237] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:41.515149 18927 leader_election.cc:336] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.466171 26529 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:41.516420 26494 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.521541 26570 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:41.524061 26179 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:41.446260 26532 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.545660 18381 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
I20260709 13:20:41.512127 18385 raft_consensus.cc:2468] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 27.
W20260709 13:20:41.548768 18351 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.556432 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:41.524071 18202 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:41.558475 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 99778.5us
W20260709 13:20:41.559356 18277 leader_election.cc:336] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.507261 26536 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.511821 26248 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.562134 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:41.562804 18956 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:41.582266 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:41.583151 18305 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:41.587004 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:41.587661 18309 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 26.
I20260709 13:20:41.588572 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:41.589156 18311 raft_consensus.cc:2468] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:41.592885 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:41.593494 18312 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:41.594164 18305 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 27.
I20260709 13:20:41.594995 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:41.595721 18307 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
W20260709 13:20:41.599772 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 75792.7us
I20260709 13:20:41.603291 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:41.613387 18307 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:20:41.619346 18307 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:41.573966 26414 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:41.600817 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:41.602814 26387 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.639139 26494 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:41.574793 26536 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.658357 18311 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 26. Current term is 27. Ops: [26.14-26.14]
W20260709 13:20:41.659015 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 66136.8us
I20260709 13:20:41.583644 26248 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:41.663996 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 63261.3us
I20260709 13:20:41.650586 26523 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:41.673449 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 71649.5us
I20260709 13:20:41.667408 18276 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:41.807147 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 139866us
W20260709 13:20:41.671031 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 145436us
I20260709 13:20:41.658097 18956 raft_consensus.cc:2468] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:41.665158 26387 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:41.741140 18311 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:20:41.741674 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 62409.4us
I20260709 13:20:41.673089 26517 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:41.603127 26485 consensus_queue.cc:237] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.741750 26575 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:41.680807 18957 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:20:41.790498 26579 log.cc:927] Time spent T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.128s	user 0.001s	sys 0.004s
I20260709 13:20:41.802351 18312 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
I20260709 13:20:41.843515 18275 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:41.845001 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:41.846228 18385 raft_consensus.cc:2410] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:20:41.803818 26179 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:41.853299 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:41.855108 18201 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:41.741338 26474 consensus_queue.cc:1059] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.090s
I20260709 13:20:41.869450 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:41.822085 26517 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.816730 26576 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.804905 26494 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 26 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:41.829777 26414 raft_consensus.cc:2804] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:20:41.880316 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:41.884089 18378 raft_consensus.cc:2393] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 27: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:41.887843 18202 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:41.889668 26595 raft_consensus.cc:2804] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:41.847848 26308 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:41.850914 26021 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.891389 26550 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:41.902884 26021 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:41.899593 26331 raft_consensus.cc:2804] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:41.903971 26331 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:41.904373 26331 raft_consensus.cc:3060] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:41.905115 26387 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:41.905282 26021 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:41.905699 26387 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:20:41.906209 26387 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 27 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:41.907068 26387 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.887405 26443 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:20:41.910113 26443 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:41.910595 26536 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:41.911211 26536 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.911463 26494 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.878839 26517 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:41.883736 26578 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:41.914278 26532 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:41.824533 26158 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:41.917606 26550 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:41.903434 26573 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.911693 26536 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:41.915928 26248 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:41.934600 18277 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:41.953994 18277 leader_election.cc:336] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.954573 18277 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:41.944957 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 138598us
I20260709 13:20:41.850602 26575 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:41.876541 26179 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:20:41.883056 26576 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:41.997016 18277 leader_election.cc:336] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:41.997716 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:41.956993 26497 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:42.035799 26497 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:42.036712 26158 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:42.038307 26497 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:42.017059 26582 raft_consensus.cc:2749] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:42.052527 17138 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 18262)
W20260709 13:20:42.022859 18277 leader_election.cc:336] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:42.028052 26594 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:20:41.930979 26573 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.057441 18277 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:42.066689 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 43942.7us
I20260709 13:20:42.024447 26532 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:41.984282 26550 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.081710 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:42.085433 18957 raft_consensus.cc:2393] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 17: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
I20260709 13:20:42.071339 26497 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:42.089347 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:42.045751 26331 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.091475 26536 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:42.093062 26573 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:42.098671 26575 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:42.100160 18349 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:42.086679 26179 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:20:42.121776 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 28 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:42.122412 18381 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 27.
I20260709 13:20:42.086759 26248 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.127888 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:42.106921 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:42.115340 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:42.127894 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
W20260709 13:20:42.105650 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 216518us
I20260709 13:20:42.135929 18309 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 12.
I20260709 13:20:42.139459 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:42.142537 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:42.144025 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:42.145749 18378 raft_consensus.cc:2393] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 12: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:42.147495 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:42.184165 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:42.109972 26497 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.108876 26538 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:42.186838 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47481us
I20260709 13:20:42.121495 26578 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.348040 26616 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.348757 26616 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:42.351919 26616 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:42.182855 26179 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.156s
W20260709 13:20:42.381697 26610 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 13:20:42.388727 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:42.315793 26333 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:42.316563 26368 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:42.397600 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 208579us
I20260709 13:20:42.149999 26248 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:42.344731 26602 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 13:20:42.430871 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:42.432271 18958 raft_consensus.cc:1275] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:20:42.389923 26616 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.313889 26497 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.321652 26538 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:42.397806 26573 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:42.322064 26578 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.480989 18380 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 17.
I20260709 13:20:42.428836 26368 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.491475 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:42.488955 26536 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:42.501080 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:42.490046 26517 consensus_meta.cc:287] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.573s	user 0.006s	sys 0.005s
I20260709 13:20:42.444790 26616 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.489081 26368 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:42.509910 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 77849.3us
I20260709 13:20:42.454772 26573 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.523625 18201 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:42.585151 26331 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:42.513230 26622 consensus_queue.cc:1048] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.167s
I20260709 13:20:42.611086 26612 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.611654 26612 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:42.612596 26248 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:42.512923 26540 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:42.606688 18382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4555) took 1129 ms. Trace:
I20260709 13:20:42.557906 26536 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:42.504864 26618 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.118s
I20260709 13:20:42.598747 26368 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.509097 26517 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:42.629540 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 425287us
I20260709 13:20:42.620445 18382 rpcz_store.cc:276] 0709 13:20:41.463339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.479558 (+ 16219us) service_pool.cc:224] Handling call
0709 13:20:41.479845 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:41.480424 (+   579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:41.480451 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:41.497007 (+ 16556us) log.cc:844] Serialized 26 byte log entry
0709 13:20:41.662222 (+165215us) spinlock_profiling.cc:243] Waited 9.83 ms on lock 0x7b18003d4c80. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:20:41.931582 (+269360us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:42.013819 (+ 82237us) log.cc:844] Serialized 14 byte log entry
0709 13:20:42.104424 (+ 90605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.104542 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:42.527325 (+422783us) raft_consensus.cc:1685] finished
0709 13:20:42.592648 (+ 65323us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.592825 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":372749,"prepare.queue_time_us":80918,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":120208,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":16049,"spinlock_wait_cycles":22598528,"thread_start_us":268988,"threads_started":1,"wal-append.queue_time_us":529382}
I20260709 13:20:42.629031 26619 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.629312 26582 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:42.662159 26582 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.665549 26584 consensus_queue.cc:1059] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:42.665952 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:42.666839 26619 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:42.670672 26573 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:42.671939 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:42.629727 26570 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:42.626549 26540 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:42.620195 26622 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:42.650364 26614 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:20:42.609155 26530 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:42.661207 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:42.674475 26485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.047s	sys 0.032s
I20260709 13:20:42.691500 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:42.692204 18385 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 26.
I20260709 13:20:42.693382 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:42.694728 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:42.696198 18385 raft_consensus.cc:3055] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:20:42.689728 26538 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:42.690538 26619 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:42.690784 26616 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:42.691792 26485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.048s	sys 0.032s
W20260709 13:20:42.686682 26631 log.cc:927] Time spent T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:42.689185 26578 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:42.701828 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:42.705452 18380 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 17.
I20260709 13:20:42.702809 18385 raft_consensus.cc:740] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:20:42.706710 26598 log.cc:927] Time spent T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.781s	user 0.000s	sys 0.006s
I20260709 13:20:42.707002 18385 consensus_queue.cc:260] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.708659 18385 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:20:42.709431 26597 log.cc:927] Time spent T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.915s	user 0.005s	sys 0.007s
W20260709 13:20:42.711133 26580 log.cc:927] Time spent T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.917s	user 0.002s	sys 0.000s
W20260709 13:20:42.713323 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 52187.9us
I20260709 13:20:42.714349 26375 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:42.715065 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:42.715484 26573 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:42.719048 18277 leader_election.cc:336] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:42.719530 18277 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:42.720216 18926 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:42.673727 26582 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:42.723429 18385 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 15. (term mismatch)
I20260709 13:20:42.723917 18385 pending_rounds.cc:85] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 14
I20260709 13:20:42.724179 18385 pending_rounds.cc:107] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 25.15
I20260709 13:20:42.724447 18385 raft_consensus.cc:2889] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:42.716078 26573 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.729884 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:42.731050 18385 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 26.
I20260709 13:20:42.659067 26368 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:42.726375 26619 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:42.676483 26570 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.726720 26584 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:20:42.728489 18277 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:42.727228 26523 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:42.682526 26622 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.754928 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:42.755721 26622 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:42.757557 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:42.728585 26497 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:42.715086 26375 consensus_queue.cc:1059] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:20:42.730116 26538 consensus_queue.cc:1059] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:20:42.735041 26179 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.750183 26368 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:42.750713 26540 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:42.752271 26517 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:42.753769 26612 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:42.747447 18304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 4226) took 1636 ms. Trace:
I20260709 13:20:42.717505 26530 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.828356 18304 rpcz_store.cc:276] 0709 13:20:41.110829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.111313 (+   484us) service_pool.cc:224] Handling call
0709 13:20:41.122191 (+ 10878us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:41.158435 (+ 36244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:41.158478 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:41.174003 (+ 15525us) log.cc:844] Serialized 78 byte log entry
0709 13:20:41.442512 (+268509us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:41.453807 (+ 11295us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.489990 (+ 36183us) log.cc:844] Serialized 14 byte log entry
0709 13:20:41.490160 (+   170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.490239 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:41.926370 (+436131us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b48002619d8. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18719caa1 00007fa187193b37 00007fa1871939ca 00007fa18728b26f 00007fa18728af37 00007fa18729f55c 00007fa18729f508 00007fa18729f488 00007fa18729f443 00007fa18729e6ec 00007fa1861c8a96
0709 13:20:42.686318 (+759948us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b18003d75c0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1542a6 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1
0709 13:20:42.687588 (+  1270us) spinlock_profiling.cc:243] Waited 9.8 ms on lock 0x7b18003d75c0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f1863f3 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
0709 13:20:42.710543 (+ 22955us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:42.747195 (+ 36652us) raft_consensus.cc:1685] finished
0709 13:20:42.747229 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.747384 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55705,"prepare.queue_time_us":8228,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":90,"raft.queue_time_us":77124,"raft.run_cpu_time_us":3078,"raft.run_wall_time_us":471282,"spinlock_wait_cycles":361236096,"thread_start_us":186661,"threads_started":1,"wal-append.queue_time_us":421778}
I20260709 13:20:42.809288 26636 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:42.760437 18277 leader_election.cc:336] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:42.737035 26619 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.745932 26584 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.813874 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:42.745114 26582 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:42.861622 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 145342us
I20260709 13:20:42.843839 26540 raft_consensus.cc:3055] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:20:42.843534 26375 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.888203 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:42.841423 26585 raft_consensus.cc:3055] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:20:42.858385 18277 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:42.806770 26179 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:42.902930 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 142519us
W20260709 13:20:42.903965 18277 leader_election.cc:336] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:42.882555 26593 log.cc:927] Time spent T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.961s	user 0.007s	sys 0.012s
I20260709 13:20:42.847570 26573 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:42.864626 26584 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:42.861229 26619 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:42.887399 26414 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.035s	sys 0.033s
I20260709 13:20:42.966898 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:42.969195 26570 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:42.971007 26633 log.cc:927] Time spent T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:20:42.973806 26530 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:42.978823 18309 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 16.
I20260709 13:20:42.888048 26387 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.980967 18927 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:42.982146 26611 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:42.983222 26179 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:43.002496 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 93090.3us
W20260709 13:20:42.979327 26414 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.043s	sys 0.043s
I20260709 13:20:42.899333 26585 raft_consensus.cc:740] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:42.909236 26416 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:42.984457 26158 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:43.020179 26646 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:43.020355 26158 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.020787 26646 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.984588 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:42.905790 26582 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.994163 26176 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:42.889920 26523 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:43.003612 26587 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:42.989755 18384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4548) took 1528 ms. Trace:
I20260709 13:20:42.892400 26540 raft_consensus.cc:740] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:42.995347 18201 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:42.866669 26636 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:42.978857 26635 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:20:43.010780 26595 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.120s	user 0.007s	sys 0.007s
W20260709 13:20:42.999773 26627 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
W20260709 13:20:43.014876 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 125810us
I20260709 13:20:42.907382 26375 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:42.987743 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.021986 18957 raft_consensus.cc:2468] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:42.890220 26612 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:20:43.056424 17138 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 18262)
I20260709 13:20:42.999744 26387 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.026350 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef83aa6f9534403ebe38156348430345" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:43.027669 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.030953 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.059294 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:43.033303 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.034471 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.064009 18311 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
W20260709 13:20:43.014742 26474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.111s	user 0.007s	sys 0.032s
W20260709 13:20:43.040131 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 44857.2us
I20260709 13:20:43.035336 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.011895 26620 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:43.028862 18384 rpcz_store.cc:276] 0709 13:20:41.461247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.463197 (+  1950us) service_pool.cc:224] Handling call
0709 13:20:41.463513 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:41.463899 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:41.463928 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:41.464495 (+   567us) log.cc:844] Serialized 52 byte log entry
0709 13:20:41.565175 (+100680us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:20:41.565318 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.565472 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:42.716501 (+1151029us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:42.978200 (+261699us) raft_consensus.cc:1685] finished
0709 13:20:42.978220 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:42.989681 (+ 11461us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":512,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":87,"spinlock_wait_cycles":21694336,"thread_start_us":99912,"threads_started":1,"wal-append.queue_time_us":362484}
I20260709 13:20:43.020470 26642 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:43.051862 18200 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:43.022353 26414 raft_consensus.cc:697] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 27 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:43.068740 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.004089 26611 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.067418 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.073719 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:43.083758 18384 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:20:43.073079 26474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.007s	sys 0.033s
I20260709 13:20:43.075806 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.072688 26530 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:43.079216 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.055189 26509 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:43.093981 18308 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 26.
I20260709 13:20:43.023350 26622 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:43.082415 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.085093 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.086310 18379 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:20:43.074927 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:43.052605 26595 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.162s	user 0.008s	sys 0.007s
I20260709 13:20:43.095538 18311 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 24.
I20260709 13:20:43.096180 18310 raft_consensus.cc:2468] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
W20260709 13:20:43.102314 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 97730.4us
I20260709 13:20:43.036052 26523 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.081496 26620 raft_consensus.cc:697] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:43.028605 26176 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:43.108760 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 58340.5us
I20260709 13:20:43.118546 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:43.109258 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 57476us
I20260709 13:20:43.106942 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:43.119961 18311 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 16.
I20260709 13:20:43.122680 18308 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:43.044727 26587 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.115881 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.128278 18307 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 12.
W20260709 13:20:43.119850 18351 leader_election.cc:336] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:43.098443 26595 raft_consensus.cc:697] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:43.127053 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:43.130292 18351 consensus_peers.cc:597] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:43.098351 26509 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.106460 26651 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:43.137079 26640 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:20:43.136919 26651 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:43.139560 18351 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 125 similar messages]
I20260709 13:20:43.139902 18201 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:43.140810 26509 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:43.143847 18384 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 27.
I20260709 13:20:43.145182 18308 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 27.
I20260709 13:20:43.115299 26573 raft_consensus.cc:493] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:43.079638 26612 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.152266 18311 raft_consensus.cc:1240] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 26. Current term is 27. Ops: [26.14-26.14]
I20260709 13:20:43.101373 26530 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.115736 26497 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:43.101912 26622 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.137595 26331 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.082104 26642 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.125622 26616 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.068s
I20260709 13:20:43.044577 26585 consensus_queue.cc:260] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.101436 26540 consensus_queue.cc:260] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.212836 26530 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:43.205077 26497 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.215178 26622 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:43.211865 26657 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:20:43.150336 26414 consensus_queue.cc:237] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.229212 26176 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:43.152069 26578 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:43.227388 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 68144.9us
I20260709 13:20:43.149438 26632 raft_consensus.cc:2804] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:43.188251 26618 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:20:43.221230 26649 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:43.200968 26573 raft_consensus.cc:515] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.231789 26540 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:43.257885 26611 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:43.269157 26158 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:43.273988 26526 raft_consensus.cc:3055] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:43.282680 26526 raft_consensus.cc:740] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:43.260674 26523 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:43.283653 26526 consensus_queue.cc:260] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.284816 26526 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:43.287005 26497 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:43.288262 26591 log.cc:927] Time spent T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 1.367s	user 0.007s	sys 0.005s
W20260709 13:20:43.269836 26647 log.cc:927] Time spent T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:20:43.291671 18377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4544) took 1833 ms. Trace:
I20260709 13:20:43.293030 26642 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:43.292059 18377 rpcz_store.cc:276] 0709 13:20:41.459136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.459278 (+   142us) service_pool.cc:224] Handling call
0709 13:20:41.459613 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:41.459970 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:41.460000 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:41.460480 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:20:41.565125 (+104645us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:20:41.565258 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:41.565506 (+   248us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.287628 (+1722122us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:43.291385 (+  3757us) raft_consensus.cc:1685] finished
0709 13:20:43.291408 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.291608 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4003,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"spinlock_wait_cycles":65364224,"thread_start_us":103859,"threads_started":1,"wal-append.queue_time_us":430986}
W20260709 13:20:43.270665 26648 log.cc:927] Time spent T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 13:20:43.272125 26021 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 26 current term: 26 is higher.
I20260709 13:20:43.218602 26331 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:43.262830 26652 log.cc:927] Time spent T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:20:43.263628 26654 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:20:43.301849 18386 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4554) took 1838 ms. Trace:
I20260709 13:20:43.301929 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:43.303088 26021 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:43.303158 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:43.303570 26021 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.303942 26021 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:43.305420 26600 log.cc:927] Time spent T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 1.511s	user 0.001s	sys 0.011s
I20260709 13:20:43.302325 18386 rpcz_store.cc:276] 0709 13:20:41.463017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.465874 (+  2857us) service_pool.cc:224] Handling call
0709 13:20:41.466180 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:41.478732 (+ 12552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:41.478765 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:41.479251 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:20:42.961360 (+1482109us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b1800325540. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:20:43.022715 (+ 61355us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:43.022793 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:43.023085 (+   292us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.301558 (+278473us) raft_consensus.cc:1685] finished
0709 13:20:43.301576 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.301786 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14359,"raft.queue_time_us":23170,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":23291648,"thread_start_us":61160,"threads_started":1,"wal-append.queue_time_us":1586829}
I20260709 13:20:43.256754 26649 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.306852 18383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46844 (request call id 4558) took 1842 ms. Trace:
I20260709 13:20:43.308815 26538 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:43.308928 26649 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:43.309274 26538 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.309530 26570 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.309696 26538 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:43.309931 18277 consensus_peers.cc:597] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:43.310117 26570 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:43.311208 18277 leader_election.cc:336] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:43.311437 26573 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:43.227051 26620 consensus_queue.cc:237] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.238878 26595 consensus_queue.cc:237] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.333762 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.362818 18306 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:43.363121 18303 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:20:43.336477 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.249079 26632 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.364288 18312 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:43.280373 26375 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:43.307605 18383 rpcz_store.cc:276] 0709 13:20:41.464132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.481189 (+ 17057us) service_pool.cc:224] Handling call
0709 13:20:41.481497 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:41.481822 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:41.481851 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:41.482261 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:20:41.591276 (+109015us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b18003253c0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f168e07 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1 00007fa18222ea0f
0709 13:20:42.669977 (+1078701us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b18003253c0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa181e1b4bc 00007fa17f16948b 00007fa187fc3ab9 00007fa17f18569b 00007fa17f18393f 00007fa17f185c02 00007fa181e0d20b 00007fa181e12d23 00007fa181e130d1
0709 13:20:42.670203 (+   226us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:20:42.670248 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:42.670322 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:43.304797 (+634475us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:43.306652 (+  1855us) raft_consensus.cc:1685] finished
0709 13:20:43.306673 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:43.306799 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44629,"raft.queue_time_us":25623,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":35268,"spinlock_wait_cycles":330716288,"thread_start_us":27081,"threads_started":1,"wal-append.queue_time_us":211255}
W20260709 13:20:43.398746 18351 leader_election.cc:336] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:43.403776 18277 leader_election.cc:336] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:43.405154 18351 leader_election.cc:336] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:43.366338 26632 raft_consensus.cc:3060] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:43.265990 26576 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:43.406378 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:43.411577 18351 leader_election.cc:336] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:43.412279 18351 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:43.412922 18351 leader_election.cc:336] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:43.274073 26612 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:43.407101 18277 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:43.423345 18277 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:43.420331 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 278807us
I20260709 13:20:43.428956 18201 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:43.416867 26375 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:43.429636 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 324234us
W20260709 13:20:43.439774 18277 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:43.438125 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 346751us
I20260709 13:20:43.420606 26387 leader_election.cc:290] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:43.447957 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.449981 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.449965 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:43.452603 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.454546 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.422163 26570 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:43.458752 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:43.459913 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:43.463781 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.470077 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:43.470883 18956 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 24.
I20260709 13:20:43.476074 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:43.478994 18277 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:43.433384 26661 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:43.483530 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.493319 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:43.496150 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.496526 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.482946 26375 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:43.497781 26375 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.498289 26375 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:43.500916 26616 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.501417 26616 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.502669 26474 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.480800 26584 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.506173 26584 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:43.497814 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.462123 26573 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:43.510977 26573 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.514479 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.517412 26651 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:43.463285 26331 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:43.518821 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.494488 26661 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.465179 26578 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:20:43.506703 18378 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 25: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:43.466534 26138 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:43.531764 18303 raft_consensus.cc:2393] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 23: Already voted for candidate b52e2477fc524694967c4a16afa983e3 in this term.
I20260709 13:20:43.540071 26578 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 27 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:43.544879 26138 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:43.532461 26509 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.559063 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:43.577889 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.599318 18275 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:43.621188 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:43.628877 18352 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.503311 26474 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.639911 26485 raft_consensus.cc:493] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:43.648895 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 189047us
I20260709 13:20:43.567895 26138 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:43.653121 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.666673 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.668716 18958 raft_consensus.cc:1275] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:20:43.640614 26672 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:43.674654 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:43.675314 18303 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:43.683754 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:43.685166 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.690872 18305 raft_consensus.cc:2393] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 21: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:20:43.676105 26619 consensus_meta.cc:287] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: Time spent flushing consensus metadata: real 0.682s	user 0.006s	sys 0.007s
I20260709 13:20:43.660171 26649 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:20:43.705642 18200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:43.674038 26582 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:43.673918 26530 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:43.656100 26485 raft_consensus.cc:515] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.713604 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:43.680163 26672 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:43.711109 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:43.731166 26636 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:43.694587 26673 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.733536 26673 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.736006 26673 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:43.736147 26538 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.737171 26474 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:43.738472 26509 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:43.713584 26661 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:43.739429 26683 consensus_queue.cc:1048] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:20:43.695888 26573 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:43.712437 26649 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.742359 26485 leader_election.cc:290] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:43.742921 26649 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:43.738225 26538 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:43.719657 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:43.740144 26021 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.728312 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.747170 26530 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.749194 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:43.750355 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:43.751202 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:20:43.723194 18351 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:43.763449 18351 leader_election.cc:336] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:43.764186 18277 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:43.766214 18303 raft_consensus.cc:2468] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 25.
W20260709 13:20:43.766214 18277 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:43.764393 18351 leader_election.cc:336] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:43.767987 18277 leader_election.cc:336] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:43.709223 26616 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:43.773092 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:43.714553 26634 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:43.778391 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:43.775247 18349 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:43.777947 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.778968 18381 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:43.779277 18382 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:43.780339 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:43.747206 26021 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:43.708267 26619 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:43.785418 18277 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:43.787184 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.787489 18349 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:43.789132 18277 leader_election.cc:336] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:43.786644 26678 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.700887 26578 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.748909 26672 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:43.790666 26021 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:43.794345 26678 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.795176 18381 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 27.
I20260709 13:20:43.796281 18201 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:43.796463 26678 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:43.797179 26626 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:20:43.797690 26626 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 27 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:43.798516 26626 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.799060 18958 raft_consensus.cc:2393] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 18: Already voted for candidate e016302b7e734d74833a2bf7bab44838 in this term.
W20260709 13:20:43.789989 18277 leader_election.cc:336] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:43.800336 18277 consensus_peers.cc:597] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:43.785365 26474 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:43.801887 26474 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.802273 26474 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:43.801162 18277 leader_election.cc:336] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:43.808993 18277 leader_election.cc:336] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:43.788223 26651 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:43.811350 18201 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:43.811893 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.812759 18303 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:43.818748 26530 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:43.821790 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647155b6479b4f689aca5b6c1efcc633" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:43.822326 18303 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:43.822963 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:43.784472 26634 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:43.826897 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 138853us
I20260709 13:20:43.821425 26116 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:43.829573 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:43.829481 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.832998 18308 raft_consensus.cc:3060] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:20:43.833257 18303 raft_consensus.cc:2468] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:20:43.806569 26375 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.839560 18308 raft_consensus.cc:2468] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 18.
W20260709 13:20:43.853154 18277 consensus_peers.cc:597] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:43.860378 18277 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:43.861148 18277 consensus_peers.cc:597] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:43.861768 18277 leader_election.cc:336] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:43.869675 26587 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:43.871273 26138 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.872349 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac262d04a1a4d94aec44b2679caee9d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.874152 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.875064 18305 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:43.875239 26632 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.877411 26632 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:43.878470 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:43.879371 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:43.880616 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.882113 18305 raft_consensus.cc:1240] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:20:43.889415 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.892887 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.896004 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:43.896418 26634 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:43.896800 18386 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 24. Current term is 25. Ops: [24.12-24.12]
I20260709 13:20:43.896100 26375 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:43.899794 18305 raft_consensus.cc:2410] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:20:43.901996 18308 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:20:43.904412 18306 raft_consensus.cc:2393] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:43.905313 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d0760748294d8d8cb291466766b8a5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.904006 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:43.908023 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:43.909705 18303 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:43.911715 18927 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:43.913718 18202 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:43.915349 18202 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:43.913437 26509 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.919598 18927 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:43.921605 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:43.926190 18303 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 27.
I20260709 13:20:43.920972 26536 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:43.929432 26509 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:43.931809 26509 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:43.933749 26618 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:43.921015 26629 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:43.921096 26636 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:20:43.937052 26138 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:43.941015 26619 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:43.944617 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:43.947918 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610ebeb615ff40b9baae6de30d397e22" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.948804 18382 raft_consensus.cc:1240] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:43.949293 18927 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:43.950546 18275 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:43.951201 26568 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:43.958150 18383 raft_consensus.cc:2393] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 in current term 18: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:43.916030 26672 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:43.957208 18277 consensus_peers.cc:597] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:43.956274 26638 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.960386 26601 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:43.960400 26573 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:43.968344 18277 consensus_peers.cc:597] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:43.960225 18202 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:43.977140 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.977430 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:43.974287 18276 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:43.985806 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:43.987594 18202 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:43.978403 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:43.988955 26632 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:43.994300 18926 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:43.988785 26333 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:43.986931 26390 raft_consensus.cc:493] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:43.998368 26628 consensus_queue.cc:1059] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:43.998605 26646 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:44.016368 26601 raft_consensus.cc:3055] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:43.999014 26414 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:20:44.016781 26601 raft_consensus.cc:740] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:44.017048 26414 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:44.017365 18309 raft_consensus.cc:1240] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Rejecting Update request from peer e016302b7e734d74833a2bf7bab44838 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:44.017743 26601 consensus_queue.cc:260] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:44.018491 26616 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:44.018875 26601 raft_consensus.cc:3060] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:44.019028 26616 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.000435 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.022387 18276 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.017499 26414 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:43.962945 26672 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:43.962998 26585 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:44.025615 18277 consensus_peers.cc:597] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:44.027479 18276 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:43.990530 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:44.029042 18202 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:44.040558 18202 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:44.043012 26570 raft_consensus.cc:2764] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:20:44.046998 18276 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.048733 26632 raft_consensus.cc:2804] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:44.050421 26616 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:44.053062 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:44.057324 17138 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 18262)
I20260709 13:20:44.068722 18276 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.070313 18385 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 14. (term mismatch)
I20260709 13:20:44.070616 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:44.061443 26333 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:44.061870 26672 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:44.062204 26573 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:44.035125 26390 raft_consensus.cc:515] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:44.070864 18385 pending_rounds.cc:85] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting all ops after (but not including) 13
I20260709 13:20:44.081368 18385 pending_rounds.cc:107] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: Aborting uncommitted NO_OP operation due to leader change: 26.14
I20260709 13:20:44.081643 18385 raft_consensus.cc:2889] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:44.070497 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:44.059278 18277 consensus_peers.cc:597] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:44.075119 18381 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:44.067092 26632 raft_consensus.cc:493] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.077756 18351 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:44.079289 26570 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:44.084100 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:44.014575 26547 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:44.093218 26587 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:44.093652 26587 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:44.094033 26587 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:44.098459 26390 leader_election.cc:290] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:44.078032 26582 raft_consensus.cc:2764] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
I20260709 13:20:44.102375 18351 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:44.106259 26646 raft_consensus.cc:2804] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:44.106930 26646 raft_consensus.cc:697] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:44.104082 18351 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
I20260709 13:20:44.109433 26138 raft_consensus.cc:2804] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:44.109952 26138 raft_consensus.cc:697] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:44.110777 26138 consensus_queue.cc:237] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:44.116451 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:44.107990 26646 consensus_queue.cc:237] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:43.965111 26626 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
W20260709 13:20:44.137657 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 54327.9us
I20260709 13:20:43.966560 26474 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.145407 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:44.150465 18135 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 123) took 23045 ms (client timeout 15000 ms). Trace:
I20260709 13:20:44.084740 26679 raft_consensus.cc:2804] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:44.151517 26679 raft_consensus.cc:697] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:44.152592 26679 consensus_queue.cc:237] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.079493 26540 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:44.077585 26333 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:44.156852 26333 raft_consensus.cc:3060] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:44.160022 26474 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:44.067904 26509 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:44.087731 26632 raft_consensus.cc:3060] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:44.139822 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:44.165899 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:44.168318 26578 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:44.170504 26536 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:44.171490 26616 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:44.172685 26494 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.173267 26494 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:44.176326 26494 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:44.180897 26368 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:44.144246 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:43.965101 26638 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:44.190245 26638 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:44.145478 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:44.193802 26474 consensus_queue.cc:1059] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:44.181236 18202 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:44.183310 18384 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 23.
I20260709 13:20:44.172298 26540 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:44.185202 18307 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:44.076766 18276 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.195158 26368 raft_consensus.cc:3055] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:20:44.150868 18135 rpcz_store.cc:269] 0709 13:20:21.104778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.105092 (+   314us) service_pool.cc:224] Handling call
0709 13:20:44.150390 (+23045298us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:40.386524 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:40.387204 (+   680us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:40.387246 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:20:40.387267 (+    21us) tablet.cc:662] Decoding operations
0709 13:20:40.388293 (+  1026us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:40.388388 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:40.388426 (+    38us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:20:40.532796 (+144370us) tablet.cc:701] Row locks acquired
0709 13:20:40.532825 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:20:40.533085 (+   260us) write_op.cc:270] Start()
0709 13:20:40.533253 (+   168us) write_op.cc:276] Timestamp: P: 1783603240533016 usec, L: 0
0709 13:20:40.533282 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:20:40.534179 (+   897us) log.cc:844] Serialized 3621 byte log entry
0709 13:20:41.021687 (+487508us) op_driver.cc:464] REPLICATION: finished
0709 13:20:41.090228 (+ 68541us) write_op.cc:301] APPLY: starting
0709 13:20:41.090315 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:41.452897 (+362582us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:41.457321 (+  4424us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:42.327412 (+870091us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:42.429917 (+102505us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 13:20:42.435430 (+  5513us) write_op.cc:312] APPLY: finished
0709 13:20:42.485803 (+ 50373us) log.cc:844] Serialized 81 byte log entry
0709 13:20:42.503704 (+ 17901us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:42.511836 (+  8132us) write_op.cc:454] Released schema lock
0709 13:20:42.514792 (+  2956us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:42.620113 (+105321us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:42.621728 (+  1615us) write_op.cc:454] Released schema lock
0709 13:20:43.294274 (+672546us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b180035a1c0. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa18804ede1 00007fa18805b5b1 00007fa17f186522 00007fa17f1887c1 00007fa17f188779 00007fa17f188709 00007fa17f1886d1 00007fa17f1879cd 000000000038f354 000000000038f199 00007fa17f16983a
Metrics: {"mutex_wait_us":211299,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":68273,"apply.run_cpu_time_us":21419,"apply.run_wall_time_us":1493577,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37503,"num_ops":8,"prepare.queue_time_us":248868,"prepare.run_cpu_time_us":46711,"prepare.run_wall_time_us":412732,"raft.queue_time_us":99332,"raft.run_cpu_time_us":23360,"raft.run_wall_time_us":59074,"replication_time_us":488245,"spinlock_wait_cycles":4436608,"thread_start_us":608616,"threads_started":4,"wal-append.queue_time_us":1106831,"wal-append.run_cpu_time_us":28159,"wal-append.run_wall_time_us":1172974}]]}
W20260709 13:20:44.207631 18200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 61504.3us
W20260709 13:20:44.208827 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 132152us
I20260709 13:20:44.209734 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.209841 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:44.211086 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:44.212344 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:44.215021 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:44.216604 18958 raft_consensus.cc:2393] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 20: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:44.216883 18276 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.223994 18276 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.226130 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b14d7467c934fdca91c8a466ef2d764" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:44.230973 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:44.231559 18378 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:20:44.234681 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:44.236289 18201 leader_election.cc:304] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:44.239044 18276 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.240418 18276 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.248268 18276 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.249752 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.250891 18202 leader_election.cc:304] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:44.251295 18351 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:44.252079 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:44.254323 18276 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.253031 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:44.250025 18927 leader_election.cc:336] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:44.258395 18307 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 25.
I20260709 13:20:44.258940 18927 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.207804 26368 raft_consensus.cc:740] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:44.219594 26583 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:44.218097 26375 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:44.221585 26497 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:44.241566 26672 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:44.221787 26387 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:20:44.280956 18378 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 25.
I20260709 13:20:44.284881 18386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:44.275490 18927 leader_election.cc:336] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:44.297438 18927 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.289142 26575 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:44.245867 26576 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:44.313076 26609 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:44.248888 26570 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:44.320990 26368 consensus_queue.cc:260] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.237679 26651 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:44.256608 26595 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:44.256928 26573 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:44.285279 26586 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:44.256418 26683 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:44.214766 26333 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:44.303670 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 50745.4us
W20260709 13:20:44.303123 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 66936.5us
I20260709 13:20:44.258781 26642 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:44.259037 26670 raft_consensus.cc:2749] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:44.278564 26540 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:44.291294 26375 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.308980 26578 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:44.309515 26616 raft_consensus.cc:2749] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:44.311542 26575 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:44.303804 18927 leader_election.cc:336] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:44.260412 26599 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:44.276360 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.278756 26538 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:44.300724 18378 raft_consensus.cc:1275] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:20:44.299124 26587 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.238317 26414 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.284744 26628 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:44.271785 26671 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:44.328192 18276 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:44.371888 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 43845.2us
I20260709 13:20:44.343487 18202 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:44.322629 26368 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:44.358551 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54777.8us
W20260709 13:20:44.378711 18927 leader_election.cc:336] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:44.379326 18202 leader_election.cc:304] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:44.380589 18927 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:44.361754 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 85487.7us
I20260709 13:20:44.327286 26651 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.363090 26586 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:44.386603 18385 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:44.381258 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.397464 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:44.342694 26683 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.402633 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:44.403414 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:44.382267 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.405174 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:44.410960 18308 raft_consensus.cc:1240] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 27. Current term is 28. Ops: []
I20260709 13:20:44.413539 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbade5381d641e9b60bcc9994ae9b51" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:44.356483 26540 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.369560 26632 raft_consensus.cc:515] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.418840 18351 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:44.376907 26570 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:44.368439 26538 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.386824 26616 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:44.429865 18309 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260709 13:20:44.432075 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51586.7us
I20260709 13:20:44.428565 18304 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:20:44.422657 26021 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:44.434123 26665 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:44.416772 26550 raft_consensus.cc:2749] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:44.435047 18130 catalog_manager.cc:5697] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 17 to 23, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 23 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:44.437664 26587 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:44.437783 26651 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:44.441772 18201 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:44.441918 26375 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:44.443646 26683 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:44.445674 26575 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:44.417121 26573 consensus_queue.cc:1048] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:20:44.447252 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:44.480162 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
W20260709 13:20:44.535048 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 192346us
W20260709 13:20:44.544087 18202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 64034us
W20260709 13:20:44.494042 18351 leader_election.cc:336] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:44.486986 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:44.505330 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:44.461787 18303 raft_consensus.cc:1240] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 24. Current term is 25. Ops: [24.12-24.12]
I20260709 13:20:44.538769 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4300927be0384401aa46050bd5996d2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:44.485255 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:44.545800 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 51794.1us
I20260709 13:20:44.548007 18312 raft_consensus.cc:1240] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Rejecting Update request from peer 8b4fbc44aa2649f0bcac5cd70f71951d for earlier term 24. Current term is 25. Ops: []
W20260709 13:20:44.548492 18351 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:44.451154 26609 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:44.467525 26540 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:44.551772 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:44.552353 18130 catalog_manager.cc:5697] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:44.560009 18202 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:44.477241 26699 log.cc:927] Time spent T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:20:44.544755 18201 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:44.423031 26578 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:44.573778 18958 raft_consensus.cc:1275] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:44.456777 26138 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:44.422544 26179 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.149s
I20260709 13:20:44.458297 26632 leader_election.cc:290] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:44.578279 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:44.542915 26494 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:44.429129 26667 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.467186 26414 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:44.561810 26368 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:44.602339 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:44.603276 18927 leader_election.cc:336] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:44.603999 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.606854 18383 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:20:44.607609 18386 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:20:44.614614 18384 raft_consensus.cc:1240] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 20. Current term is 21. Ops: []
W20260709 13:20:44.582617 18351 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:44.560649 26638 consensus_queue.cc:1059] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 27.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 13:20:44.585095 26550 raft_consensus.cc:3060] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:44.584841 26447 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:44.616080 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e1dd423d7184b408a5257ea471f540d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:44.617947 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:44.602483 26138 raft_consensus.cc:697] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:20:44.669147 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 49902.7us
I20260709 13:20:44.602339 26333 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:44.626765 26581 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:44.615056 26609 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:44.586400 26578 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.615850 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.663391 26570 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.597209 26576 consensus_queue.cc:1048] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:20:44.614372 26667 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.619737 18130 catalog_manager.cc:5697] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 17 to 20, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 20 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:44.602931 26536 consensus_queue.cc:1059] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:20:44.684767 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:44.690251 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:44.707760 18201 leader_election.cc:304] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:44.680198 26447 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 25 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:44.699297 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 116715us
I20260709 13:20:44.694136 26575 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:20:44.702550 26538 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:44.685765 26494 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 13:20:44.719236 26447 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.698372 26570 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.722662 26570 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:44.702857 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 92402.9us
I20260709 13:20:44.683836 26308 raft_consensus.cc:3055] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:20:44.723778 26308 raft_consensus.cc:740] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:44.691888 18377 raft_consensus.cc:1240] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Rejecting Update request from peer 459e82ee6b564cc19be6f73186938e79 for earlier term 23. Current term is 25. Ops: []
I20260709 13:20:44.724817 26632 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:44.724911 26651 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:44.708704 26638 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:44.710156 18130 catalog_manager.cc:5697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 21 to 23, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 23 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:44.734338 26616 raft_consensus.cc:2749] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:44.757349 26368 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:44.729645 26179 consensus_queue.cc:1059] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:20:44.772825 26333 raft_consensus.cc:3055] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:20:44.773408 26333 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:44.774621 26333 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.776937 26333 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:44.734948 26667 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:44.738552 26138 consensus_queue.cc:237] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.769896 26368 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:44.789381 26308 consensus_queue.cc:260] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.791433 26368 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:44.770159 26578 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:44.793462 18277 consensus_peers.cc:597] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:44.793951 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 160858us
W20260709 13:20:44.795099 18277 leader_election.cc:336] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:44.795559 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:44.731752 26390 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:20:44.802271 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:44.809877 18130 catalog_manager.cc:5697] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:44.804989 26573 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:20:44.791265 26308 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:44.831735 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:44.827772 18130 catalog_manager.cc:5697] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 21 to 24, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 24 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:44.841141 18309 raft_consensus.cc:2393] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 in current term 25: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:44.846333 18303 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:20:44.852988 26573 consensus_queue.cc:1059] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:44.854364 26573 raft_consensus.cc:3055] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:20:44.854597 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:44.855671 18380 raft_consensus.cc:2410] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:20:44.854774 26573 raft_consensus.cc:740] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:44.856973 26573 consensus_queue.cc:260] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:44.860656 26704 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:44.869168 26704 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:44.873610 26704 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:44.874564 18957 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:20:44.874699 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:44.874869 26573 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:20:44.886907 18960 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:20:44.887393 18960 pending_rounds.cc:85] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Aborting all ops after (but not including) 10
I20260709 13:20:44.887703 18960 pending_rounds.cc:107] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:20:44.887997 18960 raft_consensus.cc:2889] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:44.906330 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:44.907881 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:44.908605 18304 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:44.909369 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:44.910734 26587 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:44.911289 26333 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:44.911948 26333 consensus_queue.cc:1243] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer 459e82ee6b564cc19be6f73186938e79 log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:20:44.917091 18202 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:44.920399 26443 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:44.921146 26670 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:20:44.921038 26443 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:44.923800 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:44.934167 18130 catalog_manager.cc:5697] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 18 to 19, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 19 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:44.936383 18130 catalog_manager.cc:5697] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 20 to 21, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 21 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.938350 26683 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:44.945700 18202 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:44.939581 18306 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.079s	sys 0.114s
I20260709 13:20:44.959317 18305 raft_consensus.cc:1275] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:44.950073 18275 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:44.953060 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 47605.2us
W20260709 13:20:44.951555 18306 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.079s	sys 0.115s
I20260709 13:20:44.961766 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83392764a50d4598aedbe4d1cc557dad" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:44.947150 18130 catalog_manager.cc:5697] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 21 to 23, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 23 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:44.967639 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:44.983954 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:44.986680 18305 raft_consensus.cc:1275] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:20:44.990954 18351 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:44.953248 26333 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:44.953325 26443 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:44.999233 18275 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:44.996052 18130 catalog_manager.cc:5697] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 22 to 23, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 23 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:44.974511 26414 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:45.044092 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:45.049674 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:45.054287 18303 raft_consensus.cc:1275] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 13:20:45.067986 17138 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 18262)
I20260709 13:20:45.058637 18305 pending_rounds.cc:85] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Aborting all ops after (but not including) 13
I20260709 13:20:45.071157 18305 pending_rounds.cc:107] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:20:45.071522 18305 raft_consensus.cc:2889] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:45.080370 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 89452.4us
W20260709 13:20:45.085606 18351 leader_election.cc:336] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:45.080837 18130 catalog_manager.cc:5697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 15 to 20, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 20 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:20:45.086764 18351 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:45.087383 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:45.090755 26138 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:45.059365 26333 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:45.090027 18351 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:45.105048 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:45.106459 18351 leader_election.cc:336] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:45.106985 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:45.107827 26138 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:20:45.015126 26540 consensus_queue.cc:1059] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.069s
W20260709 13:20:45.110167 18351 leader_election.cc:336] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:45.083858 26708 log.cc:927] Time spent T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.120s	user 0.001s	sys 0.001s
I20260709 13:20:45.099924 18130 catalog_manager.cc:5697] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:20:45.111244 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 401877us
I20260709 13:20:45.074502 26390 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:45.141104 18130 catalog_manager.cc:5697] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:45.143008 18130 catalog_manager.cc:5697] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 11 to 15, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 15 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:45.147219 18130 catalog_manager.cc:5697] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 16 to 17, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 17 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:45.149139 18130 catalog_manager.cc:5697] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 23 to 26, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 26 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:45.081725 26683 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:45.111619 26333 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:45.108561 26138 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:45.153657 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:45.159464 18383 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
W20260709 13:20:45.174664 26550 consensus_meta.cc:287] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.508s	user 0.013s	sys 0.000s
I20260709 13:20:45.186205 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d2ac0cb46434c19a6e4f18836703096" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:45.117132 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:45.174847 18130 catalog_manager.cc:5697] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 18 to 20, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 20 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:45.210335 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:45.218381 18130 catalog_manager.cc:5697] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:45.223649 18130 catalog_manager.cc:5697] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 18 to 21, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 21 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:45.209483 26550 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:45.232693 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 122532us
I20260709 13:20:45.232288 26021 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:45.257951 18351 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:45.267690 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:45.270453 18130 catalog_manager.cc:5697] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 21 to 22, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 22 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:45.241376 26536 raft_consensus.cc:493] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.280007 18130 catalog_manager.cc:5697] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:45.294271 18201 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:45.279803 26645 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:45.299837 18130 catalog_manager.cc:5697] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 16 to 20, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 20 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:45.285207 26536 raft_consensus.cc:515] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:45.310819 26536 leader_election.cc:290] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:45.312018 26638 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:45.312842 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:45.315922 26626 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:45.321182 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:45.324049 18382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c6cd802105b49c68d85e7abdce24871" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:45.329885 26710 log.cc:927] Time spent T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:20:45.339404 26375 raft_consensus.cc:3055] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:20:45.340032 26375 raft_consensus.cc:740] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:45.341361 26375 consensus_queue.cc:260] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:45.349164 26717 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:20:45.349787 26725 log.cc:927] Time spent T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.243s	user 0.000s	sys 0.008s
I20260709 13:20:45.363564 18201 leader_election.cc:304] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:45.367549 18386 raft_consensus.cc:1240] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Rejecting Update request from peer b52e2477fc524694967c4a16afa983e3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:20:45.439256 26638 raft_consensus.cc:2749] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:45.441013 26720 log.cc:927] Time spent T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.336s	user 0.002s	sys 0.000s
W20260709 13:20:45.472245 26718 log.cc:927] Time spent T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.167s	user 0.000s	sys 0.002s
W20260709 13:20:45.474946 26714 log.cc:927] Time spent T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:20:45.546550 18130 catalog_manager.cc:5697] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 reported cstate change: config changed from index 13 to 15, term changed from 21 to 23, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:45.567157 18350 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:45.598650 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 280168us
I20260709 13:20:45.577126 18130 catalog_manager.cc:5697] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 16 to 20, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 20 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:45.607364 26474 consensus_queue.cc:1059] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:20:45.609202 18130 catalog_manager.cc:5697] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:45.622658 26626 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:45.629684 26632 raft_consensus.cc:493] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.631049 26632 raft_consensus.cc:515] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:45.646668 26711 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.648346 26711 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:45.660775 26632 leader_election.cc:290] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:45.663810 26711 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:45.668186 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 54479.8us
I20260709 13:20:45.623968 26626 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:45.681854 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:45.683434 18377 raft_consensus.cc:2410] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:20:45.700044 26575 raft_consensus.cc:3055] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:20:45.700745 26575 raft_consensus.cc:740] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:45.702646 26575 consensus_queue.cc:260] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:45.706183 18957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:45.707448 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:45.708506 18958 raft_consensus.cc:2410] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b52e2477fc524694967c4a16afa983e3 for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:20:45.713233 26375 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:45.721004 18277 leader_election.cc:336] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:45.721810 18277 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:45.725458 18201 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:45.730033 26536 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:45.737294 26573 raft_consensus.cc:2749] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:45.741114 18130 catalog_manager.cc:5697] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 17 to 22, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 22 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:45.743999 26715 log.cc:927] Time spent T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.632s	user 0.009s	sys 0.006s
I20260709 13:20:45.746556 18378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f88ffc8ca74740b36c09a2eb312c10" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:45.746922 26626 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:45.748540 26575 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:45.768067 18130 catalog_manager.cc:5697] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 reported cstate change: term changed from 18 to 20, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 20 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:45.826551 18384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:45.828951 18377 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:20:45.836625 26333 consensus_meta.cc:287] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: Time spent flushing consensus metadata: real 0.679s	user 0.005s	sys 0.022s
I20260709 13:20:45.837283 26333 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:45.862386 26540 consensus_queue.cc:1048] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:45.883361 26333 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:45.894971 18201 leader_election.cc:304] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:45.896580 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 47843.3us
I20260709 13:20:45.896916 26447 raft_consensus.cc:2749] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:45.898329 26581 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:45.904772 26582 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:45.905576 26582 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:45.908188 26582 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:45.910897 26599 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:45.911580 26599 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:45.913564 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:45.914968 18381 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 22: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:45.915815 26599 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:45.918334 18309 raft_consensus.cc:1275] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:20:45.922093 18309 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:20:45.936372 26626 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:45.937247 26626 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:45.939571 26626 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:45.945688 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:45.946921 18380 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:45.951845 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:45.975272 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:45.975621 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 107994us
I20260709 13:20:45.976045 18309 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:45.978824 18380 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:45.980139 26683 consensus_queue.cc:1048] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:45.985134 26599 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:45.991714 26599 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:45.981024 18351 leader_election.cc:336] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:45.986974 18201 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:45.988653 26645 consensus_queue.cc:1048] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:45.995407 26333 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:45.996125 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:46.000358 26333 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:46.001703 26333 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.006464 26599 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:46.008734 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:46.015815 26587 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:46.017519 18351 consensus_peers.cc:597] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.018165 18351 leader_election.cc:336] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:46.018597 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:46.018728 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:46.019457 26587 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:46.020578 26626 raft_consensus.cc:493] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.021209 26626 raft_consensus.cc:515] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:46.025897 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:46.026561 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed649e8e79144f338d9c590603fa0b7c" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:46.028741 26626 leader_election.cc:290] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:46.031617 26575 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.032384 26575 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:46.042645 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:46.046034 26575 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:46.050848 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:46.051669 18309 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:46.055998 18202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:46.059042 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:46.059803 18310 raft_consensus.cc:2468] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 25.
I20260709 13:20:46.060070 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1889d6d746545a0bdf04811a102b35b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:46.066491 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:46.067554 26587 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.068326 26587 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:46.069146 17138 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 18262)
I20260709 13:20:46.066339 26575 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:46.074684 26587 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:46.078158 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:46.078965 18956 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:46.080372 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:46.086660 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 65758.5us
I20260709 13:20:46.089457 18201 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:46.094200 26390 raft_consensus.cc:2749] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:46.109234 18202 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:46.111057 26587 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:46.111817 26587 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.114275 26587 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:46.121203 26575 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:46.135521 26599 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:46.135928 18277 leader_election.cc:336] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:46.136420 26599 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:46.138192 18277 consensus_peers.cc:597] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.140224 18309 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:46.141499 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:46.150975 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd00413a3134a12a08e72e7925f6473" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:46.149768 26599 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:46.154603 26474 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.155380 26474 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:46.166715 18202 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:46.168120 18202 leader_election.cc:304] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:46.168269 26575 raft_consensus.cc:2804] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:46.159423 26587 consensus_queue.cc:1048] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:20:46.169178 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:46.173460 26638 raft_consensus.cc:2749] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:46.182322 18275 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:46.188707 26308 raft_consensus.cc:493] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.189286 26308 raft_consensus.cc:515] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.191398 26308 leader_election.cc:290] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:46.192446 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:46.193994 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:46.193922 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:46.195820 18311 raft_consensus.cc:2393] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 28: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:46.201956 26474 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:46.181478 18312 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:46.177965 26575 raft_consensus.cc:493] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.203307 26575 raft_consensus.cc:3060] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:46.211339 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:46.231670 18200 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:46.241060 26599 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:46.241878 26599 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.243945 26474 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:20:46.245523 18351 consensus_peers.cc:597] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.245899 18305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ee2a6512e24d10af3526398de71490" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:46.245986 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:46.245963 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 81733us
I20260709 13:20:46.250228 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96c6309e774a4e15bd33a0a93d1a7f2e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:46.257426 18351 leader_election.cc:336] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:46.267972 18277 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:46.244238 26599 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:46.272581 18277 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:46.271381 26750 log.cc:927] Time spent T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: Append to log took a long time: real 0.094s	user 0.007s	sys 0.000s
W20260709 13:20:46.275424 18277 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:46.279361 18277 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: b52e2477fc524694967c4a16afa983e3, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:46.280898 26599 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:46.281167 18277 leader_election.cc:336] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:46.281661 18277 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:46.282826 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.283416 26599 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:46.272954 18351 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:46.284922 18202 leader_election.cc:304] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:46.280941 26735 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:46.302505 26447 raft_consensus.cc:493] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:46.303231 26447 raft_consensus.cc:515] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.297406 26138 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:46.300877 26638 raft_consensus.cc:2749] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:46.304773 26138 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.301362 26581 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.305244 26138 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:46.310366 26447 leader_election.cc:290] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:46.319168 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:46.316256 26581 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.323127 26581 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:46.329751 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:46.330550 18377 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 27.
I20260709 13:20:46.320386 26575 raft_consensus.cc:515] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.340653 18201 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:46.341660 26626 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:20:46.342187 26626 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.342526 26626 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:20:46.342840 26735 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:46.348384 26575 leader_election.cc:290] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:46.353420 18351 leader_election.cc:336] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:46.357028 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:46.356242 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a11d8d7fb14609b0bb479587b23e37" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:46.352178 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:46.365216 26138 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:46.369904 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdde66e5e9e64c508bb1a79d0f5754bd" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:46.367439 18277 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:46.371515 18277 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:46.376077 26645 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:46.403679 26138 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:46.412484 26672 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:46.412858 26671 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:46.413648 26671 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:46.414295 26671 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.416638 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:46.417472 18307 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 28.
I20260709 13:20:46.418865 26599 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.419438 26599 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:46.427915 26599 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:46.429965 26474 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.441303 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:46.443403 18956 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:46.442973 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:46.437366 26575 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.453191 26474 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.454355 26575 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:46.456616 26671 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:46.456794 26575 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:46.468763 18202 leader_election.cc:304] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:46.469352 26626 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.470245 26575 raft_consensus.cc:2749] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:46.480093 18351 consensus_peers.cc:597] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.481865 18351 leader_election.cc:336] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:46.480363 26626 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 29 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:46.485999 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:46.490376 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:46.490962 18306 raft_consensus.cc:3060] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:46.492822 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:46.456266 26474 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:46.501863 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:46.502592 18303 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:20:46.507586 18306 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:46.527336 26645 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:20:46.534576 18956 raft_consensus.cc:2468] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:46.535713 18303 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 29.
I20260709 13:20:46.545846 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:46.544526 18202 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:46.546653 18377 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 25.
I20260709 13:20:46.550897 26474 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:20:46.552858 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:46.554111 18383 raft_consensus.cc:2393] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 21: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:46.551483 26474 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 29 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
W20260709 13:20:46.545279 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.558262 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c074d20c77e423597f342d5ed4ccc6d" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:46.557793 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9abdaa4bb845cd8d40c4f182cf98c9" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:46.559252 18201 leader_election.cc:304] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:46.561915 26333 raft_consensus.cc:2749] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:20:46.564704 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:46.565271 18381 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:20:46.567273 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: e016302b7e734d74833a2bf7bab44838
W20260709 13:20:46.553228 18351 consensus_peers.cc:597] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.564220 18277 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:46.569444 18276 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:46.575280 26575 raft_consensus.cc:493] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.575932 26575 raft_consensus.cc:515] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.577031 26474 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.578141 26575 leader_election.cc:290] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:46.579372 26599 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:46.579772 26599 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.580153 26599 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:46.580816 26582 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:46.590975 26582 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:46.593699 18349 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:46.595072 18381 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 29.
I20260709 13:20:46.606244 26744 raft_consensus.cc:2804] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:46.606842 26744 raft_consensus.cc:697] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:20:46.607347 18927 consensus_peers.cc:597] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.608007 26744 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:46.610477 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:46.613844 18377 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:20:46.626838 18351 consensus_peers.cc:597] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.635121 26575 raft_consensus.cc:493] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.635763 26575 raft_consensus.cc:515] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.637904 26575 leader_election.cc:290] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:46.644116 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3055da6db47abb16a433d66a5c79e" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:46.645524 18306 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:20:46.648370 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:46.652890 26333 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.656200 26626 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:20:46.653513 26333 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.662420 26333 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:46.669860 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:46.670645 18310 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:46.671912 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:46.676399 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab600bb4ff4ad99b8a9ff2604b8f4b" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:46.681022 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:46.681649 18381 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 21.
I20260709 13:20:46.677446 26333 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:46.684046 18201 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:46.686753 26581 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:46.685206 26333 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:46.689236 18201 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:46.691817 26333 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:46.693138 26447 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:46.683190 26599 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:46.714512 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:46.715133 18381 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:46.722430 18381 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 26.
I20260709 13:20:46.723505 18276 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:46.730988 26765 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:46.731629 26765 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 26 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:46.732646 26765 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:46.733497 26599 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: Requested vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:46.735905 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
W20260709 13:20:46.739111 18351 consensus_peers.cc:597] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.749783 18201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 60619.1us
I20260709 13:20:46.749217 26575 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.752629 26575 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:46.770143 26474 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:20:46.770224 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:46.749068 26333 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.774269 18201 leader_election.cc:304] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:46.775352 26447 raft_consensus.cc:2749] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:46.774511 26333 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:46.783411 18134 catalog_manager.cc:5697] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 20 to 24, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 24 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:46.785560 18134 catalog_manager.cc:5697] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 14 to 16, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 16 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.787371 26575 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:46.787561 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:46.788192 18303 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:46.787575 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "715a2657f09449038e569acddbab1aea" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:46.795552 18202 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:46.796070 26447 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:46.796777 26770 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:46.796738 26447 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:46.799980 18303 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:46.800251 18134 catalog_manager.cc:5697] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 14 to 16, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 16 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:46.802702 18202 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:46.801716 18134 catalog_manager.cc:5697] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 17 to 18, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 18 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.805480 18201 leader_election.cc:304] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:46.809509 26581 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:20:46.816730 26772 log.cc:927] Time spent T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:20:46.820917 26447 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:46.823330 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:46.826354 26581 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:46.827427 26581 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:46.829497 18134 catalog_manager.cc:5697] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 15 to 17, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 17 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.831005 26333 raft_consensus.cc:2749] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:46.832871 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd19f13a42412b9dda536e24c324b1" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:46.831447 18134 catalog_manager.cc:5697] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 9 to 13, term changed from 19 to 22, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to <none>, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129), VOTER 459e82ee6b564cc19be6f73186938e79 (127.16.188.130), VOTER 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131), VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 22 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:46.841338 18134 catalog_manager.cc:5697] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 11 to 13, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 13 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:46.836380 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:46.842881 18377 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:46.845018 18134 catalog_manager.cc:5697] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 21 to 23, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 23 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.849465 18200 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:46.850867 18134 catalog_manager.cc:5697] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 16 to 17, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 17 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.852851 18134 catalog_manager.cc:5697] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.858378 18134 catalog_manager.cc:5697] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:46.865527 18927 consensus_peers.cc:597] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.870530 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.869434 18351 consensus_peers.cc:597] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.873144 26770 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:46.941212 26390 raft_consensus.cc:493] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:46.941890 26390 raft_consensus.cc:515] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:46.936017 18351 consensus_peers.cc:597] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.942847 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 69078.6us
I20260709 13:20:46.950057 26390 leader_election.cc:290] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:46.956475 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:46.930011 26474 raft_consensus.cc:493] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:46.962376 18377 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:46.981025 26474 raft_consensus.cc:515] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:47.010066 26474 leader_election.cc:290] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:47.013497 18958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:47.028258 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7e53f100fe49dea344afeea45f7cf5" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:47.031639 26774 log.cc:927] Time spent T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:20:47.036041 26683 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.038539 26683 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:47.040102 18351 consensus_peers.cc:597] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:47.040663 26683 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:47.046474 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efd953e96dc54f10a635581a413244e2" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:47.063531 18201 leader_election.cc:304] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
W20260709 13:20:47.066834 18351 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:47.069657 17138 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 18262)
W20260709 13:20:47.071467 18130 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39270 (request call id 224) took 12711 ms (client timeout 15000 ms). Trace:
W20260709 13:20:47.072012 18130 rpcz_store.cc:269] 0709 13:20:34.366469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.423858 (+ 57389us) service_pool.cc:224] Handling call
0709 13:20:47.071321 (+12647463us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:46.097070 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:46.097881 (+   811us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:46.097950 (+    69us) write_op.cc:435] Acquired schema lock
0709 13:20:46.097997 (+    47us) tablet.cc:662] Decoding operations
0709 13:20:46.100399 (+  2402us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:46.114760 (+ 14361us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:46.114797 (+    37us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:20:46.117806 (+  3009us) tablet.cc:701] Row locks acquired
0709 13:20:46.117860 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:20:46.118046 (+   186us) write_op.cc:270] Start()
0709 13:20:46.118210 (+   164us) write_op.cc:276] Timestamp: P: 1783603246117981 usec, L: 0
0709 13:20:46.118259 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 13:20:46.134682 (+ 16423us) log.cc:844] Serialized 10736 byte log entry
0709 13:20:46.234653 (+ 99971us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b4400022b4c. stack: 00007fa17f154343 00007fa17f154240 00007fa17eae31d4 00007fa188821304 00007fa188821299 00007fa17f00edb1 00007fa17f0acc85 00007fa17f0ad6a2 00007fa181e1f1db 00007fa181e1aaaf 00007fa181e0e86e 00007fa181e0dbb6 00007fa181e0d7d8 00007fa181e17221 00007fa181e171d9 00007fa181e17169
0709 13:20:46.413073 (+178420us) op_driver.cc:464] REPLICATION: finished
0709 13:20:46.536845 (+123772us) write_op.cc:301] APPLY: starting
0709 13:20:46.536954 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:46.640698 (+103744us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:46.640749 (+    51us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:46.705842 (+ 65093us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:46.706343 (+   501us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=0,mrs_lookups=0
0709 13:20:46.706413 (+    70us) write_op.cc:312] APPLY: finished
0709 13:20:46.707033 (+   620us) log.cc:844] Serialized 236 byte log entry
0709 13:20:46.723262 (+ 16229us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:46.723472 (+   210us) write_op.cc:454] Released schema lock
0709 13:20:46.723557 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:46.724012 (+   455us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:46.724038 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":235141,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":122337,"apply.run_cpu_time_us":36180,"apply.run_wall_time_us":187157,"cfile_cache_hit":110,"cfile_cache_hit_bytes":116771,"num_ops":27,"prepare.queue_time_us":128584,"prepare.run_cpu_time_us":21322,"prepare.run_wall_time_us":63138,"raft.queue_time_us":133302,"raft.run_cpu_time_us":9196,"raft.run_wall_time_us":133384,"replication_time_us":294635,"spinlock_wait_cycles":52802944,"thread_start_us":367719,"threads_started":4,"wal-append.queue_time_us":41947}]]}
I20260709 13:20:47.081264 26779 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:20:47.081957 26779 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:47.088023 26575 raft_consensus.cc:2749] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:20:47.103665 18927 consensus_peers.cc:597] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:47.106629 18927 consensus_peers.cc:597] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:47.109330 18306 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:47.099396 26779 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:47.112941 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:47.115166 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:47.111194 18927 consensus_peers.cc:597] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:47.116740 18202 leader_election.cc:304] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:47.118683 26776 raft_consensus.cc:2749] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:20:47.118752 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 154988us
I20260709 13:20:47.134176 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:47.135018 18379 raft_consensus.cc:2368] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 25. Current term is 26.
W20260709 13:20:47.130900 18277 consensus_peers.cc:597] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:47.132022 26760 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:20:47.164711 18926 leader_election.cc:400] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 25. Current term is 26.
I20260709 13:20:47.165117 18926 leader_election.cc:403] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:47.165726 26762 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:20:47.176666 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:47.177094 26581 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.177706 26581 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:47.181607 18304 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 29 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 13:20:47.183068 26581 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:47.184665 17138 tablet_replica.cc:333] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.186708 17138 raft_consensus.cc:2243] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.187628 17138 raft_consensus.cc:2272] T 610ebeb615ff40b9baae6de30d397e22 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.194706 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:47.195436 18379 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 22.
I20260709 13:20:47.195544 18377 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:20:47.199065 18201 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
I20260709 13:20:47.199920 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:47.210371 26581 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:47.210839 26581 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:47.211279 26581 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:47.201185 26599 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:20:47.215406 26771 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:47.223210 18379 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 13:20:47.224321 18134 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60856 (request call id 124) took 9352 ms. Trace:
I20260709 13:20:47.233304 26762 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265) with higher term. Message: Invalid argument: T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e016302b7e734d74833a2bf7bab44838 for earlier term 25. Current term is 26.
I20260709 13:20:47.234401 18958 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 26 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:20:47.234526 18956 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:20:47.236282 26587 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:47.238129 26599 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:20:47.249569 17138 tablet_replica.cc:333] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.251134 17138 raft_consensus.cc:2243] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.251787 26771 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:20:47.239588 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 107890us
I20260709 13:20:47.265892 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:47.268184 26540 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:47.268769 17138 raft_consensus.cc:2272] T 4c7dd453327840c0811097f0c2b4c75b P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:47.251149 18277 consensus_peers.cc:597] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:47.257416 26581 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:47.228916 18134 rpcz_store.cc:276] 0709 13:20:37.871761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:37.872076 (+   315us) service_pool.cc:224] Handling call
0709 13:20:47.224248 (+9352172us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:46.993705 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:46.994236 (+   531us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:46.994267 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:20:46.994285 (+    18us) tablet.cc:662] Decoding operations
0709 13:20:46.995263 (+   978us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:46.995339 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:46.995364 (+    25us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:20:46.996296 (+   932us) tablet.cc:701] Row locks acquired
0709 13:20:46.996323 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:20:47.003766 (+  7443us) write_op.cc:270] Start()
0709 13:20:47.009708 (+  5942us) write_op.cc:276] Timestamp: P: 1783603247003714 usec, L: 0
0709 13:20:47.009732 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:20:47.010401 (+   669us) log.cc:844] Serialized 4430 byte log entry
0709 13:20:47.015632 (+  5231us) op_driver.cc:464] REPLICATION: finished
0709 13:20:47.015947 (+   315us) write_op.cc:301] APPLY: starting
0709 13:20:47.016019 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:47.026961 (+ 10942us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:47.027063 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:47.152387 (+125324us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:47.152674 (+   287us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 13:20:47.152736 (+    62us) write_op.cc:312] APPLY: finished
0709 13:20:47.153238 (+   502us) log.cc:844] Serialized 105 byte log entry
0709 13:20:47.153436 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:47.153602 (+   166us) write_op.cc:454] Released schema lock
0709 13:20:47.153662 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:47.154058 (+   396us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:47.154092 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15444,"reported_tablets":24,"spinlock_wait_cycles":15232,"child_traces":[["op",{"apply.queue_time_us":105,"apply.run_cpu_time_us":17544,"apply.run_wall_time_us":138059,"cfile_cache_hit":44,"cfile_cache_hit_bytes":45892,"num_ops":11,"prepare.queue_time_us":56230,"prepare.run_cpu_time_us":4007,"prepare.run_wall_time_us":20166,"replication_time_us":5754,"thread_start_us":36430,"threads_started":1}]]}
I20260709 13:20:47.308960 17138 tablet_replica.cc:333] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.310561 17138 raft_consensus.cc:2243] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.312165 17138 raft_consensus.cc:2272] T 6c5058a8396d4e77a38f85a04e24eae7 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.293957 26581 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:47.295238 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:47.313527 18379 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:47.334260 18379 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b52e2477fc524694967c4a16afa983e3 in term 23.
I20260709 13:20:47.341387 26771 raft_consensus.cc:493] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e016302b7e734d74833a2bf7bab44838)
I20260709 13:20:47.348975 17138 tablet_replica.cc:333] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.365806 26771 raft_consensus.cc:515] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:47.366814 17138 raft_consensus.cc:2243] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.354794 18132 catalog_manager.cc:5697] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 20 to 23, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 23 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:47.368255 26771 leader_election.cc:290] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:47.369894 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:47.368193 17138 raft_consensus.cc:2272] T 49c6a2a19b90491f9336362305339eca P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.373586 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
W20260709 13:20:47.354060 18351 consensus_peers.cc:597] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:47.378207 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4cde9a14cb4fca95a288de6d075e9a" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:47.378777 18351 consensus_peers.cc:597] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:47.360821 18304 raft_consensus.cc:2955] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 9 to 13, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:47.369935 18132 catalog_manager.cc:5697] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 19 to 22, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 22 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.373553 17138 tablet_replica.cc:333] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.392633 18201 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3; no voters: 
W20260709 13:20:47.396004 18277 consensus_peers.cc:597] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:47.396427 17138 raft_consensus.cc:2243] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.405453 26771 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:47.406003 26771 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Becoming Leader. State: Replica: b52e2477fc524694967c4a16afa983e3, State: Running, Role: LEADER
I20260709 13:20:47.407253 17138 raft_consensus.cc:2272] T efd953e96dc54f10a635581a413244e2 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.403631 18132 catalog_manager.cc:5697] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 19 to 21, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 21 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.411175 17138 tablet_replica.cc:333] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.418175 17138 raft_consensus.cc:2243] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.410874 26771 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:47.412891 18132 catalog_manager.cc:5697] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 18 to 19, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 19 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:47.420113 18201 leader_election.cc:304] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:47.426975 26770 raft_consensus.cc:2749] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:47.427806 18132 catalog_manager.cc:5697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 20 to 21, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 21 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:47.430549 18132 catalog_manager.cc:5697] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 21 to 23, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 23 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:47.433033 18132 catalog_manager.cc:5697] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.436762 18132 catalog_manager.cc:5697] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:47.434478 17138 raft_consensus.cc:2272] T 0d2ac0cb46434c19a6e4f18836703096 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.449698 17138 tablet_replica.cc:333] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
W20260709 13:20:47.443833 18277 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:47.458081 17138 raft_consensus.cc:2243] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.456056 18379 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:47.459321 18312 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:20:47.450644 18132 catalog_manager.cc:5697] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:47.470412 17138 raft_consensus.cc:2272] T c230199b226a4b03b63c04fd79847b50 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.470263 26770 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:20:47.471141 18277 consensus_peers.cc:597] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:47.474922 26771 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:47.471171 18132 catalog_manager.cc:5697] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 21 to 22, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 22 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:47.484702 18132 catalog_manager.cc:5697] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 17 to 19, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 19 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.491516 17138 tablet_replica.cc:333] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.492931 17138 raft_consensus.cc:2243] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.493731 17138 raft_consensus.cc:2272] T 7e1dd423d7184b408a5257ea471f540d P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.510839 17138 tablet_replica.cc:333] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.521329 17138 raft_consensus.cc:2243] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.522691 17138 raft_consensus.cc:2272] T d49caac43d924696b2d3a9cc660f2c48 P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.531412 17138 tablet_replica.cc:333] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
W20260709 13:20:47.537066 18277 consensus_peers.cc:597] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:47.539268 17138 raft_consensus.cc:2243] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.540164 17138 raft_consensus.cc:2272] T 715a2657f09449038e569acddbab1aea P b52e2477fc524694967c4a16afa983e3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.548017 17138 tablet_replica.cc:333] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
W20260709 13:20:47.559381 18277 consensus_peers.cc:597] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:47.568547 17138 raft_consensus.cc:2243] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.578069 17138 raft_consensus.cc:2272] T cbd66a28ecbc4386b9e1489688542ca9 P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:47.581324 18277 consensus_peers.cc:597] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:47.625797 18134 catalog_manager.cc:5697] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 17 to 22, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 22 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:47.627463 18134 catalog_manager.cc:5697] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 16 to 20, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 20 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:47.629071 18134 catalog_manager.cc:5697] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 11 to 13, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 13 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:47.630388 18134 catalog_manager.cc:5697] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 24 to 26, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 26 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:47.631620 18134 catalog_manager.cc:5697] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 14 to 18, leader changed from e016302b7e734d74833a2bf7bab44838 (127.16.188.132) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 18 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:47.638968 18134 catalog_manager.cc:5697] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:47.642516 17138 tablet_replica.cc:333] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.644132 17138 raft_consensus.cc:2243] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.643148 18134 catalog_manager.cc:5697] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 22 to 24, leader changed from <none> to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 24 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:47.646351 18134 catalog_manager.cc:5697] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:47.657502 17138 raft_consensus.cc:2272] T 3611564ea3974f58a23e3fea4f39c5c7 P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.647814 18134 catalog_manager.cc:5697] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 23 to 24, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 24 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:47.663765 17138 tablet_replica.cc:333] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.671312 17138 raft_consensus.cc:2243] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.672827 18134 catalog_manager.cc:5697] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:47.674353 18303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53354
I20260709 13:20:47.676120 18303 raft_consensus.cc:606] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Received request to transfer leadership
I20260709 13:20:47.674667 17138 raft_consensus.cc:2272] T 87ce294aa3d9426291ec809884e80749 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.682369 18303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53354
I20260709 13:20:47.682919 18303 raft_consensus.cc:606] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Received request to transfer leadership
W20260709 13:20:47.688684 18277 consensus_peers.cc:597] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:47.675495 18132 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39284 (request call id 216) took 6617 ms. Trace:
W20260709 13:20:47.695712 18351 consensus_peers.cc:597] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:47.701550 17138 tablet_replica.cc:333] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.705986 17138 raft_consensus.cc:2243] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.709167 17138 raft_consensus.cc:2272] T fe9abdaa4bb845cd8d40c4f182cf98c9 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.693428 18132 rpcz_store.cc:276] 0709 13:20:41.057968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:41.060643 (+  2675us) service_pool.cc:224] Handling call
0709 13:20:47.675409 (+6614766us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:47.492792 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:47.493342 (+   550us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:47.493385 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:20:47.493402 (+    17us) tablet.cc:662] Decoding operations
0709 13:20:47.494443 (+  1041us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:47.494504 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:47.494544 (+    40us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:20:47.495541 (+   997us) tablet.cc:701] Row locks acquired
0709 13:20:47.495565 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:20:47.495696 (+   131us) write_op.cc:270] Start()
0709 13:20:47.495823 (+   127us) write_op.cc:276] Timestamp: P: 1783603247495658 usec, L: 0
0709 13:20:47.495846 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:20:47.496483 (+   637us) log.cc:844] Serialized 4509 byte log entry
0709 13:20:47.503253 (+  6770us) op_driver.cc:464] REPLICATION: finished
0709 13:20:47.503691 (+   438us) write_op.cc:301] APPLY: starting
0709 13:20:47.503766 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:47.521573 (+ 17807us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:47.521675 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:47.531452 (+  9777us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:47.531717 (+   265us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 13:20:47.531780 (+    63us) write_op.cc:312] APPLY: finished
0709 13:20:47.532262 (+   482us) log.cc:844] Serialized 105 byte log entry
0709 13:20:47.539341 (+  7079us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:47.539490 (+   149us) write_op.cc:454] Released schema lock
0709 13:20:47.539544 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:47.539956 (+   412us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:47.540000 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15088,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":238,"apply.run_cpu_time_us":13977,"apply.run_wall_time_us":36192,"cfile_cache_hit":44,"cfile_cache_hit_bytes":45892,"num_ops":11,"prepare.queue_time_us":334,"prepare.run_cpu_time_us":4010,"prepare.run_wall_time_us":6548,"replication_time_us":7299}]]}
I20260709 13:20:47.712211 18303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0"
dest_uuid: "459e82ee6b564cc19be6f73186938e79"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53354
I20260709 13:20:47.713443 18303 raft_consensus.cc:606] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Received request to transfer leadership
W20260709 13:20:47.718962 18183 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:20:47.719421 18183 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 23d48585586a4bb3bc800da7f54e12f0 already in progress
W20260709 13:20:47.719708 18183 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 23d48585586a4bb3bc800da7f54e12f0 already in progress
I20260709 13:20:47.756367 17138 tablet_replica.cc:333] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.757673 17138 raft_consensus.cc:2243] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.758426 17138 raft_consensus.cc:2272] T fbab600bb4ff4ad99b8a9ff2604b8f4b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.761714 17138 tablet_replica.cc:333] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.762756 17138 raft_consensus.cc:2243] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.764109 17138 raft_consensus.cc:2272] T 23eb586495714fcf90b0b81c5ec4cc2f P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.794225 17138 tablet_replica.cc:333] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.795225 17138 raft_consensus.cc:2243] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.796365 17138 pending_rounds.cc:70] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Trying to abort 1 pending ops.
I20260709 13:20:47.796693 17138 pending_rounds.cc:77] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3: Aborting op as it isn't in flight: id { term: 22 index: 17 } timestamp: 7305638854831841280 op_type: NO_OP noop_request { }
I20260709 13:20:47.800941 17138 raft_consensus.cc:2889] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:47.801307 17138 raft_consensus.cc:2272] T 39dd19f13a42412b9dda536e24c324b1 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.804440 17138 tablet_replica.cc:333] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.805359 17138 raft_consensus.cc:2243] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.806259 17138 raft_consensus.cc:2272] T 4300927be0384401aa46050bd5996d2f P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.813927 18377 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:47.816471 26771 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:47.822269 17138 tablet_replica.cc:333] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.828540 17138 raft_consensus.cc:2243] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.833891 17138 raft_consensus.cc:2272] T fac262d04a1a4d94aec44b2679caee9d P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.808560 18133 catalog_manager.cc:5697] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.837586 17138 tablet_replica.cc:333] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.845438 17138 raft_consensus.cc:2243] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.846105 17138 raft_consensus.cc:2272] T ef83aa6f9534403ebe38156348430345 P b52e2477fc524694967c4a16afa983e3 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.849599 18133 catalog_manager.cc:5697] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:47.856738 17138 tablet_replica.cc:333] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.857658 17138 raft_consensus.cc:2243] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.865015 17138 raft_consensus.cc:2272] T fd151355294e450f85a51ac658d4a465 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.871873 17138 tablet_replica.cc:333] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.874418 17138 raft_consensus.cc:2243] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.875077 17138 raft_consensus.cc:2272] T 0c4cde9a14cb4fca95a288de6d075e9a P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.879909 18303 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:47.882030 18133 catalog_manager.cc:5697] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 19 to 23, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 23 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.892410 18303 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Refusing update from remote peer b52e2477fc524694967c4a16afa983e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:47.894078 26474 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:47.916998 17138 tablet_replica.cc:333] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.919631 17138 raft_consensus.cc:2243] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.920231 17138 pending_rounds.cc:70] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Trying to abort 1 pending ops.
I20260709 13:20:47.920493 17138 pending_rounds.cc:77] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3: Aborting op as it isn't in flight: id { term: 20 index: 13 } timestamp: 7305638802128252928 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "b6e6be0c25704f45b1b4f3c4f246fa02" old_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } } new_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } attrs { replace: true } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } } }
I20260709 13:20:47.921661 17138 raft_consensus.cc:2917] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Aborting config change with OpId 20.13: Aborted: Op aborted
I20260709 13:20:47.922060 17138 raft_consensus.cc:2889] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:20:47.922411 17138 raft_consensus.cc:2272] T b6e6be0c25704f45b1b4f3c4f246fa02 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.935742 17138 tablet_replica.cc:333] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.941475 17138 raft_consensus.cc:2243] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.951925 17138 pending_rounds.cc:70] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Trying to abort 1 pending ops.
I20260709 13:20:47.952551 18134 catalog_manager.cc:5697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 23 to 25, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 25 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:47.952260 17138 pending_rounds.cc:77] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3: Aborting op as it isn't in flight: id { term: 24 index: 12 } timestamp: 7305638877262557184 op_type: NO_OP noop_request { }
I20260709 13:20:47.953958 17138 raft_consensus.cc:2889] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:47.954475 17138 raft_consensus.cc:2272] T fdde66e5e9e64c508bb1a79d0f5754bd P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.954425 18134 catalog_manager.cc:5697] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 24 to 27. New cstate: current_term: 27 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:47.955708 18134 catalog_manager.cc:5697] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 19 to 20, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 20 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:47.957012 18134 catalog_manager.cc:5697] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 23 to 26. New cstate: current_term: 26 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:47.958180 18134 catalog_manager.cc:5697] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 23 to 27. New cstate: current_term: 27 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:47.967962 18133 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39288 (request call id 217) took 11928 ms (client timeout 15000 ms). Trace:
I20260709 13:20:47.967020 18134 catalog_manager.cc:5697] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 18 to 22, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 22 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:47.971673 18134 catalog_manager.cc:5697] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 19 to 22, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 22 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
W20260709 13:20:47.968396 18133 rpcz_store.cc:269] 0709 13:20:36.039380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:36.039576 (+   196us) service_pool.cc:224] Handling call
0709 13:20:47.898955 (+11859379us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:47.898983 (+    28us) write_op.cc:454] Released schema lock
0709 13:20:47.967899 (+ 68916us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:47.887419 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:47.887920 (+   501us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:47.887956 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:20:47.887974 (+    18us) tablet.cc:662] Decoding operations
0709 13:20:47.888487 (+   513us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:47.888557 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:47.888581 (+    24us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:20:47.888881 (+   300us) tablet.cc:701] Row locks acquired
0709 13:20:47.888902 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:20:47.889036 (+   134us) write_op.cc:270] Start()
0709 13:20:47.889145 (+   109us) write_op.cc:276] Timestamp: P: 1783603247888997 usec, L: 0
0709 13:20:47.889166 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:20:47.889734 (+   568us) log.cc:844] Serialized 1326 byte log entry
0709 13:20:47.891686 (+  1952us) op_driver.cc:464] REPLICATION: finished
0709 13:20:47.892188 (+   502us) write_op.cc:301] APPLY: starting
0709 13:20:47.892278 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:47.894209 (+  1931us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:47.894310 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:47.896144 (+  1834us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:47.896344 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 13:20:47.896389 (+    45us) write_op.cc:312] APPLY: finished
0709 13:20:47.896784 (+   395us) log.cc:844] Serialized 41 byte log entry
0709 13:20:47.897676 (+   892us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:47.897785 (+   109us) write_op.cc:454] Released schema lock
0709 13:20:47.897839 (+    54us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":261,"apply.run_cpu_time_us":5157,"apply.run_wall_time_us":5987,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12516,"num_ops":3,"prepare.queue_time_us":136,"prepare.run_cpu_time_us":2567,"prepare.run_wall_time_us":2566,"replication_time_us":2370}]]}
I20260709 13:20:47.972503 18134 catalog_manager.cc:5697] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 17 to 20, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 20 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:47.981676 18134 catalog_manager.cc:5697] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 20 to 21, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 21 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:47.986191 17138 tablet_replica.cc:333] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:47.996296 17138 raft_consensus.cc:2243] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:47.983052 18134 catalog_manager.cc:5697] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 23 to 26, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 26 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:48.000319 18134 catalog_manager.cc:5697] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 23 to 24, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 24 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:48.002488 18134 catalog_manager.cc:5697] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 20 to 29. New cstate: current_term: 29 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:48.003387 18134 catalog_manager.cc:5697] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 22 to 25, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 25 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:48.004276 18134 catalog_manager.cc:5697] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:48.008777 17138 raft_consensus.cc:2272] T 20a11d8d7fb14609b0bb479587b23e37 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.012081 17138 tablet_replica.cc:333] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.013957 26582 raft_consensus.cc:993] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: : Instructing follower e016302b7e734d74833a2bf7bab44838 to start an election
I20260709 13:20:48.014454 26582 raft_consensus.cc:1081] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Signalling peer e016302b7e734d74833a2bf7bab44838 to start an election
I20260709 13:20:48.017442 18134 catalog_manager.cc:5697] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 22 to 27, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 27 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:48.018440 18134 catalog_manager.cc:5697] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:48.019685 18134 catalog_manager.cc:5697] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:48.021039 18134 catalog_manager.cc:5697] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 23 to 27. New cstate: current_term: 27 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:48.022228 18134 catalog_manager.cc:5697] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 21 to 22, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 22 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:48.023455 18134 catalog_manager.cc:5697] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 17 to 24. New cstate: current_term: 24 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:48.024639 18134 catalog_manager.cc:5697] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 22 to 23, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 23 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:48.026669 18956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0"
dest_uuid: "e016302b7e734d74833a2bf7bab44838"
 from {username='slave'} at 127.0.0.1:54020
I20260709 13:20:48.026502 18134 catalog_manager.cc:5697] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 22 to 23, leader changed from 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131) to b52e2477fc524694967c4a16afa983e3 (127.16.188.129). New cstate: current_term: 23 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:48.027254 18956 raft_consensus.cc:493] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:48.027611 18956 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:48.027760 18134 catalog_manager.cc:5697] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:48.036929 17138 raft_consensus.cc:2243] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.039009 18956 raft_consensus.cc:515] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:48.041349 17138 raft_consensus.cc:2272] T 2b14d7467c934fdca91c8a466ef2d764 P b52e2477fc524694967c4a16afa983e3 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:48.050137 18927 leader_election.cc:336] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:48.057240 17138 tablet_replica.cc:333] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.058462 17138 raft_consensus.cc:2243] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.059621 17138 raft_consensus.cc:2272] T d88cda52389848d584c846a8597f4977 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.080649 17138 tablet_replica.cc:333] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.083484 17138 raft_consensus.cc:2243] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.084887 17138 pending_rounds.cc:70] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3: Trying to abort 1 pending ops.
I20260709 13:20:48.085094 17138 pending_rounds.cc:77] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3: Aborting op as it isn't in flight: id { term: 20 index: 12 } timestamp: 7305638855582584832 op_type: NO_OP noop_request { }
I20260709 13:20:48.085321 17138 raft_consensus.cc:2889] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:48.085538 17138 raft_consensus.cc:2272] T 3c074d20c77e423597f342d5ed4ccc6d P b52e2477fc524694967c4a16afa983e3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.088016 17138 tablet_replica.cc:333] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.088889 17138 raft_consensus.cc:2243] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.089651 17138 raft_consensus.cc:2272] T 96c6309e774a4e15bd33a0a93d1a7f2e P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.119366 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:48.120110 18310 raft_consensus.cc:3055] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:20:48.120486 18310 raft_consensus.cc:740] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:48.121580 18310 consensus_queue.cc:260] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:48.130697 17138 tablet_replica.cc:333] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.131778 17138 raft_consensus.cc:2243] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.132054 18310 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:48.133589 17138 raft_consensus.cc:2272] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.142232 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d48585586a4bb3bc800da7f54e12f0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:48.142899 18379 raft_consensus.cc:3060] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:20:48.150978 17138 tablet_replica.cc:333] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.156955 17138 raft_consensus.cc:2243] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.159245 18956 leader_election.cc:290] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:48.165580 18277 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 246 similar messages]
I20260709 13:20:48.168450 17138 raft_consensus.cc:2272] T e5a31bcfc315403994b8ecac224542b5 P b52e2477fc524694967c4a16afa983e3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.172000 17138 tablet_replica.cc:333] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.173125 17138 raft_consensus.cc:2243] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.173779 17138 raft_consensus.cc:2272] T b1889d6d746545a0bdf04811a102b35b P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.171229 18379 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 20.
I20260709 13:20:48.140235 18310 raft_consensus.cc:2468] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 20.
I20260709 13:20:48.189980 18927 leader_election.cc:304] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:48.190949 26779 raft_consensus.cc:2804] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:20:48.191509 26779 raft_consensus.cc:697] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 20 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:48.192906 26779 consensus_queue.cc:237] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:48.200553 17138 tablet_replica.cc:333] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.201946 17138 raft_consensus.cc:2243] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.202684 17138 pending_rounds.cc:70] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: Trying to abort 1 pending ops.
I20260709 13:20:48.202993 17138 pending_rounds.cc:77] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3: Aborting op as it isn't in flight: id { term: 20 index: 15 } timestamp: 7305638829390319616 op_type: NO_OP noop_request { }
I20260709 13:20:48.203377 17138 raft_consensus.cc:2889] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:48.203752 17138 raft_consensus.cc:2272] T 83392764a50d4598aedbe4d1cc557dad P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.207141 17138 tablet_replica.cc:333] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.207998 17138 raft_consensus.cc:2243] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.222065 26770 raft_consensus.cc:493] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.222662 26770 raft_consensus.cc:515] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:48.226318 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:48.230713 26770 leader_election.cc:290] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:48.231689 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d094a2c1f67e4ab7bc263e71d49ced86" candidate_uuid: "b52e2477fc524694967c4a16afa983e3" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:48.234387 18201 leader_election.cc:304] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b52e2477fc524694967c4a16afa983e3; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:48.236743 17138 raft_consensus.cc:2272] T 23d48585586a4bb3bc800da7f54e12f0 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.239715 17138 tablet_replica.cc:333] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.240775 26770 raft_consensus.cc:2749] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:48.240475 17138 raft_consensus.cc:2243] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.261957 17138 raft_consensus.cc:2272] T ed649e8e79144f338d9c590603fa0b7c P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.265050 17138 tablet_replica.cc:333] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.265847 17138 raft_consensus.cc:2243] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.266782 17138 raft_consensus.cc:2272] T 23abbfc724a94243a40588649dd76b4f P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.281319 17138 tablet_replica.cc:333] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.282352 17138 raft_consensus.cc:2243] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.283075 17138 raft_consensus.cc:2272] T 9d7e53f100fe49dea344afeea45f7cf5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.286415 17138 tablet_replica.cc:333] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.287314 17138 raft_consensus.cc:2243] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.288407 17138 raft_consensus.cc:2272] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.299847 17138 tablet_replica.cc:333] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.300732 17138 raft_consensus.cc:2243] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.301939 17138 raft_consensus.cc:2272] T dd45943dc64b4e86b54ae5c263345e6e P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.305240 17138 tablet_replica.cc:333] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.306259 17138 raft_consensus.cc:2243] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.307503 17138 raft_consensus.cc:2272] T 9db2383f92d34ec9ab6bed764ba818f4 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.326412 18133 catalog_manager.cc:5697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "b52e2477fc524694967c4a16afa983e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } }
I20260709 13:20:48.336601 17138 tablet_replica.cc:333] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.337762 17138 raft_consensus.cc:2243] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.338510 17138 raft_consensus.cc:2272] T d6d3055da6db47abb16a433d66a5c79e P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.342056 17138 tablet_replica.cc:333] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.342922 17138 raft_consensus.cc:2243] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.344166 17138 raft_consensus.cc:2272] T 7a18591c0ed248258c1fcafa9811f7c4 P b52e2477fc524694967c4a16afa983e3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.349762 26599 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.350343 26599 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:48.353832 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:48.355471 26599 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:48.358893 18277 leader_election.cc:336] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:48.359397 18277 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:48.364212 17138 tablet_replica.cc:333] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.364835 26599 raft_consensus.cc:2749] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:20:48.373164 17138 raft_consensus.cc:2243] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.373997 17138 raft_consensus.cc:2272] T 58f88ffc8ca74740b36c09a2eb312c10 P b52e2477fc524694967c4a16afa983e3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.377161 17138 tablet_replica.cc:333] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.378058 17138 raft_consensus.cc:2243] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.379187 18132 catalog_manager.cc:5697] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 19 to 20, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 20 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:48.405588 17138 raft_consensus.cc:2272] T 7db17400d59a40a786f346aefbfbcbb0 P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.408870 17138 tablet_replica.cc:333] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
W20260709 13:20:48.411491 18277 consensus_peers.cc:597] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:48.432669 17138 raft_consensus.cc:2243] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.433470 17138 raft_consensus.cc:2272] T 3c6cd802105b49c68d85e7abdce24871 P b52e2477fc524694967c4a16afa983e3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.446262 17138 tablet_replica.cc:333] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.454674 17138 raft_consensus.cc:2243] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.455214 17138 raft_consensus.cc:2272] T 35ee2a6512e24d10af3526398de71490 P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.458297 17138 tablet_replica.cc:333] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.471465 17138 raft_consensus.cc:2243] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.472452 17138 raft_consensus.cc:2272] T e0d4b879cb5a45d0ab3dc5401e957620 P b52e2477fc524694967c4a16afa983e3 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.475345 17138 tablet_replica.cc:333] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.476122 17138 raft_consensus.cc:2243] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:48.495976 18351 consensus_peers.cc:597] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:48.524667 18385 consensus_queue.cc:237] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:48.527442 17138 raft_consensus.cc:2272] T d094a2c1f67e4ab7bc263e71d49ced86 P b52e2477fc524694967c4a16afa983e3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.531124 18379 consensus_queue.cc:237] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:48.534655 17138 tablet_replica.cc:333] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.535570 17138 raft_consensus.cc:2243] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.539795 17138 raft_consensus.cc:2272] T 80d0760748294d8d8cb291466766b8a5 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:48.545771 18351 consensus_peers.cc:597] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:48.546944 26683 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.547539 26683 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:48.549984 26683 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:48.553654 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:48.557539 17138 tablet_replica.cc:333] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.561444 17138 raft_consensus.cc:2243] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.562213 17138 raft_consensus.cc:2272] T 2cbade5381d641e9b60bcc9994ae9b51 P b52e2477fc524694967c4a16afa983e3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.565058 17138 tablet_replica.cc:333] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.565745 17138 raft_consensus.cc:2243] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.566787 17138 raft_consensus.cc:2272] T 069a152975ce431fb5fd1abe7e07178e P b52e2477fc524694967c4a16afa983e3 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:48.569038 18351 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:48.571412 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:48.575259 26683 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:48.587788 18956 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:20:48.589385 26780 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:20:48.597819 26683 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.598387 17138 tablet_replica.cc:333] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3: stopping tablet replica
I20260709 13:20:48.599251 17138 raft_consensus.cc:2243] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.599251 26780 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.600217 26780 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:48.598387 26683 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:48.602571 26683 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:48.600382 17138 raft_consensus.cc:2272] T d03313400e274f83883c84395905b4cd P b52e2477fc524694967c4a16afa983e3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.615106 26780 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:48.623255 26780 raft_consensus.cc:2955] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 LEADER]: Committing config change with OpId 24.18: config changed from index 15 to 18, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:48.623719 18956 raft_consensus.cc:2955] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 15 to 18, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:48.627537 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:48.630704 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:48.631340 18303 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 27.
I20260709 13:20:48.654417 18133 catalog_manager.cc:5697] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 15 to 18, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New cstate: current_term: 24 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:48.660060 18377 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:48.661700 26778 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:48.651973 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:48.701750 18349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 67076.1us
W20260709 13:20:48.712677 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 60788us
W20260709 13:20:48.719636 18351 leader_election.cc:336] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:48.720963 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:48.754282 26796 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.758344 26796 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:48.747499 26683 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:20:48.746059 26599 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.761791 26599 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:48.793190 18277 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:48.795162 18121 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 94366.8us
I20260709 13:20:48.741549 26806 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:20:48.783133 26796 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:48.799902 18351 leader_election.cc:336] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:48.803710 18277 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:48.798758 26804 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.808499 26804 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:48.810889 26804 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:48.818845 18303 raft_consensus.cc:1275] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 13:20:48.823211 18351 consensus_peers.cc:597] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:48.826251 26804 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.826800 26804 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:48.842845 26804 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:48.797667 26806 raft_consensus.cc:493] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.845963 26806 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:48.849859 26599 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:48.861749 18310 raft_consensus.cc:1275] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:20:48.865641 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:48.868103 26780 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.868781 26780 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:48.870959 26780 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:48.873447 18306 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:20:48.876313 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:48.882334 26582 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.882942 26582 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:48.866117 18121 catalog_manager.cc:4755] TS b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 35ee2a6512e24d10af3526398de71490: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:20:48.889038 26796 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.889200 18120 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 35ee2a6512e24d10af3526398de71490 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:48.889647 26796 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:48.877213 18303 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
W20260709 13:20:48.895340 18351 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:48.896873 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:48.898120 18379 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
I20260709 13:20:48.899281 26806 raft_consensus.cc:515] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:48.899706 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:48.900581 18379 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:48.901726 26806 leader_election.cc:290] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:48.904819 18958 raft_consensus.cc:1275] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:20:48.912977 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:48.897183 26778 consensus_queue.cc:1048] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:20:48.913985 18379 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 26.
I20260709 13:20:48.866724 26599 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.890998 26582 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:48.919142 18927 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:48.928776 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:48.932399 18351 consensus_peers.cc:597] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:48.939620 26809 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 13:20:48.944669 26804 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.947773 26804 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:48.935552 26806 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.948607 26806 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:48.949776 26804 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:48.950536 26806 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:48.951117 26812 consensus_queue.cc:1048] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:20:48.935132 18351 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:48.959188 18276 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:48.963124 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:48.967252 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:48.969231 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c6a2a19b90491f9336362305339eca" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:48.969799 18304 raft_consensus.cc:3060] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:48.974218 26582 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:48.974718 26796 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:48.975271 26812 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.975780 26812 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:48.921968 26599 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:48.977770 26812 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:48.974660 26582 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.978474 26582 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:48.934809 26807 consensus_queue.cc:1048] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.031s
I20260709 13:20:48.983246 18312 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 27.
I20260709 13:20:48.967980 18306 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 26.
I20260709 13:20:48.978009 26599 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:48.989035 26796 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:48.989516 26796 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:48.989908 26796 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:49.000397 26807 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.000981 26807 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.003016 26807 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.004716 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:20:49.011848 18351 leader_election.cc:336] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:49.013311 18351 leader_election.cc:336] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:48.986483 18276 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:49.016398 18304 raft_consensus.cc:2468] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 28.
I20260709 13:20:49.016680 26807 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:49.034121 26582 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.036337 26582 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.037822 26582 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:49.047658 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.043552 18351 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.049939 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:49.050470 18351 leader_election.cc:336] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.025002 26807 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.053233 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:49.053941 18306 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 27.
I20260709 13:20:49.056875 26807 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:49.061602 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:49.062288 18307 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 26.
I20260709 13:20:49.062529 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:49.052683 18351 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:49.063887 18351 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.046126 26582 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.071695 18312 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 24.
I20260709 13:20:49.079865 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.080894 26804 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:49.081352 26804 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.081699 26814 raft_consensus.cc:2955] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index 13 to 16, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:49.083078 26819 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:49.083559 26819 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.083900 26819 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:49.081723 26804 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:49.087230 26796 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.090189 18960 raft_consensus.cc:2955] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 13 to 16, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:49.099740 26804 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.103257 26815 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:49.129148 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 142637us
I20260709 13:20:49.129586 26815 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.131635 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:49.131837 26815 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.132328 18379 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 26.
I20260709 13:20:49.134923 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:49.109650 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:20:49.136718 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 55510.6us
I20260709 13:20:49.136873 18385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c5058a8396d4e77a38f85a04e24eae7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:49.108302 26807 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.123358 18120 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b6e6be0c25704f45b1b4f3c4f246fa02 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:49.137538 18351 leader_election.cc:304] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.112584 26582 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.125913 18133 catalog_manager.cc:5697] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 13 to 16, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New cstate: current_term: 24 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:49.126113 18311 raft_consensus.cc:2955] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 15 to 18, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:20:49.128093 18927 consensus_peers.cc:597] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.107295 18277 leader_election.cc:336] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:49.141685 18277 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.144613 26806 raft_consensus.cc:2804] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:20:49.145241 26806 raft_consensus.cc:697] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:49.146193 26806 consensus_queue.cc:237] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.135599 18379 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 27.
I20260709 13:20:49.137490 18385 raft_consensus.cc:3060] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:20:49.153352 18277 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.124015 26796 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.140314 26804 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.131753 26819 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.156368 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:49.161602 18377 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 24.
I20260709 13:20:49.163959 26819 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.155427 26812 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 13:20:49.168629 18277 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.170689 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.166700 26812 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.179113 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.177656 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:49.180122 18379 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 21: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:49.179482 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.180817 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:49.181603 18377 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:49.186580 18276 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:49.182858 26812 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:20:49.196136 18277 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.185968 26780 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:20:49.204110 26780 raft_consensus.cc:493] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.204643 26780 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:49.186298 26819 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:20:49.206727 26819 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.207137 26819 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:49.201411 26582 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:49.186460 26820 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:49.222527 18385 raft_consensus.cc:2468] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 24.
I20260709 13:20:49.220348 26582 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.227952 26582 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:49.233860 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:49.241415 18379 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 27: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:49.224728 26820 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.245260 26820 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:49.247370 18134 catalog_manager.cc:5697] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 27 to 28, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 28 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:49.249109 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 56545.8us
I20260709 13:20:49.224879 26807 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.256820 26826 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.257514 26826 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.259740 26826 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.261760 26582 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.263859 26582 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:49.301723 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 121282us
I20260709 13:20:49.302665 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
W20260709 13:20:49.303059 18277 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.304025 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:49.305784 18275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:42479, user_credentials={real_user=slave}} blocked reactor thread for 110954us
W20260709 13:20:49.304900 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 119721us
W20260709 13:20:49.305648 18277 leader_election.cc:336] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:49.308792 18277 leader_election.cc:336] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.310410 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.304339 26807 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:49.317580 18276 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.324620 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:49.325495 18304 raft_consensus.cc:2393] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 27: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:49.325606 18312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:49.326493 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:49.327245 18309 raft_consensus.cc:2393] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 21: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:49.309901 26806 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:49.318859 26803 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:49.329212 26803 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.329608 26803 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:49.324046 26813 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.336133 26813 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:49.343653 26823 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.321774 26807 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.344280 26823 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.345047 26807 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:49.347165 26823 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:49.348093 18277 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.352751 26599 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:49.353191 26599 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.353575 26599 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:49.354374 18277 leader_election.cc:336] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.353700 26820 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.358939 26582 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.358871 26819 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.359424 26599 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.359649 26582 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.361522 26780 raft_consensus.cc:515] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.362021 26582 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.359935 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.362931 26582 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:20:49.363416 26820 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.363772 26780 leader_election.cc:290] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:49.373324 18277 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.364094 18276 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.368780 26819 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.370048 26812 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.370620 26813 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:20:49.366251 26599 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.374897 18276 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:49.388271 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 51492.8us
W20260709 13:20:49.389525 18277 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.411010 26815 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:20:49.411767 26815 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.412254 26815 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.414078 26807 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.414791 26815 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.389299 26816 raft_consensus.cc:2804] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:49.430575 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:49.431283 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:49.436906 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:49.437623 18380 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 28: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:49.437795 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3611564ea3974f58a23e3fea4f39c5c7" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:49.438311 18383 raft_consensus.cc:3060] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:20:49.438738 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:49.433372 26804 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.443087 26804 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.443365 18276 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.444465 26812 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.444597 26828 raft_consensus.cc:2749] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:49.445250 26804 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.391433 26830 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.432024 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:49.433651 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:49.453358 18381 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 24.
W20260709 13:20:49.447984 18277 leader_election.cc:336] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.431447 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:49.454421 18276 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.452476 26803 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.461544 26830 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.462450 18377 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 25: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:49.462877 18380 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
I20260709 13:20:49.465212 18379 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 27: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
W20260709 13:20:49.466578 18277 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.467031 18277 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.475478 18383 raft_consensus.cc:2468] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:49.476382 26804 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.464226 26830 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.478540 18276 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.477346 26804 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.482455 26832 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.466054 26816 raft_consensus.cc:697] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 24 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:49.485603 26804 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.485488 26816 consensus_queue.cc:237] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.482844 26807 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.486806 26828 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:49.549568 18276 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:49.549695 26828 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.550443 26582 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:49.551349 26582 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.551908 26582 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:49.519024 26803 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.486791 26819 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:20:49.550513 26828 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:49.483973 26832 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.556106 26832 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.562706 26582 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.564759 26817 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:20:49.565707 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 77431.5us
W20260709 13:20:49.568547 18277 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:49.568620 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 80299.5us
W20260709 13:20:49.569566 18277 consensus_peers.cc:597] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:49.569613 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.576093 26823 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:20:49.577786 26803 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.578384 26803 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.565972 26599 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.581947 26599 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.584257 26599 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.590816 26826 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.591073 26803 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.591447 26826 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.593598 26826 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.573258 26817 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.598680 26817 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:49.600785 26804 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.601496 26804 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.603969 26804 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.604611 26817 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:49.609863 18309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd66a28ecbc4386b9e1489688542ca9" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:49.610471 18309 raft_consensus.cc:3060] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:49.613780 18276 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.616096 18304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:49.616844 18304 raft_consensus.cc:2393] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 28: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:49.617996 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:49.618155 18309 raft_consensus.cc:2468] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 28.
I20260709 13:20:49.622526 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:49.622751 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:49.623431 18308 raft_consensus.cc:2393] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 27: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:49.626655 18307 raft_consensus.cc:2393] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 24: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:20:49.627853 18276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 54263us
I20260709 13:20:49.628331 26582 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.630453 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:49.631033 18379 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 20.
I20260709 13:20:49.636405 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:49.637173 18380 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:49.640218 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:49.640827 18310 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:49.641069 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdcc6f227f447c0bd7e5ce750cc3c04" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:49.641988 18307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:49.642750 18307 raft_consensus.cc:2393] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 25: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:49.643294 18380 raft_consensus.cc:3060] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:49.632733 26828 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.644567 18308 raft_consensus.cc:2955] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 13 to 16, VOTER b52e2477fc524694967c4a16afa983e3 (127.16.188.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:49.647152 26828 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.648738 18311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:49.649971 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:49.650578 18306 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
I20260709 13:20:49.652370 26815 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.652869 26815 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.654793 26815 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.657186 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:49.657451 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd151355294e450f85a51ac658d4a465" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:49.657773 18303 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 20.
I20260709 13:20:49.657987 18379 raft_consensus.cc:3060] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:49.661999 18277 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.663317 18380 raft_consensus.cc:2468] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 24.
I20260709 13:20:49.624003 26599 raft_consensus.cc:2804] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:49.666802 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:49.667274 26599 raft_consensus.cc:697] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:49.667606 18383 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 26.
I20260709 13:20:49.668896 26599 consensus_queue.cc:237] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:49.663028 18277 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.666451 18276 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.659651 26817 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.673995 18379 raft_consensus.cc:2468] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 25.
I20260709 13:20:49.674304 26817 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.676720 26828 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:49.677232 26828 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.677639 26828 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:49.678018 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:49.676769 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 52751.4us
I20260709 13:20:49.681304 26815 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:49.681720 26815 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.682047 26815 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:49.683465 18351 leader_election.cc:336] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.683965 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.684811 26803 raft_consensus.cc:2749] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 13:20:49.685554 18351 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.686007 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.686731 26803 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:20:49.687150 18351 consensus_peers.cc:597] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:49.688237 26803 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.688804 26803 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.690990 26803 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.678810 26817 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:49.697247 18277 leader_election.cc:336] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.698228 26599 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.699026 26599 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.703387 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:49.706707 18276 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.704241 26599 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.705448 26815 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.709697 26815 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.707274 26816 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:49.710371 26816 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.710842 26816 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:49.712862 26582 raft_consensus.cc:2804] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:20:49.713449 26582 raft_consensus.cc:697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 24 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:49.714299 26582 consensus_queue.cc:237] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:49.715171 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 236000us
W20260709 13:20:49.715835 18351 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.716361 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.717185 26803 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:49.718611 18134 catalog_manager.cc:5697] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 23 to 24, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 24 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:49.728880 18276 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:49.698331 18277 consensus_peers.cc:597] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.717651 18351 consensus_peers.cc:597] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.734745 18277 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:49.735934 18277 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:49.736636 18277 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.703375 26828 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.744025 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:49.744583 26828 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.744665 18310 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:49.747081 18351 leader_election.cc:304] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:49.747963 26830 raft_consensus.cc:2804] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:20:49.752028 26828 raft_consensus.cc:2804] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:49.752660 26828 raft_consensus.cc:697] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 25 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:49.753618 26599 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.754205 26599 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.758132 26599 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.758735 26830 raft_consensus.cc:697] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
W20260709 13:20:49.758179 18277 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.759755 26830 consensus_queue.cc:237] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.760844 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:49.761513 18956 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:49.760923 26828 consensus_queue.cc:237] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.762749 26815 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.767808 26817 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.768419 26817 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.769701 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd45943dc64b4e86b54ae5c263345e6e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:49.770047 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:49.770277 18377 raft_consensus.cc:3060] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:49.770494 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:49.771226 18379 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
I20260709 13:20:49.771375 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:49.772158 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db2383f92d34ec9ab6bed764ba818f4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:49.772730 18383 raft_consensus.cc:3060] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:49.773162 26812 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:20:49.773080 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:49.770694 26817 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.774581 18276 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.764369 26815 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.784606 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:49.784870 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:49.784979 18277 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.786288 18379 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:49.787268 18380 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 25.
I20260709 13:20:49.786271 26820 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:49.788849 26820 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.789291 26820 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:49.784549 26803 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.782130 26812 raft_consensus.cc:493] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.791781 26812 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:20:49.793318 18277 leader_election.cc:336] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:49.794737 18277 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.796204 18383 raft_consensus.cc:2468] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
W20260709 13:20:49.799427 18277 consensus_peers.cc:597] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:49.788022 18276 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:49.802064 18377 raft_consensus.cc:2468] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:49.791446 26816 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.801250 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:49.791468 26803 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.803800 26817 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:49.800196 26804 raft_consensus.cc:2764] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:20:49.809660 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.818984 26817 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.819481 26817 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:49.820394 26582 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:49.820935 26582 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.820453 18276 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.821322 18133 catalog_manager.cc:5697] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 21 to 22, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 22 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:49.822803 26819 raft_consensus.cc:2804] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:49.823359 26819 raft_consensus.cc:697] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:49.823276 18133 catalog_manager.cc:5697] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 23 to 24, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 24 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:49.818017 26826 raft_consensus.cc:2764] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:20:49.813721 26807 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
W20260709 13:20:49.816886 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:49.828765 26807 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.831035 26807 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.811160 18275 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.824432 26819 consensus_queue.cc:237] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.832911 26823 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:49.822813 18276 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.833403 26823 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.833840 26823 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:49.834570 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:49.835505 26835 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:20:49.835928 26835 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.836305 26835 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:20:49.818202 26803 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.821364 26582 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:49.833850 26816 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.840910 26820 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.842978 26820 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:49.831137 18927 consensus_peers.cc:597] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.844630 18927 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.845099 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.847132 26823 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:49.850268 18927 consensus_peers.cc:597] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:49.847326 26582 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.849288 26833 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:49.854597 26582 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.836887 26815 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:49.858208 26835 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.860416 26835 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:49.816164 18277 leader_election.cc:336] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:49.861560 18277 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.855666 26823 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:49.862659 26815 raft_consensus.cc:2804] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:49.868505 26815 raft_consensus.cc:697] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
W20260709 13:20:49.864295 18351 connection.cc:769] client connection to 127.16.188.129:43781 send error: Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 13:20:49.860180 26817 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:49.866480 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63677.5us
W20260709 13:20:49.872462 18277 connection.cc:769] client connection to 127.16.188.129:43781 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:20:49.867142 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a31bcfc315403994b8ecac224542b5" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:49.867542 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:49.870818 18377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:49.873468 18380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1f5c8f2c0e4687bcbe4eb6baed26c8" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:49.873558 18377 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 459e82ee6b564cc19be6f73186938e79 in current term 24: Already voted for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in this term.
I20260709 13:20:49.874258 18380 raft_consensus.cc:3060] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:49.877076 18383 raft_consensus.cc:3060] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:49.872694 26820 raft_consensus.cc:2749] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:20:49.856456 26812 raft_consensus.cc:515] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:49.908285 18277 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:20:49.910297 18380 raft_consensus.cc:2468] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 26.
I20260709 13:20:49.910524 18383 raft_consensus.cc:2468] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 27.
I20260709 13:20:49.918121 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db17400d59a40a786f346aefbfbcbb0" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:49.911077 18381 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 24.
I20260709 13:20:49.888990 26815 consensus_queue.cc:237] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:49.916970 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 47478.1us
I20260709 13:20:49.918782 18956 raft_consensus.cc:3060] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:49.923528 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 50640.5us
W20260709 13:20:49.922847 18351 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: sendmsg error: Connection reset by peer (error 104)
W20260709 13:20:49.925545 18351 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 13:20:49.927129 18133 catalog_manager.cc:5697] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 27 to 28, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 28 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:49.926141 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:49.938437 18927 consensus_peers.cc:597] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.939337 18927 consensus_peers.cc:597] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.941596 18351 leader_election.cc:336] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 13:20:49.945413 18956 raft_consensus.cc:2468] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
W20260709 13:20:49.945631 18351 consensus_peers.cc:597] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: sendmsg error: Connection reset by peer (error 104). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.947064 18351 leader_election.cc:336] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: sendmsg error: Connection reset by peer (error 104)
W20260709 13:20:49.948441 18351 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 13:20:49.943703 26830 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:49.948948 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.951048 26830 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 13:20:49.951761 18351 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 13:20:49.948028 18276 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:49.952349 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.944314 26812 leader_election.cc:290] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:49.954130 26817 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:49.955094 18351 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 13:20:49.956583 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.956879 18276 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:49.957777 18351 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 13:20:49.961540 26804 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:49.960652 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.956317 26830 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:20:49.965797 18351 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 13:20:49.965399 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:49.966732 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:49.957705 26823 raft_consensus.cc:2804] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:49.967000 26819 raft_consensus.cc:2804] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:20:49.973047 26819 raft_consensus.cc:697] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 27 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:49.968773 26835 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:20:49.974162 26819 consensus_queue.cc:237] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:49.967000 26804 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:20:49.968353 18351 consensus_peers.cc:597] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: sendmsg error: Connection reset by peer (error 104). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:49.969295 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:49.979964 18381 raft_consensus.cc:3060] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:20:49.979912 18351 leader_election.cc:336] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 13:20:49.976626 26820 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:49.985491 26820 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:49.985931 26820 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:49.993825 18275 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:49.995047 26817 raft_consensus.cc:2804] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:49.995611 26817 raft_consensus.cc:697] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:49.996548 26817 consensus_queue.cc:237] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:50.005664 18310 raft_consensus.cc:1275] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:20:50.003139 18381 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 23.
I20260709 13:20:50.010390 18276 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:50.013873 26582 raft_consensus.cc:2804] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:50.014400 26582 raft_consensus.cc:697] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:50.015470 26582 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:50.001767 26823 raft_consensus.cc:697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 26 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:50.028189 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
W20260709 13:20:50.028851 18277 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:50.029678 18277 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:50.029003 18310 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 22.
W20260709 13:20:50.030340 18277 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:50.032239 18277 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:50.036345 26823 consensus_queue.cc:237] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:50.030017 26807 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Starting pre-election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:50.036932 26804 consensus_queue.cc:1048] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:20:50.048813 18381 raft_consensus.cc:1275] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:20:50.051280 18277 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:50.052039 18277 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:50.052840 26807 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:50.052727 18277 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:50.055171 26807 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:50.058691 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:50.061157 26807 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:20:50.061548 26807 raft_consensus.cc:493] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:50.061911 26807 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:50.075291 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:50.082950 18308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:50.083871 18308 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 29.
I20260709 13:20:50.088660 26819 consensus_queue.cc:1048] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:20:50.095758 18351 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:50.099007 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:50.100030 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88cda52389848d584c846a8597f4977" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:50.100657 18303 raft_consensus.cc:3060] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:20:50.082104 26817 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:20:50.124167 18306 raft_consensus.cc:2393] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 24: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
I20260709 13:20:50.079964 26820 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:50.148319 18303 raft_consensus.cc:2468] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 21.
I20260709 13:20:50.152549 18310 raft_consensus.cc:2393] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b4fbc44aa2649f0bcac5cd70f71951d in current term 25: Already voted for candidate 459e82ee6b564cc19be6f73186938e79 in this term.
W20260709 13:20:50.192993 26848 log.cc:927] Time spent T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 13:20:50.194325 18121 catalog_manager.cc:4755] TS b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet b6e6be0c25704f45b1b4f3c4f246fa02: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:50.163070 26807 raft_consensus.cc:515] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:50.204494 18133 catalog_manager.cc:5697] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 24 to 25, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 25 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.206319 26807 leader_election.cc:290] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:50.206998 18133 catalog_manager.cc:5697] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 20 to 21, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 21 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.208957 26820 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:50.209231 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "069a152975ce431fb5fd1abe7e07178e" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:50.209966 18381 raft_consensus.cc:3060] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:20:50.210348 26849 log.cc:927] Time spent T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:20:50.217249 18133 catalog_manager.cc:5697] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 22 to 23, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 23 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:50.224793 18277 consensus_peers.cc:597] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.229712 18277 consensus_peers.cc:597] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:50.230218 18277 consensus_peers.cc:597] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.236893 18277 consensus_peers.cc:597] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:50.237365 18277 consensus_peers.cc:597] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.237795 18277 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:50.238237 18277 consensus_peers.cc:597] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:50.236415 18381 raft_consensus.cc:2468] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 25.
I20260709 13:20:50.245087 18276 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:50.246724 26820 raft_consensus.cc:2804] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:20:50.247319 26820 raft_consensus.cc:697] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 25 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:50.248303 26820 consensus_queue.cc:237] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:50.259690 18380 raft_consensus.cc:1275] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:20:50.264454 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 152514us
I20260709 13:20:50.265286 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:50.266086 26830 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:20:50.270115 26830 raft_consensus.cc:493] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Starting leader election (detected failure of leader b52e2477fc524694967c4a16afa983e3)
I20260709 13:20:50.270512 26830 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:20:50.274398 18351 leader_election.cc:304] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:50.275046 18381 raft_consensus.cc:1275] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:20:50.293521 26804 raft_consensus.cc:2804] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:20:50.294189 26804 raft_consensus.cc:697] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:50.295209 26804 consensus_queue.cc:237] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:50.295974 18383 raft_consensus.cc:1275] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:20:50.296473 26817 consensus_queue.cc:1048] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:50.297817 26832 consensus_queue.cc:1048] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:50.318200 18134 catalog_manager.cc:5697] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 22 to 23, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 23 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.323442 18134 catalog_manager.cc:5697] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 22 to 23, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 23 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.325907 18134 catalog_manager.cc:5697] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 26 to 27, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 27 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.327440 18134 catalog_manager.cc:5697] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 24 to 25, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 25 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.328883 18134 catalog_manager.cc:5697] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 25 to 26, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 26 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.334740 18306 raft_consensus.cc:1275] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:20:50.353334 18310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03313400e274f83883c84395905b4cd" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:50.353885 18310 raft_consensus.cc:3060] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:20:50.360656 18310 raft_consensus.cc:2468] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:20:50.329470 26820 consensus_queue.cc:1048] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:20:50.392627 18379 raft_consensus.cc:1275] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:20:50.394436 26817 consensus_queue.cc:1048] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:20:50.396484 18351 leader_election.cc:336] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:50.397559 18351 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:50.397984 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:50.398761 26807 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:20:50.399827 18351 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:50.400326 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:20:50.401295 18351 leader_election.cc:336] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:50.402563 18351 consensus_peers.cc:597] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.403059 18351 leader_election.cc:336] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:50.401315 26780 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:20:50.410591 18277 consensus_peers.cc:597] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:50.411253 18277 consensus_peers.cc:597] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.420671 26830 raft_consensus.cc:515] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:50.422648 26830 leader_election.cc:290] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:50.422405 18134 catalog_manager.cc:5697] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 20 to 21, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 21 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:50.438880 26835 consensus_queue.cc:1048] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:50.441854 18351 leader_election.cc:304] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:50.442692 26807 raft_consensus.cc:2804] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:20:50.443212 26807 raft_consensus.cc:697] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:50.444190 26807 consensus_queue.cc:237] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:50.449180 18351 leader_election.cc:336] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:50.456101 18277 consensus_peers.cc:597] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:50.465536 18277 consensus_peers.cc:597] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.474980 18306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d4b879cb5a45d0ab3dc5401e957620" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:50.475584 18306 raft_consensus.cc:3060] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:20:50.484622 18306 raft_consensus.cc:2468] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 30.
I20260709 13:20:50.484352 18377 raft_consensus.cc:1275] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
W20260709 13:20:50.484459 18351 consensus_peers.cc:597] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.488917 26820 consensus_queue.cc:1048] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:20:50.494880 18277 consensus_peers.cc:597] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.497870 18277 consensus_peers.cc:597] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.497314 18351 consensus_peers.cc:597] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:50.499260 18351 leader_election.cc:336] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:50.500232 18351 leader_election.cc:304] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:50.510408 26807 raft_consensus.cc:2804] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:20:50.511044 26807 raft_consensus.cc:697] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 30 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:50.525604 18133 catalog_manager.cc:5697] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 22 to 23, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 23 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:50.531708 18277 consensus_peers.cc:597] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.534978 18377 raft_consensus.cc:1275] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:50.512007 26807 consensus_queue.cc:237] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:50.554114 26816 consensus_queue.cc:1048] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:50.559293 18377 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:20:50.563336 26817 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:20:50.566525 26868 log.cc:927] Time spent T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:20:50.588811 18958 raft_consensus.cc:1275] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:20:50.593768 18377 raft_consensus.cc:1275] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:20:50.596973 26817 consensus_queue.cc:1048] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:20:50.597124 26815 consensus_queue.cc:1048] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:20:50.701992 18183 auto_rebalancer.cc:629] Failed to schedule move for tablet d49caac43d924696b2d3a9cc660f2c48: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:50.713778 18183 auto_rebalancer.cc:629] Failed to schedule move for tablet fa1f5c8f2c0e4687bcbe4eb6baed26c8: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:20:50.718816 18183 auto_rebalancer.cc:629] Failed to schedule move for tablet 87ce294aa3d9426291ec809884e80749: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:50.724354 18310 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:50.733760 18381 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:20:50.735428 26828 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
W20260709 13:20:50.740163 18275 consensus_peers.cc:597] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 -> Peer e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479): Couldn't send request to peer e016302b7e734d74833a2bf7bab44838. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23abbfc724a94243a40588649dd76b4f. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.740608 26872 log.cc:927] Time spent T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: Append to log took a long time: real 0.064s	user 0.002s	sys 0.000s
W20260709 13:20:50.739778 18277 consensus_peers.cc:597] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.754237 26819 raft_consensus.cc:2955] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index -1 to 16, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
W20260709 13:20:50.764792 18351 consensus_peers.cc:597] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.767495 18381 raft_consensus.cc:2955] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index -1 to 16, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } } }
I20260709 13:20:50.791920 18133 catalog_manager.cc:5697] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 29 to 30, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 30 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:50.819577 18310 raft_consensus.cc:1275] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:20:50.834638 18134 catalog_manager.cc:5697] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 reported cstate change: config changed from index -1 to 16, NON_VOTER e016302b7e734d74833a2bf7bab44838 (127.16.188.132) added. New cstate: current_term: 23 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:50.850260 18277 consensus_peers.cc:597] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.850970 18277 consensus_peers.cc:597] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.852921 26812 consensus_queue.cc:1048] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:50.858969 18381 raft_consensus.cc:1275] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:20:50.865397 26828 consensus_queue.cc:1048] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
W20260709 13:20:50.875777 18277 consensus_peers.cc:597] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.876323 18277 consensus_peers.cc:597] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:50.903110 18351 consensus_peers.cc:597] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.944752 18351 consensus_peers.cc:597] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.987911 18306 raft_consensus.cc:1275] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:20:50.996878 26803 consensus_queue.cc:1048] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:20:51.018363 17138 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 18258)
W20260709 13:20:51.029062 18351 consensus_peers.cc:597] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:51.049678 18303 raft_consensus.cc:1275] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 30 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
I20260709 13:20:51.053069 26830 consensus_queue.cc:1048] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:20:51.087705 26816 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.088320 26816 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:51.090610 26816 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:51.094751 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:51.095479 18381 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 25.
I20260709 13:20:51.096788 18276 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:51.098196 26815 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:20:51.098584 26815 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.098933 26815 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:20:51.135803 18351 consensus_peers.cc:597] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:51.149466 26815 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:51.157826 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23eb586495714fcf90b0b81c5ec4cc2f" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:51.158483 18381 raft_consensus.cc:3060] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:20:51.167626 18381 raft_consensus.cc:2468] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 26.
I20260709 13:20:51.169422 18276 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:51.168145 26815 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:51.171427 26828 raft_consensus.cc:2804] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:20:51.172456 26828 raft_consensus.cc:697] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 26 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:51.174441 26885 ts_tablet_manager.cc:933] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838: Initiating tablet copy from peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:51.173951 26828 consensus_queue.cc:237] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:51.181830 26816 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.182339 26816 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:51.187525 26816 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:51.190740 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:51.195528 18381 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 21.
I20260709 13:20:51.196802 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:51.197849 26815 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:20:51.199360 26815 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.199770 26815 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:51.233209 18277 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:51.240839 18121 catalog_manager.cc:4755] TS b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 35ee2a6512e24d10af3526398de71490: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:51.257022 26807 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.257601 26807 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:51.263134 18277 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:51.255509 26815 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:51.271699 18277 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:51.276559 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c7dd453327840c0811097f0c2b4c75b" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:51.277153 18381 raft_consensus.cc:3060] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:20:51.283766 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:51.284837 18381 raft_consensus.cc:2468] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 22.
I20260709 13:20:51.285297 26815 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:51.266527 26807 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:51.294715 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79" is_pre_election: true
I20260709 13:20:51.295310 18303 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 27.
I20260709 13:20:51.269111 18132 catalog_manager.cc:5697] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 24 to 26, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 26 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.302692 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:51.305303 26803 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:20:51.305399 18276 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:51.305877 26803 raft_consensus.cc:493] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.306299 26803 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:51.306357 26815 raft_consensus.cc:2804] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:20:51.307199 26815 raft_consensus.cc:697] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:51.308013 26815 consensus_queue.cc:237] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:20:51.313566 18351 leader_election.cc:336] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:51.316704 26885 tablet_copy_client.cc:323] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838: tablet copy: Beginning tablet copy session from remote peer at address 127.16.188.130:34605
W20260709 13:20:51.320024 18277 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:51.321157 18322 tablet_copy_service.cc:140] P 459e82ee6b564cc19be6f73186938e79: Received BeginTabletCopySession request for tablet 23abbfc724a94243a40588649dd76b4f from peer e016302b7e734d74833a2bf7bab44838 ({username='slave'} at 127.0.0.1:46642)
I20260709 13:20:51.321808 18322 tablet_copy_service.cc:161] P 459e82ee6b564cc19be6f73186938e79: Beginning new tablet copy session on tablet 23abbfc724a94243a40588649dd76b4f from peer e016302b7e734d74833a2bf7bab44838 at {username='slave'} at 127.0.0.1:46642: session id = e016302b7e734d74833a2bf7bab44838-23abbfc724a94243a40588649dd76b4f
I20260709 13:20:51.342650 18132 catalog_manager.cc:5697] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 20 to 22, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 22 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.349354 18322 tablet_copy_source_session.cc:215] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:51.353467 26803 raft_consensus.cc:515] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:51.364209 26885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23abbfc724a94243a40588649dd76b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:51.382601 26803 leader_election.cc:290] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:51.400405 18303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c230199b226a4b03b63c04fd79847b50" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "459e82ee6b564cc19be6f73186938e79"
I20260709 13:20:51.401049 18303 raft_consensus.cc:3060] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:20:51.404395 18351 leader_election.cc:336] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:51.409433 18303 raft_consensus.cc:2468] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 28.
I20260709 13:20:51.421617 18351 leader_election.cc:304] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: b52e2477fc524694967c4a16afa983e3
I20260709 13:20:51.424305 26803 raft_consensus.cc:2804] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:20:51.424862 26803 raft_consensus.cc:697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:51.425737 26803 consensus_queue.cc:237] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:51.443926 26885 tablet_copy_client.cc:806] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 0 data blocks...
W20260709 13:20:51.449198 18927 consensus_peers.cc:597] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:51.446038 26885 tablet_copy_client.cc:670] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:51.463201 26885 tablet_copy_client.cc:538] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:51.466909 18132 catalog_manager.cc:5697] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 26 to 28, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 28 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:51.476302 26815 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.476956 26815 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:51.479228 26815 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:51.480325 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:51.481087 18381 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 28.
I20260709 13:20:51.482419 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:51.483464 26815 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:20:51.484090 26815 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.484733 26815 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:20:51.487416 18277 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:51.492781 26815 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:51.505072 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49caac43d924696b2d3a9cc660f2c48" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:51.505662 18381 raft_consensus.cc:3060] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:20:51.512562 18381 raft_consensus.cc:2468] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 29.
I20260709 13:20:51.513854 18276 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
W20260709 13:20:51.514539 18277 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:51.514920 26828 raft_consensus.cc:2804] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 29 FOLLOWER]: Leader election won for term 29
W20260709 13:20:51.521015 18927 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:51.524168 26828 raft_consensus.cc:697] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 29 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:51.524346 26885 tablet_bootstrap.cc:492] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838: Bootstrap starting.
I20260709 13:20:51.534161 26828 consensus_queue.cc:237] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:51.548641 26815 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 29 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:20:51.577268 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:51.579025 18132 catalog_manager.cc:5697] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 27 to 29, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 29 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:51.600449 18351 consensus_peers.cc:597] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:51.606508 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:51.612639 26816 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.613323 26816 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:51.616608 26816 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:51.616824 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:51.617568 18383 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 27.
I20260709 13:20:51.619731 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:51.620852 26815 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:20:51.623034 26815 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.623467 26815 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:20:51.633303 18277 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:51.632650 26815 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:51.656023 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ce294aa3d9426291ec809884e80749" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:51.656670 18381 raft_consensus.cc:3060] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:20:51.664314 18381 raft_consensus.cc:2468] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 28.
I20260709 13:20:51.665684 18276 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:51.666534 26816 raft_consensus.cc:2804] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:20:51.667016 26816 raft_consensus.cc:697] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 28 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:51.667894 26816 consensus_queue.cc:237] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:51.673740 26815 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:51.692399 18132 catalog_manager.cc:5697] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 26 to 28, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 28 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:51.707201 18351 consensus_peers.cc:597] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:51.719235 18277 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:51.722115 18351 consensus_peers.cc:597] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:51.727672 18381 raft_consensus.cc:1275] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:20:51.730835 26815 consensus_queue.cc:1048] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:20:51.788993 18277 consensus_peers.cc:597] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:51.841079 18277 consensus_peers.cc:597] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:51.853639 26885 tablet_bootstrap.cc:492] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:51.854774 26885 tablet_bootstrap.cc:492] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838: Bootstrap complete.
I20260709 13:20:51.855726 26885 ts_tablet_manager.cc:1403] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838: Time spent bootstrapping tablet: real 0.332s	user 0.068s	sys 0.020s
I20260709 13:20:51.862035 26885 raft_consensus.cc:359] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:51.886499 26885 raft_consensus.cc:740] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Initialized, Role: LEARNER
I20260709 13:20:51.887176 26885 consensus_queue.cc:260] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: NON_VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: true } }
I20260709 13:20:51.889659 26885 ts_tablet_manager.cc:1434] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838: Time spent starting tablet: real 0.034s	user 0.001s	sys 0.005s
I20260709 13:20:51.894732 18322 tablet_copy_service.cc:342] P 459e82ee6b564cc19be6f73186938e79: Request end of tablet copy session e016302b7e734d74833a2bf7bab44838-23abbfc724a94243a40588649dd76b4f received from {username='slave'} at 127.0.0.1:46642
I20260709 13:20:51.895172 18310 raft_consensus.cc:1275] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:20:51.895327 18322 tablet_copy_service.cc:434] P 459e82ee6b564cc19be6f73186938e79: ending tablet copy session e016302b7e734d74833a2bf7bab44838-23abbfc724a94243a40588649dd76b4f on tablet 23abbfc724a94243a40588649dd76b4f with peer e016302b7e734d74833a2bf7bab44838
I20260709 13:20:51.898964 26807 consensus_queue.cc:1048] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:20:51.903716 18927 consensus_peers.cc:597] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:51.950912 18277 consensus_peers.cc:597] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:51.983997 18381 raft_consensus.cc:1275] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:20:52.018911 17138 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 18258)
W20260709 13:20:52.021368 18351 consensus_peers.cc:597] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:52.021916 18351 consensus_peers.cc:597] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:52.023429 26819 consensus_queue.cc:1048] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:52.081979 18381 raft_consensus.cc:1275] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 13:20:52.084606 26819 consensus_queue.cc:1048] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:20:52.108671 18277 consensus_peers.cc:597] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:52.114857 18927 consensus_peers.cc:597] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:52.129071 18124 maintenance_manager.cc:419] P dc71a90b0e6d42fc8a6b135fbfbac453: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033355
I20260709 13:20:52.187559 18958 raft_consensus.cc:1217] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.15->[23.16-23.16]   Dedup: 23.16->[]
W20260709 13:20:52.203362 18277 consensus_peers.cc:597] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:52.212695 26832 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.213280 26832 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:52.215512 26832 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:52.217227 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:52.218000 18383 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 24.
I20260709 13:20:52.219274 18276 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:52.221099 26816 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:20:52.221499 26816 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.221853 26816 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:52.233641 26816 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:52.247852 18383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18591c0ed248258c1fcafa9811f7c4" candidate_uuid: "459e82ee6b564cc19be6f73186938e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:52.248410 18383 raft_consensus.cc:3060] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:20:52.258461 18383 raft_consensus.cc:2468] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459e82ee6b564cc19be6f73186938e79 in term 25.
I20260709 13:20:52.259589 18276 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 
I20260709 13:20:52.260478 26815 raft_consensus.cc:2804] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:20:52.261029 18927 consensus_peers.cc:597] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:52.237334 18277 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:52.261021 26815 raft_consensus.cc:697] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 25 LEADER]: Becoming Leader. State: Replica: 459e82ee6b564cc19be6f73186938e79, State: Running, Role: LEADER
I20260709 13:20:52.262319 26815 consensus_queue.cc:237] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:52.268376 26816 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: Requested vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:52.283396 18132 catalog_manager.cc:5697] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 reported cstate change: term changed from 23 to 25, leader changed from b52e2477fc524694967c4a16afa983e3 (127.16.188.129) to 459e82ee6b564cc19be6f73186938e79 (127.16.188.130). New cstate: current_term: 25 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:52.289201 18277 consensus_peers.cc:597] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:52.291460 18383 raft_consensus.cc:1275] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
W20260709 13:20:52.296869 18277 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:52.307480 26832 consensus_queue.cc:1048] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:52.319857 18123 maintenance_manager.cc:643] P dc71a90b0e6d42fc8a6b135fbfbac453: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.190s	user 0.047s	sys 0.008s Metrics: {"bytes_written":9926,"delete_count":0,"lbm_write_time_us":20250,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":6,"reinsert_count":0,"update_count":408}
W20260709 13:20:52.332137 18351 consensus_peers.cc:597] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:52.333405 18277 consensus_peers.cc:597] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:52.342566 18124 maintenance_manager.cc:419] P dc71a90b0e6d42fc8a6b135fbfbac453: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.429660
W20260709 13:20:52.390271 18277 consensus_peers.cc:597] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:52.452066 18927 consensus_peers.cc:597] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:52.506768 18351 consensus_peers.cc:597] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:52.526285 18277 consensus_peers.cc:597] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:52.539275 18351 consensus_peers.cc:597] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:52.572175 18277 consensus_peers.cc:597] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:52.576407 18277 consensus_peers.cc:597] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.620769 18351 consensus_peers.cc:597] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.633716 18277 consensus_peers.cc:597] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.656134 18277 consensus_peers.cc:597] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:52.730458 26815 raft_consensus.cc:1064] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79: attempting to promote NON_VOTER e016302b7e734d74833a2bf7bab44838 to VOTER
I20260709 13:20:52.733131 26815 consensus_queue.cc:237] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 14, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:52.799842 18383 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:20:52.802596 18277 consensus_peers.cc:597] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:52.802757 26815 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:52.813879 18383 raft_consensus.cc:1275] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:20:52.815514 26816 consensus_queue.cc:1048] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:20:52.818243 18277 consensus_peers.cc:597] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.818760 18277 consensus_peers.cc:597] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:52.845295 18958 raft_consensus.cc:1275] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 LEARNER]: Refusing update from remote peer 459e82ee6b564cc19be6f73186938e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:20:52.847100 18277 consensus_peers.cc:597] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:52.853971 26832 consensus_queue.cc:1048] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:20:52.868801 18123 maintenance_manager.cc:643] P dc71a90b0e6d42fc8a6b135fbfbac453: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.525s	user 0.116s	sys 0.035s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":30470,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":23452,"dirs.run_cpu_time_us":506,"dirs.run_wall_time_us":2092,"lbm_read_time_us":2318,"lbm_reads_lt_1ms":25,"lbm_write_time_us":2121,"lbm_writes_lt_1ms":13,"peak_mem_usage":612888,"reinsert_count":0,"thread_start_us":53879,"threads_started":2,"update_count":408}
W20260709 13:20:52.880007 18277 consensus_peers.cc:597] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:52.902215 26816 raft_consensus.cc:2955] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index 16 to 17, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:52.909682 18958 raft_consensus.cc:2955] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:20:52.933106 18277 consensus_peers.cc:597] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:52.934000 18383 raft_consensus.cc:2955] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
I20260709 13:20:52.953418 18133 catalog_manager.cc:5697] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 reported cstate change: config changed from index 16 to 17, e016302b7e734d74833a2bf7bab44838 (127.16.188.132) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "459e82ee6b564cc19be6f73186938e79" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } } }
W20260709 13:20:52.946033 18351 consensus_peers.cc:597] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.992369 18277 consensus_peers.cc:597] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.999658 18351 consensus_peers.cc:597] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:53.019665 17138 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 18258)
W20260709 13:20:53.037490 18277 consensus_peers.cc:597] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:53.137768 18277 consensus_peers.cc:597] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:53.167783 18277 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111) [suppressed 476 similar messages]
W20260709 13:20:53.260280 18351 consensus_peers.cc:597] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:53.351153 18277 consensus_peers.cc:597] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:53.389750 18351 consensus_peers.cc:597] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:53.430929 18121 catalog_manager.cc:4755] TS b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 35ee2a6512e24d10af3526398de71490: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:53.462139 18277 consensus_peers.cc:597] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:53.475365 18277 consensus_peers.cc:597] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:53.579582 18351 consensus_peers.cc:597] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:53.617074 18351 consensus_peers.cc:597] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:53.729910 18351 consensus_peers.cc:597] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:53.815837 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.020224 17138 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 18258)
W20260709 13:20:54.096608 18927 consensus_peers.cc:597] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.099821 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.174407 18927 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:54.196846 18351 consensus_peers.cc:597] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:54.246704 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.351984 18927 consensus_peers.cc:597] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.391783 18351 consensus_peers.cc:597] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.392684 18351 consensus_peers.cc:597] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.462651 18351 consensus_peers.cc:597] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.523022 18351 consensus_peers.cc:597] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:54.525601 18927 consensus_peers.cc:597] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.782716 18927 consensus_peers.cc:597] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.876930 18351 consensus_peers.cc:597] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:55.054314 18927 consensus_peers.cc:597] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:55.071650 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 200555us
W20260709 13:20:55.103963 18277 consensus_peers.cc:597] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:55.109272 18277 consensus_peers.cc:597] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:55.192458 18277 consensus_peers.cc:597] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:55.195288 18277 consensus_peers.cc:597] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:55.235497 18351 consensus_peers.cc:597] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:55.243474 18351 consensus_peers.cc:597] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:55.247138 18277 consensus_peers.cc:597] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:55.270373 18351 consensus_peers.cc:597] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:55.274829 18277 consensus_peers.cc:597] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:55.403160 18351 consensus_peers.cc:597] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:55.452353 18277 consensus_peers.cc:597] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:55.624596 18351 consensus_peers.cc:597] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:55.646891 18277 consensus_peers.cc:597] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:55.864287 18277 consensus_peers.cc:597] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:55.876317 18277 consensus_peers.cc:597] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:55.877544 18277 consensus_peers.cc:597] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:55.893316 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 45687.3us
W20260709 13:20:55.919449 18277 consensus_peers.cc:597] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:55.967578 18277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 48181.8us
W20260709 13:20:55.976063 18277 consensus_peers.cc:597] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:55.990242 18351 consensus_peers.cc:597] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.099112 18277 consensus_peers.cc:597] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.144564 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:56.151180 18983 debug-util.cc:398] Leaking SignalData structure 0x7b0800340b20 after lost signal to thread 17141
W20260709 13:20:56.152953 18983 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0760 after lost signal to thread 18169
W20260709 13:20:56.155019 18983 debug-util.cc:398] Leaking SignalData structure 0x7b0800322620 after lost signal to thread 18336
W20260709 13:20:56.156504 18983 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2000 after lost signal to thread 18410
W20260709 13:20:56.158869 18983 debug-util.cc:398] Leaking SignalData structure 0x7b08003ee360 after lost signal to thread 18986
W20260709 13:20:56.199281 18351 consensus_peers.cc:597] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.201975 18277 consensus_peers.cc:597] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:56.205825 18277 consensus_peers.cc:597] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.233392 18277 consensus_peers.cc:597] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.242087 18351 consensus_peers.cc:597] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:56.257449 18351 consensus_peers.cc:597] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.262766 18277 consensus_peers.cc:597] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:56.263447 18277 consensus_peers.cc:597] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.271363 18277 consensus_peers.cc:597] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:56.274948 18277 consensus_peers.cc:597] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:56.319207 18277 consensus_peers.cc:597] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.349130 18351 consensus_peers.cc:597] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:56.566291 18277 consensus_peers.cc:597] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.595383 18277 consensus_peers.cc:597] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.671085 18927 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:56.695151 18927 consensus_peers.cc:597] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:56.722599 18927 consensus_peers.cc:597] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:56.798343 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:56.873430 18351 consensus_peers.cc:597] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:56.924265 18351 consensus_peers.cc:597] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:57.022156 18277 consensus_peers.cc:597] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:57.049753 17138 tablet_server.cc:196] TabletServer@127.16.188.129:0 shutdown complete.
W20260709 13:20:57.078565 18351 consensus_peers.cc:597] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.096457 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:57.141296 18351 consensus_peers.cc:597] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:57.181865 18351 consensus_peers.cc:597] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:57.201407 18927 consensus_peers.cc:597] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:57.277451 18927 consensus_peers.cc:597] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:57.424067 18277 consensus_peers.cc:597] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.424732 18277 consensus_peers.cc:597] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.477330 18351 consensus_peers.cc:597] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:57.582504 18927 consensus_peers.cc:597] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:57.611946 18277 consensus_peers.cc:597] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:57.629182 18351 consensus_peers.cc:597] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:57.636111 17138 tablet_server.cc:179] TabletServer@127.16.188.130:0 shutting down...
W20260709 13:20:57.651412 18121 catalog_manager.cc:4755] TS b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 35ee2a6512e24d10af3526398de71490: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:57.652837 18351 consensus_peers.cc:597] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.689129 18927 consensus_peers.cc:597] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.706218 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.713201 18351 consensus_peers.cc:597] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.756246 18277 consensus_peers.cc:597] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:57.765666 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.775195 18277 consensus_peers.cc:597] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:57.779299 18351 consensus_peers.cc:597] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.780015 18351 consensus_peers.cc:597] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.780681 18351 consensus_peers.cc:597] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.788599 18351 consensus_peers.cc:597] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.789350 18351 consensus_peers.cc:597] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.805892 18927 consensus_peers.cc:597] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.820993 18927 consensus_peers.cc:597] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.824168 18351 consensus_peers.cc:597] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.839702 18351 consensus_peers.cc:597] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:57.865185 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:57.874037 17138 tablet_replica.cc:333] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:57.875299 17138 raft_consensus.cc:2243] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:20:57.878644 17138 raft_consensus.cc:2272] T 6c5058a8396d4e77a38f85a04e24eae7 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:57.880892 18351 consensus_peers.cc:597] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.893059 18351 consensus_peers.cc:597] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:57.893887 18351 consensus_peers.cc:597] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.908975 18351 consensus_peers.cc:597] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.914647 18277 consensus_peers.cc:597] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:57.916630 17138 tablet_replica.cc:333] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:57.917840 17138 raft_consensus.cc:2243] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:20:57.919327 17138 raft_consensus.cc:2272] T 4c7dd453327840c0811097f0c2b4c75b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:57.927842 17138 tablet_replica.cc:333] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:57.928622 17138 raft_consensus.cc:2243] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:57.929525 17138 raft_consensus.cc:2272] T 49c6a2a19b90491f9336362305339eca P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:57.932946 17138 tablet_replica.cc:333] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:57.934633 17138 raft_consensus.cc:2243] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:57.935341 17138 raft_consensus.cc:2272] T efd953e96dc54f10a635581a413244e2 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:57.938628 17138 tablet_replica.cc:333] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:57.939613 17138 raft_consensus.cc:2243] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:20:57.941017 17138 raft_consensus.cc:2272] T 0d2ac0cb46434c19a6e4f18836703096 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:57.944281 17138 tablet_replica.cc:333] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:57.945320 17138 raft_consensus.cc:2243] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:57.946770 17138 raft_consensus.cc:2272] T c230199b226a4b03b63c04fd79847b50 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:57.952703 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:57.958437 17138 tablet_replica.cc:333] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:57.959960 17138 raft_consensus.cc:2243] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:57.961153 17138 raft_consensus.cc:2272] T 7e1dd423d7184b408a5257ea471f540d P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:57.967547 18351 consensus_peers.cc:597] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:57.970286 17138 tablet_replica.cc:333] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
W20260709 13:20:57.971146 18277 consensus_peers.cc:597] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:57.971542 17138 raft_consensus.cc:2243] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:20:57.974133 17138 raft_consensus.cc:2272] T d49caac43d924696b2d3a9cc660f2c48 P 459e82ee6b564cc19be6f73186938e79 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:57.977365 17138 tablet_replica.cc:333] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:57.981689 17138 raft_consensus.cc:2243] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:57.982517 17138 raft_consensus.cc:2272] T cbd66a28ecbc4386b9e1489688542ca9 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:57.997216 18351 consensus_peers.cc:597] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.006522 18351 consensus_peers.cc:597] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:58.014424 17138 tablet_replica.cc:333] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.022436 17138 raft_consensus.cc:2243] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.027590 17138 raft_consensus.cc:2272] T 715a2657f09449038e569acddbab1aea P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.033910 17138 tablet_replica.cc:333] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.041356 17138 raft_consensus.cc:2243] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.042275 17138 raft_consensus.cc:2272] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.047995 17138 tablet_replica.cc:333] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
W20260709 13:20:58.049163 18277 consensus_peers.cc:597] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:58.059481 17138 raft_consensus.cc:2243] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.060935 17138 raft_consensus.cc:2272] T 23eb586495714fcf90b0b81c5ec4cc2f P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.065155 17138 tablet_replica.cc:333] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
W20260709 13:20:58.065363 18351 consensus_peers.cc:597] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.066143 17138 raft_consensus.cc:2243] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:20:58.072233 18277 consensus_peers.cc:597] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:20:58.074611 17138 raft_consensus.cc:2272] T 3611564ea3974f58a23e3fea4f39c5c7 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.088811 17138 tablet_replica.cc:333] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
W20260709 13:20:58.090435 18351 consensus_peers.cc:597] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:58.091184 18277 consensus_peers.cc:597] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:20:58.091391 17138 raft_consensus.cc:2243] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.092836 17138 raft_consensus.cc:2272] T 87ce294aa3d9426291ec809884e80749 P 459e82ee6b564cc19be6f73186938e79 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.097954 17138 tablet_replica.cc:333] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
W20260709 13:20:58.103392 18927 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.105006 17138 raft_consensus.cc:2243] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.112180 17138 raft_consensus.cc:2272] T 647155b6479b4f689aca5b6c1efcc633 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.116407 17138 tablet_replica.cc:333] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.117501 17138 raft_consensus.cc:2243] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.118283 17138 raft_consensus.cc:2272] T fac262d04a1a4d94aec44b2679caee9d P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.136754 17138 tablet_replica.cc:333] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.138047 17138 raft_consensus.cc:2243] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.139492 17138 raft_consensus.cc:2272] T 39dd19f13a42412b9dda536e24c324b1 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.142793 17138 tablet_replica.cc:333] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.143694 17138 raft_consensus.cc:2243] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.144917 17138 raft_consensus.cc:2272] T 4300927be0384401aa46050bd5996d2f P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.147780 17138 tablet_replica.cc:333] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.161410 17138 raft_consensus.cc:2243] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.162936 17138 raft_consensus.cc:2272] T fd151355294e450f85a51ac658d4a465 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.166306 17138 tablet_replica.cc:333] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.167207 17138 raft_consensus.cc:2243] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.168882 17138 raft_consensus.cc:2272] T b6e6be0c25704f45b1b4f3c4f246fa02 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:58.168931 18351 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111) [suppressed 481 similar messages]
I20260709 13:20:58.172190 17138 tablet_replica.cc:333] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.185361 17138 raft_consensus.cc:2243] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.186278 17138 raft_consensus.cc:2272] T fdde66e5e9e64c508bb1a79d0f5754bd P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.189512 17138 tablet_replica.cc:333] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.190362 17138 raft_consensus.cc:2243] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.190958 17138 raft_consensus.cc:2272] T 1dea3366ee674017a0bbfc9bce0d9a73 P 459e82ee6b564cc19be6f73186938e79 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:58.200091 18351 consensus_peers.cc:597] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.202688 18351 consensus_peers.cc:597] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.214752 17138 tablet_replica.cc:333] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.216012 17138 raft_consensus.cc:2243] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.217484 17138 raft_consensus.cc:2272] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.220487 17138 tablet_replica.cc:333] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.225190 17138 raft_consensus.cc:2243] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.226013 17138 raft_consensus.cc:2272] T 20a11d8d7fb14609b0bb479587b23e37 P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.229269 17138 tablet_replica.cc:333] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.233901 17138 raft_consensus.cc:2243] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.246809 17138 raft_consensus.cc:2272] T d88cda52389848d584c846a8597f4977 P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.266835 17138 tablet_replica.cc:333] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.267843 17138 raft_consensus.cc:2243] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.268793 17138 raft_consensus.cc:2272] T 9dd00413a3134a12a08e72e7925f6473 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.286885 17138 tablet_replica.cc:333] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.287849 17138 raft_consensus.cc:2243] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.289494 17138 raft_consensus.cc:2272] T 3c074d20c77e423597f342d5ed4ccc6d P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.297654 17138 tablet_replica.cc:333] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.298518 17138 raft_consensus.cc:2243] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.299158 17138 raft_consensus.cc:2272] T 96c6309e774a4e15bd33a0a93d1a7f2e P 459e82ee6b564cc19be6f73186938e79 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:58.308393 18351 consensus_peers.cc:597] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.340644 17138 tablet_replica.cc:333] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.341559 17138 raft_consensus.cc:2243] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.342892 17138 raft_consensus.cc:2272] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 459e82ee6b564cc19be6f73186938e79 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.345956 17138 tablet_replica.cc:333] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.346823 17138 raft_consensus.cc:2243] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.348055 17138 raft_consensus.cc:2272] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.350816 17138 tablet_replica.cc:333] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.351560 17138 raft_consensus.cc:2243] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.354508 17138 raft_consensus.cc:2272] T e5a31bcfc315403994b8ecac224542b5 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.359334 17138 tablet_replica.cc:333] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.372081 17138 raft_consensus.cc:2243] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.404333 17138 raft_consensus.cc:2272] T b1889d6d746545a0bdf04811a102b35b P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.407675 17138 tablet_replica.cc:333] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.408943 17138 raft_consensus.cc:2243] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.410552 17138 raft_consensus.cc:2272] T 83392764a50d4598aedbe4d1cc557dad P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.418340 17138 tablet_replica.cc:333] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.423763 17138 raft_consensus.cc:2243] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.430730 17138 raft_consensus.cc:2272] T 943649b738074d87a593c237cf998758 P 459e82ee6b564cc19be6f73186938e79 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.439350 17138 tablet_replica.cc:333] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.449273 17138 raft_consensus.cc:2243] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.450569 17138 raft_consensus.cc:2272] T 2682a7690fb640b1a9ad52d5fa19e281 P 459e82ee6b564cc19be6f73186938e79 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:58.451913 18277 consensus_peers.cc:597] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:58.463022 17138 tablet_replica.cc:333] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
W20260709 13:20:58.463462 18351 consensus_peers.cc:597] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:58.464146 17138 raft_consensus.cc:2243] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.465561 17138 raft_consensus.cc:2272] T 23d48585586a4bb3bc800da7f54e12f0 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.468840 17138 tablet_replica.cc:333] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.469859 17138 raft_consensus.cc:2243] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.471208 17138 raft_consensus.cc:2272] T ed649e8e79144f338d9c590603fa0b7c P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.474527 17138 tablet_replica.cc:333] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.475486 17138 raft_consensus.cc:2243] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.477592 17138 raft_consensus.cc:2272] T 23abbfc724a94243a40588649dd76b4f P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.480549 17138 tablet_replica.cc:333] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.481412 17138 raft_consensus.cc:2243] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.482874 17138 raft_consensus.cc:2272] T ef83aa6f9534403ebe38156348430345 P 459e82ee6b564cc19be6f73186938e79 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.486979 17138 tablet_replica.cc:333] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.487993 17138 raft_consensus.cc:2243] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.489974 17138 raft_consensus.cc:2272] T dd45943dc64b4e86b54ae5c263345e6e P 459e82ee6b564cc19be6f73186938e79 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.495785 17138 tablet_replica.cc:333] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.496659 17138 raft_consensus.cc:2243] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.498751 17138 raft_consensus.cc:2272] T 9db2383f92d34ec9ab6bed764ba818f4 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.501746 17138 tablet_replica.cc:333] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.502555 17138 raft_consensus.cc:2243] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.503185 17138 raft_consensus.cc:2272] T d6d3055da6db47abb16a433d66a5c79e P 459e82ee6b564cc19be6f73186938e79 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.510778 17138 tablet_replica.cc:333] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.511616 17138 raft_consensus.cc:2243] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.513015 17138 raft_consensus.cc:2272] T 7a18591c0ed248258c1fcafa9811f7c4 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.520918 17138 tablet_replica.cc:333] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.521883 17138 raft_consensus.cc:2243] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:20:58.523661 17138 raft_consensus.cc:2272] T 7db17400d59a40a786f346aefbfbcbb0 P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.540942 17138 tablet_replica.cc:333] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.548430 17138 raft_consensus.cc:2243] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.549153 17138 raft_consensus.cc:2272] T d03313400e274f83883c84395905b4cd P 459e82ee6b564cc19be6f73186938e79 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:58.556907 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:20:58.562839 17138 tablet_replica.cc:333] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.563716 17138 raft_consensus.cc:2243] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.564378 17138 raft_consensus.cc:2272] T d094a2c1f67e4ab7bc263e71d49ced86 P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.575312 17138 tablet_replica.cc:333] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.576081 17138 raft_consensus.cc:2243] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.577611 17138 raft_consensus.cc:2272] T 80d0760748294d8d8cb291466766b8a5 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.597790 17138 tablet_replica.cc:333] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.598616 17138 raft_consensus.cc:2243] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:20:58.616755 18351 consensus_peers.cc:597] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:58.611989 17138 raft_consensus.cc:2272] T 2cbade5381d641e9b60bcc9994ae9b51 P 459e82ee6b564cc19be6f73186938e79 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.623178 17138 tablet_replica.cc:333] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.626822 17138 raft_consensus.cc:2243] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:20:58.631534 18351 consensus_peers.cc:597] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:58.633610 17138 raft_consensus.cc:2272] T 069a152975ce431fb5fd1abe7e07178e P 459e82ee6b564cc19be6f73186938e79 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.638384 17138 tablet_replica.cc:333] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.652793 17138 raft_consensus.cc:2243] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.656708 17138 raft_consensus.cc:2272] T e0d4b879cb5a45d0ab3dc5401e957620 P 459e82ee6b564cc19be6f73186938e79 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.659812 17138 tablet_replica.cc:333] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.667976 17138 raft_consensus.cc:2243] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.669515 17138 raft_consensus.cc:2272] T 35ee2a6512e24d10af3526398de71490 P 459e82ee6b564cc19be6f73186938e79 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:58.672883 17138 tablet_replica.cc:333] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79: stopping tablet replica
I20260709 13:20:58.676147 17138 raft_consensus.cc:2243] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:58.678507 17138 raft_consensus.cc:2272] T eafcec4c722f49fa90d23d1326870a82 P 459e82ee6b564cc19be6f73186938e79 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:58.780530 18351 consensus_peers.cc:597] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:58.823297 18351 consensus_peers.cc:597] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:58.928956 18351 consensus_peers.cc:597] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:58.944756 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:58.965553 18927 consensus_peers.cc:597] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:20:59.017616 26941 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.018360 26941 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.021066 26941 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:59.048720 18351 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:59.050184 18351 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.054014 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.054863 26941 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:20:59.088234 26941 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.088788 26941 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.090751 26941 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:59.113335 18351 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:20:59.115473 18351 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:59.115958 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.121809 26941 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:20:59.136498 26941 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.137154 26941 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.139386 26941 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:59.158435 18351 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:59.159585 18351 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.166303 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.177117 26941 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:59.184580 26941 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.185139 26941 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.187286 26941 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:59.207870 18351 leader_election.cc:336] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:20:59.212630 18351 leader_election.cc:336] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:59.215241 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.225131 26941 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:20:59.229285 26838 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.229857 26838 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:59.231822 26838 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:59.237854 26941 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.238417 26941 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.240378 26941 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:59.258240 18351 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:20:59.266245 18927 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:20:59.264806 18351 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:59.270771 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.271811 26941 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:59.279515 18927 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:59.280128 18927 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.280995 26838 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:59.303246 26899 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.303759 26899 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.305757 26899 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:59.311437 26941 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.311930 26941 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.314100 26941 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:59.321106 26941 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.321694 26941 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.324098 26941 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:59.326517 18351 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:59.337396 26838 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.338052 26838 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:59.340102 26838 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:59.351248 18927 leader_election.cc:336] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:59.351969 18927 leader_election.cc:336] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.352396 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.353379 26946 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:59.355000 18351 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.355669 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.356599 26941 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:20:59.362321 26941 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.362799 26941 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.364765 26941 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:59.367323 18927 consensus_peers.cc:597] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:59.379377 18351 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:20:59.380359 18351 leader_election.cc:336] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:20:59.384272 18351 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:59.390513 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.391541 26941 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:20:59.391939 18351 leader_election.cc:336] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:59.392620 26941 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.393281 26941 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.395426 26941 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:59.392583 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.399767 26941 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:20:59.404636 26838 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.404831 26941 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.405259 26838 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:59.405594 26941 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.407498 26838 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:59.408126 26941 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:59.409123 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
W20260709 13:20:59.411664 18351 leader_election.cc:336] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:59.413209 18351 leader_election.cc:336] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:20:59.417264 18927 leader_election.cc:336] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.417507 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.418666 26941 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:20:59.417805 18927 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:20:59.425945 26838 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:59.427908 18351 leader_election.cc:336] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:59.436946 18351 leader_election.cc:336] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.437604 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.438825 26941 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:20:59.447165 18351 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:59.451097 18351 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.451767 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.452682 26941 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.455009 26941 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.457540 26941 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:59.458755 26941 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:20:59.473940 18351 consensus_peers.cc:597] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:59.476758 18351 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:59.479519 18351 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.484249 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.485351 26941 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:20:59.492041 18351 consensus_peers.cc:597] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:59.519169 18351 consensus_peers.cc:597] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:59.533574 18927 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:59.550683 26899 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.556080 26941 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.551383 26899 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:59.561355 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:59.556668 26941 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.566259 26941 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:59.566881 26941 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.567444 26941 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.576772 26899 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:59.581337 26941 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:59.594240 18351 leader_election.cc:336] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.595243 18351 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, e016302b7e734d74833a2bf7bab44838
I20260709 13:20:59.596092 26941 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.597062 26941 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.599776 26941 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:59.600538 26941 raft_consensus.cc:2749] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:20:59.601419 18351 leader_election.cc:336] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:20:59.603402 18351 leader_election.cc:336] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:59.611398 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.612691 26954 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:59.623347 18351 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:20:59.624447 18351 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:59.628695 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.635607 26941 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:20:59.647459 18351 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:20:59.648362 18351 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:59.648904 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.652011 26941 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:20:59.659808 26838 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.660607 26838 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:59.664136 26838 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:59.666988 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:59.667699 18379 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 23.
W20260709 13:20:59.674714 18927 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:59.675469 18927 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.675841 18927 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.676766 26838 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:20:59.688421 18351 consensus_peers.cc:597] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:20:59.690482 26941 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.691082 26941 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.693608 26941 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:59.711452 18351 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:59.712990 26941 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.713708 26941 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.716374 26941 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:59.720141 18351 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.732770 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.733924 26941 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:20:59.735373 26838 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.735997 26838 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:59.738508 26838 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:59.740275 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:20:59.741058 18379 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 26.
I20260709 13:20:59.742360 18926 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:59.747134 26838 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:20:59.747509 26838 raft_consensus.cc:493] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.747836 26838 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:20:59.750358 18927 leader_election.cc:336] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:20:59.751140 18351 leader_election.cc:336] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:59.763273 18351 leader_election.cc:336] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.763933 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.765277 26954 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:20:59.767745 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:20:59.770850 26838 raft_consensus.cc:515] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:59.777204 18927 leader_election.cc:336] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.790838 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2682a7690fb640b1a9ad52d5fa19e281" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d"
I20260709 13:20:59.791458 18379 raft_consensus.cc:3060] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:20:59.800665 18379 raft_consensus.cc:2468] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 27.
I20260709 13:20:59.802230 18926 leader_election.cc:304] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:59.800544 26946 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.803548 26946 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:59.806277 26946 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
I20260709 13:20:59.806938 26946 raft_consensus.cc:2804] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:20:59.807525 26946 raft_consensus.cc:697] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 27 LEADER]: Becoming Leader. State: Replica: e016302b7e734d74833a2bf7bab44838, State: Running, Role: LEADER
I20260709 13:20:59.811015 26838 leader_election.cc:290] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 27 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:20:59.812115 26946 consensus_queue.cc:237] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:59.842713 18927 consensus_peers.cc:597] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:59.843231 18927 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:59.848475 18927 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.848934 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.850522 26956 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:20:59.856787 18134 catalog_manager.cc:5697] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 reported cstate change: term changed from 26 to 27, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to e016302b7e734d74833a2bf7bab44838 (127.16.188.132). New cstate: current_term: 27 leader_uuid: "e016302b7e734d74833a2bf7bab44838" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:59.858377 26941 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.862028 26941 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.865125 26941 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:59.891593 26941 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.892457 26941 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:59.896555 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:20:59.897329 18956 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 13.
I20260709 13:20:59.899209 18349 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 
I20260709 13:20:59.900803 26899 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.901503 26899 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.901901 26954 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:59.902534 26954 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.902997 26954 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:59.903633 26899 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:59.909796 26941 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:20:59.921999 18351 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.929538 26954 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:59.930279 18351 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:20:59.930935 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.931838 26941 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:20:59.932214 26954 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Requested vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:20:59.933938 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943649b738074d87a593c237cf998758" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838"
I20260709 13:20:59.934618 18956 raft_consensus.cc:3060] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:59.938416 26954 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.939049 26954 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:20:59.941385 26954 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:20:59.946300 18351 leader_election.cc:336] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:20:59.949399 18351 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:20:59.954084 18351 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:59.962208 17138 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 18333)
I20260709 13:20:59.970963 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.971859 26899 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:20:59.972147 18351 consensus_peers.cc:597] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:59.974087 18351 leader_election.cc:336] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:20:59.978094 18927 consensus_peers.cc:597] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:20:59.968484 18956 raft_consensus.cc:2468] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 14.
I20260709 13:20:59.980376 18349 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79
I20260709 13:20:59.981741 26941 raft_consensus.cc:2804] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:59.982313 26941 raft_consensus.cc:697] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Becoming Leader. State: Replica: 8b4fbc44aa2649f0bcac5cd70f71951d, State: Running, Role: LEADER
I20260709 13:20:59.983258 26946 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:20:59.984398 26946 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:20:59.983340 26941 consensus_queue.cc:237] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:20:59.976655 18351 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:20:59.988972 18351 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:20:59.989440 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:20:59.991158 26946 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:20:59.993199 26899 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:00.003654 18927 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:00.010692 18927 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:00.011250 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:00.012717 26946 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:00.024821 18927 consensus_peers.cc:597] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:00.030997 18130 catalog_manager.cc:5697] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d reported cstate change: term changed from 13 to 14, leader changed from 459e82ee6b564cc19be6f73186938e79 (127.16.188.130) to 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131). New cstate: current_term: 14 leader_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:00.054944 18351 consensus_peers.cc:597] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.057551 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.059798 18351 consensus_peers.cc:597] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.108459 18351 consensus_peers.cc:597] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.150763 18927 consensus_peers.cc:597] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.165343 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.180912 18351 consensus_peers.cc:597] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.215996 18351 consensus_peers.cc:597] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.217031 18351 consensus_peers.cc:597] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.226523 18351 consensus_peers.cc:597] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:00.242815 18927 consensus_peers.cc:597] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:00.244022 18351 consensus_peers.cc:597] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:00.253733 18927 consensus_peers.cc:597] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.256439 18351 consensus_peers.cc:597] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:00.265868 18351 consensus_peers.cc:597] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:00.279037 18927 consensus_peers.cc:597] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.293710 18379 raft_consensus.cc:1275] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Refusing update from remote peer e016302b7e734d74833a2bf7bab44838: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 13:21:00.295840 26955 consensus_queue.cc:1048] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 13:21:00.300926 18351 consensus_peers.cc:597] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.306552 18351 consensus_peers.cc:597] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.363116 18351 consensus_peers.cc:597] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.390897 18351 consensus_peers.cc:597] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.391606 18351 consensus_peers.cc:597] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.433547 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.443689 18351 consensus_peers.cc:597] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.478269 18351 consensus_peers.cc:597] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.549649 18927 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.559484 18351 consensus_peers.cc:597] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.564406 18351 consensus_peers.cc:597] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:00.566159 18351 consensus_peers.cc:597] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:00.574977 18956 raft_consensus.cc:1275] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Refusing update from remote peer 8b4fbc44aa2649f0bcac5cd70f71951d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:21:00.578907 26954 consensus_queue.cc:1048] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:21:00.610972 18351 consensus_peers.cc:597] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.648334 18351 consensus_peers.cc:597] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.735939 18351 consensus_peers.cc:597] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.763258 18351 consensus_peers.cc:597] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:00.852406 18351 consensus_peers.cc:597] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.892011 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:00.903169 26955 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:00.903846 26955 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:00.906256 26955 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:00.914594 18927 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:00.916545 18927 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:00.916976 18927 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:00.921327 26955 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:00.922226 26941 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:00.922781 26941 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:00.924993 26941 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:00.965143 18351 leader_election.cc:336] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:00.966390 18351 leader_election.cc:336] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:00.970911 17138 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 18333)
I20260709 13:21:00.976732 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:00.977644 26941 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:01.007786 18351 consensus_peers.cc:597] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:01.039006 26941 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.039536 26941 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:01.044324 26941 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:01.066839 18351 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:01.067898 18351 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.068341 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.068737 26941 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.069340 26941 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:01.071118 26941 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:01.077095 26954 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:01.104832 26941 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.105423 26941 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:01.107396 26941 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:01.111167 18351 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:01.113242 18351 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:01.114488 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.115269 26941 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:01.124881 18351 leader_election.cc:336] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:01.125555 18351 leader_election.cc:336] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:01.125903 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.126611 26941 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:01.157310 18351 consensus_peers.cc:597] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:01.224979 26954 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.225526 26954 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:01.227639 26954 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:01.236056 18351 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:01.236804 18351 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.237269 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.238224 26941 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:01.238950 26941 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.239385 26941 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:01.239737 26955 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.240321 26955 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:01.241556 26941 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:01.242350 26955 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:01.250504 18927 leader_election.cc:336] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:01.251178 18927 leader_election.cc:336] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.251583 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.251713 26941 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.252470 26955 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:01.251545 18351 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:01.258512 18351 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.253193 26941 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:01.258884 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.259722 26954 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:21:01.261301 26954 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.261886 26954 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:01.264134 26954 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:01.265337 26941 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:01.276599 18351 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:01.285033 26941 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
W20260709 13:21:01.288801 18351 leader_election.cc:336] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:01.288910 26941 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:21:01.289451 18351 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.289875 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.291206 26941 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:01.291770 26941 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:01.292001 18351 leader_election.cc:336] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.292469 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.293402 26941 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:01.303210 18351 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:01.303911 18351 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.304876 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.305665 26941 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:01.308337 26941 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.308831 26941 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:01.310902 26941 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:01.318612 18351 leader_election.cc:336] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:01.319386 18351 leader_election.cc:336] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.319802 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.320577 26941 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:21:01.323938 26941 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.324452 26941 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:01.326401 26941 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:01.329172 18351 consensus_peers.cc:597] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:01.340412 26941 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.340962 26941 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:01.342890 26941 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:01.343456 18351 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:01.344007 18351 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.344452 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.345059 26941 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:01.352470 18351 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:01.353195 18351 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.353623 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.354398 26941 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:21:01.356736 26941 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.357376 26941 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:01.360874 26941 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:01.386138 18351 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:01.388486 18351 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.388952 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.389760 26954 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:01.409060 26954 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.409648 26954 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:01.411614 26954 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:01.416592 18351 consensus_peers.cc:597] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:01.422904 18351 leader_election.cc:336] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:01.423568 18351 leader_election.cc:336] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.424016 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.424866 26954 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:01.493914 26954 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.494536 26954 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:21:01.495839 18927 consensus_peers.cc:597] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:01.496946 26954 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:01.507965 18351 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:01.509498 18351 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:01.509837 26969 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.510550 26969 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:01.514530 18379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:21:01.515126 18379 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 23.
I20260709 13:21:01.509909 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.516625 26969 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:21:01.517022 26941 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:21:01.531073 18927 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:01.532708 18927 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.533497 26954 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.535024 26954 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:01.537191 26954 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:01.537762 18927 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.544039 26969 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:01.545046 26970 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.545622 26970 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:01.549220 26970 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:01.558815 18351 leader_election.cc:336] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:01.560253 18351 leader_election.cc:336] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.560606 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.561192 26970 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:01.572994 18351 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:01.576141 18351 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.576624 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.577425 26970 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:01.603930 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:01.662827 18351 consensus_peers.cc:597] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:01.674019 26970 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.674590 26970 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:21:01.681272 18351 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:01.688124 26970 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:01.697250 18351 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.697706 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.698689 26941 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:01.816480 26969 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.817068 26969 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:01.819226 26969 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
W20260709 13:21:01.829222 18927 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:01.829970 18927 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:01.830438 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.831602 26969 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:01.873224 26971 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:01.873755 26971 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:01.875980 26971 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:01.881597 18351 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:01.882169 18351 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:01.883440 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:01.886459 26971 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:21:01.958021 18927 consensus_peers.cc:597] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:01.977741 17138 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 18333)
W20260709 13:21:01.981731 18351 consensus_peers.cc:597] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:02.013114 18927 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:02.090571 18351 consensus_peers.cc:597] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:02.113963 26955 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:02.114647 26955 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:02.116716 26955 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:02.126231 26941 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:02.126770 26941 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:02.129036 26941 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:02.126698 18927 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:02.130195 18927 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:02.130609 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:02.131376 26955 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:02.137166 18351 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:02.137948 18351 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:02.138406 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:02.139164 26970 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:02.205761 18927 consensus_peers.cc:597] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:02.220878 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:02.228266 18351 consensus_peers.cc:597] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:02.244771 18351 consensus_peers.cc:597] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:02.434463 18351 consensus_peers.cc:597] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.476320 18927 consensus_peers.cc:597] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:02.498747 18927 consensus_peers.cc:597] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.535723 18351 consensus_peers.cc:597] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.572827 18351 consensus_peers.cc:597] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:02.610546 18351 consensus_peers.cc:597] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.661942 18351 consensus_peers.cc:597] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:02.684381 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.685552 18351 consensus_peers.cc:597] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.697171 18351 consensus_peers.cc:597] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:02.708912 26973 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:02.709538 26973 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:02.711573 26973 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:02.718847 18927 consensus_peers.cc:597] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.724568 18927 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:02.725258 18927 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:02.725663 18927 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:02.729560 26973 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:02.726660 18351 consensus_peers.cc:597] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.754637 18927 consensus_peers.cc:597] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:02.760637 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.762785 18351 consensus_peers.cc:597] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:02.782173 18351 consensus_peers.cc:597] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.794382 18351 consensus_peers.cc:597] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:02.817535 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.840107 18351 consensus_peers.cc:597] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.845057 18351 consensus_peers.cc:597] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.865824 18351 consensus_peers.cc:597] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.947576 18351 consensus_peers.cc:597] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.948207 18351 consensus_peers.cc:597] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.976902 18927 consensus_peers.cc:597] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.978204 17138 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 18333)
I20260709 13:21:02.979423 26970 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:02.980400 26970 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:02.982585 26970 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:02.992985 18351 consensus_peers.cc:597] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:03.007987 18927 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:03.000041 18351 consensus_peers.cc:597] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:03.020462 18351 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:03.021476 18351 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:03.021895 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.022694 26970 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:03.027848 26970 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.028367 26970 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:03.032478 18956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:21:03.033135 18956 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
I20260709 13:21:03.036743 26970 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
W20260709 13:21:03.056666 18927 consensus_peers.cc:597] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:03.049896 18351 consensus_peers.cc:597] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:03.076560 18351 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:03.077517 18351 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:03.077962 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.078814 26970 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:03.104307 18351 consensus_peers.cc:597] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:03.170624 18351 consensus_peers.cc:597] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:03.171244 18351 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111) [suppressed 626 similar messages]
W20260709 13:21:03.195793 18351 consensus_peers.cc:597] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:03.216100 18351 consensus_peers.cc:597] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:03.257069 26970 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.257659 26970 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:03.259845 26970 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:03.267200 26941 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.267693 26941 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:03.268105 26974 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.268652 26974 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:03.269646 26941 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:03.276571 26974 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:03.279063 26974 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.279547 26974 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:03.281587 26974 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:03.287396 18351 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:03.300669 18351 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:03.301239 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.302016 26970 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:03.317682 18351 leader_election.cc:336] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:03.318464 18351 leader_election.cc:336] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:03.320091 18351 leader_election.cc:336] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:03.323349 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.324151 26970 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:03.324376 18351 leader_election.cc:336] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:03.324831 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.334467 26970 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:03.359712 18351 leader_election.cc:336] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:03.366709 18351 leader_election.cc:336] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:03.367172 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.368046 26970 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:03.393579 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:03.400575 26974 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.401213 26974 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:03.403388 26974 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:03.436352 18351 leader_election.cc:336] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:03.437364 18351 leader_election.cc:336] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:03.437799 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.438634 26974 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:03.477509 18351 consensus_peers.cc:597] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:03.491206 26974 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.491869 26974 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:03.494155 26974 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:03.507678 18351 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:03.508466 18351 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:03.512457 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.513331 26974 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:03.525926 26973 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.526527 26973 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:03.528698 26973 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
W20260709 13:21:03.543009 18927 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:03.543840 18927 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:03.544682 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.546449 26969 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:03.553968 18351 consensus_peers.cc:597] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:03.576749 26974 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.577376 26974 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:03.579591 26974 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:03.581188 18351 consensus_peers.cc:597] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:03.594295 18351 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:03.595201 18351 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:03.595633 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.598278 26974 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:21:03.633261 26974 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.633872 26974 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
W20260709 13:21:03.641530 18351 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:03.642284 18351 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:03.642719 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.643640 26970 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:03.636219 26974 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:03.751250 18351 consensus_peers.cc:597] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:03.793639 26941 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.799448 26941 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:03.801596 26941 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:03.807875 26978 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.808436 26978 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:03.810729 26978 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:03.816972 18351 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:03.818230 18351 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:03.818647 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.819451 26976 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:21:03.827343 18351 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:03.828342 18351 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:03.829203 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.831453 26976 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:21:03.833362 26976 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.833950 26976 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:03.836330 26976 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:03.854458 18351 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:03.856448 18351 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:03.856954 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.857779 26976 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:21:03.892239 18351 consensus_peers.cc:597] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:03.924669 26969 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.925321 26969 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:03.927565 26969 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:03.928120 26976 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.928717 26976 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:03.930887 26976 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:03.944042 18927 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:03.944916 18927 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:03.945369 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.946280 26977 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:03.946712 18351 leader_election.cc:336] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:03.947516 18351 leader_election.cc:336] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:03.947945 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.948839 26976 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:21:03.978190 26941 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:03.978751 26941 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:03.980741 26941 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:03.982868 17138 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 18333)
W20260709 13:21:03.990943 18351 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:03.992426 18351 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:03.994221 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:03.995214 26976 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:03.999624 18351 consensus_peers.cc:597] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:04.003317 18351 consensus_peers.cc:597] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:04.071002 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:04.111980 26976 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:04.112639 26976 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:04.114909 26976 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:04.138342 18927 consensus_peers.cc:597] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:04.151321 18351 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:04.152309 18351 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:04.152796 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:04.153677 26976 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:04.201858 26976 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:04.202414 26976 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:04.204644 26976 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:04.235909 18351 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:04.239054 18351 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:04.239435 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:04.240111 26941 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:21:04.259668 26941 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:04.260200 26941 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:04.262056 26941 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:04.266021 18351 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:04.266712 18351 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:04.267118 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:04.267910 26976 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:04.371407 18351 consensus_peers.cc:597] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:04.449687 26975 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:04.450276 26975 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:04.452358 26975 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:04.461792 18927 consensus_peers.cc:597] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:04.462445 18927 leader_election.cc:336] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:04.463079 18927 leader_election.cc:336] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:04.463729 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:04.465732 26975 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:04.507050 18351 consensus_peers.cc:597] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:04.524272 26941 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:04.524919 26941 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:04.526866 26941 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:04.533538 18927 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:04.544859 18351 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:04.545550 18351 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:04.545917 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:04.546595 26941 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:21:04.573550 26941 raft_consensus.cc:493] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:04.576344 26941 raft_consensus.cc:515] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:04.578265 26941 leader_election.cc:290] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:04.617676 18351 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:04.619115 18351 leader_election.cc:336] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:04.619532 18351 leader_election.cc:304] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:04.620318 26941 raft_consensus.cc:2749] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:21:04.689600 18927 consensus_peers.cc:597] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:04.744194 18351 consensus_peers.cc:597] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:04.790912 18351 consensus_peers.cc:597] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:04.848950 18351 consensus_peers.cc:597] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:04.856698 26941 raft_consensus.cc:493] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:04.857378 26941 raft_consensus.cc:515] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:04.859548 26941 leader_election.cc:290] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:04.872691 18351 leader_election.cc:336] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:04.873437 18351 leader_election.cc:336] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:04.873823 18351 leader_election.cc:304] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:04.874598 26941 raft_consensus.cc:2749] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:04.898358 18927 consensus_peers.cc:597] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:04.903891 18351 consensus_peers.cc:597] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:04.912153 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:04.914757 18351 consensus_peers.cc:597] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:04.927028 18927 consensus_peers.cc:597] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:04.929530 18351 consensus_peers.cc:597] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:04.983332 17138 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 18333)
W20260709 13:21:04.995627 18351 consensus_peers.cc:597] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:05.034633 26941 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:05.035256 26941 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:05.037102 26941 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:05.079423 26976 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:05.079967 26976 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:05.082626 26976 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), e016302b7e734d74833a2bf7bab44838 (127.16.188.132:42479)
I20260709 13:21:05.084199 18960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e016302b7e734d74833a2bf7bab44838" is_pre_election: true
I20260709 13:21:05.084882 18960 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b4fbc44aa2649f0bcac5cd70f71951d in term 23.
W20260709 13:21:05.101056 18927 consensus_peers.cc:597] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:05.104162 18351 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:05.108289 18351 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:05.108922 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:05.109649 26976 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:21:05.117543 18351 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:05.119284 18351 consensus_peers.cc:597] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:05.119717 18351 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:05.120196 18351 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:05.120929 26976 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:05.148885 18351 consensus_peers.cc:597] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:05.153892 18351 consensus_peers.cc:597] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:05.155723 26976 raft_consensus.cc:493] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:05.156199 26976 raft_consensus.cc:515] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:05.158113 26976 leader_election.cc:290] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:05.170776 18351 consensus_peers.cc:597] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:05.177724 18351 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:05.178427 18351 consensus_peers.cc:597] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:05.178838 18351 leader_election.cc:336] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:05.179231 18351 leader_election.cc:304] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:05.179929 26976 raft_consensus.cc:2749] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:05.211900 18927 consensus_peers.cc:597] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:05.221032 26982 raft_consensus.cc:493] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:05.221630 26982 raft_consensus.cc:515] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:05.223769 26982 leader_election.cc:290] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:05.236976 18927 consensus_peers.cc:597] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:05.247174 18351 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:05.247931 18351 leader_election.cc:336] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:05.248335 18351 leader_election.cc:304] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:05.249070 26982 raft_consensus.cc:2749] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:05.250118 18351 consensus_peers.cc:597] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:05.252559 26982 raft_consensus.cc:493] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:05.253067 26982 raft_consensus.cc:515] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:05.255103 26982 leader_election.cc:290] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:05.264283 18351 leader_election.cc:336] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:05.265128 18351 leader_election.cc:336] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:05.265552 18351 leader_election.cc:304] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:05.266492 26982 raft_consensus.cc:2749] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:21:05.312974 18351 consensus_peers.cc:597] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:05.316066 18351 consensus_peers.cc:597] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:05.347841 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:05.366818 18351 consensus_peers.cc:597] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:05.373757 18927 consensus_peers.cc:597] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:05.414954 26982 raft_consensus.cc:493] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:05.415557 26982 raft_consensus.cc:515] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:05.434624 26982 leader_election.cc:290] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:05.457463 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:05.464896 18351 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:05.465953 18351 consensus_peers.cc:597] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:05.466415 18351 consensus_peers.cc:597] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:05.466849 18351 leader_election.cc:336] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:05.467228 18351 leader_election.cc:304] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:05.467968 26982 raft_consensus.cc:2749] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:21:05.475935 26941 raft_consensus.cc:493] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:05.476375 26941 raft_consensus.cc:515] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:05.478346 26941 leader_election.cc:290] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:05.485097 18927 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:05.505126 18351 leader_election.cc:336] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:05.506959 18351 leader_election.cc:336] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:05.507442 18351 leader_election.cc:304] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:05.508204 26982 raft_consensus.cc:2749] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:05.509394 18351 consensus_peers.cc:597] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:05.513173 18351 consensus_peers.cc:597] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:05.538901 18351 consensus_peers.cc:597] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:05.570715 18351 consensus_peers.cc:597] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:05.573223 18351 consensus_peers.cc:597] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:05.600570 26982 raft_consensus.cc:493] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:05.601110 26982 raft_consensus.cc:515] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:05.603111 26982 leader_election.cc:290] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:05.625563 18351 leader_election.cc:336] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:05.627641 18351 leader_election.cc:336] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:05.628078 18351 leader_election.cc:304] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:05.628819 26941 raft_consensus.cc:2749] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:05.689036 26981 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:05.689633 26981 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:05.691694 26981 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:05.742760 18927 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:05.746325 18351 consensus_peers.cc:597] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:05.743721 18927 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:05.753973 18927 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:05.755445 26981 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:05.782434 18351 consensus_peers.cc:597] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:05.783504 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:05.819299 26941 raft_consensus.cc:493] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:05.819808 26941 raft_consensus.cc:515] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:05.821811 26941 leader_election.cc:290] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:05.831497 18351 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:05.833928 18351 leader_election.cc:336] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:05.834450 18351 leader_election.cc:304] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:05.835956 26941 raft_consensus.cc:2749] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:21:05.920215 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:05.934968 18351 consensus_peers.cc:597] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:05.940347 18121 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 63555.9us
W20260709 13:21:05.954674 18121 catalog_manager.cc:4755] TS b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 35ee2a6512e24d10af3526398de71490: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:05.982406 18351 consensus_peers.cc:597] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:05.984177 17138 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 18333)
I20260709 13:21:06.019901 26975 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:06.021333 26975 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
W20260709 13:21:06.025949 18351 consensus_peers.cc:597] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:06.028364 26975 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
W20260709 13:21:06.036485 18927 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:06.039330 18927 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:06.040972 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:06.041935 26975 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:06.131474 18351 consensus_peers.cc:597] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:06.207268 18351 consensus_peers.cc:597] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:06.219749 26976 raft_consensus.cc:493] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:06.221627 26988 raft_consensus.cc:493] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:06.222390 26988 raft_consensus.cc:515] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:06.225189 26988 leader_election.cc:290] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:06.225857 26976 raft_consensus.cc:515] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:06.228502 26976 leader_election.cc:290] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:06.243952 18351 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:06.244668 18351 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:06.246222 18351 leader_election.cc:336] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:06.246659 18351 leader_election.cc:304] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:06.247509 26976 raft_consensus.cc:2749] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:06.248780 18351 leader_election.cc:336] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:06.249187 18351 leader_election.cc:304] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:06.253281 26976 raft_consensus.cc:2749] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:21:06.264210 18351 consensus_peers.cc:597] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:06.280810 18351 consensus_peers.cc:597] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:06.658543 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:06.666898 26993 raft_consensus.cc:493] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:06.668009 26993 raft_consensus.cc:515] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:06.670873 26993 leader_election.cc:290] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:06.705576 18351 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:06.708788 18351 consensus_peers.cc:597] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:06.709715 18351 leader_election.cc:336] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:06.710270 18351 leader_election.cc:304] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:06.711175 26993 raft_consensus.cc:2749] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:21:06.834141 26992 raft_consensus.cc:493] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:06.834965 26992 raft_consensus.cc:515] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:06.837623 26992 leader_election.cc:290] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:06.872951 18351 leader_election.cc:336] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:06.874895 18351 leader_election.cc:336] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:06.875411 18351 leader_election.cc:304] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:06.876291 26992 raft_consensus.cc:2749] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:21:06.877491 18351 consensus_peers.cc:597] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:21:06.935492 18927 consensus_peers.cc:597] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:06.938266 26992 raft_consensus.cc:493] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:06.938992 26992 raft_consensus.cc:515] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:06.941713 26992 leader_election.cc:290] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:06.966106 18351 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:06.970299 18351 leader_election.cc:336] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:06.970908 18351 leader_election.cc:304] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:06.974726 26992 raft_consensus.cc:2749] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:06.984827 17138 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 18333)
I20260709 13:21:07.085110 26989 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:07.085979 26989 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:07.110476 18381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abbfc724a94243a40588649dd76b4f" candidate_uuid: "e016302b7e734d74833a2bf7bab44838" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" is_pre_election: true
I20260709 13:21:07.111650 18381 raft_consensus.cc:2468] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e016302b7e734d74833a2bf7bab44838 in term 23.
I20260709 13:21:07.114440 26989 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:21:07.131076 18927 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:07.134841 18927 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:07.135335 18927 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d, e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:07.137215 26989 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:07.152951 18351 consensus_peers.cc:597] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:07.155282 26993 raft_consensus.cc:493] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:07.155874 26993 raft_consensus.cc:515] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:07.158042 26993 leader_election.cc:290] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:07.159132 26989 raft_consensus.cc:493] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:07.160632 26989 raft_consensus.cc:515] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:07.162689 26989 leader_election.cc:290] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:07.182337 18351 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:07.188211 18351 leader_election.cc:336] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:07.169610 18927 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:07.189034 18351 leader_election.cc:304] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
W20260709 13:21:07.189217 18927 consensus_peers.cc:597] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:21:07.189888 26993 raft_consensus.cc:2749] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:07.193241 18927 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:07.202361 18927 leader_election.cc:336] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:07.202877 18927 leader_election.cc:304] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:07.209437 26989 raft_consensus.cc:2749] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:21:07.210671 26993 raft_consensus.cc:493] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:07.211238 26993 raft_consensus.cc:515] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:07.213217 26993 leader_election.cc:290] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:07.236254 18351 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:07.237576 18351 leader_election.cc:336] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:07.238078 18351 leader_election.cc:304] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:07.239007 26993 raft_consensus.cc:2749] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:07.245561 18351 consensus_peers.cc:597] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:07.274605 18927 consensus_peers.cc:597] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:07.279199 18927 consensus_peers.cc:597] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:07.371498 18351 consensus_peers.cc:597] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:07.391230 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:07.574585 18927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:43781, user_credentials={real_user=slave}} blocked reactor thread for 183396us
W20260709 13:21:07.520897 18351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.130:34605, user_credentials={real_user=slave}} blocked reactor thread for 149466us
I20260709 13:21:07.543277 26999 raft_consensus.cc:493] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:07.555516 27000 raft_consensus.cc:493] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:07.576395 26999 raft_consensus.cc:515] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:07.576704 27000 raft_consensus.cc:515] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:07.578893 26999 leader_election.cc:290] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:07.579377 27000 leader_election.cc:290] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
I20260709 13:21:07.579989 27000 raft_consensus.cc:493] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:07.580487 27000 raft_consensus.cc:515] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:07.583570 27000 leader_election.cc:290] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:07.609263 18351 consensus_peers.cc:597] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:07.620816 18351 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:07.621656 18351 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:07.624927 18351 consensus_peers.cc:597] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:07.633672 18351 leader_election.cc:336] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:07.634387 18351 consensus_peers.cc:597] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:07.634523 18926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44265, user_credentials={real_user=slave}} blocked reactor thread for 67603.3us
W20260709 13:21:07.634963 18351 consensus_peers.cc:597] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:07.635576 18351 consensus_peers.cc:597] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:07.636333 18351 consensus_peers.cc:597] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:07.641932 18351 leader_election.cc:336] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:07.642370 18351 leader_election.cc:304] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:07.643270 27004 raft_consensus.cc:2749] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:21:07.644483 18351 leader_election.cc:336] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:07.644955 18351 leader_election.cc:304] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:07.645743 27004 raft_consensus.cc:2749] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:21:07.647208 18351 leader_election.cc:336] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:07.647670 18351 leader_election.cc:304] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:07.648382 27004 raft_consensus.cc:2749] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:21:07.648703 18927 consensus_peers.cc:597] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:07.666481 18351 consensus_peers.cc:597] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:07.670074 18351 consensus_peers.cc:597] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:07.731825 18351 consensus_peers.cc:597] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:07.735177 18351 consensus_peers.cc:597] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:07.741873 18351 consensus_peers.cc:597] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:07.748292 18927 consensus_peers.cc:597] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:07.749415 18351 consensus_peers.cc:597] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:07.762537 18927 consensus_peers.cc:597] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:07.769596 18351 consensus_peers.cc:597] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:07.817178 18351 consensus_peers.cc:597] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:07.929194 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:07.957059 18351 consensus_peers.cc:597] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:07.984239 27002 raft_consensus.cc:493] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:07.984797 27002 raft_consensus.cc:515] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:07.986658 27002 leader_election.cc:290] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781)
W20260709 13:21:07.992681 18927 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:07.993193 18927 leader_election.cc:336] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:07.993499 18927 leader_election.cc:304] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:07.994133 27002 raft_consensus.cc:2749] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:21:07.999038 17138 tablet_server.cc:196] TabletServer@127.16.188.130:0 shutdown complete.
W20260709 13:21:08.009377 18351 consensus_peers.cc:597] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:08.064800 27004 raft_consensus.cc:493] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:08.065378 27004 raft_consensus.cc:515] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } }
I20260709 13:21:08.067566 27004 leader_election.cc:290] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:08.079051 18351 consensus_peers.cc:597] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:08.079839 18351 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:08.082000 18351 leader_election.cc:336] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:08.082587 18351 leader_election.cc:304] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b4fbc44aa2649f0bcac5cd70f71951d; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:08.083598 27004 raft_consensus.cc:2749] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:08.107435 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:08.108670 18351 consensus_peers.cc:597] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:08.114871 18351 consensus_peers.cc:597] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:08.127303 18927 consensus_peers.cc:597] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:08.140492 18351 consensus_peers.cc:597] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:08.162441 18351 consensus_peers.cc:597] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:08.171597 18351 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111) [suppressed 610 similar messages]
W20260709 13:21:08.181205 18351 consensus_peers.cc:597] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:08.200327 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:08.201982 17138 tablet_server.cc:179] TabletServer@127.16.188.131:0 shutting down...
W20260709 13:21:08.214782 18351 consensus_peers.cc:597] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:21:08.219470 18926 consensus_peers.cc:597] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 -> Peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Couldn't send request to peer 8b4fbc44aa2649f0bcac5cd70f71951d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:08.223649 18927 consensus_peers.cc:597] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:21:08.254139 18926 consensus_peers.cc:597] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 -> Peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Couldn't send request to peer 8b4fbc44aa2649f0bcac5cd70f71951d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:08.259521 18926 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 -> Peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Couldn't send request to peer 8b4fbc44aa2649f0bcac5cd70f71951d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:08.266633 18351 consensus_peers.cc:597] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:08.275731 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:08.276955 17138 tablet_replica.cc:333] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.278148 17138 raft_consensus.cc:2243] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.279927 17138 raft_consensus.cc:2272] T 610ebeb615ff40b9baae6de30d397e22 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.282760 17138 tablet_replica.cc:333] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.283448 17138 raft_consensus.cc:2243] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.283953 17138 raft_consensus.cc:2272] T 6c5058a8396d4e77a38f85a04e24eae7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.286160 17138 tablet_replica.cc:333] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.286772 17138 raft_consensus.cc:2243] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.287299 17138 raft_consensus.cc:2272] T 4c7dd453327840c0811097f0c2b4c75b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.289584 17138 tablet_replica.cc:333] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.290198 17138 raft_consensus.cc:2243] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.291391 17138 raft_consensus.cc:2272] T 49c6a2a19b90491f9336362305339eca P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.294202 17138 tablet_replica.cc:333] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.294939 17138 raft_consensus.cc:2243] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.295691 17138 raft_consensus.cc:2272] T 0d2ac0cb46434c19a6e4f18836703096 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.298532 17138 tablet_replica.cc:333] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.299185 17138 raft_consensus.cc:2243] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.300544 17138 raft_consensus.cc:2272] T c230199b226a4b03b63c04fd79847b50 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.303712 17138 tablet_replica.cc:333] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.304425 17138 raft_consensus.cc:2243] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.306358 17138 raft_consensus.cc:2272] T 7e1dd423d7184b408a5257ea471f540d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.308463 17138 tablet_replica.cc:333] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.309131 17138 raft_consensus.cc:2243] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.309670 17138 raft_consensus.cc:2272] T d49caac43d924696b2d3a9cc660f2c48 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.311750 17138 tablet_replica.cc:333] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.312353 17138 raft_consensus.cc:2243] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.313570 17138 raft_consensus.cc:2272] T cbd66a28ecbc4386b9e1489688542ca9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.315725 17138 tablet_replica.cc:333] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.316442 17138 raft_consensus.cc:2243] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.317389 17138 raft_consensus.cc:2272] T 3611564ea3974f58a23e3fea4f39c5c7 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.319845 17138 tablet_replica.cc:333] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.320809 17138 raft_consensus.cc:2243] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.321555 17138 raft_consensus.cc:2272] T 87ce294aa3d9426291ec809884e80749 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.323791 17138 tablet_replica.cc:333] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.324455 17138 raft_consensus.cc:2243] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.325449 17138 raft_consensus.cc:2272] T fe9abdaa4bb845cd8d40c4f182cf98c9 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.327406 17138 tablet_replica.cc:333] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.327950 17138 raft_consensus.cc:2243] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.328799 17138 raft_consensus.cc:2272] T 23eb586495714fcf90b0b81c5ec4cc2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.330781 17138 tablet_replica.cc:333] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.331342 17138 raft_consensus.cc:2243] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.332502 17138 raft_consensus.cc:2272] T fbab600bb4ff4ad99b8a9ff2604b8f4b P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.335182 17138 tablet_replica.cc:333] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.335940 17138 raft_consensus.cc:2243] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.337322 17138 raft_consensus.cc:2272] T 647155b6479b4f689aca5b6c1efcc633 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.339663 17138 tablet_replica.cc:333] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.340250 17138 raft_consensus.cc:2243] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.341552 17138 raft_consensus.cc:2272] T fac262d04a1a4d94aec44b2679caee9d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.344998 17138 tablet_replica.cc:333] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.345917 17138 raft_consensus.cc:2243] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.346868 17138 raft_consensus.cc:2272] T ef83aa6f9534403ebe38156348430345 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.349568 17138 tablet_replica.cc:333] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.350193 17138 raft_consensus.cc:2243] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.350911 17138 raft_consensus.cc:2272] T 4300927be0384401aa46050bd5996d2f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.353331 17138 tablet_replica.cc:333] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.354005 17138 raft_consensus.cc:2243] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.355392 17138 raft_consensus.cc:2272] T fdde66e5e9e64c508bb1a79d0f5754bd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.358361 17138 tablet_replica.cc:333] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.359189 17138 raft_consensus.cc:2243] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.359946 17138 raft_consensus.cc:2272] T 1dea3366ee674017a0bbfc9bce0d9a73 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.363010 17138 tablet_replica.cc:333] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.363927 17138 raft_consensus.cc:2243] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.364775 17138 raft_consensus.cc:2272] T 0c4cde9a14cb4fca95a288de6d075e9a P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.367175 17138 tablet_replica.cc:333] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.367771 17138 raft_consensus.cc:2243] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.369167 17138 raft_consensus.cc:2272] T b6e6be0c25704f45b1b4f3c4f246fa02 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.371914 17138 tablet_replica.cc:333] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.372786 17138 raft_consensus.cc:2243] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:08.373888 18927 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:08.374655 17138 raft_consensus.cc:2272] T 9d7e53f100fe49dea344afeea45f7cf5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.377135 17138 tablet_replica.cc:333] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.377799 17138 raft_consensus.cc:2243] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.378597 17138 raft_consensus.cc:2272] T fa1f5c8f2c0e4687bcbe4eb6baed26c8 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.381039 17138 tablet_replica.cc:333] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.381618 17138 raft_consensus.cc:2243] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.382560 17138 raft_consensus.cc:2272] T fd151355294e450f85a51ac658d4a465 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.384924 17138 tablet_replica.cc:333] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.385776 17138 raft_consensus.cc:2243] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.387256 17138 raft_consensus.cc:2272] T d88cda52389848d584c846a8597f4977 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:08.389344 18351 consensus_peers.cc:597] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:08.390416 17138 tablet_replica.cc:333] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.391080 17138 raft_consensus.cc:2243] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.392055 17138 raft_consensus.cc:2272] T 20a11d8d7fb14609b0bb479587b23e37 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.394297 17138 tablet_replica.cc:333] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.394919 17138 raft_consensus.cc:2243] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.395720 17138 raft_consensus.cc:2272] T 2b14d7467c934fdca91c8a466ef2d764 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.398162 17138 tablet_replica.cc:333] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.398837 17138 raft_consensus.cc:2243] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.399957 17138 raft_consensus.cc:2272] T 9dd00413a3134a12a08e72e7925f6473 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.402113 17138 tablet_replica.cc:333] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.402724 17138 raft_consensus.cc:2243] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.403398 17138 raft_consensus.cc:2272] T 3c074d20c77e423597f342d5ed4ccc6d P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.406428 17138 tablet_replica.cc:333] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.407264 17138 raft_consensus.cc:2243] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.408823 17138 raft_consensus.cc:2272] T 96c6309e774a4e15bd33a0a93d1a7f2e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.411602 17138 tablet_replica.cc:333] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.412384 17138 raft_consensus.cc:2243] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.413188 17138 raft_consensus.cc:2272] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:08.414011 18926 consensus_peers.cc:597] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 -> Peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Couldn't send request to peer 8b4fbc44aa2649f0bcac5cd70f71951d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:08.415630 17138 tablet_replica.cc:333] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.416433 17138 raft_consensus.cc:2243] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.417322 17138 raft_consensus.cc:2272] T 6cdcc6f227f447c0bd7e5ce750cc3c04 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.420369 17138 tablet_replica.cc:333] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.421317 17138 raft_consensus.cc:2243] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.422128 17138 raft_consensus.cc:2272] T e5a31bcfc315403994b8ecac224542b5 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.424703 17138 tablet_replica.cc:333] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.425590 17138 raft_consensus.cc:2243] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.426678 17138 raft_consensus.cc:2272] T 83392764a50d4598aedbe4d1cc557dad P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.431205 17138 tablet_replica.cc:333] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.432919 17138 raft_consensus.cc:2243] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.435292 17138 raft_consensus.cc:2272] T 943649b738074d87a593c237cf998758 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.437712 17138 tablet_replica.cc:333] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.438345 17138 raft_consensus.cc:2243] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.438910 17138 raft_consensus.cc:2272] T 2682a7690fb640b1a9ad52d5fa19e281 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.441359 17138 tablet_replica.cc:333] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.442152 17138 raft_consensus.cc:2243] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.443040 17138 raft_consensus.cc:2272] T 23d48585586a4bb3bc800da7f54e12f0 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.445668 17138 tablet_replica.cc:333] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.446447 17138 raft_consensus.cc:2243] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.447237 17138 raft_consensus.cc:2272] T 3c6cd802105b49c68d85e7abdce24871 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:08.449687 18926 consensus_peers.cc:597] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 -> Peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Couldn't send request to peer 8b4fbc44aa2649f0bcac5cd70f71951d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:08.450273 17138 tablet_replica.cc:333] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.450994 17138 raft_consensus.cc:2243] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.452221 17138 raft_consensus.cc:2272] T 35ee2a6512e24d10af3526398de71490 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.454679 17138 tablet_replica.cc:333] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.455380 17138 raft_consensus.cc:2243] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.456131 17138 raft_consensus.cc:2272] T eafcec4c722f49fa90d23d1326870a82 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.459339 17138 tablet_replica.cc:333] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
W20260709 13:21:08.459882 18926 consensus_peers.cc:597] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 -> Peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Couldn't send request to peer 8b4fbc44aa2649f0bcac5cd70f71951d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:08.460223 17138 raft_consensus.cc:2243] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.461162 17138 raft_consensus.cc:2272] T ed649e8e79144f338d9c590603fa0b7c P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.463691 17138 tablet_replica.cc:333] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.464360 17138 raft_consensus.cc:2243] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.466053 17138 raft_consensus.cc:2272] T 23abbfc724a94243a40588649dd76b4f P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.468699 17138 tablet_replica.cc:333] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.469328 17138 raft_consensus.cc:2243] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.469910 17138 raft_consensus.cc:2272] T dd45943dc64b4e86b54ae5c263345e6e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.472795 17138 tablet_replica.cc:333] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.473656 17138 raft_consensus.cc:2243] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.474567 17138 raft_consensus.cc:2272] T 9db2383f92d34ec9ab6bed764ba818f4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.477268 17138 tablet_replica.cc:333] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.478020 17138 raft_consensus.cc:2243] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.479660 17138 raft_consensus.cc:2272] T d6d3055da6db47abb16a433d66a5c79e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:08.480769 18407 debug-util.cc:398] Leaking SignalData structure 0x7b080029e1c0 after lost signal to thread 17141
W20260709 13:21:08.481948 18407 debug-util.cc:398] Leaking SignalData structure 0x7b080029e120 after lost signal to thread 18169
I20260709 13:21:08.482635 17138 tablet_replica.cc:333] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
W20260709 13:21:08.483333 18407 debug-util.cc:398] Leaking SignalData structure 0x7b080014ef60 after lost signal to thread 18410
I20260709 13:21:08.483348 17138 raft_consensus.cc:2243] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:08.480563 18926 consensus_peers.cc:597] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 -> Peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Couldn't send request to peer 8b4fbc44aa2649f0bcac5cd70f71951d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:08.484542 17138 raft_consensus.cc:2272] T 7a18591c0ed248258c1fcafa9811f7c4 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:08.485065 18407 debug-util.cc:398] Leaking SignalData structure 0x7b08000bb400 after lost signal to thread 18986
I20260709 13:21:08.487512 17138 tablet_replica.cc:333] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.488423 17138 raft_consensus.cc:2243] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.489269 17138 raft_consensus.cc:2272] T 58f88ffc8ca74740b36c09a2eb312c10 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.492677 17138 tablet_replica.cc:333] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.493556 17138 raft_consensus.cc:2243] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 30 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.495724 17138 raft_consensus.cc:2272] T e0d4b879cb5a45d0ab3dc5401e957620 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.498724 17138 tablet_replica.cc:333] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.499590 17138 raft_consensus.cc:2243] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.501067 17138 raft_consensus.cc:2272] T d03313400e274f83883c84395905b4cd P 8b4fbc44aa2649f0bcac5cd70f71951d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:08.503520 17138 tablet_replica.cc:333] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.504302 17138 raft_consensus.cc:2243] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:21:08.506271 17138 raft_consensus.cc:2272] T d094a2c1f67e4ab7bc263e71d49ced86 P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:08.509135 18926 consensus_peers.cc:597] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 -> Peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Couldn't send request to peer 8b4fbc44aa2649f0bcac5cd70f71951d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:08.510401 17138 tablet_replica.cc:333] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d: stopping tablet replica
I20260709 13:21:08.511052 17138 raft_consensus.cc:2243] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:08.511726 17138 raft_consensus.cc:2272] T 069a152975ce431fb5fd1abe7e07178e P 8b4fbc44aa2649f0bcac5cd70f71951d [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:08.540097 18926 consensus_peers.cc:597] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 -> Peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Couldn't send request to peer 8b4fbc44aa2649f0bcac5cd70f71951d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:08.573980 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:08.702879 18926 consensus_peers.cc:597] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 -> Peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Couldn't send request to peer 8b4fbc44aa2649f0bcac5cd70f71951d. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.131:44265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:09.175431 27006 raft_consensus.cc:493] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:09.176117 27006 raft_consensus.cc:515] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:09.178498 27006 leader_election.cc:290] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:09.183604 18927 leader_election.cc:336] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:09.184600 18927 leader_election.cc:336] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:09.185029 18927 leader_election.cc:304] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:09.185813 27006 raft_consensus.cc:2749] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:09.302773 18927 consensus_peers.cc:597] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:09.377074 27006 raft_consensus.cc:493] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:21:09.377656 27006 raft_consensus.cc:515] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:09.380175 27006 leader_election.cc:290] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:21:09.386181 18926 leader_election.cc:336] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Network error: Client connection negotiation failed: client connection to 127.16.188.131:44265: connect: Connection refused (error 111)
W20260709 13:21:09.386811 18927 leader_election.cc:336] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:09.387300 18927 leader_election.cc:304] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:09.388064 27006 raft_consensus.cc:2749] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:21:09.475303 27006 raft_consensus.cc:493] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:21:09.475868 27006 raft_consensus.cc:515] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:09.478171 27006 leader_election.cc:290] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:21:09.483165 18926 leader_election.cc:336] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Network error: Client connection negotiation failed: client connection to 127.16.188.131:44265: connect: Connection refused (error 111)
W20260709 13:21:09.484982 18927 leader_election.cc:336] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:09.485451 18927 leader_election.cc:304] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:21:09.486267 27006 raft_consensus.cc:2749] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:09.522686 27006 raft_consensus.cc:493] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:21:09.523360 27006 raft_consensus.cc:515] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:09.525815 27006 leader_election.cc:290] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:21:09.530748 18927 leader_election.cc:336] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
W20260709 13:21:09.531342 18926 leader_election.cc:336] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Network error: Client connection negotiation failed: client connection to 127.16.188.131:44265: connect: Connection refused (error 111)
I20260709 13:21:09.531805 18926 leader_election.cc:304] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:09.532620 27006 raft_consensus.cc:2749] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:09.556200 18927 consensus_peers.cc:597] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:09.600016 27006 raft_consensus.cc:493] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:21:09.600555 27006 raft_consensus.cc:515] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:09.602717 27006 leader_election.cc:290] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:21:09.607499 18926 leader_election.cc:336] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Network error: Client connection negotiation failed: client connection to 127.16.188.131:44265: connect: Connection refused (error 111)
W20260709 13:21:09.608500 18927 leader_election.cc:336] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:09.608889 18927 leader_election.cc:304] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:21:09.609469 27006 raft_consensus.cc:2749] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:09.627924 18927 consensus_peers.cc:597] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:09.709116 27006 raft_consensus.cc:493] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:21:09.709743 27006 raft_consensus.cc:515] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:09.712234 27006 leader_election.cc:290] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
I20260709 13:21:09.715039 27006 raft_consensus.cc:493] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
W20260709 13:21:09.715077 18927 leader_election.cc:336] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:09.715710 27006 raft_consensus.cc:515] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:09.718179 27006 leader_election.cc:290] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:21:09.721410 18926 leader_election.cc:336] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Network error: Client connection negotiation failed: client connection to 127.16.188.131:44265: connect: Connection refused (error 111)
W20260709 13:21:09.722960 18927 leader_election.cc:336] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:09.723066 18926 leader_election.cc:304] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:21:09.724069 27006 raft_consensus.cc:2749] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:21:09.726071 18926 leader_election.cc:336] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Network error: Client connection negotiation failed: client connection to 127.16.188.131:44265: connect: Connection refused (error 111)
I20260709 13:21:09.726594 18926 leader_election.cc:304] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:21:09.727319 27006 raft_consensus.cc:2749] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:09.739961 18927 consensus_peers.cc:597] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:09.765918 27006 raft_consensus.cc:493] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8b4fbc44aa2649f0bcac5cd70f71951d)
I20260709 13:21:09.766575 27006 raft_consensus.cc:515] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:09.770607 27006 leader_election.cc:290] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:21:09.773548 18926 leader_election.cc:336] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Network error: Client connection negotiation failed: client connection to 127.16.188.131:44265: connect: Connection refused (error 111)
W20260709 13:21:09.774070 18927 leader_election.cc:336] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:09.774554 18927 leader_election.cc:304] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, 8b4fbc44aa2649f0bcac5cd70f71951d
I20260709 13:21:09.775281 27006 raft_consensus.cc:2749] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:09.830981 18927 consensus_peers.cc:597] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:09.869828 18927 consensus_peers.cc:597] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:09.956899 27006 raft_consensus.cc:493] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:09.957603 27006 raft_consensus.cc:515] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "8b4fbc44aa2649f0bcac5cd70f71951d" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44265 } attrs { replace: true } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:09.962888 27006 leader_election.cc:290] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605), 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265)
W20260709 13:21:09.967092 18926 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Network error: Client connection negotiation failed: client connection to 127.16.188.131:44265: connect: Connection refused (error 111)
W20260709 13:21:09.970338 18927 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:09.970845 18927 leader_election.cc:304] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 8b4fbc44aa2649f0bcac5cd70f71951d, b52e2477fc524694967c4a16afa983e3
W20260709 13:21:09.971794 18927 leader_election.cc:336] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
I20260709 13:21:09.972311 27006 raft_consensus.cc:2749] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:09.979319 18927 consensus_peers.cc:597] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:21:09.992542 18927 consensus_peers.cc:597] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 -> Peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Couldn't send request to peer b52e2477fc524694967c4a16afa983e3. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:21:10.034746 27006 raft_consensus.cc:493] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 459e82ee6b564cc19be6f73186938e79)
I20260709 13:21:10.035490 27006 raft_consensus.cc:515] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b52e2477fc524694967c4a16afa983e3" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 43781 } } peers { permanent_uuid: "459e82ee6b564cc19be6f73186938e79" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 34605 } } peers { permanent_uuid: "e016302b7e734d74833a2bf7bab44838" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 42479 } attrs { promote: false } }
I20260709 13:21:10.038153 27006 leader_election.cc:290] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781), 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605)
W20260709 13:21:10.043500 18927 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111)
W20260709 13:21:10.044301 18927 leader_election.cc:336] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:10.044706 18927 leader_election.cc:304] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e016302b7e734d74833a2bf7bab44838; no voters: 459e82ee6b564cc19be6f73186938e79, b52e2477fc524694967c4a16afa983e3
I20260709 13:21:10.045488 27006 raft_consensus.cc:2749] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:21:10.219491 18927 consensus_peers.cc:597] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:10.355611 17138 tablet_server.cc:196] TabletServer@127.16.188.131:0 shutdown complete.
W20260709 13:21:10.436575 18927 consensus_peers.cc:597] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:10.466176 17138 tablet_server.cc:179] TabletServer@127.16.188.132:0 shutting down...
W20260709 13:21:10.490078 18927 consensus_peers.cc:597] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:10.526825 18926 consensus_peers.cc:597] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 -> Peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Couldn't send request to peer 8b4fbc44aa2649f0bcac5cd70f71951d. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.131:44265: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:10.537951 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:10.539084 17138 tablet_replica.cc:333] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.540652 17138 raft_consensus.cc:2243] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.541710 17138 raft_consensus.cc:2272] T 23abbfc724a94243a40588649dd76b4f P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.545209 17138 tablet_replica.cc:333] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.545998 17138 raft_consensus.cc:2243] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.546957 17138 raft_consensus.cc:2272] T 35ee2a6512e24d10af3526398de71490 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.550321 17138 tablet_replica.cc:333] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.551017 17138 raft_consensus.cc:2243] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:21:10.552167 17138 raft_consensus.cc:2272] T 1dea3366ee674017a0bbfc9bce0d9a73 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.555042 17138 tablet_replica.cc:333] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.556021 17138 raft_consensus.cc:2243] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.557358 17138 raft_consensus.cc:2272] T b6e6be0c25704f45b1b4f3c4f246fa02 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.561694 17138 tablet_replica.cc:333] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.562486 17138 raft_consensus.cc:2243] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:21:10.563772 17138 raft_consensus.cc:2272] T 2682a7690fb640b1a9ad52d5fa19e281 P e016302b7e734d74833a2bf7bab44838 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.567608 17138 tablet_replica.cc:333] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.568377 17138 raft_consensus.cc:2243] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:10.569458 17138 raft_consensus.cc:2272] T 80d0760748294d8d8cb291466766b8a5 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.572247 17138 tablet_replica.cc:333] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.572990 17138 raft_consensus.cc:2243] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.573622 17138 raft_consensus.cc:2272] T 39dd19f13a42412b9dda536e24c324b1 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.576601 17138 tablet_replica.cc:333] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.577145 17138 raft_consensus.cc:2243] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.577677 17138 raft_consensus.cc:2272] T 943649b738074d87a593c237cf998758 P e016302b7e734d74833a2bf7bab44838 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.580015 17138 tablet_replica.cc:333] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.580744 17138 raft_consensus.cc:2243] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:21:10.581840 17138 raft_consensus.cc:2272] T 3c6cd802105b49c68d85e7abdce24871 P e016302b7e734d74833a2bf7bab44838 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.585481 17138 tablet_replica.cc:333] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.586294 17138 raft_consensus.cc:2243] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.587091 17138 raft_consensus.cc:2272] T 7db17400d59a40a786f346aefbfbcbb0 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.590279 17138 tablet_replica.cc:333] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.591147 17138 raft_consensus.cc:2243] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:21:10.591178 18926 consensus_peers.cc:597] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 -> Peer 8b4fbc44aa2649f0bcac5cd70f71951d (127.16.188.131:44265): Couldn't send request to peer 8b4fbc44aa2649f0bcac5cd70f71951d. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.131:44265: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:10.592656 17138 raft_consensus.cc:2272] T 58f88ffc8ca74740b36c09a2eb312c10 P e016302b7e734d74833a2bf7bab44838 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.595305 17138 tablet_replica.cc:333] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.595989 17138 raft_consensus.cc:2243] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.596598 17138 raft_consensus.cc:2272] T 9dd00413a3134a12a08e72e7925f6473 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.599713 17138 tablet_replica.cc:333] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.600997 17138 raft_consensus.cc:2243] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:10.602159 17138 raft_consensus.cc:2272] T 2b14d7467c934fdca91c8a466ef2d764 P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:10.602246 18927 consensus_peers.cc:597] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 -> Peer 459e82ee6b564cc19be6f73186938e79 (127.16.188.130:34605): Couldn't send request to peer 459e82ee6b564cc19be6f73186938e79. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:34605: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:10.604820 17138 tablet_replica.cc:333] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.605492 17138 raft_consensus.cc:2243] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:10.606494 17138 raft_consensus.cc:2272] T eafcec4c722f49fa90d23d1326870a82 P e016302b7e734d74833a2bf7bab44838 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.608920 17138 tablet_replica.cc:333] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.609552 17138 raft_consensus.cc:2243] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:21:10.610504 17138 raft_consensus.cc:2272] T fbb0f3b6bc6342f0bd5d2efc5d4f6463 P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.613016 17138 tablet_replica.cc:333] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.613605 17138 raft_consensus.cc:2243] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.614077 17138 raft_consensus.cc:2272] T 715a2657f09449038e569acddbab1aea P e016302b7e734d74833a2bf7bab44838 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.616372 17138 tablet_replica.cc:333] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.616992 17138 raft_consensus.cc:2243] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.617522 17138 raft_consensus.cc:2272] T 2cbade5381d641e9b60bcc9994ae9b51 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.619875 17138 tablet_replica.cc:333] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.620416 17138 raft_consensus.cc:2243] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.621025 17138 raft_consensus.cc:2272] T 647155b6479b4f689aca5b6c1efcc633 P e016302b7e734d74833a2bf7bab44838 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.623064 17138 tablet_replica.cc:333] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.623634 17138 raft_consensus.cc:2243] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:21:10.624716 17138 raft_consensus.cc:2272] T b1889d6d746545a0bdf04811a102b35b P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.627080 17138 tablet_replica.cc:333] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.627640 17138 raft_consensus.cc:2243] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:10.628523 17138 raft_consensus.cc:2272] T 9d7e53f100fe49dea344afeea45f7cf5 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.630725 17138 tablet_replica.cc:333] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.631394 17138 raft_consensus.cc:2243] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:21:10.632326 17138 raft_consensus.cc:2272] T efd953e96dc54f10a635581a413244e2 P e016302b7e734d74833a2bf7bab44838 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.635005 17138 tablet_replica.cc:333] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.635565 17138 raft_consensus.cc:2243] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:10.636449 17138 raft_consensus.cc:2272] T 0c4cde9a14cb4fca95a288de6d075e9a P e016302b7e734d74833a2bf7bab44838 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.638698 17138 tablet_replica.cc:333] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.639314 17138 raft_consensus.cc:2243] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:21:10.640432 17138 raft_consensus.cc:2272] T 23d48585586a4bb3bc800da7f54e12f0 P e016302b7e734d74833a2bf7bab44838 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.643245 17138 tablet_replica.cc:333] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.643808 17138 raft_consensus.cc:2243] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.644479 17138 raft_consensus.cc:2272] T fe9abdaa4bb845cd8d40c4f182cf98c9 P e016302b7e734d74833a2bf7bab44838 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.647115 17138 tablet_replica.cc:333] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838: stopping tablet replica
I20260709 13:21:10.647598 17138 raft_consensus.cc:2243] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:10.648245 17138 raft_consensus.cc:2272] T 610ebeb615ff40b9baae6de30d397e22 P e016302b7e734d74833a2bf7bab44838 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:10.931051 17138 tablet_server.cc:196] TabletServer@127.16.188.132:0 shutdown complete.
I20260709 13:21:10.995394 17138 master.cc:562] Master@127.16.188.190:46739 shutting down...
W20260709 13:21:11.040319 18183 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:21:11.040668 18183 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:21:11.040899 18183 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:21:13.527060 18166 debug-util.cc:398] Leaking SignalData structure 0x7b0800389f80 after lost signal to thread 17141
W20260709 13:21:13.527537 18166 debug-util.cc:398] Leaking SignalData structure 0x7b0800266b00 after lost signal to thread 18169
W20260709 13:21:22.357534 18121 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111) [suppressed 170 similar messages]
W20260709 13:21:22.363718 18121 catalog_manager.cc:4755] TS b52e2477fc524694967c4a16afa983e3 (127.16.188.129:43781): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 35ee2a6512e24d10af3526398de71490: Network error: Client connection negotiation failed: client connection to 127.16.188.129:43781: connect: Connection refused (error 111)
I20260709 13:21:24.675858 17138 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:24.676954 17138 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:24.677354 17138 tablet_replica.cc:333] T 00000000000000000000000000000000 P dc71a90b0e6d42fc8a6b135fbfbac453: stopping tablet replica
I20260709 13:21:24.832856 17138 master.cc:584] Master@127.16.188.190:46739 shutdown complete.
I20260709 13:21:24.888760 17138 test_util.cc:182] -----------------------------------------------
I20260709 13:21:24.889029 17138 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602984839783-17138-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (276620 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:21:24.893335 17138 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.188.190:42581
I20260709 13:21:24.894690 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:24.901724 27017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:24.901757 27016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:24.902132 27019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:24.904623 17138 server_base.cc:1061] running on GCE node
I20260709 13:21:24.908339 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:24.908641 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:24.908789 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603284908774 us; error 0 us; skew 500 ppm
I20260709 13:21:24.909416 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:24.912076 17138 webserver.cc:533] Webserver started at http://127.16.188.190:45899/ using document root <none> and password file <none>
I20260709 13:21:24.912698 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:24.912897 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:24.913236 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:24.914642 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/master-0-root/instance:
uuid: "e7e8a36e61cb4fc38ccf440704df6ccd"
format_stamp: "Formatted at 2026-07-09 13:21:24 on dist-test-slave-2hqk"
I20260709 13:21:24.919481 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:21:24.923343 27024 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:24.924185 17138 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:21:24.924733 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/master-0-root
uuid: "e7e8a36e61cb4fc38ccf440704df6ccd"
format_stamp: "Formatted at 2026-07-09 13:21:24 on dist-test-slave-2hqk"
I20260709 13:21:24.925161 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:24.947275 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:24.948958 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:24.999258 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.190:42581
I20260709 13:21:24.999378 27075 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.190:42581 every 8 connection(s)
I20260709 13:21:25.004204 27076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:25.015386 27076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd: Bootstrap starting.
I20260709 13:21:25.020304 27076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.024991 27076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd: No bootstrap required, opened a new log
I20260709 13:21:25.027320 27076 raft_consensus.cc:359] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e8a36e61cb4fc38ccf440704df6ccd" member_type: VOTER }
I20260709 13:21:25.027833 27076 raft_consensus.cc:385] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.028092 27076 raft_consensus.cc:740] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7e8a36e61cb4fc38ccf440704df6ccd, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.028784 27076 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e8a36e61cb4fc38ccf440704df6ccd" member_type: VOTER }
I20260709 13:21:25.029266 27076 raft_consensus.cc:399] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:25.029487 27076 raft_consensus.cc:493] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:25.029780 27076 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.034430 27076 raft_consensus.cc:515] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e8a36e61cb4fc38ccf440704df6ccd" member_type: VOTER }
I20260709 13:21:25.034955 27076 leader_election.cc:304] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7e8a36e61cb4fc38ccf440704df6ccd; no voters: 
I20260709 13:21:25.036167 27076 leader_election.cc:290] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:25.036844 27079 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:25.038688 27079 raft_consensus.cc:697] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [term 1 LEADER]: Becoming Leader. State: Replica: e7e8a36e61cb4fc38ccf440704df6ccd, State: Running, Role: LEADER
I20260709 13:21:25.039515 27076 sys_catalog.cc:565] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:25.039552 27079 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e8a36e61cb4fc38ccf440704df6ccd" member_type: VOTER }
I20260709 13:21:25.053218 27081 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7e8a36e61cb4fc38ccf440704df6ccd. Latest consensus state: current_term: 1 leader_uuid: "e7e8a36e61cb4fc38ccf440704df6ccd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e8a36e61cb4fc38ccf440704df6ccd" member_type: VOTER } }
I20260709 13:21:25.054425 27081 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:25.056753 27080 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7e8a36e61cb4fc38ccf440704df6ccd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e8a36e61cb4fc38ccf440704df6ccd" member_type: VOTER } }
I20260709 13:21:25.057643 27080 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:25.061695 17138 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
W20260709 13:21:25.064711 27095 catalog_manager.cc:1594] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260709 13:21:25.064980 27095 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260709 13:21:25.065505 27094 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:25.070505 27094 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:25.079869 27094 catalog_manager.cc:1383] Generated new cluster ID: 6a9b20b84ce84e31959a56597d75c274
I20260709 13:21:25.080209 27094 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:25.112023 27094 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:25.113384 27094 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:25.126844 27094 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd: Generated new TSK 0
I20260709 13:21:25.127631 27094 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:25.193468 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:25.200963 27097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:25.202298 27098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:25.205524 27100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:25.205798 17138 server_base.cc:1061] running on GCE node
I20260709 13:21:25.208710 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:25.208921 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:25.209044 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603285209033 us; error 0 us; skew 500 ppm
I20260709 13:21:25.209627 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:25.212210 17138 webserver.cc:533] Webserver started at http://127.16.188.129:41217/ using document root <none> and password file <none>
I20260709 13:21:25.212766 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:25.212940 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:25.213191 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:25.214614 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-0-root/instance:
uuid: "f79efe7c9e6a4384b765393621da6816"
format_stamp: "Formatted at 2026-07-09 13:21:25 on dist-test-slave-2hqk"
I20260709 13:21:25.219661 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:21:25.223517 27105 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:25.224426 17138 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:21:25.224877 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-0-root
uuid: "f79efe7c9e6a4384b765393621da6816"
format_stamp: "Formatted at 2026-07-09 13:21:25 on dist-test-slave-2hqk"
I20260709 13:21:25.225185 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:25.255340 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:25.256915 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:25.258833 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:25.261677 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:25.261921 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:25.262198 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:25.262418 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:25.312695 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.129:35935
I20260709 13:21:25.312815 27167 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.129:35935 every 8 connection(s)
I20260709 13:21:25.318914 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:25.334331 27172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:25.334441 27173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:25.338258 27175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:25.339340 17138 server_base.cc:1061] running on GCE node
I20260709 13:21:25.341370 27168 heartbeater.cc:344] Connected to a master server at 127.16.188.190:42581
I20260709 13:21:25.341780 27168 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:25.342640 27168 heartbeater.cc:507] Master 127.16.188.190:42581 requested a full tablet report, sending...
I20260709 13:21:25.343431 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:25.343735 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:25.343981 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603285343958 us; error 0 us; skew 500 ppm
I20260709 13:21:25.344844 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:25.344941 27041 ts_manager.cc:194] Registered new tserver with Master: f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:25.347069 27041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59656
I20260709 13:21:25.348466 17138 webserver.cc:533] Webserver started at http://127.16.188.130:36973/ using document root <none> and password file <none>
I20260709 13:21:25.349296 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:25.349545 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:25.349865 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:25.351440 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-1-root/instance:
uuid: "05f7e02ff65b470591cb5d9565f123d6"
format_stamp: "Formatted at 2026-07-09 13:21:25 on dist-test-slave-2hqk"
I20260709 13:21:25.356701 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:21:25.360448 27180 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:25.361334 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:21:25.361661 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-1-root
uuid: "05f7e02ff65b470591cb5d9565f123d6"
format_stamp: "Formatted at 2026-07-09 13:21:25 on dist-test-slave-2hqk"
I20260709 13:21:25.362007 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:25.406782 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:25.408259 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:25.410041 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:25.412621 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:25.412837 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:25.413108 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:25.413287 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:25.459158 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.130:38009
I20260709 13:21:25.459299 27242 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.130:38009 every 8 connection(s)
I20260709 13:21:25.464484 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:25.474052 27246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:25.475534 27247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:25.477859 17138 server_base.cc:1061] running on GCE node
W20260709 13:21:25.478736 27249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:25.479437 27243 heartbeater.cc:344] Connected to a master server at 127.16.188.190:42581
I20260709 13:21:25.479923 27243 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:25.480118 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:25.480427 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:25.480670 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603285480648 us; error 0 us; skew 500 ppm
I20260709 13:21:25.481002 27243 heartbeater.cc:507] Master 127.16.188.190:42581 requested a full tablet report, sending...
I20260709 13:21:25.481617 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:25.483605 27041 ts_manager.cc:194] Registered new tserver with Master: 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:25.485164 27041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59672
I20260709 13:21:25.487754 17138 webserver.cc:533] Webserver started at http://127.16.188.131:41645/ using document root <none> and password file <none>
I20260709 13:21:25.488327 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:25.488579 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:25.488876 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:25.490207 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-2-root/instance:
uuid: "2d8e002e04a74c2598405158a99d86c1"
format_stamp: "Formatted at 2026-07-09 13:21:25 on dist-test-slave-2hqk"
I20260709 13:21:25.494966 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:25.498523 27254 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:25.499294 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:25.499625 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-2-root
uuid: "2d8e002e04a74c2598405158a99d86c1"
format_stamp: "Formatted at 2026-07-09 13:21:25 on dist-test-slave-2hqk"
I20260709 13:21:25.499940 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:25.520174 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:25.521663 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:25.523404 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:25.525888 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:25.526121 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:25.526368 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:25.526551 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:25.578153 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.131:39829
I20260709 13:21:25.578279 27316 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.131:39829 every 8 connection(s)
I20260709 13:21:25.584052 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:25.592432 27320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:25.594247 27321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:25.595258 27323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:25.595903 17138 server_base.cc:1061] running on GCE node
I20260709 13:21:25.596921 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:25.597136 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:25.597277 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603285597266 us; error 0 us; skew 500 ppm
I20260709 13:21:25.597836 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:25.601584 17138 webserver.cc:533] Webserver started at http://127.16.188.132:35663/ using document root <none> and password file <none>
I20260709 13:21:25.602237 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:25.602478 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:25.602789 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:25.603287 27317 heartbeater.cc:344] Connected to a master server at 127.16.188.190:42581
I20260709 13:21:25.603765 27317 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:25.604332 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-3-root/instance:
uuid: "1962786a39404929920d966805e48399"
format_stamp: "Formatted at 2026-07-09 13:21:25 on dist-test-slave-2hqk"
I20260709 13:21:25.604635 27317 heartbeater.cc:507] Master 127.16.188.190:42581 requested a full tablet report, sending...
I20260709 13:21:25.606881 27041 ts_manager.cc:194] Registered new tserver with Master: 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:25.608239 27041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59676
I20260709 13:21:25.610067 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:21:25.614387 27328 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:25.615240 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:21:25.615588 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-3-root
uuid: "1962786a39404929920d966805e48399"
format_stamp: "Formatted at 2026-07-09 13:21:25 on dist-test-slave-2hqk"
I20260709 13:21:25.615937 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:25.632692 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:25.634147 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:25.635547 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:25.637805 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:25.638048 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:25.638295 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:25.638484 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:25.687455 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.132:40225
I20260709 13:21:25.687593 27390 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.132:40225 every 8 connection(s)
I20260709 13:21:25.702795 27391 heartbeater.cc:344] Connected to a master server at 127.16.188.190:42581
I20260709 13:21:25.703224 27391 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:25.704006 27391 heartbeater.cc:507] Master 127.16.188.190:42581 requested a full tablet report, sending...
I20260709 13:21:25.706225 27041 ts_manager.cc:194] Registered new tserver with Master: 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:25.707227 17138 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01611906s
I20260709 13:21:25.707649 27041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59688
I20260709 13:21:25.738927 27041 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59692:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:26.053671 27088 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:26.089241 27133 tablet_service.cc:1511] Processing CreateTablet for tablet 15e3484b734c41099e53b3f518789f39 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:26.090378 27130 tablet_service.cc:1511] Processing CreateTablet for tablet c942513b146c4cfeba8bdfc1baac288e (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:26.091825 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e3484b734c41099e53b3f518789f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.092710 27130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c942513b146c4cfeba8bdfc1baac288e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.092929 27129 tablet_service.cc:1511] Processing CreateTablet for tablet 315d4de5fc5940f9b5f1d3206e7028c0 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:26.093995 27132 tablet_service.cc:1511] Processing CreateTablet for tablet dd1665cdc23c4af782f4111587dbf68f (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:26.095248 27129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 315d4de5fc5940f9b5f1d3206e7028c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.097087 27131 tablet_service.cc:1511] Processing CreateTablet for tablet 26ef473dee144c5dbc7086d2b983cb59 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:26.098793 27131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ef473dee144c5dbc7086d2b983cb59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.110447 27132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd1665cdc23c4af782f4111587dbf68f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.127375 27128 tablet_service.cc:1511] Processing CreateTablet for tablet f684c9c7b4874567b690e70a7ddae640 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:26.128793 27208 tablet_service.cc:1511] Processing CreateTablet for tablet 15e3484b734c41099e53b3f518789f39 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:26.130609 27208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e3484b734c41099e53b3f518789f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.129314 27128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f684c9c7b4874567b690e70a7ddae640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.138552 27127 tablet_service.cc:1511] Processing CreateTablet for tablet 2809a3a620544e7f8ce472b3563c2df9 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:26.141870 27127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2809a3a620544e7f8ce472b3563c2df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.150704 27411 tablet_bootstrap.cc:492] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:26.151139 27207 tablet_service.cc:1511] Processing CreateTablet for tablet dd1665cdc23c4af782f4111587dbf68f (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:26.152911 27207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd1665cdc23c4af782f4111587dbf68f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.160063 27411 tablet_bootstrap.cc:654] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.162966 27206 tablet_service.cc:1511] Processing CreateTablet for tablet ff5e8ee488ee4e18adea644ba22ed683 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:26.165068 27206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5e8ee488ee4e18adea644ba22ed683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.165409 27131 tablet_service.cc:1511] Processing CreateTablet for tablet 2097666912334a53a80b648a0fad2786 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:26.167160 27131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2097666912334a53a80b648a0fad2786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.172655 27127 tablet_service.cc:1511] Processing CreateTablet for tablet 148eb001e9854043a2ad74dc8af08ae0 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:26.174440 27127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148eb001e9854043a2ad74dc8af08ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.175141 27205 tablet_service.cc:1511] Processing CreateTablet for tablet c942513b146c4cfeba8bdfc1baac288e (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:26.176888 27204 tablet_service.cc:1511] Processing CreateTablet for tablet 315d4de5fc5940f9b5f1d3206e7028c0 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:26.180598 27205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c942513b146c4cfeba8bdfc1baac288e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.182816 27282 tablet_service.cc:1511] Processing CreateTablet for tablet 15e3484b734c41099e53b3f518789f39 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:26.187875 27282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e3484b734c41099e53b3f518789f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.188891 27204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 315d4de5fc5940f9b5f1d3206e7028c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.199543 27281 tablet_service.cc:1511] Processing CreateTablet for tablet 26ef473dee144c5dbc7086d2b983cb59 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:26.201850 27281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ef473dee144c5dbc7086d2b983cb59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.214977 27280 tablet_service.cc:1511] Processing CreateTablet for tablet ff5e8ee488ee4e18adea644ba22ed683 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:26.216538 27280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5e8ee488ee4e18adea644ba22ed683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.216280 27279 tablet_service.cc:1511] Processing CreateTablet for tablet c942513b146c4cfeba8bdfc1baac288e (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:26.218556 27279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c942513b146c4cfeba8bdfc1baac288e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.228050 27356 tablet_service.cc:1511] Processing CreateTablet for tablet dd1665cdc23c4af782f4111587dbf68f (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:26.228109 27278 tablet_service.cc:1511] Processing CreateTablet for tablet f684c9c7b4874567b690e70a7ddae640 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:26.231150 27277 tablet_service.cc:1511] Processing CreateTablet for tablet 7109f14a616b49939aa2fbd96d6ad458 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:26.231150 27276 tablet_service.cc:1511] Processing CreateTablet for tablet 2809a3a620544e7f8ce472b3563c2df9 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:26.235052 27278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f684c9c7b4874567b690e70a7ddae640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.237272 27276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2809a3a620544e7f8ce472b3563c2df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.239379 27277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7109f14a616b49939aa2fbd96d6ad458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.239588 27203 tablet_service.cc:1511] Processing CreateTablet for tablet 2809a3a620544e7f8ce472b3563c2df9 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:26.241839 27201 tablet_service.cc:1511] Processing CreateTablet for tablet 960bc3fba4dc481e9602d13cd4a0b5ae (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:26.244073 27202 tablet_service.cc:1511] Processing CreateTablet for tablet 2097666912334a53a80b648a0fad2786 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:26.246821 27355 tablet_service.cc:1511] Processing CreateTablet for tablet 26ef473dee144c5dbc7086d2b983cb59 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:26.253674 27352 tablet_service.cc:1511] Processing CreateTablet for tablet f684c9c7b4874567b690e70a7ddae640 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:26.256698 27349 tablet_service.cc:1511] Processing CreateTablet for tablet 148eb001e9854043a2ad74dc8af08ae0 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:26.259321 27350 tablet_service.cc:1511] Processing CreateTablet for tablet 2097666912334a53a80b648a0fad2786 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:26.260869 27133 tablet_service.cc:1511] Processing CreateTablet for tablet add22a21c5bf424390df6d87617a47e7 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:26.261862 27351 tablet_service.cc:1511] Processing CreateTablet for tablet 7109f14a616b49939aa2fbd96d6ad458 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:26.262394 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add22a21c5bf424390df6d87617a47e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.266360 27348 tablet_service.cc:1511] Processing CreateTablet for tablet 960bc3fba4dc481e9602d13cd4a0b5ae (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:26.266942 27205 tablet_service.cc:1511] Processing CreateTablet for tablet add22a21c5bf424390df6d87617a47e7 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:26.267423 27274 tablet_service.cc:1511] Processing CreateTablet for tablet 960bc3fba4dc481e9602d13cd4a0b5ae (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:26.267720 27354 tablet_service.cc:1511] Processing CreateTablet for tablet ff5e8ee488ee4e18adea644ba22ed683 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:26.268939 27274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 960bc3fba4dc481e9602d13cd4a0b5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.269061 27347 tablet_service.cc:1511] Processing CreateTablet for tablet b8bc3f6a11ae4b85870951a4ef079571 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:26.270186 27353 tablet_service.cc:1511] Processing CreateTablet for tablet 315d4de5fc5940f9b5f1d3206e7028c0 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:26.233110 27275 tablet_service.cc:1511] Processing CreateTablet for tablet 148eb001e9854043a2ad74dc8af08ae0 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:26.272722 27275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148eb001e9854043a2ad74dc8af08ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.273855 27273 tablet_service.cc:1511] Processing CreateTablet for tablet add22a21c5bf424390df6d87617a47e7 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:26.275274 27273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add22a21c5bf424390df6d87617a47e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.281241 27203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2809a3a620544e7f8ce472b3563c2df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.289605 27208 tablet_service.cc:1511] Processing CreateTablet for tablet 7109f14a616b49939aa2fbd96d6ad458 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:26.293349 27202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2097666912334a53a80b648a0fad2786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.249224 27355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ef473dee144c5dbc7086d2b983cb59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.296329 27205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add22a21c5bf424390df6d87617a47e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.296898 27351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7109f14a616b49939aa2fbd96d6ad458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.297772 27208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7109f14a616b49939aa2fbd96d6ad458. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.300936 27356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd1665cdc23c4af782f4111587dbf68f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.302615 27350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2097666912334a53a80b648a0fad2786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.305233 27201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 960bc3fba4dc481e9602d13cd4a0b5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.307403 27354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5e8ee488ee4e18adea644ba22ed683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.311535 27353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 315d4de5fc5940f9b5f1d3206e7028c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.315148 27349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148eb001e9854043a2ad74dc8af08ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.315917 27413 tablet_bootstrap.cc:492] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:26.320914 27352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f684c9c7b4874567b690e70a7ddae640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.324020 27347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8bc3f6a11ae4b85870951a4ef079571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.325939 27348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 960bc3fba4dc481e9602d13cd4a0b5ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.334614 27208 tablet_service.cc:1511] Processing CreateTablet for tablet b8bc3f6a11ae4b85870951a4ef079571 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:26.336084 27208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8bc3f6a11ae4b85870951a4ef079571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.339677 27413 tablet_bootstrap.cc:654] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.340828 27133 tablet_service.cc:1511] Processing CreateTablet for tablet b8bc3f6a11ae4b85870951a4ef079571 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:26.342314 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8bc3f6a11ae4b85870951a4ef079571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.350461 27168 heartbeater.cc:499] Master 127.16.188.190:42581 was elected leader, sending a full tablet report...
I20260709 13:21:26.354647 27411 tablet_bootstrap.cc:492] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:26.355239 27411 ts_tablet_manager.cc:1403] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.205s	user 0.033s	sys 0.030s
I20260709 13:21:26.358496 27131 tablet_service.cc:1511] Processing CreateTablet for tablet 501b61a3989144c5a902cbf9ddbab055 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:26.360291 27131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501b61a3989144c5a902cbf9ddbab055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.372900 27276 tablet_service.cc:1511] Processing CreateTablet for tablet 501b61a3989144c5a902cbf9ddbab055 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:26.374737 27276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501b61a3989144c5a902cbf9ddbab055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.359783 27411 raft_consensus.cc:359] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:26.375322 27411 raft_consensus.cc:385] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.375741 27411 raft_consensus.cc:740] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.377013 27411 consensus_queue.cc:260] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:26.392112 27208 tablet_service.cc:1511] Processing CreateTablet for tablet be5dc6e054a74138af98e26f08cd76e0 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:26.393579 27208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5dc6e054a74138af98e26f08cd76e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.399986 27273 tablet_service.cc:1511] Processing CreateTablet for tablet be5dc6e054a74138af98e26f08cd76e0 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:26.409230 27273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5dc6e054a74138af98e26f08cd76e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.419121 27128 tablet_service.cc:1511] Processing CreateTablet for tablet b1a9e5ac221b44be83106f28e32dc20e (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:26.420650 27128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a9e5ac221b44be83106f28e32dc20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.438755 27414 tablet_bootstrap.cc:492] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:26.456491 27411 ts_tablet_manager.cc:1434] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.101s	user 0.009s	sys 0.009s
I20260709 13:21:26.457837 27411 tablet_bootstrap.cc:492] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:26.461517 27127 tablet_service.cc:1511] Processing CreateTablet for tablet 42ad970eae96417783396e7accb1b834 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:26.462903 27127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ad970eae96417783396e7accb1b834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.470675 27205 tablet_service.cc:1511] Processing CreateTablet for tablet b1a9e5ac221b44be83106f28e32dc20e (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:26.471977 27205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a9e5ac221b44be83106f28e32dc20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.477677 27351 tablet_service.cc:1511] Processing CreateTablet for tablet 501b61a3989144c5a902cbf9ddbab055 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:26.488178 27243 heartbeater.cc:499] Master 127.16.188.190:42581 was elected leader, sending a full tablet report...
I20260709 13:21:26.489171 27351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501b61a3989144c5a902cbf9ddbab055. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.497680 27278 tablet_service.cc:1511] Processing CreateTablet for tablet 93e07aed35c54d449d6103728c481ab5 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:26.499152 27278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e07aed35c54d449d6103728c481ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.482726 27347 tablet_service.cc:1511] Processing CreateTablet for tablet be5dc6e054a74138af98e26f08cd76e0 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:26.490485 27348 tablet_service.cc:1511] Processing CreateTablet for tablet 42ad970eae96417783396e7accb1b834 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:26.504666 27347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5dc6e054a74138af98e26f08cd76e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.505357 27348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ad970eae96417783396e7accb1b834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.501250 27202 tablet_service.cc:1511] Processing CreateTablet for tablet 42ad970eae96417783396e7accb1b834 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:26.508782 27413 tablet_bootstrap.cc:492] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:26.511070 27413 ts_tablet_manager.cc:1403] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.196s	user 0.010s	sys 0.010s
I20260709 13:21:26.513433 27411 tablet_bootstrap.cc:654] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.514216 27202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ad970eae96417783396e7accb1b834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.512954 27280 tablet_service.cc:1511] Processing CreateTablet for tablet b1a9e5ac221b44be83106f28e32dc20e (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:26.521562 27280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a9e5ac221b44be83106f28e32dc20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.545528 27131 tablet_service.cc:1511] Processing CreateTablet for tablet 93e07aed35c54d449d6103728c481ab5 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:26.547148 27131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e07aed35c54d449d6103728c481ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.549921 27132 tablet_service.cc:1511] Processing CreateTablet for tablet dd74c5033db646ea91b4ca463507c3a3 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:26.551288 27132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd74c5033db646ea91b4ca463507c3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.559288 27413 raft_consensus.cc:359] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:26.560194 27413 raft_consensus.cc:385] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.568451 27130 tablet_service.cc:1511] Processing CreateTablet for tablet 0fb491563d1a49ac99c74ae4f6553d26 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:26.569944 27130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb491563d1a49ac99c74ae4f6553d26. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:26.568925 27169 tablet.cc:2406] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:21:26.572582 27203 tablet_service.cc:1511] Processing CreateTablet for tablet dd74c5033db646ea91b4ca463507c3a3 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:26.573861 27203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd74c5033db646ea91b4ca463507c3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.573668 27349 tablet_service.cc:1511] Processing CreateTablet for tablet 2c666107348f4678ba2161b66cd6d486 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:26.574038 27273 tablet_service.cc:1511] Processing CreateTablet for tablet dd74c5033db646ea91b4ca463507c3a3 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:26.574914 27349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c666107348f4678ba2161b66cd6d486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.575618 27273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd74c5033db646ea91b4ca463507c3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.577315 27347 tablet_service.cc:1511] Processing CreateTablet for tablet 0fb491563d1a49ac99c74ae4f6553d26 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:26.578537 27414 tablet_bootstrap.cc:654] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.578694 27347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb491563d1a49ac99c74ae4f6553d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.578575 27276 tablet_service.cc:1511] Processing CreateTablet for tablet 2c666107348f4678ba2161b66cd6d486 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:26.570737 27354 tablet_service.cc:1511] Processing CreateTablet for tablet 93e07aed35c54d449d6103728c481ab5 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:26.583178 27205 tablet_service.cc:1511] Processing CreateTablet for tablet 2c666107348f4678ba2161b66cd6d486 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:26.584321 27413 raft_consensus.cc:740] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.593549 27354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e07aed35c54d449d6103728c481ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.596629 27276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c666107348f4678ba2161b66cd6d486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.601111 27205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c666107348f4678ba2161b66cd6d486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.611763 27317 heartbeater.cc:499] Master 127.16.188.190:42581 was elected leader, sending a full tablet report...
I20260709 13:21:26.601792 27413 consensus_queue.cc:260] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:26.624769 27417 tablet_bootstrap.cc:492] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:26.640200 27411 tablet_bootstrap.cc:492] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:26.641729 27411 ts_tablet_manager.cc:1403] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.184s	user 0.020s	sys 0.007s
I20260709 13:21:26.655530 27413 ts_tablet_manager.cc:1434] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.144s	user 0.014s	sys 0.002s
I20260709 13:21:26.657258 27413 tablet_bootstrap.cc:492] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:26.675803 27417 tablet_bootstrap.cc:654] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.648167 27411 raft_consensus.cc:359] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:26.680627 27411 raft_consensus.cc:385] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.681100 27411 raft_consensus.cc:740] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.684199 27411 consensus_queue.cc:260] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:26.687734 27411 ts_tablet_manager.cc:1434] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:21:26.688915 27411 tablet_bootstrap.cc:492] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:26.696190 27411 tablet_bootstrap.cc:654] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.696098 27202 tablet_service.cc:1511] Processing CreateTablet for tablet 0fb491563d1a49ac99c74ae4f6553d26 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:26.697894 27202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb491563d1a49ac99c74ae4f6553d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.699725 27414 tablet_bootstrap.cc:492] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:26.700392 27414 ts_tablet_manager.cc:1403] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.262s	user 0.026s	sys 0.042s
I20260709 13:21:26.705545 27414 raft_consensus.cc:359] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:26.706579 27414 raft_consensus.cc:385] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.706890 27414 raft_consensus.cc:740] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.707649 27414 consensus_queue.cc:260] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:26.708858 27413 tablet_bootstrap.cc:654] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.710633 27391 heartbeater.cc:499] Master 127.16.188.190:42581 was elected leader, sending a full tablet report...
I20260709 13:21:26.714960 27414 ts_tablet_manager.cc:1434] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:21:26.716073 27414 tablet_bootstrap.cc:492] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:26.719017 27411 tablet_bootstrap.cc:492] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:26.719676 27411 ts_tablet_manager.cc:1403] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.002s
I20260709 13:21:26.724611 27280 tablet_service.cc:1511] Processing CreateTablet for tablet 76efc04736174df4a18381faaf044830 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:26.726075 27413 tablet_bootstrap.cc:492] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:26.726738 27413 ts_tablet_manager.cc:1403] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.002s
I20260709 13:21:26.727228 27411 raft_consensus.cc:359] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:26.727972 27411 raft_consensus.cc:385] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.728230 27411 raft_consensus.cc:740] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.729002 27411 consensus_queue.cc:260] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:26.730533 27280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76efc04736174df4a18381faaf044830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.730906 27417 tablet_bootstrap.cc:492] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:26.731277 27411 ts_tablet_manager.cc:1434] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:21:26.732357 27411 tablet_bootstrap.cc:492] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:26.732764 27347 tablet_service.cc:1511] Processing CreateTablet for tablet 76efc04736174df4a18381faaf044830 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:26.734157 27347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76efc04736174df4a18381faaf044830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.722944 27414 tablet_bootstrap.cc:654] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.737847 27411 tablet_bootstrap.cc:654] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.739460 27413 raft_consensus.cc:359] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:26.731477 27417 ts_tablet_manager.cc:1403] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.004s
I20260709 13:21:26.742183 27413 raft_consensus.cc:385] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.742748 27413 raft_consensus.cc:740] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.743746 27413 consensus_queue.cc:260] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:26.746408 27132 tablet_service.cc:1511] Processing CreateTablet for tablet 76efc04736174df4a18381faaf044830 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:26.746328 27413 ts_tablet_manager.cc:1434] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.003s
I20260709 13:21:26.747982 27132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76efc04736174df4a18381faaf044830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.748557 27415 raft_consensus.cc:493] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.749323 27415 raft_consensus.cc:515] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:26.754689 27417 raft_consensus.cc:359] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:26.755514 27417 raft_consensus.cc:385] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.754947 27415 leader_election.cc:290] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:26.758337 27205 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8d513ca0a647d5a716650ed58360f6 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:26.759829 27205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8d513ca0a647d5a716650ed58360f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.755841 27417 raft_consensus.cc:740] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.762285 27417 consensus_queue.cc:260] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:26.768128 27413 tablet_bootstrap.cc:492] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:26.769367 27276 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8d513ca0a647d5a716650ed58360f6 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:26.771860 27276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8d513ca0a647d5a716650ed58360f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.801733 27420 raft_consensus.cc:493] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.802407 27420 raft_consensus.cc:515] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:26.808363 27420 leader_election.cc:290] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:26.829475 27414 tablet_bootstrap.cc:492] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:26.830094 27414 ts_tablet_manager.cc:1403] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.114s	user 0.023s	sys 0.003s
I20260709 13:21:26.833362 27414 raft_consensus.cc:359] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:26.834079 27414 raft_consensus.cc:385] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.834380 27414 raft_consensus.cc:740] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.835827 27414 consensus_queue.cc:260] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:26.849670 27417 ts_tablet_manager.cc:1434] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.107s	user 0.009s	sys 0.015s
I20260709 13:21:26.855201 27411 tablet_bootstrap.cc:492] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:26.853031 27420 raft_consensus.cc:493] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.855734 27411 ts_tablet_manager.cc:1403] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.124s	user 0.024s	sys 0.061s
I20260709 13:21:26.855984 27420 raft_consensus.cc:515] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:26.858069 27420 leader_election.cc:290] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:26.858901 27411 raft_consensus.cc:359] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:26.859648 27411 raft_consensus.cc:385] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.859938 27411 raft_consensus.cc:740] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.860819 27411 consensus_queue.cc:260] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:26.863667 27411 ts_tablet_manager.cc:1434] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:21:26.864760 27411 tablet_bootstrap.cc:492] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:26.869856 27413 tablet_bootstrap.cc:654] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.873871 27411 tablet_bootstrap.cc:654] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.879262 27417 tablet_bootstrap.cc:492] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:26.886498 27414 ts_tablet_manager.cc:1434] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.000s
I20260709 13:21:26.888226 27414 tablet_bootstrap.cc:492] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:26.906325 27130 tablet_service.cc:1511] Processing CreateTablet for tablet 46295debdbf04af3ae614987b17bd03d (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:26.906417 27347 tablet_service.cc:1511] Processing CreateTablet for tablet 6b8d513ca0a647d5a716650ed58360f6 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:26.908215 27202 tablet_service.cc:1511] Processing CreateTablet for tablet 46295debdbf04af3ae614987b17bd03d (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:26.909469 27423 raft_consensus.cc:493] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.917093 27423 raft_consensus.cc:515] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:26.919129 27130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46295debdbf04af3ae614987b17bd03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.914042 27347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b8d513ca0a647d5a716650ed58360f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.910286 27273 tablet_service.cc:1511] Processing CreateTablet for tablet 46295debdbf04af3ae614987b17bd03d (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:26.920205 27423 leader_election.cc:290] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:26.932061 27354 tablet_service.cc:1511] Processing CreateTablet for tablet b76838dbe1fd4a4eac1e7d5740cf668f (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:26.940459 27273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46295debdbf04af3ae614987b17bd03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.941438 27411 tablet_bootstrap.cc:492] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:26.942085 27411 ts_tablet_manager.cc:1403] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.013s
I20260709 13:21:26.942514 27415 raft_consensus.cc:493] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.943087 27415 raft_consensus.cc:515] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:26.945642 27415 leader_election.cc:290] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:26.945523 27411 raft_consensus.cc:359] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:26.946350 27411 raft_consensus.cc:385] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.946667 27411 raft_consensus.cc:740] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.946691 27128 tablet_service.cc:1511] Processing CreateTablet for tablet b76838dbe1fd4a4eac1e7d5740cf668f (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:26.947770 27411 consensus_queue.cc:260] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:26.950572 27205 tablet_service.cc:1511] Processing CreateTablet for tablet b76838dbe1fd4a4eac1e7d5740cf668f (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:26.951217 27411 ts_tablet_manager.cc:1434] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:21:26.939217 27202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46295debdbf04af3ae614987b17bd03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.952680 27411 tablet_bootstrap.cc:492] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:26.964052 27354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76838dbe1fd4a4eac1e7d5740cf668f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.971208 27128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76838dbe1fd4a4eac1e7d5740cf668f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.971777 27414 tablet_bootstrap.cc:654] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.982661 27349 tablet_service.cc:1511] Processing CreateTablet for tablet 728a1fd5a8c84cb19f6691fc08e1eeef (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:26.983289 27417 tablet_bootstrap.cc:654] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.984161 27349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728a1fd5a8c84cb19f6691fc08e1eeef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.994683 27205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76838dbe1fd4a4eac1e7d5740cf668f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:26.997822 27131 tablet_service.cc:1511] Processing CreateTablet for tablet 728a1fd5a8c84cb19f6691fc08e1eeef (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:27.001075 27131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728a1fd5a8c84cb19f6691fc08e1eeef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.002785 27203 tablet_service.cc:1511] Processing CreateTablet for tablet f28a920522f34d318c610b60571ca004 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:27.004099 27203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f28a920522f34d318c610b60571ca004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.011590 27356 tablet_service.cc:1511] Processing CreateTablet for tablet f28a920522f34d318c610b60571ca004 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:27.013821 27411 tablet_bootstrap.cc:654] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.014276 27356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f28a920522f34d318c610b60571ca004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.025528 27201 tablet_service.cc:1511] Processing CreateTablet for tablet f09320cdf2a440f789313b20646079a6 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:27.027292 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3484b734c41099e53b3f518789f39" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:27.027786 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c942513b146c4cfeba8bdfc1baac288e" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:27.028678 27142 raft_consensus.cc:2468] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:27.029642 27201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09320cdf2a440f789313b20646079a6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:27.030792 27183 leader_election.cc:343] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.031580 27183 leader_election.cc:304] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:27.032539 27420 raft_consensus.cc:2804] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:27.032449 27352 tablet_service.cc:1511] Processing CreateTablet for tablet 966ee691db624d2bac9b9cfe639d8963 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:27.033021 27420 raft_consensus.cc:493] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.033372 27420 raft_consensus.cc:3060] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.033917 27352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966ee691db624d2bac9b9cfe639d8963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.037550 27133 tablet_service.cc:1511] Processing CreateTablet for tablet 966ee691db624d2bac9b9cfe639d8963 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:27.038813 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966ee691db624d2bac9b9cfe639d8963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.053634 27208 tablet_service.cc:1511] Processing CreateTablet for tablet 966ee691db624d2bac9b9cfe639d8963 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:27.055178 27208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 966ee691db624d2bac9b9cfe639d8963. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:27.059614 27088 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:27.067881 27415 raft_consensus.cc:493] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.069468 27415 raft_consensus.cc:515] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:27.070122 27417 tablet_bootstrap.cc:492] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:27.070757 27417 ts_tablet_manager.cc:1403] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.192s	user 0.010s	sys 0.007s
I20260709 13:21:27.071758 27415 leader_election.cc:290] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:27.079520 27413 tablet_bootstrap.cc:492] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:27.080183 27413 ts_tablet_manager.cc:1403] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.312s	user 0.013s	sys 0.047s
I20260709 13:21:27.083694 27413 raft_consensus.cc:359] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.086385 27280 tablet_service.cc:1511] Processing CreateTablet for tablet f28a920522f34d318c610b60571ca004 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:27.091549 27280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f28a920522f34d318c610b60571ca004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.087800 27276 tablet_service.cc:1511] Processing CreateTablet for tablet f09320cdf2a440f789313b20646079a6 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:27.093189 27276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09320cdf2a440f789313b20646079a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.096082 27278 tablet_service.cc:1511] Processing CreateTablet for tablet 00a2e2e4269146dd8e2bf720a1c890d8 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:27.097474 27278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a2e2e4269146dd8e2bf720a1c890d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.098697 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:27.098834 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315d4de5fc5940f9b5f1d3206e7028c0" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:27.099857 27420 raft_consensus.cc:515] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
W20260709 13:21:27.101433 27109 leader_election.cc:343] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.102135 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315d4de5fc5940f9b5f1d3206e7028c0" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:27.102288 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2809a3a620544e7f8ce472b3563c2df9" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:27.103052 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c942513b146c4cfeba8bdfc1baac288e" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
W20260709 13:21:27.114466 27109 leader_election.cc:343] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:27.104029 27257 leader_election.cc:343] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.084504 27413 raft_consensus.cc:385] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.114943 27109 leader_election.cc:304] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399
I20260709 13:21:27.115434 27413 raft_consensus.cc:740] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.115890 27415 raft_consensus.cc:2749] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.116267 27128 tablet_service.cc:1511] Processing CreateTablet for tablet 00a2e2e4269146dd8e2bf720a1c890d8 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:27.117997 27128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a2e2e4269146dd8e2bf720a1c890d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.118738 27417 raft_consensus.cc:359] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:27.119570 27417 raft_consensus.cc:385] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.119867 27417 raft_consensus.cc:740] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
W20260709 13:21:27.122485 27109 leader_election.cc:343] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.085958 27132 tablet_service.cc:1511] Processing CreateTablet for tablet f09320cdf2a440f789313b20646079a6 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:27.132855 27281 tablet_service.cc:1511] Processing CreateTablet for tablet 706ddcc20d574055ac044c0ff3d638a0 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:27.133301 27273 tablet_service.cc:1511] Processing CreateTablet for tablet 728a1fd5a8c84cb19f6691fc08e1eeef (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:27.123543 27413 consensus_queue.cc:260] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.134267 27281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706ddcc20d574055ac044c0ff3d638a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.125042 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3484b734c41099e53b3f518789f39" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:27.125509 27423 raft_consensus.cc:493] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.135916 27423 raft_consensus.cc:515] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.138252 27423 leader_election.cc:290] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:27.144304 27217 raft_consensus.cc:2393] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f79efe7c9e6a4384b765393621da6816 in current term 1: Already voted for candidate 05f7e02ff65b470591cb5d9565f123d6 in this term.
I20260709 13:21:27.145226 27356 tablet_service.cc:1511] Processing CreateTablet for tablet 706ddcc20d574055ac044c0ff3d638a0 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:27.146698 27356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706ddcc20d574055ac044c0ff3d638a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.127875 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c942513b146c4cfeba8bdfc1baac288e" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:27.147912 27429 raft_consensus.cc:493] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.129703 27132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09320cdf2a440f789313b20646079a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.148420 27429 raft_consensus.cc:515] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:27.150940 27273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728a1fd5a8c84cb19f6691fc08e1eeef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.141080 27292 raft_consensus.cc:2468] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:27.155866 27429 leader_election.cc:290] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
W20260709 13:21:27.167637 27184 leader_election.cc:343] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.169131 27184 leader_election.cc:304] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: f79efe7c9e6a4384b765393621da6816
I20260709 13:21:27.169673 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3484b734c41099e53b3f518789f39" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:27.176995 27205 tablet_service.cc:1511] Processing CreateTablet for tablet 706ddcc20d574055ac044c0ff3d638a0 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:27.181507 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c942513b146c4cfeba8bdfc1baac288e" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:27.181777 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2809a3a620544e7f8ce472b3563c2df9" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
W20260709 13:21:27.183461 27109 leader_election.cc:343] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.183681 27420 leader_election.cc:290] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:27.183979 27109 leader_election.cc:304] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:27.184458 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c942513b146c4cfeba8bdfc1baac288e" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:27.184988 27415 raft_consensus.cc:3060] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.180850 27414 tablet_bootstrap.cc:492] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:27.186074 27414 ts_tablet_manager.cc:1403] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.298s	user 0.024s	sys 0.006s
I20260709 13:21:27.186827 27411 tablet_bootstrap.cc:492] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:27.187434 27411 ts_tablet_manager.cc:1403] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.235s	user 0.010s	sys 0.014s
I20260709 13:21:27.188863 27131 tablet_service.cc:1511] Processing CreateTablet for tablet 976b5b49dae34fae8a725ff84ca47fe5 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:27.190301 27131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 976b5b49dae34fae8a725ff84ca47fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.190745 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3484b734c41099e53b3f518789f39" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:27.191018 27411 raft_consensus.cc:359] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:27.191826 27411 raft_consensus.cc:385] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.192116 27411 raft_consensus.cc:740] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
W20260709 13:21:27.193035 27109 leader_election.cc:343] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.193539 27109 leader_election.cc:304] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:27.193670 27413 ts_tablet_manager.cc:1434] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.113s	user 0.009s	sys 0.011s
I20260709 13:21:27.200196 27411 consensus_queue.cc:260] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:27.200768 27352 tablet_service.cc:1511] Processing CreateTablet for tablet 00a2e2e4269146dd8e2bf720a1c890d8 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:27.143391 27417 consensus_queue.cc:260] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:27.197220 27415 raft_consensus.cc:2749] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.197274 27420 raft_consensus.cc:2804] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:27.198472 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:27.211593 27205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 706ddcc20d574055ac044c0ff3d638a0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:27.218106 27258 leader_election.cc:343] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.218667 27258 leader_election.cc:304] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:27.219975 27423 raft_consensus.cc:2749] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.212592 27420 raft_consensus.cc:493] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.235937 27413 tablet_bootstrap.cc:492] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:27.241453 27347 tablet_service.cc:1511] Processing CreateTablet for tablet e69c998c37474f57b3b6d7355f0cc235 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:27.245486 27414 raft_consensus.cc:359] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:27.246644 27414 raft_consensus.cc:385] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.247010 27414 raft_consensus.cc:740] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.251811 27417 ts_tablet_manager.cc:1434] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.181s	user 0.008s	sys 0.002s
I20260709 13:21:27.253093 27417 tablet_bootstrap.cc:492] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:27.254483 27133 tablet_service.cc:1511] Processing CreateTablet for tablet e69c998c37474f57b3b6d7355f0cc235 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:27.216672 27415 raft_consensus.cc:2749] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.232658 27352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a2e2e4269146dd8e2bf720a1c890d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.264120 27451 raft_consensus.cc:493] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.267951 27142 raft_consensus.cc:2468] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:27.248064 27414 consensus_queue.cc:260] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:27.230238 27420 raft_consensus.cc:3060] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.279414 27183 leader_election.cc:304] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:27.281234 27349 tablet_service.cc:1511] Processing CreateTablet for tablet 2af7a5fd35f9478ba7387eec2ab4d036 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:27.292217 27349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af7a5fd35f9478ba7387eec2ab4d036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.294916 27449 raft_consensus.cc:2804] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:27.295475 27449 raft_consensus.cc:697] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:27.296432 27449 consensus_queue.cc:237] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:27.297233 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69c998c37474f57b3b6d7355f0cc235. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:27.212687 27184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 43752.6us
I20260709 13:21:27.284698 27451 raft_consensus.cc:515] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:27.302711 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c942513b146c4cfeba8bdfc1baac288e" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
W20260709 13:21:27.304283 27184 leader_election.cc:343] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.304134 27203 tablet_service.cc:1511] Processing CreateTablet for tablet e69c998c37474f57b3b6d7355f0cc235 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:27.305622 27203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69c998c37474f57b3b6d7355f0cc235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.305924 27451 leader_election.cc:290] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:27.306452 27451 raft_consensus.cc:493] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.306885 27451 raft_consensus.cc:515] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.308856 27451 leader_election.cc:290] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:27.308938 27411 ts_tablet_manager.cc:1434] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.121s	user 0.022s	sys 0.005s
I20260709 13:21:27.309672 27201 tablet_service.cc:1511] Processing CreateTablet for tablet 976b5b49dae34fae8a725ff84ca47fe5 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:27.310310 27411 tablet_bootstrap.cc:492] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:27.304466 27202 tablet_service.cc:1511] Processing CreateTablet for tablet 5ab38e5621004b79ad7c4f961d7e29ae (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:27.300952 27417 tablet_bootstrap.cc:654] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.299724 27415 raft_consensus.cc:493] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.311080 27201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 976b5b49dae34fae8a725ff84ca47fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.312775 27415 raft_consensus.cc:515] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:27.316326 27348 tablet_service.cc:1511] Processing CreateTablet for tablet 5ab38e5621004b79ad7c4f961d7e29ae (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:27.316936 27202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab38e5621004b79ad7c4f961d7e29ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.343072 27413 tablet_bootstrap.cc:654] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.361639 27347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69c998c37474f57b3b6d7355f0cc235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.362608 27348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab38e5621004b79ad7c4f961d7e29ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.372141 27415 leader_election.cc:290] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
W20260709 13:21:27.262771 27257 leader_election.cc:343] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:27.264586 27109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 71621.7us
I20260709 13:21:27.385831 27205 tablet_service.cc:1511] Processing CreateTablet for tablet 548f20dfb71a4917ae7ba2f706241ec1 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:21:27.378086 27257 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:35935, user_credentials={real_user=slave}} blocked reactor thread for 116948us
I20260709 13:21:27.391811 27039 catalog_manager.cc:5697] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:27.392829 27128 tablet_service.cc:1511] Processing CreateTablet for tablet 2af7a5fd35f9478ba7387eec2ab4d036 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:27.394302 27128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af7a5fd35f9478ba7387eec2ab4d036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.394376 27281 tablet_service.cc:1511] Processing CreateTablet for tablet 976b5b49dae34fae8a725ff84ca47fe5 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:27.394886 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f684c9c7b4874567b690e70a7ddae640" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:27.395805 27281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 976b5b49dae34fae8a725ff84ca47fe5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:27.396373 27332 leader_election.cc:343] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.398692 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ef473dee144c5dbc7086d2b983cb59" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:27.397606 27275 tablet_service.cc:1511] Processing CreateTablet for tablet 5ab38e5621004b79ad7c4f961d7e29ae (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:27.400604 27275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ab38e5621004b79ad7c4f961d7e29ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.401464 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1665cdc23c4af782f4111587dbf68f" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:27.402240 27217 raft_consensus.cc:2468] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 0.
I20260709 13:21:27.402390 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148eb001e9854043a2ad74dc8af08ae0" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:27.397557 27278 tablet_service.cc:1511] Processing CreateTablet for tablet 2af7a5fd35f9478ba7387eec2ab4d036 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:27.403386 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ef473dee144c5dbc7086d2b983cb59" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
W20260709 13:21:27.404197 27109 leader_election.cc:343] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:27.405022 27109 leader_election.cc:343] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.404929 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1665cdc23c4af782f4111587dbf68f" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:27.405798 27109 leader_election.cc:304] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:27.407629 27278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af7a5fd35f9478ba7387eec2ab4d036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.409127 27414 ts_tablet_manager.cc:1434] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.223s	user 0.001s	sys 0.008s
I20260709 13:21:27.412570 27205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548f20dfb71a4917ae7ba2f706241ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.412245 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f684c9c7b4874567b690e70a7ddae640" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
W20260709 13:21:27.414474 27331 leader_election.cc:343] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.415043 27331 leader_election.cc:304] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:27.422439 27429 raft_consensus.cc:2749] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.423280 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148eb001e9854043a2ad74dc8af08ae0" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:27.429715 27274 tablet_service.cc:1511] Processing CreateTablet for tablet 548f20dfb71a4917ae7ba2f706241ec1 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:27.431316 27274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548f20dfb71a4917ae7ba2f706241ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.436400 27356 tablet_service.cc:1511] Processing CreateTablet for tablet 98dc2c568d9642a587b5741241562afe (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 13:21:27.437034 27109 leader_election.cc:343] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.437500 27109 leader_election.cc:304] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:27.437880 27356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98dc2c568d9642a587b5741241562afe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:27.438747 27109 leader_election.cc:343] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:27.439662 27109 leader_election.cc:343] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.440045 27109 leader_election.cc:304] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:27.440351 27132 tablet_service.cc:1511] Processing CreateTablet for tablet 548f20dfb71a4917ae7ba2f706241ec1 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:27.441952 27132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548f20dfb71a4917ae7ba2f706241ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.442046 27415 raft_consensus.cc:2749] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.442836 27415 raft_consensus.cc:2749] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.452458 27130 tablet_service.cc:1511] Processing CreateTablet for tablet 98dc2c568d9642a587b5741241562afe (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:27.454463 27130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98dc2c568d9642a587b5741241562afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.454993 27420 raft_consensus.cc:515] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.456354 27216 raft_consensus.cc:2393] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d8e002e04a74c2598405158a99d86c1 in current term 1: Already voted for candidate 05f7e02ff65b470591cb5d9565f123d6 in this term.
I20260709 13:21:27.458489 27258 leader_election.cc:304] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:27.459641 27423 raft_consensus.cc:3060] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.452572 27450 raft_consensus.cc:2804] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:27.467849 27208 tablet_service.cc:1511] Processing CreateTablet for tablet 98dc2c568d9642a587b5741241562afe (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:27.468812 27450 raft_consensus.cc:493] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.469686 27450 raft_consensus.cc:3060] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.470486 27208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98dc2c568d9642a587b5741241562afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.467947 27423 raft_consensus.cc:2749] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.487522 27280 tablet_service.cc:1511] Processing CreateTablet for tablet a2a24e48beb74b37aa9434f9d9be4a22 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:27.489185 27411 tablet_bootstrap.cc:654] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.492180 27280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a24e48beb74b37aa9434f9d9be4a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.494578 27414 tablet_bootstrap.cc:492] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:27.508545 27417 tablet_bootstrap.cc:492] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:27.509229 27417 ts_tablet_manager.cc:1403] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.256s	user 0.027s	sys 0.012s
I20260709 13:21:27.515785 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3484b734c41099e53b3f518789f39" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:27.518800 27420 leader_election.cc:290] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:27.520394 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3484b734c41099e53b3f518789f39" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:27.521740 27423 raft_consensus.cc:493] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:27.522296 27183 leader_election.cc:343] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.522300 27423 raft_consensus.cc:515] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:27.524914 27291 raft_consensus.cc:2468] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:27.526274 27184 leader_election.cc:304] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: f79efe7c9e6a4384b765393621da6816
I20260709 13:21:27.526295 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2809a3a620544e7f8ce472b3563c2df9" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:27.527537 27142 raft_consensus.cc:2468] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:27.527873 27420 raft_consensus.cc:2804] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:27.528630 27420 raft_consensus.cc:697] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:27.529472 27420 consensus_queue.cc:237] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.529982 27257 leader_election.cc:304] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:27.530997 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2809a3a620544e7f8ce472b3563c2df9" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
W20260709 13:21:27.533252 27258 leader_election.cc:343] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.533977 27423 leader_election.cc:290] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:27.534653 27423 raft_consensus.cc:2804] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:27.535133 27423 raft_consensus.cc:493] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.535578 27423 raft_consensus.cc:3060] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.495338 27450 raft_consensus.cc:515] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.539407 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1665cdc23c4af782f4111587dbf68f" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:27.510031 27352 tablet_service.cc:1511] Processing CreateTablet for tablet a2a24e48beb74b37aa9434f9d9be4a22 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 13:21:27.546047 27109 leader_election.cc:343] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.547586 27133 tablet_service.cc:1511] Processing CreateTablet for tablet a2a24e48beb74b37aa9434f9d9be4a22 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:27.551254 27413 tablet_bootstrap.cc:492] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:27.551920 27413 ts_tablet_manager.cc:1403] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.316s	user 0.029s	sys 0.042s
I20260709 13:21:27.553272 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a24e48beb74b37aa9434f9d9be4a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.550815 27423 raft_consensus.cc:515] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:27.551765 27417 raft_consensus.cc:359] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.563758 27417 raft_consensus.cc:385] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.573961 27413 raft_consensus.cc:359] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.574527 27201 tablet_service.cc:1511] Processing CreateTablet for tablet 46bbc4b2c88745c699787c5df44ed464 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:27.575058 27413 raft_consensus.cc:385] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.575594 27413 raft_consensus.cc:740] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.575409 27356 tablet_service.cc:1511] Processing CreateTablet for tablet 46bbc4b2c88745c699787c5df44ed464 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:27.576009 27450 leader_election.cc:290] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:27.576092 27201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46bbc4b2c88745c699787c5df44ed464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.577574 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1665cdc23c4af782f4111587dbf68f" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:27.578377 27216 raft_consensus.cc:3060] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.570185 27417 raft_consensus.cc:740] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.580286 27413 consensus_queue.cc:260] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.581558 27417 consensus_queue.cc:260] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.583039 27413 ts_tablet_manager.cc:1434] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:21:27.584324 27413 tablet_bootstrap.cc:492] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:27.580297 27414 tablet_bootstrap.cc:654] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.584725 27411 tablet_bootstrap.cc:492] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:27.585547 27281 tablet_service.cc:1511] Processing CreateTablet for tablet 46bbc4b2c88745c699787c5df44ed464 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:27.590682 27352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a24e48beb74b37aa9434f9d9be4a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.598760 27356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46bbc4b2c88745c699787c5df44ed464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.602061 27128 tablet_service.cc:1511] Processing CreateTablet for tablet 8474c28d9650438ca267ba04bf79b5eb (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:27.603148 27429 raft_consensus.cc:493] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.593102 27281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46bbc4b2c88745c699787c5df44ed464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.603741 27429 raft_consensus.cc:515] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:27.603680 27128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8474c28d9650438ca267ba04bf79b5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.591868 27417 ts_tablet_manager.cc:1434] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.001s
I20260709 13:21:27.613211 27423 leader_election.cc:290] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:27.614573 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2809a3a620544e7f8ce472b3563c2df9" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:27.620401 27142 raft_consensus.cc:3060] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.614812 27429 leader_election.cc:290] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:27.614759 27275 tablet_service.cc:1511] Processing CreateTablet for tablet 8474c28d9650438ca267ba04bf79b5eb (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:27.633515 27275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8474c28d9650438ca267ba04bf79b5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.616499 27208 tablet_service.cc:1511] Processing CreateTablet for tablet 8474c28d9650438ca267ba04bf79b5eb (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:27.617187 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7109f14a616b49939aa2fbd96d6ad458" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:27.637490 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7109f14a616b49939aa2fbd96d6ad458" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
W20260709 13:21:27.637668 27332 leader_election.cc:343] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:27.639048 27332 leader_election.cc:343] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.639552 27332 leader_election.cc:304] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:27.629310 27429 raft_consensus.cc:493] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.632326 27413 tablet_bootstrap.cc:654] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.640820 27429 raft_consensus.cc:515] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.616288 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2809a3a620544e7f8ce472b3563c2df9" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:27.639214 27208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8474c28d9650438ca267ba04bf79b5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.610230 27411 ts_tablet_manager.cc:1403] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.300s	user 0.007s	sys 0.011s
I20260709 13:21:27.643201 27429 leader_election.cc:290] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:27.653652 27429 raft_consensus.cc:2749] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.651465 27417 tablet_bootstrap.cc:492] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:27.652294 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bc3f6a11ae4b85870951a4ef079571" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
W20260709 13:21:27.662055 27331 leader_election.cc:343] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.673333 27417 tablet_bootstrap.cc:654] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.674567 27347 tablet_service.cc:1511] Processing CreateTablet for tablet 7d205fe2cb9d4d319c85bb33f59ca660 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:27.676031 27347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d205fe2cb9d4d319c85bb33f59ca660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.679508 27414 tablet_bootstrap.cc:492] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:27.680117 27414 ts_tablet_manager.cc:1403] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.190s	user 0.023s	sys 0.000s
W20260709 13:21:27.680814 27258 leader_election.cc:343] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.660018 27411 raft_consensus.cc:359] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:27.681833 27411 raft_consensus.cc:385] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.682157 27411 raft_consensus.cc:740] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.683024 27411 consensus_queue.cc:260] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:27.683806 27414 raft_consensus.cc:359] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:27.684705 27414 raft_consensus.cc:385] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.685057 27414 raft_consensus.cc:740] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.685976 27414 consensus_queue.cc:260] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:27.686743 27411 ts_tablet_manager.cc:1434] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:21:27.690271 27216 raft_consensus.cc:2468] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 1.
I20260709 13:21:27.692618 27414 ts_tablet_manager.cc:1434] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:21:27.692287 27109 leader_election.cc:304] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:27.693775 27414 tablet_bootstrap.cc:492] T c942513b146c4cfeba8bdfc1baac288e P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:27.694057 27450 raft_consensus.cc:2804] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:27.694862 27450 raft_consensus.cc:697] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:27.696096 27450 consensus_queue.cc:237] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.700659 27411 tablet_bootstrap.cc:492] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:27.715090 27133 tablet_service.cc:1511] Processing CreateTablet for tablet 7d205fe2cb9d4d319c85bb33f59ca660 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:27.716624 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d205fe2cb9d4d319c85bb33f59ca660. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:27.723742 27332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:38009, user_credentials={real_user=slave}} blocked reactor thread for 84714us
I20260709 13:21:27.726524 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bc3f6a11ae4b85870951a4ef079571" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:27.730216 27202 tablet_service.cc:1511] Processing CreateTablet for tablet 7d205fe2cb9d4d319c85bb33f59ca660 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:27.735327 27417 tablet_bootstrap.cc:492] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:27.735918 27417 ts_tablet_manager.cc:1403] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.009s
I20260709 13:21:27.740314 27280 tablet_service.cc:1511] Processing CreateTablet for tablet c32e5371db8c4a95ab423532604c6f33 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:27.741510 27356 tablet_service.cc:1511] Processing CreateTablet for tablet c32e5371db8c4a95ab423532604c6f33 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:27.741997 27202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d205fe2cb9d4d319c85bb33f59ca660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.742463 27132 tablet_service.cc:1511] Processing CreateTablet for tablet c32e5371db8c4a95ab423532604c6f33 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:27.742862 27280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32e5371db8c4a95ab423532604c6f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.743850 27132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32e5371db8c4a95ab423532604c6f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.740968 27417 raft_consensus.cc:359] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:27.747370 27417 raft_consensus.cc:385] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.747773 27417 raft_consensus.cc:740] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.749891 27417 consensus_queue.cc:260] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:27.742864 27356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32e5371db8c4a95ab423532604c6f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.755698 27413 tablet_bootstrap.cc:492] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:27.756290 27413 ts_tablet_manager.cc:1403] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.172s	user 0.012s	sys 0.008s
I20260709 13:21:27.761243 27420 consensus_queue.cc:1048] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:27.762282 27414 tablet_bootstrap.cc:654] T c942513b146c4cfeba8bdfc1baac288e P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.763247 27413 raft_consensus.cc:359] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:27.764081 27413 raft_consensus.cc:385] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.766667 27142 raft_consensus.cc:2468] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:27.769035 27257 leader_election.cc:304] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6
I20260709 13:21:27.770397 27423 raft_consensus.cc:2804] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:27.770931 27423 raft_consensus.cc:697] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Becoming Leader. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Running, Role: LEADER
I20260709 13:21:27.764393 27413 raft_consensus.cc:740] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.773488 27413 consensus_queue.cc:260] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:27.773908 27274 tablet_service.cc:1511] Processing CreateTablet for tablet 4fade412cd974138979c417dd233c35a (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:27.775357 27274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fade412cd974138979c417dd233c35a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.776268 27413 ts_tablet_manager.cc:1434] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:21:27.771842 27423 consensus_queue.cc:237] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:27.783066 27130 tablet_service.cc:1511] Processing CreateTablet for tablet eeabd510d2384d3dab2df8fa001a3400 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:27.783383 27201 tablet_service.cc:1511] Processing CreateTablet for tablet 4fade412cd974138979c417dd233c35a (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:27.784579 27130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeabd510d2384d3dab2df8fa001a3400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.784783 27201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fade412cd974138979c417dd233c35a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.834290 27411 tablet_bootstrap.cc:654] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.780748 27039 catalog_manager.cc:5697] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:27.839282 27203 tablet_service.cc:1511] Processing CreateTablet for tablet eeabd510d2384d3dab2df8fa001a3400 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:27.844430 27203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeabd510d2384d3dab2df8fa001a3400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.788420 27040 catalog_manager.cc:5697] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 0 to 1, leader changed from <none> to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:27.844095 27352 tablet_service.cc:1511] Processing CreateTablet for tablet 4fade412cd974138979c417dd233c35a (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:27.850503 27352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fade412cd974138979c417dd233c35a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:27.791455 27332 leader_election.cc:343] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.860433 27413 tablet_bootstrap.cc:492] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:27.858960 27332 leader_election.cc:304] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
W20260709 13:21:27.875434 27332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:38009, user_credentials={real_user=slave}} blocked reactor thread for 86216.3us
I20260709 13:21:27.877050 27464 raft_consensus.cc:2749] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.890640 27417 ts_tablet_manager.cc:1434] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.154s	user 0.007s	sys 0.002s
I20260709 13:21:27.890287 27038 catalog_manager.cc:5697] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "2d8e002e04a74c2598405158a99d86c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:27.891958 27417 tablet_bootstrap.cc:492] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399: Bootstrap starting.
W20260709 13:21:27.892926 27184 consensus_peers.cc:597] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:27.901796 27275 tablet_service.cc:1511] Processing CreateTablet for tablet eeabd510d2384d3dab2df8fa001a3400 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:27.903898 27275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeabd510d2384d3dab2df8fa001a3400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.909441 27417 tablet_bootstrap.cc:654] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.922966 27414 tablet_bootstrap.cc:492] T c942513b146c4cfeba8bdfc1baac288e P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:27.923771 27414 ts_tablet_manager.cc:1403] T c942513b146c4cfeba8bdfc1baac288e P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.230s	user 0.016s	sys 0.013s
I20260709 13:21:27.925904 27413 tablet_bootstrap.cc:654] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.932356 27132 tablet_service.cc:1511] Processing CreateTablet for tablet ba68051b3f1c40c9bcface09069e68e0 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:27.934417 27132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba68051b3f1c40c9bcface09069e68e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.934305 27348 tablet_service.cc:1511] Processing CreateTablet for tablet ba68051b3f1c40c9bcface09069e68e0 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:27.936313 27348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba68051b3f1c40c9bcface09069e68e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.940871 27450 raft_consensus.cc:493] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.941519 27450 raft_consensus.cc:515] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:27.943960 27450 leader_election.cc:290] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:27.946285 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f684c9c7b4874567b690e70a7ddae640" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:27.947046 27365 raft_consensus.cc:2468] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 0.
I20260709 13:21:27.947496 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f684c9c7b4874567b690e70a7ddae640" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
W20260709 13:21:27.949149 27109 leader_election.cc:343] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.949898 27109 leader_election.cc:304] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:27.951166 27450 raft_consensus.cc:2804] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:27.951575 27450 raft_consensus.cc:493] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.951913 27450 raft_consensus.cc:3060] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.953601 27201 tablet_service.cc:1511] Processing CreateTablet for tablet ba68051b3f1c40c9bcface09069e68e0 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:27.955087 27201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba68051b3f1c40c9bcface09069e68e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.959348 27417 tablet_bootstrap.cc:492] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:27.959949 27417 ts_tablet_manager.cc:1403] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.032s
I20260709 13:21:27.963377 27274 tablet_service.cc:1511] Processing CreateTablet for tablet d45fa14105f64435ae8fd7b34c0dc72c (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:27.965651 27349 tablet_service.cc:1511] Processing CreateTablet for tablet d45fa14105f64435ae8fd7b34c0dc72c (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:27.967106 27349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45fa14105f64435ae8fd7b34c0dc72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.969295 27274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45fa14105f64435ae8fd7b34c0dc72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.971515 27133 tablet_service.cc:1511] Processing CreateTablet for tablet d45fa14105f64435ae8fd7b34c0dc72c (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:27.966874 27414 raft_consensus.cc:359] T c942513b146c4cfeba8bdfc1baac288e P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:27.963488 27417 raft_consensus.cc:359] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.972915 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45fa14105f64435ae8fd7b34c0dc72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:27.974463 27417 raft_consensus.cc:385] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.974866 27417 raft_consensus.cc:740] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.975982 27417 consensus_queue.cc:260] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
W20260709 13:21:27.976749 27183 consensus_peers.cc:597] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:27.977492 27420 raft_consensus.cc:493] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.978066 27420 raft_consensus.cc:515] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.980232 27417 ts_tablet_manager.cc:1434] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 13:21:27.981504 27417 tablet_bootstrap.cc:492] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:27.986048 27411 tablet_bootstrap.cc:492] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:27.986657 27411 ts_tablet_manager.cc:1403] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.286s	user 0.019s	sys 0.006s
I20260709 13:21:27.990049 27411 raft_consensus.cc:359] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.990810 27411 raft_consensus.cc:385] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.991107 27411 raft_consensus.cc:740] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.992069 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315d4de5fc5940f9b5f1d3206e7028c0" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:27.991870 27411 consensus_queue.cc:260] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:27.993013 27143 raft_consensus.cc:2468] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:27.994467 27183 leader_election.cc:304] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:27.983328 27414 raft_consensus.cc:385] T c942513b146c4cfeba8bdfc1baac288e P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.007061 27417 tablet_bootstrap.cc:654] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.012241 27464 raft_consensus.cc:493] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.012866 27464 raft_consensus.cc:515] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:28.015295 27464 leader_election.cc:290] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:27.997633 27420 leader_election.cc:290] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:28.004669 27414 raft_consensus.cc:740] T c942513b146c4cfeba8bdfc1baac288e P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.018045 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960bc3fba4dc481e9602d13cd4a0b5ae" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:28.018136 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960bc3fba4dc481e9602d13cd4a0b5ae" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
W20260709 13:21:28.020502 27332 leader_election.cc:343] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:28.021436 27332 leader_election.cc:343] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.021960 27332 leader_election.cc:304] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:28.023200 27464 raft_consensus.cc:2749] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:28.045830 27420 raft_consensus.cc:2804] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:28.046667 27420 raft_consensus.cc:493] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.047233 27420 raft_consensus.cc:3060] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.062882 27411 ts_tablet_manager.cc:1434] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.076s	user 0.016s	sys 0.001s
I20260709 13:21:28.066213 27411 tablet_bootstrap.cc:492] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
W20260709 13:21:28.070791 27183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:35935, user_credentials={real_user=slave}} blocked reactor thread for 76414.3us
I20260709 13:21:28.073292 27423 raft_consensus.cc:493] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.074046 27423 raft_consensus.cc:515] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
W20260709 13:21:28.064918 27332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 43513.9us
W20260709 13:21:28.082194 27088 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:28.094753 27281 tablet_service.cc:1511] Processing CreateTablet for tablet be748b869d8b48dfa56a49c838cc4818 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:28.096374 27281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be748b869d8b48dfa56a49c838cc4818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.085481 27464 raft_consensus.cc:493] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.097121 27464 raft_consensus.cc:515] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.099645 27464 leader_election.cc:290] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:28.102751 27478 raft_consensus.cc:493] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.103417 27478 raft_consensus.cc:515] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:28.106088 27478 leader_election.cc:290] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:28.107304 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2097666912334a53a80b648a0fad2786" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:28.110719 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7109f14a616b49939aa2fbd96d6ad458" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:28.111860 27411 tablet_bootstrap.cc:654] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.100099 27203 tablet_service.cc:1511] Processing CreateTablet for tablet be748b869d8b48dfa56a49c838cc4818 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:28.111676 27216 raft_consensus.cc:2468] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:28.108017 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7109f14a616b49939aa2fbd96d6ad458" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
W20260709 13:21:28.117499 27331 leader_election.cc:343] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.120369 27291 raft_consensus.cc:2468] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:28.108233 27423 leader_election.cc:290] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:28.123611 27452 raft_consensus.cc:493] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.124212 27203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be748b869d8b48dfa56a49c838cc4818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.124326 27452 raft_consensus.cc:515] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.127625 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2097666912334a53a80b648a0fad2786" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
W20260709 13:21:28.129464 27332 leader_election.cc:343] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.129558 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3484b734c41099e53b3f518789f39" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:28.130054 27332 leader_election.cc:304] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:28.131745 27452 leader_election.cc:290] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:28.132654 27464 raft_consensus.cc:2749] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:28.135389 27356 tablet_service.cc:1511] Processing CreateTablet for tablet be748b869d8b48dfa56a49c838cc4818 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:28.136898 27356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be748b869d8b48dfa56a49c838cc4818. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.141462 27133 tablet_service.cc:1511] Processing CreateTablet for tablet d93a08da579844d4b341d52ce65113ce (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:28.143072 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d93a08da579844d4b341d52ce65113ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.076392 27414 consensus_queue.cc:260] T c942513b146c4cfeba8bdfc1baac288e P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:28.149492 27202 tablet_service.cc:1511] Processing CreateTablet for tablet d93a08da579844d4b341d52ce65113ce (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:28.158906 27202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d93a08da579844d4b341d52ce65113ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.118144 27450 raft_consensus.cc:515] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:28.163556 27275 tablet_service.cc:1511] Processing CreateTablet for tablet d93a08da579844d4b341d52ce65113ce (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:28.165531 27275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d93a08da579844d4b341d52ce65113ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.170461 27349 tablet_service.cc:1511] Processing CreateTablet for tablet 992029a58c6b4e9fae2a4024cda34dcd (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:28.172168 27349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992029a58c6b4e9fae2a4024cda34dcd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:28.163473 27109 consensus_peers.cc:597] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 -> Peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Couldn't send request to peer 1962786a39404929920d966805e48399. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.167446 27413 tablet_bootstrap.cc:492] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:28.166551 27414 ts_tablet_manager.cc:1434] T c942513b146c4cfeba8bdfc1baac288e P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.242s	user 0.010s	sys 0.009s
I20260709 13:21:28.177801 27450 leader_election.cc:290] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:28.179055 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f684c9c7b4874567b690e70a7ddae640" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:28.179787 27365 raft_consensus.cc:3060] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.179989 27280 tablet_service.cc:1511] Processing CreateTablet for tablet 8b37122e3aa24369b6edfe70347b97e9 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:28.180369 27420 raft_consensus.cc:515] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.182989 27280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b37122e3aa24369b6edfe70347b97e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.185400 27414 tablet_bootstrap.cc:492] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:28.176149 27133 tablet_service.cc:1511] Processing CreateTablet for tablet 992029a58c6b4e9fae2a4024cda34dcd (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:28.188676 27420 leader_election.cc:290] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:28.190384 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315d4de5fc5940f9b5f1d3206e7028c0" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:28.190563 27184 leader_election.cc:304] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:28.191095 27143 raft_consensus.cc:3060] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.192131 27352 tablet_service.cc:1511] Processing CreateTablet for tablet 8b37122e3aa24369b6edfe70347b97e9 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:28.193679 27352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b37122e3aa24369b6edfe70347b97e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.206590 27130 tablet_service.cc:1511] Processing CreateTablet for tablet 8b37122e3aa24369b6edfe70347b97e9 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:28.208112 27130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b37122e3aa24369b6edfe70347b97e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.212553 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992029a58c6b4e9fae2a4024cda34dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.213207 27417 tablet_bootstrap.cc:492] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:28.213922 27417 ts_tablet_manager.cc:1403] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.233s	user 0.010s	sys 0.023s
I20260709 13:21:28.215577 27143 raft_consensus.cc:2468] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:28.217092 27183 leader_election.cc:304] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:28.220558 27417 raft_consensus.cc:359] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:28.229441 27417 raft_consensus.cc:385] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.229921 27417 raft_consensus.cc:740] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.240947 27413 ts_tablet_manager.cc:1403] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.411s	user 0.031s	sys 0.017s
I20260709 13:21:28.243618 27449 raft_consensus.cc:2804] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:28.244233 27449 raft_consensus.cc:697] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:28.245136 27449 consensus_queue.cc:237] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.254823 27201 tablet_service.cc:1511] Processing CreateTablet for tablet 992029a58c6b4e9fae2a4024cda34dcd (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:21:28.248690 27184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 59189.9us
I20260709 13:21:28.246412 27413 raft_consensus.cc:359] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.259238 27201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992029a58c6b4e9fae2a4024cda34dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.250030 27417 consensus_queue.cc:260] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:28.259632 27365 raft_consensus.cc:2468] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 1.
I20260709 13:21:28.261124 27109 leader_election.cc:304] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:28.261588 27417 ts_tablet_manager.cc:1434] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.004s
I20260709 13:21:28.262754 27450 raft_consensus.cc:2804] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:28.263207 27450 raft_consensus.cc:697] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:28.263854 27414 tablet_bootstrap.cc:654] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.264048 27450 consensus_queue.cc:237] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:28.272688 27452 consensus_queue.cc:1048] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:28.265833 27413 raft_consensus.cc:385] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.268976 27417 tablet_bootstrap.cc:492] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:28.292598 27413 raft_consensus.cc:740] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.282673 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e3484b734c41099e53b3f518789f39" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:28.293737 27413 consensus_queue.cc:260] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.284433 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f684c9c7b4874567b690e70a7ddae640" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:28.283763 27258 leader_election.cc:304] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:28.285478 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7109f14a616b49939aa2fbd96d6ad458" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:28.284680 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315d4de5fc5940f9b5f1d3206e7028c0" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:28.286315 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315d4de5fc5940f9b5f1d3206e7028c0" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:28.287541 27202 tablet_service.cc:1511] Processing CreateTablet for tablet 180999038c4a4fa7912fea59dfabd4d4 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:28.295683 27366 raft_consensus.cc:2468] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:28.285938 27274 tablet_service.cc:1511] Processing CreateTablet for tablet 180999038c4a4fa7912fea59dfabd4d4 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:28.296727 27202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 180999038c4a4fa7912fea59dfabd4d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.294574 27291 raft_consensus.cc:2393] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f79efe7c9e6a4384b765393621da6816 in current term 1: Already voted for candidate 05f7e02ff65b470591cb5d9565f123d6 in this term.
W20260709 13:21:28.297343 27184 leader_election.cc:343] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.297355 27274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 180999038c4a4fa7912fea59dfabd4d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.298221 27411 tablet_bootstrap.cc:492] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:28.298744 27411 ts_tablet_manager.cc:1403] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.233s	user 0.013s	sys 0.013s
I20260709 13:21:28.290285 27480 raft_consensus.cc:2804] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:28.300426 27480 raft_consensus.cc:493] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.300215 27352 tablet_service.cc:1511] Processing CreateTablet for tablet 180999038c4a4fa7912fea59dfabd4d4 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:28.300786 27423 raft_consensus.cc:2804] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:28.301313 27423 raft_consensus.cc:493] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.300889 27480 raft_consensus.cc:3060] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.301693 27423 raft_consensus.cc:3060] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:28.303563 27184 leader_election.cc:343] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:28.305472 27109 leader_election.cc:343] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.309836 27411 raft_consensus.cc:359] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.310591 27411 raft_consensus.cc:385] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.310896 27411 raft_consensus.cc:740] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.310950 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7109f14a616b49939aa2fbd96d6ad458" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:28.311753 27365 raft_consensus.cc:2468] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:28.301692 27352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 180999038c4a4fa7912fea59dfabd4d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.315766 27133 tablet_service.cc:1511] Processing CreateTablet for tablet f3ab667936414e288be72021cfbcbc1b (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:28.317962 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ab667936414e288be72021cfbcbc1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.319152 27109 leader_election.cc:304] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:28.317689 27411 consensus_queue.cc:260] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.318754 27037 catalog_manager.cc:5697] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 0 to 1, leader changed from <none> to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:28.324277 27452 raft_consensus.cc:3060] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.329310 27420 consensus_queue.cc:1048] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:28.330892 27208 tablet_service.cc:1511] Processing CreateTablet for tablet f3ab667936414e288be72021cfbcbc1b (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:28.332759 27480 raft_consensus.cc:515] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:28.335731 27480 leader_election.cc:290] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:28.337754 27291 raft_consensus.cc:3060] T c942513b146c4cfeba8bdfc1baac288e P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.337615 27280 tablet_service.cc:1511] Processing CreateTablet for tablet f3ab667936414e288be72021cfbcbc1b (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:28.332340 27208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ab667936414e288be72021cfbcbc1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.339815 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7109f14a616b49939aa2fbd96d6ad458" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:28.340021 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7109f14a616b49939aa2fbd96d6ad458" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:28.338968 27280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ab667936414e288be72021cfbcbc1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.344611 27365 raft_consensus.cc:3060] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.372450 27423 raft_consensus.cc:515] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:28.370736 27413 ts_tablet_manager.cc:1434] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.127s	user 0.001s	sys 0.007s
I20260709 13:21:28.373811 27290 raft_consensus.cc:2393] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 05f7e02ff65b470591cb5d9565f123d6 in current term 1: Already voted for candidate 2d8e002e04a74c2598405158a99d86c1 in this term.
I20260709 13:21:28.374692 27413 tablet_bootstrap.cc:492] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:28.381004 27414 tablet_bootstrap.cc:492] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:28.375558 27423 leader_election.cc:290] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:28.376475 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7109f14a616b49939aa2fbd96d6ad458" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:28.381568 27414 ts_tablet_manager.cc:1403] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.196s	user 0.015s	sys 0.001s
I20260709 13:21:28.381961 27217 raft_consensus.cc:2393] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d8e002e04a74c2598405158a99d86c1 in current term 1: Already voted for candidate 05f7e02ff65b470591cb5d9565f123d6 in this term.
I20260709 13:21:28.378187 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7109f14a616b49939aa2fbd96d6ad458" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:28.385500 27411 ts_tablet_manager.cc:1434] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260709 13:21:28.386873 27411 tablet_bootstrap.cc:492] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:28.393879 27449 raft_consensus.cc:493] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.399591 27452 raft_consensus.cc:2749] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:28.404189 27133 tablet_service.cc:1511] Processing CreateTablet for tablet 9f72db119dad434b84f9712dc1930f7f (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:28.405481 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f72db119dad434b84f9712dc1930f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.397886 27414 raft_consensus.cc:359] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:28.406629 27414 raft_consensus.cc:385] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.406951 27414 raft_consensus.cc:740] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.407694 27414 consensus_queue.cc:260] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:28.408833 27258 leader_election.cc:304] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399
I20260709 13:21:28.416587 27414 ts_tablet_manager.cc:1434] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:21:28.418342 27414 tablet_bootstrap.cc:492] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:28.414673 27411 tablet_bootstrap.cc:654] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.397473 27365 raft_consensus.cc:2468] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:28.429196 27491 raft_consensus.cc:2749] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:21:28.427748 27258 consensus_peers.cc:597] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.431994 27413 tablet_bootstrap.cc:654] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.436538 27208 tablet_service.cc:1511] Processing CreateTablet for tablet 9f72db119dad434b84f9712dc1930f7f (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:28.435838 27184 leader_election.cc:304] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:28.438033 27208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f72db119dad434b84f9712dc1930f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.438725 27480 raft_consensus.cc:2804] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:28.439534 27480 raft_consensus.cc:697] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:28.452884 27130 tablet_service.cc:1511] Processing CreateTablet for tablet 178fe9f66bbf440780bf6f265626a054 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:28.454826 27130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 178fe9f66bbf440780bf6f265626a054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.442888 27356 tablet_service.cc:1511] Processing CreateTablet for tablet 178fe9f66bbf440780bf6f265626a054 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:28.463188 27356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 178fe9f66bbf440780bf6f265626a054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.412724 27449 raft_consensus.cc:515] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.469893 27274 tablet_service.cc:1511] Processing CreateTablet for tablet 178fe9f66bbf440780bf6f265626a054 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:28.470355 27414 tablet_bootstrap.cc:654] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.471009 27491 consensus_queue.cc:1048] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:28.470763 27480 consensus_queue.cc:237] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:28.473387 27037 catalog_manager.cc:5697] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:28.431895 27349 tablet_service.cc:1511] Processing CreateTablet for tablet 9f72db119dad434b84f9712dc1930f7f (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:28.485428 27274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 178fe9f66bbf440780bf6f265626a054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.500248 27417 tablet_bootstrap.cc:654] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.506260 27280 tablet_service.cc:1511] Processing CreateTablet for tablet c475a8c029024e99b4377fdda1a27c2a (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:28.507563 27464 raft_consensus.cc:493] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.508152 27464 raft_consensus.cc:515] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:28.509821 27449 leader_election.cc:290] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:28.510515 27464 leader_election.cc:290] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:28.510882 27280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c475a8c029024e99b4377fdda1a27c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.513334 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ef473dee144c5dbc7086d2b983cb59" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
W20260709 13:21:28.515303 27332 leader_election.cc:343] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.533020 27349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f72db119dad434b84f9712dc1930f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.537715 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bc3f6a11ae4b85870951a4ef079571" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:28.538318 27347 tablet_service.cc:1511] Processing CreateTablet for tablet c475a8c029024e99b4377fdda1a27c2a (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:28.539803 27347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c475a8c029024e99b4377fdda1a27c2a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:28.540859 27183 leader_election.cc:343] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.538585 27140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ef473dee144c5dbc7086d2b983cb59" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:28.542101 27140 raft_consensus.cc:2468] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:28.542065 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bc3f6a11ae4b85870951a4ef079571" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:28.543665 27365 raft_consensus.cc:2468] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:28.541999 27208 tablet_service.cc:1511] Processing CreateTablet for tablet c475a8c029024e99b4377fdda1a27c2a (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:28.545321 27208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c475a8c029024e99b4377fdda1a27c2a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:28.546077 27495 log.cc:927] Time spent T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
I20260709 13:21:28.545619 27133 tablet_service.cc:1511] Processing CreateTablet for tablet 07a377a6c91543278d51ac9a9db49050 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:28.545650 27184 leader_election.cc:304] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: f79efe7c9e6a4384b765393621da6816
I20260709 13:21:28.549444 27420 raft_consensus.cc:2804] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:28.540938 27490 raft_consensus.cc:493] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.548354 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a377a6c91543278d51ac9a9db49050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.549825 27420 raft_consensus.cc:493] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.561880 27420 raft_consensus.cc:3060] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.564713 27490 raft_consensus.cc:515] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.567227 27490 leader_election.cc:290] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:28.570140 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2097666912334a53a80b648a0fad2786" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
W20260709 13:21:28.572813 27109 leader_election.cc:343] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.574743 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2097666912334a53a80b648a0fad2786" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:28.564091 27331 leader_election.cc:304] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:28.575632 27365 raft_consensus.cc:2468] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 0.
I20260709 13:21:28.576902 27464 raft_consensus.cc:2804] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:28.577447 27464 raft_consensus.cc:493] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.577868 27464 raft_consensus.cc:3060] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.584187 27109 leader_election.cc:304] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6
I20260709 13:21:28.585460 27490 raft_consensus.cc:2804] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:28.585881 27490 raft_consensus.cc:493] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.586265 27490 raft_consensus.cc:3060] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.608947 27203 tablet_service.cc:1511] Processing CreateTablet for tablet 07a377a6c91543278d51ac9a9db49050 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:28.610503 27203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a377a6c91543278d51ac9a9db49050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.616883 27411 tablet_bootstrap.cc:492] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:28.617684 27411 ts_tablet_manager.cc:1403] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.231s	user 0.027s	sys 0.018s
I20260709 13:21:28.623730 27420 raft_consensus.cc:515] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.631104 27280 tablet_service.cc:1511] Processing CreateTablet for tablet 07a377a6c91543278d51ac9a9db49050 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:28.644641 27280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07a377a6c91543278d51ac9a9db49050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.644479 27130 tablet_service.cc:1511] Processing CreateTablet for tablet 6df6aa2911c94954949e3b8283d1d2e1 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:28.646191 27130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6df6aa2911c94954949e3b8283d1d2e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.649991 27201 tablet_service.cc:1511] Processing CreateTablet for tablet 6df6aa2911c94954949e3b8283d1d2e1 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:28.651450 27201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6df6aa2911c94954949e3b8283d1d2e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.656426 27498 consensus_queue.cc:1048] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:28.657505 27414 tablet_bootstrap.cc:492] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:28.658097 27414 ts_tablet_manager.cc:1403] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.240s	user 0.010s	sys 0.007s
I20260709 13:21:28.634496 27413 tablet_bootstrap.cc:492] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:28.636075 27464 raft_consensus.cc:515] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:28.639703 27490 raft_consensus.cc:515] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.641130 27411 raft_consensus.cc:359] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:28.643031 27352 tablet_service.cc:1511] Processing CreateTablet for tablet 6df6aa2911c94954949e3b8283d1d2e1 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:28.663657 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bc3f6a11ae4b85870951a4ef079571" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:28.665722 27411 raft_consensus.cc:385] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.668689 27411 raft_consensus.cc:740] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.673961 27411 consensus_queue.cc:260] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:28.675341 27366 raft_consensus.cc:3060] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.678354 27352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6df6aa2911c94954949e3b8283d1d2e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.678431 27275 tablet_service.cc:1511] Processing CreateTablet for tablet 8115282f2b1544e6a930473c43950bc4 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:28.679912 27275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8115282f2b1544e6a930473c43950bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.682507 27464 leader_election.cc:290] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:28.682708 27417 tablet_bootstrap.cc:492] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:28.673415 27413 ts_tablet_manager.cc:1403] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.299s	user 0.008s	sys 0.019s
I20260709 13:21:28.683502 27417 ts_tablet_manager.cc:1403] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.418s	user 0.012s	sys 0.010s
I20260709 13:21:28.685855 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ef473dee144c5dbc7086d2b983cb59" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:28.686589 27142 raft_consensus.cc:3060] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.688792 27414 raft_consensus.cc:359] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:28.689594 27414 raft_consensus.cc:385] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.689883 27414 raft_consensus.cc:740] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.690734 27414 consensus_queue.cc:260] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:28.691797 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bc3f6a11ae4b85870951a4ef079571" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
W20260709 13:21:28.694303 27183 leader_election.cc:343] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.696043 27413 raft_consensus.cc:359] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:28.696857 27413 raft_consensus.cc:385] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.697160 27413 raft_consensus.cc:740] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.698006 27413 consensus_queue.cc:260] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:28.701769 27414 ts_tablet_manager.cc:1434] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:21:28.701175 27038 catalog_manager.cc:5697] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:28.683396 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ef473dee144c5dbc7086d2b983cb59" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
W20260709 13:21:28.706691 27332 leader_election.cc:343] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.714056 27413 ts_tablet_manager.cc:1434] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:21:28.715318 27413 tablet_bootstrap.cc:492] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:28.718339 27411 ts_tablet_manager.cc:1434] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.002s
I20260709 13:21:28.719606 27411 tablet_bootstrap.cc:492] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:28.702931 27414 tablet_bootstrap.cc:492] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:28.722282 27366 raft_consensus.cc:2468] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:28.723752 27184 leader_election.cc:304] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: f79efe7c9e6a4384b765393621da6816
I20260709 13:21:28.724771 27449 raft_consensus.cc:2804] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:28.702680 27417 raft_consensus.cc:359] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.686029 27420 leader_election.cc:290] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:28.725317 27449 raft_consensus.cc:697] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:28.726929 27417 raft_consensus.cc:385] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.731560 27417 raft_consensus.cc:740] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.732583 27417 consensus_queue.cc:260] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.735067 27411 tablet_bootstrap.cc:654] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.735652 27130 tablet_service.cc:1511] Processing CreateTablet for tablet 8115282f2b1544e6a930473c43950bc4 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:28.731338 27449 consensus_queue.cc:237] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.739143 27142 raft_consensus.cc:2468] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:28.739497 27417 ts_tablet_manager.cc:1434] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.004s
I20260709 13:21:28.740727 27331 leader_election.cc:304] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:28.741694 27130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8115282f2b1544e6a930473c43950bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:28.742162 27464 raft_consensus.cc:2804] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:28.742704 27464 raft_consensus.cc:697] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:28.743633 27464 consensus_queue.cc:237] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:28.741014 27417 tablet_bootstrap.cc:492] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:28.751703 27490 leader_election.cc:290] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:28.751747 27420 consensus_queue.cc:1048] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:28.753901 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2097666912334a53a80b648a0fad2786" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:28.780087 27349 tablet_service.cc:1511] Processing CreateTablet for tablet 8115282f2b1544e6a930473c43950bc4 (DEFAULT_TABLE table=test-workload [id=d6df4b879db34e629bc84578bcc856ef]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:28.782152 27349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8115282f2b1544e6a930473c43950bc4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:28.774003 27109 leader_election.cc:343] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.768888 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2097666912334a53a80b648a0fad2786" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:28.794011 27366 raft_consensus.cc:3060] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.788350 27414 tablet_bootstrap.cc:654] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.815513 27413 tablet_bootstrap.cc:654] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.829640 27364 raft_consensus.cc:3060] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.836308 27417 tablet_bootstrap.cc:654] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.840417 27037 catalog_manager.cc:5697] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:28.846745 27420 consensus_queue.cc:1048] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:28.847229 27411 tablet_bootstrap.cc:492] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:28.843581 27366 raft_consensus.cc:2468] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 1.
I20260709 13:21:28.847959 27411 ts_tablet_manager.cc:1403] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.129s	user 0.024s	sys 0.035s
I20260709 13:21:28.854751 27411 raft_consensus.cc:359] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:28.855517 27411 raft_consensus.cc:385] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.855816 27411 raft_consensus.cc:740] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.857107 27411 consensus_queue.cc:260] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:28.859403 27411 ts_tablet_manager.cc:1434] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:21:28.861320 27411 tablet_bootstrap.cc:492] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:28.863883 27423 raft_consensus.cc:493] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.864475 27423 raft_consensus.cc:515] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:28.867015 27423 leader_election.cc:290] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:28.866619 27039 catalog_manager.cc:5697] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:28.868398 27411 tablet_bootstrap.cc:654] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.874233 27414 tablet_bootstrap.cc:492] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:28.874763 27414 ts_tablet_manager.cc:1403] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.172s	user 0.008s	sys 0.005s
I20260709 13:21:28.878065 27414 raft_consensus.cc:359] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:28.878782 27414 raft_consensus.cc:385] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.878875 27413 tablet_bootstrap.cc:492] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:28.879144 27414 raft_consensus.cc:740] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.879582 27413 ts_tablet_manager.cc:1403] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.165s	user 0.009s	sys 0.009s
I20260709 13:21:28.879949 27414 consensus_queue.cc:260] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:28.882489 27414 ts_tablet_manager.cc:1434] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:21:28.885171 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5e8ee488ee4e18adea644ba22ed683" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:28.886305 27414 tablet_bootstrap.cc:492] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
W20260709 13:21:28.890067 27109 consensus_peers.cc:597] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.890791 27109 leader_election.cc:304] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6
I20260709 13:21:28.891793 27496 raft_consensus.cc:2804] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:28.892354 27496 raft_consensus.cc:697] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:28.893406 27496 consensus_queue.cc:237] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.886349 27217 raft_consensus.cc:2468] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:28.897267 27417 tablet_bootstrap.cc:492] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:28.897845 27417 ts_tablet_manager.cc:1403] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.157s	user 0.018s	sys 0.007s
I20260709 13:21:28.899366 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5e8ee488ee4e18adea644ba22ed683" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:28.900906 27417 raft_consensus.cc:359] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:28.901973 27414 tablet_bootstrap.cc:654] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.888401 27413 raft_consensus.cc:359] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
W20260709 13:21:28.906816 27258 leader_election.cc:343] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.917769 27413 raft_consensus.cc:385] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.918162 27413 raft_consensus.cc:740] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.901757 27417 raft_consensus.cc:385] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.919330 27417 raft_consensus.cc:740] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.919342 27413 consensus_queue.cc:260] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:28.920785 27417 consensus_queue.cc:260] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:28.919143 27258 leader_election.cc:304] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:28.923134 27413 ts_tablet_manager.cc:1434] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.003s
I20260709 13:21:28.925283 27417 ts_tablet_manager.cc:1434] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.027s	user 0.015s	sys 0.000s
I20260709 13:21:28.928081 27423 raft_consensus.cc:2804] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:28.928763 27423 raft_consensus.cc:493] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.929240 27423 raft_consensus.cc:3060] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.931071 27413 tablet_bootstrap.cc:492] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:28.927409 27417 tablet_bootstrap.cc:492] T 148eb001e9854043a2ad74dc8af08ae0 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:28.946992 27478 consensus_queue.cc:1048] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:28.962963 27450 raft_consensus.cc:493] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.966357 27413 tablet_bootstrap.cc:654] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.963594 27450 raft_consensus.cc:515] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:28.969419 27450 leader_election.cc:290] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:28.971632 27411 tablet_bootstrap.cc:492] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:28.972196 27411 ts_tablet_manager.cc:1403] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.111s	user 0.009s	sys 0.027s
I20260709 13:21:28.972010 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:28.973503 27217 raft_consensus.cc:2468] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 0.
I20260709 13:21:28.975126 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:28.975625 27411 raft_consensus.cc:359] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.976173 27291 raft_consensus.cc:2468] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 0.
I20260709 13:21:28.978829 27109 leader_election.cc:304] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:28.976438 27411 raft_consensus.cc:385] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.980867 27411 raft_consensus.cc:740] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.981691 27411 consensus_queue.cc:260] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:28.981983 27450 raft_consensus.cc:2804] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:28.982668 27450 raft_consensus.cc:493] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.983183 27450 raft_consensus.cc:3060] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.984090 27411 ts_tablet_manager.cc:1434] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:21:28.985810 27411 tablet_bootstrap.cc:492] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:28.980106 27423 raft_consensus.cc:515] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:28.992861 27414 tablet_bootstrap.cc:492] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:28.984185 27040 catalog_manager.cc:5697] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 0 to 1, leader changed from <none> to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:28.993497 27414 ts_tablet_manager.cc:1403] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.107s	user 0.016s	sys 0.017s
I20260709 13:21:28.995046 27423 leader_election.cc:290] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:28.996830 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5e8ee488ee4e18adea644ba22ed683" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:28.996788 27414 raft_consensus.cc:359] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:28.997825 27414 raft_consensus.cc:385] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.998152 27414 raft_consensus.cc:740] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.999981 27411 tablet_bootstrap.cc:654] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.996829 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5e8ee488ee4e18adea644ba22ed683" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
W20260709 13:21:29.000698 27258 leader_election.cc:343] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.000917 27217 raft_consensus.cc:3060] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.004812 27414 consensus_queue.cc:260] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.007206 27414 ts_tablet_manager.cc:1434] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:21:29.008189 27414 tablet_bootstrap.cc:492] T 26ef473dee144c5dbc7086d2b983cb59 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:29.013115 27417 tablet_bootstrap.cc:654] T 148eb001e9854043a2ad74dc8af08ae0 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.025141 27417 tablet_bootstrap.cc:492] T 148eb001e9854043a2ad74dc8af08ae0 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:29.025682 27417 ts_tablet_manager.cc:1403] T 148eb001e9854043a2ad74dc8af08ae0 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.000s
I20260709 13:21:29.028699 27417 raft_consensus.cc:359] T 148eb001e9854043a2ad74dc8af08ae0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.029466 27417 raft_consensus.cc:385] T 148eb001e9854043a2ad74dc8af08ae0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.029768 27417 raft_consensus.cc:740] T 148eb001e9854043a2ad74dc8af08ae0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.030485 27417 consensus_queue.cc:260] T 148eb001e9854043a2ad74dc8af08ae0 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.031626 27217 raft_consensus.cc:2468] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:29.033301 27413 tablet_bootstrap.cc:492] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:29.033953 27413 ts_tablet_manager.cc:1403] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.110s	user 0.010s	sys 0.005s
I20260709 13:21:29.033249 27258 leader_election.cc:304] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:29.035794 27423 raft_consensus.cc:2804] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.036542 27423 raft_consensus.cc:697] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Becoming Leader. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Running, Role: LEADER
I20260709 13:21:29.022699 27478 consensus_queue.cc:1048] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:21:29.037424 27423 consensus_queue.cc:237] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.037804 27413 raft_consensus.cc:359] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.038617 27413 raft_consensus.cc:385] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.044924 27414 tablet_bootstrap.cc:654] T 26ef473dee144c5dbc7086d2b983cb59 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.038949 27413 raft_consensus.cc:740] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.048444 27450 raft_consensus.cc:515] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.048847 27413 consensus_queue.cc:260] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.051401 27413 ts_tablet_manager.cc:1434] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:21:29.053380 27417 ts_tablet_manager.cc:1434] T 148eb001e9854043a2ad74dc8af08ae0 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:21:29.054451 27417 tablet_bootstrap.cc:492] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:29.057868 27413 tablet_bootstrap.cc:492] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:29.057782 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:29.058717 27217 raft_consensus.cc:3060] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.069291 27413 tablet_bootstrap.cc:654] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.070981 27414 tablet_bootstrap.cc:492] T 26ef473dee144c5dbc7086d2b983cb59 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:29.071604 27414 ts_tablet_manager.cc:1403] T 26ef473dee144c5dbc7086d2b983cb59 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.000s
I20260709 13:21:29.073894 27417 tablet_bootstrap.cc:654] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.079334 27411 tablet_bootstrap.cc:492] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:29.079572 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:29.079946 27411 ts_tablet_manager.cc:1403] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.094s	user 0.019s	sys 0.025s
I20260709 13:21:29.080230 27291 raft_consensus.cc:3060] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.074849 27414 raft_consensus.cc:359] T 26ef473dee144c5dbc7086d2b983cb59 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.080955 27414 raft_consensus.cc:385] T 26ef473dee144c5dbc7086d2b983cb59 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.082058 27414 raft_consensus.cc:740] T 26ef473dee144c5dbc7086d2b983cb59 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.085754 27417 tablet_bootstrap.cc:492] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:29.083253 27411 raft_consensus.cc:359] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.086401 27417 ts_tablet_manager.cc:1403] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.032s	user 0.004s	sys 0.006s
I20260709 13:21:29.086479 27411 raft_consensus.cc:385] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.087209 27411 raft_consensus.cc:740] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.088356 27411 consensus_queue.cc:260] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.085856 27423 raft_consensus.cc:493] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.089982 27423 raft_consensus.cc:515] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.085312 27414 consensus_queue.cc:260] T 26ef473dee144c5dbc7086d2b983cb59 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.082940 27038 catalog_manager.cc:5697] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "2d8e002e04a74c2598405158a99d86c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.096572 27411 ts_tablet_manager.cc:1434] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.007s
I20260709 13:21:29.098076 27414 ts_tablet_manager.cc:1434] T 26ef473dee144c5dbc7086d2b983cb59 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:21:29.099256 27414 tablet_bootstrap.cc:492] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
W20260709 13:21:29.093232 27088 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:29.093286 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148eb001e9854043a2ad74dc8af08ae0" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:29.100099 27411 tablet_bootstrap.cc:492] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:29.100350 27365 raft_consensus.cc:2468] T 148eb001e9854043a2ad74dc8af08ae0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:29.101598 27417 raft_consensus.cc:359] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.101933 27258 leader_election.cc:304] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:29.103223 27489 raft_consensus.cc:2804] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:29.103645 27489 raft_consensus.cc:493] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.103987 27489 raft_consensus.cc:3060] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.105674 27413 tablet_bootstrap.cc:492] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:29.106289 27413 ts_tablet_manager.cc:1403] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.018s
I20260709 13:21:29.109756 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148eb001e9854043a2ad74dc8af08ae0" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:29.110474 27143 raft_consensus.cc:2468] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:29.113617 27423 leader_election.cc:290] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:29.109351 27413 raft_consensus.cc:359] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.082989 27450 leader_election.cc:290] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:29.114480 27413 raft_consensus.cc:385] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.114883 27413 raft_consensus.cc:740] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.115680 27413 consensus_queue.cc:260] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.118115 27413 ts_tablet_manager.cc:1434] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:21:29.120703 27411 tablet_bootstrap.cc:654] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.123504 27413 tablet_bootstrap.cc:492] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:29.124890 27414 tablet_bootstrap.cc:654] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.128901 27291 raft_consensus.cc:2468] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 1.
I20260709 13:21:29.118091 27217 raft_consensus.cc:2468] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 1.
I20260709 13:21:29.131013 27109 leader_election.cc:304] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:29.132983 27450 raft_consensus.cc:2804] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.133203 27411 tablet_bootstrap.cc:492] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:29.133720 27450 raft_consensus.cc:697] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:29.135272 27450 consensus_queue.cc:237] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.136096 27413 tablet_bootstrap.cc:654] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.139559 27411 ts_tablet_manager.cc:1403] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.003s
I20260709 13:21:29.145489 27414 tablet_bootstrap.cc:492] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:29.146132 27414 ts_tablet_manager.cc:1403] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.009s
I20260709 13:21:29.144285 27411 raft_consensus.cc:359] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.158627 27411 raft_consensus.cc:385] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.159235 27411 raft_consensus.cc:740] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.159374 27478 consensus_queue.cc:1048] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:29.149901 27417 raft_consensus.cc:385] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.160506 27411 consensus_queue.cc:260] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.163822 27040 catalog_manager.cc:5697] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 0 to 1, leader changed from <none> to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.166061 27411 ts_tablet_manager.cc:1434] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:21:29.160822 27417 raft_consensus.cc:740] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.168902 27411 tablet_bootstrap.cc:492] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:29.169438 27413 tablet_bootstrap.cc:492] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:29.170374 27413 ts_tablet_manager.cc:1403] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.019s
I20260709 13:21:29.169379 27417 consensus_queue.cc:260] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.171089 27450 raft_consensus.cc:493] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.171703 27496 raft_consensus.cc:493] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.172761 27417 ts_tablet_manager.cc:1434] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.086s	user 0.011s	sys 0.000s
I20260709 13:21:29.171695 27450 raft_consensus.cc:515] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.172287 27496 raft_consensus.cc:515] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.173540 27413 raft_consensus.cc:359] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.174315 27413 raft_consensus.cc:385] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.174638 27413 raft_consensus.cc:740] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.175115 27496 leader_election.cc:290] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:29.175565 27413 consensus_queue.cc:260] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.178037 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e07aed35c54d449d6103728c481ab5" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:29.179169 27413 ts_tablet_manager.cc:1434] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:29.180382 27413 tablet_bootstrap.cc:492] T 960bc3fba4dc481e9602d13cd4a0b5ae P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:29.180869 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a9e5ac221b44be83106f28e32dc20e" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
W20260709 13:21:29.182523 27183 consensus_peers.cc:597] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:29.183081 27109 leader_election.cc:343] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:29.183940 27109 leader_election.cc:343] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.185743 27411 tablet_bootstrap.cc:654] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.186424 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a9e5ac221b44be83106f28e32dc20e" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
W20260709 13:21:29.187950 27109 leader_election.cc:343] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.188956 27109 leader_election.cc:304] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:29.189851 27496 raft_consensus.cc:2749] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.190119 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e07aed35c54d449d6103728c481ab5" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
W20260709 13:21:29.192226 27109 leader_election.cc:343] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.192801 27109 leader_election.cc:304] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:29.175151 27450 leader_election.cc:290] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:29.152359 27489 raft_consensus.cc:515] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.173990 27417 tablet_bootstrap.cc:492] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:29.150413 27414 raft_consensus.cc:359] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.193750 27450 raft_consensus.cc:2749] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.200321 27411 tablet_bootstrap.cc:492] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:29.200829 27414 raft_consensus.cc:385] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.201256 27414 raft_consensus.cc:740] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.201643 27411 ts_tablet_manager.cc:1403] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.000s
I20260709 13:21:29.202119 27414 consensus_queue.cc:260] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.204470 27413 tablet_bootstrap.cc:654] T 960bc3fba4dc481e9602d13cd4a0b5ae P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.205044 27414 ts_tablet_manager.cc:1434] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.001s
I20260709 13:21:29.205175 27411 raft_consensus.cc:359] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.206087 27411 raft_consensus.cc:385] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.206287 27414 tablet_bootstrap.cc:492] T 501b61a3989144c5a902cbf9ddbab055 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:29.206544 27411 raft_consensus.cc:740] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.207412 27411 consensus_queue.cc:260] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.210920 27411 ts_tablet_manager.cc:1434] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:21:29.211337 27417 tablet_bootstrap.cc:654] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.212348 27411 tablet_bootstrap.cc:492] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:29.217600 27464 raft_consensus.cc:493] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.218286 27464 raft_consensus.cc:515] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.222059 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5dc6e054a74138af98e26f08cd76e0" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:29.222898 27411 tablet_bootstrap.cc:654] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.222831 27217 raft_consensus.cc:2468] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:29.223672 27413 tablet_bootstrap.cc:492] T 960bc3fba4dc481e9602d13cd4a0b5ae P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:29.224275 27413 ts_tablet_manager.cc:1403] T 960bc3fba4dc481e9602d13cd4a0b5ae P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.006s
I20260709 13:21:29.224563 27332 leader_election.cc:304] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:29.225579 27505 raft_consensus.cc:2804] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:29.226001 27464 leader_election.cc:290] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:29.226007 27505 raft_consensus.cc:493] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.227159 27505 raft_consensus.cc:3060] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.227463 27413 raft_consensus.cc:359] T 960bc3fba4dc481e9602d13cd4a0b5ae P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.228255 27413 raft_consensus.cc:385] T 960bc3fba4dc481e9602d13cd4a0b5ae P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.228592 27413 raft_consensus.cc:740] T 960bc3fba4dc481e9602d13cd4a0b5ae P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.229326 27413 consensus_queue.cc:260] T 960bc3fba4dc481e9602d13cd4a0b5ae P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.230086 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148eb001e9854043a2ad74dc8af08ae0" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:29.230813 27366 raft_consensus.cc:3060] T 148eb001e9854043a2ad74dc8af08ae0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.232999 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5dc6e054a74138af98e26f08cd76e0" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:29.233768 27291 raft_consensus.cc:2468] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:29.235826 27413 ts_tablet_manager.cc:1434] T 960bc3fba4dc481e9602d13cd4a0b5ae P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:21:29.236934 27413 tablet_bootstrap.cc:492] T b1a9e5ac221b44be83106f28e32dc20e P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:29.240542 27366 raft_consensus.cc:2468] T 148eb001e9854043a2ad74dc8af08ae0 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:29.243314 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148eb001e9854043a2ad74dc8af08ae0" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:29.249570 27143 raft_consensus.cc:3060] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.245563 27505 raft_consensus.cc:515] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.248306 27478 raft_consensus.cc:493] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.252820 27505 leader_election.cc:290] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:29.252887 27478 raft_consensus.cc:515] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.243629 27413 tablet_bootstrap.cc:654] T b1a9e5ac221b44be83106f28e32dc20e P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.254155 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5dc6e054a74138af98e26f08cd76e0" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:29.254360 27502 raft_consensus.cc:493] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.254863 27291 raft_consensus.cc:3060] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.254971 27502 raft_consensus.cc:515] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.256202 27478 leader_election.cc:290] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:29.257757 27502 leader_election.cc:290] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:29.258368 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2809a3a620544e7f8ce472b3563c2df9" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:29.260768 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2097666912334a53a80b648a0fad2786" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:29.261263 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5dc6e054a74138af98e26f08cd76e0" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:29.261737 27364 raft_consensus.cc:2393] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05f7e02ff65b470591cb5d9565f123d6 in current term 1: Already voted for candidate f79efe7c9e6a4384b765393621da6816 in this term.
I20260709 13:21:29.261984 27217 raft_consensus.cc:3060] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.265633 27291 raft_consensus.cc:2468] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:29.267102 27332 leader_election.cc:304] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:29.267369 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2097666912334a53a80b648a0fad2786" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:29.268065 27505 raft_consensus.cc:2804] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.268702 27505 raft_consensus.cc:697] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:29.268999 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2809a3a620544e7f8ce472b3563c2df9" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:29.269752 27505 consensus_queue.cc:237] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.271471 27411 tablet_bootstrap.cc:492] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:29.271186 27183 leader_election.cc:304] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6; no voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:29.272352 27502 raft_consensus.cc:3060] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.272493 27184 leader_election.cc:304] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6; no voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:29.274032 27478 raft_consensus.cc:2749] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.274523 27413 tablet_bootstrap.cc:492] T b1a9e5ac221b44be83106f28e32dc20e P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:29.275125 27413 ts_tablet_manager.cc:1403] T b1a9e5ac221b44be83106f28e32dc20e P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.009s
I20260709 13:21:29.275341 27143 raft_consensus.cc:2468] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:29.276458 27257 leader_election.cc:304] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:29.277498 27423 raft_consensus.cc:2804] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.278301 27413 raft_consensus.cc:359] T b1a9e5ac221b44be83106f28e32dc20e P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.279115 27413 raft_consensus.cc:385] T b1a9e5ac221b44be83106f28e32dc20e P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.279415 27413 raft_consensus.cc:740] T b1a9e5ac221b44be83106f28e32dc20e P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.279757 27411 ts_tablet_manager.cc:1403] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.004s
I20260709 13:21:29.280426 27450 raft_consensus.cc:493] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.281117 27450 raft_consensus.cc:515] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.283543 27450 leader_election.cc:290] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:29.283746 27413 consensus_queue.cc:260] T b1a9e5ac221b44be83106f28e32dc20e P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.248880 27489 leader_election.cc:290] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:29.285852 27502 raft_consensus.cc:2749] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.287459 27411 raft_consensus.cc:359] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.288810 27411 raft_consensus.cc:385] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.289060 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501b61a3989144c5a902cbf9ddbab055" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:29.288844 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501b61a3989144c5a902cbf9ddbab055" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:29.289340 27411 raft_consensus.cc:740] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.292105 27413 ts_tablet_manager.cc:1434] T b1a9e5ac221b44be83106f28e32dc20e P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:21:29.292778 27411 consensus_queue.cc:260] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.295364 27411 ts_tablet_manager.cc:1434] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:21:29.297425 27411 tablet_bootstrap.cc:492] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:29.298880 27413 tablet_bootstrap.cc:492] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:29.304409 27411 tablet_bootstrap.cc:654] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.304951 27414 tablet_bootstrap.cc:654] T 501b61a3989144c5a902cbf9ddbab055 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.306003 27413 tablet_bootstrap.cc:654] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.313329 27291 raft_consensus.cc:3060] T 26ef473dee144c5dbc7086d2b983cb59 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.322611 27423 raft_consensus.cc:697] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Becoming Leader. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Running, Role: LEADER
I20260709 13:21:29.323810 27423 consensus_queue.cc:237] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.330871 27505 consensus_queue.cc:1048] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:29.332501 27109 leader_election.cc:343] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:29.333554 27109 leader_election.cc:343] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.334111 27411 tablet_bootstrap.cc:492] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:29.334851 27411 ts_tablet_manager.cc:1403] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.002s
I20260709 13:21:29.335261 27038 catalog_manager.cc:5697] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:29.338778 27411 raft_consensus.cc:359] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.340932 27411 raft_consensus.cc:385] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.334055 27109 leader_election.cc:304] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:29.283429 27217 raft_consensus.cc:2468] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:29.342602 27489 raft_consensus.cc:493] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.345207 27411 raft_consensus.cc:740] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.345938 27413 tablet_bootstrap.cc:492] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:29.347316 27414 tablet_bootstrap.cc:492] T 501b61a3989144c5a902cbf9ddbab055 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:29.348611 27414 ts_tablet_manager.cc:1403] T 501b61a3989144c5a902cbf9ddbab055 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.010s
I20260709 13:21:29.348310 27489 raft_consensus.cc:515] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.351475 27413 ts_tablet_manager.cc:1403] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.053s	user 0.024s	sys 0.012s
I20260709 13:21:29.354322 27414 raft_consensus.cc:359] T 501b61a3989144c5a902cbf9ddbab055 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.356087 27414 raft_consensus.cc:385] T 501b61a3989144c5a902cbf9ddbab055 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.356505 27414 raft_consensus.cc:740] T 501b61a3989144c5a902cbf9ddbab055 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.359534 27539 raft_consensus.cc:493] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.359419 27414 consensus_queue.cc:260] T 501b61a3989144c5a902cbf9ddbab055 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.360364 27539 raft_consensus.cc:515] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.362145 27496 raft_consensus.cc:2749] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.358081 27411 consensus_queue.cc:260] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.363458 27539 leader_election.cc:290] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:29.364970 27411 ts_tablet_manager.cc:1434] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.001s
I20260709 13:21:29.367220 27411 tablet_bootstrap.cc:492] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:29.370077 27417 tablet_bootstrap.cc:492] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:29.370656 27417 ts_tablet_manager.cc:1403] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.197s	user 0.010s	sys 0.003s
I20260709 13:21:29.373461 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f684c9c7b4874567b690e70a7ddae640" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:29.376056 27411 tablet_bootstrap.cc:654] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.361193 27489 leader_election.cc:290] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:29.381896 27464 consensus_queue.cc:1048] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:29.382550 27417 raft_consensus.cc:359] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.383309 27417 raft_consensus.cc:385] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.383605 27417 raft_consensus.cc:740] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.385433 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960bc3fba4dc481e9602d13cd4a0b5ae" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:29.386297 27217 raft_consensus.cc:2468] T 960bc3fba4dc481e9602d13cd4a0b5ae P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:29.386852 27038 catalog_manager.cc:5697] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "2d8e002e04a74c2598405158a99d86c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.388041 27258 leader_election.cc:304] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:29.389115 27216 raft_consensus.cc:3060] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.389180 27539 raft_consensus.cc:2804] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:29.390213 27539 raft_consensus.cc:493] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.390611 27539 raft_consensus.cc:3060] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.391815 27413 raft_consensus.cc:359] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.392652 27413 raft_consensus.cc:385] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.392980 27413 raft_consensus.cc:740] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.393996 27413 consensus_queue.cc:260] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.395840 27417 consensus_queue.cc:260] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
W20260709 13:21:29.396718 27109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 63205.4us
I20260709 13:21:29.403159 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f684c9c7b4874567b690e70a7ddae640" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:29.394471 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960bc3fba4dc481e9602d13cd4a0b5ae" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:29.405581 27365 raft_consensus.cc:2468] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:29.414652 27257 leader_election.cc:304] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:29.415670 27423 raft_consensus.cc:2749] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.418432 27413 ts_tablet_manager.cc:1434] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 13:21:29.420010 27413 tablet_bootstrap.cc:492] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:29.432235 27413 tablet_bootstrap.cc:654] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.438901 27291 raft_consensus.cc:3060] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.439522 27417 ts_tablet_manager.cc:1434] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 13:21:29.451516 27414 ts_tablet_manager.cc:1434] T 501b61a3989144c5a902cbf9ddbab055 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.103s	user 0.033s	sys 0.014s
I20260709 13:21:29.453586 27496 consensus_queue.cc:1048] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:29.454710 27414 tablet_bootstrap.cc:492] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:29.467783 27411 tablet_bootstrap.cc:492] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:29.468487 27411 ts_tablet_manager.cc:1403] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.006s
I20260709 13:21:29.472465 27411 raft_consensus.cc:359] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.473527 27411 raft_consensus.cc:385] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.473851 27411 raft_consensus.cc:740] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.474864 27411 consensus_queue.cc:260] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.476758 27417 tablet_bootstrap.cc:492] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:29.478169 27496 raft_consensus.cc:493] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.478771 27450 consensus_queue.cc:1048] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:29.479156 27411 ts_tablet_manager.cc:1434] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:21:29.478848 27496 raft_consensus.cc:515] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.482479 27411 tablet_bootstrap.cc:492] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:29.483330 27539 raft_consensus.cc:515] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.483919 27496 leader_election.cc:290] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:29.486317 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ad970eae96417783396e7accb1b834" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:29.487135 27218 raft_consensus.cc:2468] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 0.
I20260709 13:21:29.489351 27109 leader_election.cc:304] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:29.490445 27496 raft_consensus.cc:2804] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:29.490972 27496 raft_consensus.cc:493] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.491923 27496 raft_consensus.cc:3060] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.497864 27411 tablet_bootstrap.cc:654] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.498543 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ad970eae96417783396e7accb1b834" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
W20260709 13:21:29.501147 27109 leader_election.cc:343] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.503830 27505 raft_consensus.cc:493] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.504542 27505 raft_consensus.cc:515] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.517966 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5e8ee488ee4e18adea644ba22ed683" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:29.519090 27218 raft_consensus.cc:2393] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1962786a39404929920d966805e48399 in current term 1: Already voted for candidate 2d8e002e04a74c2598405158a99d86c1 in this term.
I20260709 13:21:29.521589 27546 consensus_queue.cc:1048] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:29.524004 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5e8ee488ee4e18adea644ba22ed683" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:29.531661 27411 tablet_bootstrap.cc:492] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:29.532020 27413 tablet_bootstrap.cc:492] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:29.532287 27411 ts_tablet_manager.cc:1403] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.004s
I20260709 13:21:29.532496 27413 ts_tablet_manager.cc:1403] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.113s	user 0.017s	sys 0.010s
I20260709 13:21:29.526671 27332 leader_election.cc:304] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:29.535333 27411 raft_consensus.cc:359] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.535730 27557 raft_consensus.cc:3060] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.536108 27411 raft_consensus.cc:385] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.537401 27411 raft_consensus.cc:740] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.538257 27411 consensus_queue.cc:260] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.540648 27411 ts_tablet_manager.cc:1434] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:21:29.541678 27450 raft_consensus.cc:493] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.542358 27450 raft_consensus.cc:515] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.537056 27413 raft_consensus.cc:359] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.543996 27413 raft_consensus.cc:385] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.544312 27411 tablet_bootstrap.cc:492] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:29.544739 27450 leader_election.cc:290] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:29.544337 27413 raft_consensus.cc:740] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.547312 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76efc04736174df4a18381faaf044830" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:29.547410 27450 consensus_queue.cc:1048] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:29.547807 27413 consensus_queue.cc:260] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
W20260709 13:21:29.562662 27109 leader_election.cc:343] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.566349 27411 tablet_bootstrap.cc:654] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.568480 27413 ts_tablet_manager.cc:1434] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:21:29.569893 27413 tablet_bootstrap.cc:492] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:29.559662 27505 leader_election.cc:290] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:29.572335 27450 raft_consensus.cc:493] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.583328 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76efc04736174df4a18381faaf044830" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:29.592022 27414 tablet_bootstrap.cc:654] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.582434 27450 raft_consensus.cc:515] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.593194 27539 leader_election.cc:290] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:29.598170 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960bc3fba4dc481e9602d13cd4a0b5ae" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:29.599323 27214 raft_consensus.cc:3060] T 960bc3fba4dc481e9602d13cd4a0b5ae P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.598317 27450 leader_election.cc:290] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:29.592772 27496 raft_consensus.cc:515] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.601159 27413 tablet_bootstrap.cc:654] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.615262 27559 raft_consensus.cc:493] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.616122 27559 raft_consensus.cc:515] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.646283 27557 raft_consensus.cc:2749] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.652905 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb491563d1a49ac99c74ae4f6553d26" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:29.653448 27450 raft_consensus.cc:493] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.654045 27450 raft_consensus.cc:515] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.656862 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960bc3fba4dc481e9602d13cd4a0b5ae" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:29.657523 27366 raft_consensus.cc:3060] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.658491 27214 raft_consensus.cc:2468] T 960bc3fba4dc481e9602d13cd4a0b5ae P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:29.646652 27417 tablet_bootstrap.cc:654] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.648986 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb491563d1a49ac99c74ae4f6553d26" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:29.672737 27559 leader_election.cc:290] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:29.674994 27496 leader_election.cc:290] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:29.677636 27557 raft_consensus.cc:493] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.678481 27557 raft_consensus.cc:515] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.682457 27557 leader_election.cc:290] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:29.683889 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501b61a3989144c5a902cbf9ddbab055" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:29.684645 27143 raft_consensus.cc:2468] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:29.685235 27258 leader_election.cc:304] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:29.686002 27331 leader_election.cc:304] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:29.682416 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501b61a3989144c5a902cbf9ddbab055" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:29.687302 27291 raft_consensus.cc:2468] T 501b61a3989144c5a902cbf9ddbab055 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:29.689183 27557 raft_consensus.cc:2804] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:29.689600 27557 raft_consensus.cc:493] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.689951 27557 raft_consensus.cc:3060] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.656298 27450 leader_election.cc:290] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:29.695818 27489 raft_consensus.cc:2804] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.696415 27489 raft_consensus.cc:697] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Becoming Leader. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Running, Role: LEADER
I20260709 13:21:29.697463 27489 consensus_queue.cc:237] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
W20260709 13:21:29.698151 27109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:40225, user_credentials={real_user=slave}} blocked reactor thread for 46626us
I20260709 13:21:29.698443 27411 tablet_bootstrap.cc:492] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:29.699122 27411 ts_tablet_manager.cc:1403] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.155s	user 0.030s	sys 0.030s
I20260709 13:21:29.699916 27414 tablet_bootstrap.cc:492] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:29.700469 27414 ts_tablet_manager.cc:1403] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.246s	user 0.010s	sys 0.003s
I20260709 13:21:29.703215 27411 raft_consensus.cc:359] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.703680 27414 raft_consensus.cc:359] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.711175 27414 raft_consensus.cc:385] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.711870 27414 raft_consensus.cc:740] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.712713 27414 consensus_queue.cc:260] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.713879 27546 consensus_queue.cc:1048] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:29.715260 27414 ts_tablet_manager.cc:1434] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:21:29.716545 27414 tablet_bootstrap.cc:492] T 93e07aed35c54d449d6103728c481ab5 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:29.717470 27411 raft_consensus.cc:385] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.717813 27411 raft_consensus.cc:740] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.718653 27411 consensus_queue.cc:260] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.719456 27366 raft_consensus.cc:2468] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:29.720674 27143 raft_consensus.cc:3060] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.706871 27557 raft_consensus.cc:515] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.710479 27413 tablet_bootstrap.cc:492] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:29.723800 27413 ts_tablet_manager.cc:1403] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.154s	user 0.014s	sys 0.000s
W20260709 13:21:29.699051 27109 leader_election.cc:343] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.725569 27109 leader_election.cc:304] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:29.726593 27450 raft_consensus.cc:2749] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.726728 27413 raft_consensus.cc:359] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.729022 27413 raft_consensus.cc:385] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.729403 27413 raft_consensus.cc:740] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.728286 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46295debdbf04af3ae614987b17bd03d" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:29.730195 27489 raft_consensus.cc:493] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.730731 27489 raft_consensus.cc:515] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.731516 27413 consensus_queue.cc:260] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:29.732779 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501b61a3989144c5a902cbf9ddbab055" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:29.733052 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ad970eae96417783396e7accb1b834" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:29.733502 27489 leader_election.cc:290] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:29.733973 27291 raft_consensus.cc:3060] T 501b61a3989144c5a902cbf9ddbab055 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.734905 27413 ts_tablet_manager.cc:1434] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:21:29.736256 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ad970eae96417783396e7accb1b834" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:29.736899 27217 raft_consensus.cc:3060] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.710110 27417 tablet_bootstrap.cc:492] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:29.738137 27417 ts_tablet_manager.cc:1403] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.262s	user 0.014s	sys 0.001s
I20260709 13:21:29.742316 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501b61a3989144c5a902cbf9ddbab055" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:29.733479 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bc3f6a11ae4b85870951a4ef079571" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:29.742959 27142 raft_consensus.cc:3060] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.743747 27413 tablet_bootstrap.cc:492] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:29.748200 27557 leader_election.cc:290] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:29.751362 27414 tablet_bootstrap.cc:654] T 93e07aed35c54d449d6103728c481ab5 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.756011 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bc3f6a11ae4b85870951a4ef079571" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:29.757371 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a9e5ac221b44be83106f28e32dc20e" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:29.758252 27215 raft_consensus.cc:2468] T b1a9e5ac221b44be83106f28e32dc20e P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:29.759187 27450 raft_consensus.cc:493] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:29.759928 27109 leader_election.cc:343] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:29.761545 27109 leader_election.cc:343] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:29.762694 27109 leader_election.cc:343] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.759892 27450 raft_consensus.cc:515] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.775679 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46295debdbf04af3ae614987b17bd03d" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:29.775938 27417 raft_consensus.cc:359] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.776738 27417 raft_consensus.cc:385] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.777031 27417 raft_consensus.cc:740] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.777730 27258 leader_election.cc:304] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:29.778811 27489 raft_consensus.cc:2804] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:29.779281 27489 raft_consensus.cc:493] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.779742 27489 raft_consensus.cc:3060] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.746896 27040 catalog_manager.cc:5697] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "2d8e002e04a74c2598405158a99d86c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.786279 27291 raft_consensus.cc:2468] T 501b61a3989144c5a902cbf9ddbab055 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:29.794708 27217 raft_consensus.cc:2468] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 1.
I20260709 13:21:29.793136 27450 leader_election.cc:290] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:29.795516 27332 leader_election.cc:304] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:29.796456 27557 raft_consensus.cc:2804] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.720822 27411 ts_tablet_manager.cc:1434] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:21:29.796983 27557 raft_consensus.cc:697] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:29.797753 27411 tablet_bootstrap.cc:492] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:29.797816 27557 consensus_queue.cc:237] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.777702 27417 consensus_queue.cc:260] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.801476 27413 tablet_bootstrap.cc:654] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.763177 27109 leader_election.cc:304] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399
W20260709 13:21:29.803007 27109 leader_election.cc:343] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.804348 27559 raft_consensus.cc:2749] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.804678 27109 leader_election.cc:304] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399
I20260709 13:21:29.804337 27417 ts_tablet_manager.cc:1434] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 13:21:29.810158 27423 consensus_queue.cc:1048] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:29.821285 27547 consensus_queue.cc:1048] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:29.821898 27142 raft_consensus.cc:2468] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:29.828464 27450 raft_consensus.cc:2749] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.832808 27489 raft_consensus.cc:515] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.823503 27414 tablet_bootstrap.cc:492] T 93e07aed35c54d449d6103728c481ab5 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:29.835244 27414 ts_tablet_manager.cc:1403] T 93e07aed35c54d449d6103728c481ab5 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.009s
I20260709 13:21:29.839483 27417 tablet_bootstrap.cc:492] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:29.839512 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd74c5033db646ea91b4ca463507c3a3" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:29.840610 27414 raft_consensus.cc:359] T 93e07aed35c54d449d6103728c481ab5 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.842023 27414 raft_consensus.cc:385] T 93e07aed35c54d449d6103728c481ab5 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.842628 27414 raft_consensus.cc:740] T 93e07aed35c54d449d6103728c481ab5 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.840582 27215 raft_consensus.cc:2468] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 0.
I20260709 13:21:29.844053 27414 consensus_queue.cc:260] T 93e07aed35c54d449d6103728c481ab5 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:29.846801 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd74c5033db646ea91b4ca463507c3a3" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:29.848752 27414 ts_tablet_manager.cc:1434] T 93e07aed35c54d449d6103728c481ab5 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:21:29.849761 27414 tablet_bootstrap.cc:492] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:29.849617 27559 raft_consensus.cc:493] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.849612 27489 leader_election.cc:290] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:29.850309 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a9e5ac221b44be83106f28e32dc20e" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:29.851053 27215 raft_consensus.cc:3060] T b1a9e5ac221b44be83106f28e32dc20e P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.851150 27565 consensus_queue.cc:1048] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:29.850333 27559 raft_consensus.cc:515] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
W20260709 13:21:29.853096 27109 leader_election.cc:343] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.858959 27109 leader_election.cc:304] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:29.856676 27505 raft_consensus.cc:493] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.854961 27559 leader_election.cc:290] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:29.860427 27505 raft_consensus.cc:515] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
W20260709 13:21:29.860792 27109 leader_election.cc:343] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.864137 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a9e5ac221b44be83106f28e32dc20e" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:29.864661 27140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ad970eae96417783396e7accb1b834" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:29.864778 27143 raft_consensus.cc:3060] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.865650 27140 raft_consensus.cc:2393] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1962786a39404929920d966805e48399 in current term 1: Already voted for candidate f79efe7c9e6a4384b765393621da6816 in this term.
I20260709 13:21:29.866675 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a9e5ac221b44be83106f28e32dc20e" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:29.864153 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ad970eae96417783396e7accb1b834" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:29.870806 27217 raft_consensus.cc:2393] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1962786a39404929920d966805e48399 in current term 1: Already voted for candidate f79efe7c9e6a4384b765393621da6816 in this term.
I20260709 13:21:29.871706 27505 leader_election.cc:290] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:29.871959 27332 leader_election.cc:304] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:29.859745 27450 raft_consensus.cc:2749] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.873219 27505 raft_consensus.cc:3060] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.873488 27417 tablet_bootstrap.cc:654] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.873549 27109 leader_election.cc:304] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:29.876253 27450 raft_consensus.cc:2804] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.876781 27450 raft_consensus.cc:697] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:29.877602 27450 consensus_queue.cc:237] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.882411 27413 tablet_bootstrap.cc:492] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:29.883184 27413 ts_tablet_manager.cc:1403] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.140s	user 0.011s	sys 0.005s
I20260709 13:21:29.885563 27143 raft_consensus.cc:2468] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:29.887401 27215 raft_consensus.cc:2468] T b1a9e5ac221b44be83106f28e32dc20e P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:29.887661 27109 leader_election.cc:304] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:29.888813 27566 raft_consensus.cc:2804] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:29.889199 27566 raft_consensus.cc:493] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.889555 27566 raft_consensus.cc:3060] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.894181 27505 raft_consensus.cc:2749] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.898306 27566 raft_consensus.cc:515] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.900039 27411 tablet_bootstrap.cc:654] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.901678 27556 consensus_queue.cc:1048] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:29.903106 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76838dbe1fd4a4eac1e7d5740cf668f" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:29.903790 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76838dbe1fd4a4eac1e7d5740cf668f" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:29.906317 27414 tablet_bootstrap.cc:654] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.906085 27489 consensus_queue.cc:1048] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:29.909576 27258 leader_election.cc:304] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:29.909914 27413 raft_consensus.cc:359] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.910429 27489 raft_consensus.cc:2804] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.910830 27413 raft_consensus.cc:385] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.911024 27489 raft_consensus.cc:697] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Becoming Leader. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Running, Role: LEADER
I20260709 13:21:29.911156 27413 raft_consensus.cc:740] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.912079 27489 consensus_queue.cc:237] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.919195 27566 leader_election.cc:290] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:29.926092 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd74c5033db646ea91b4ca463507c3a3" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
W20260709 13:21:29.931980 27109 leader_election.cc:343] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:29.936710 27109 leader_election.cc:343] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:29.937422 27109 leader_election.cc:343] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.938472 27411 tablet_bootstrap.cc:492] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:29.938156 27109 leader_election.cc:304] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399
I20260709 13:21:29.924157 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd74c5033db646ea91b4ca463507c3a3" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:29.939881 27214 raft_consensus.cc:3060] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.941439 27037 catalog_manager.cc:5697] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.946902 27214 raft_consensus.cc:2468] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 1.
I20260709 13:21:29.948745 27566 raft_consensus.cc:2749] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.953580 27109 leader_election.cc:304] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:29.957931 27417 tablet_bootstrap.cc:492] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:29.958549 27417 ts_tablet_manager.cc:1403] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.152s	user 0.029s	sys 0.015s
I20260709 13:21:29.961585 27559 raft_consensus.cc:2804] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.962288 27559 raft_consensus.cc:697] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:29.962325 27417 raft_consensus.cc:359] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.963431 27417 raft_consensus.cc:385] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.963718 27040 catalog_manager.cc:5697] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 0 to 1, leader changed from <none> to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.963812 27417 raft_consensus.cc:740] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.963231 27559 consensus_queue.cc:237] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.939054 27411 ts_tablet_manager.cc:1403] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.141s	user 0.010s	sys 0.005s
I20260709 13:21:29.912909 27413 consensus_queue.cc:260] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.965804 27417 consensus_queue.cc:260] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:29.977872 27413 ts_tablet_manager.cc:1434] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.094s	user 0.009s	sys 0.001s
I20260709 13:21:29.982684 27413 tablet_bootstrap.cc:492] T 6b8d513ca0a647d5a716650ed58360f6 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:29.984469 27417 ts_tablet_manager.cc:1434] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 13:21:29.987160 27417 tablet_bootstrap.cc:492] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:29.924274 27414 tablet_bootstrap.cc:492] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:29.991279 27414 ts_tablet_manager.cc:1403] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.142s	user 0.010s	sys 0.003s
I20260709 13:21:29.994344 27414 raft_consensus.cc:359] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.995087 27414 raft_consensus.cc:385] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.995436 27414 raft_consensus.cc:740] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.996483 27414 consensus_queue.cc:260] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:29.999827 27414 ts_tablet_manager.cc:1434] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:21:29.976426 27411 raft_consensus.cc:359] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.005661 27417 tablet_bootstrap.cc:654] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.009835 27414 tablet_bootstrap.cc:492] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:30.010509 27489 raft_consensus.cc:493] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.011047 27489 raft_consensus.cc:515] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:30.013422 27489 leader_election.cc:290] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:30.014292 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd74c5033db646ea91b4ca463507c3a3" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:30.015158 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd74c5033db646ea91b4ca463507c3a3" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:30.016010 27214 raft_consensus.cc:2393] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d8e002e04a74c2598405158a99d86c1 in current term 1: Already voted for candidate f79efe7c9e6a4384b765393621da6816 in this term.
I20260709 13:21:30.015889 27037 catalog_manager.cc:5697] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "2d8e002e04a74c2598405158a99d86c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:30.017936 27258 leader_election.cc:304] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:30.004498 27411 raft_consensus.cc:385] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.020153 27411 raft_consensus.cc:740] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.020692 27489 raft_consensus.cc:3060] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.021273 27413 tablet_bootstrap.cc:654] T 6b8d513ca0a647d5a716650ed58360f6 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.022210 27411 consensus_queue.cc:260] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.024885 27411 ts_tablet_manager.cc:1434] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 13:21:30.025928 27411 tablet_bootstrap.cc:492] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:30.026046 27502 raft_consensus.cc:493] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.027791 27502 raft_consensus.cc:515] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.032282 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c666107348f4678ba2161b66cd6d486" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
W20260709 13:21:30.037071 27184 leader_election.cc:343] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.037501 27041 catalog_manager.cc:5697] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 0 to 1, leader changed from <none> to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.041235 27417 tablet_bootstrap.cc:492] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:30.042016 27417 ts_tablet_manager.cc:1403] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.001s
I20260709 13:21:30.033440 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c666107348f4678ba2161b66cd6d486" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:30.045526 27489 raft_consensus.cc:2749] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:30.046253 27184 leader_election.cc:343] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.046802 27184 leader_election.cc:304] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:30.047675 27414 tablet_bootstrap.cc:654] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.029912 27502 leader_election.cc:290] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:30.052222 27417 raft_consensus.cc:359] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.053139 27417 raft_consensus.cc:385] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.052640 27502 raft_consensus.cc:2749] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:30.053480 27417 raft_consensus.cc:740] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.055763 27411 tablet_bootstrap.cc:654] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.056490 27417 consensus_queue.cc:260] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.059825 27417 ts_tablet_manager.cc:1434] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:21:30.066905 27417 tablet_bootstrap.cc:492] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:30.073400 27417 tablet_bootstrap.cc:654] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.076978 27413 tablet_bootstrap.cc:492] T 6b8d513ca0a647d5a716650ed58360f6 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:30.077627 27413 ts_tablet_manager.cc:1403] T 6b8d513ca0a647d5a716650ed58360f6 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.000s
I20260709 13:21:30.080880 27413 raft_consensus.cc:359] T 6b8d513ca0a647d5a716650ed58360f6 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.081641 27413 raft_consensus.cc:385] T 6b8d513ca0a647d5a716650ed58360f6 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.081934 27413 raft_consensus.cc:740] T 6b8d513ca0a647d5a716650ed58360f6 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.082620 27413 consensus_queue.cc:260] T 6b8d513ca0a647d5a716650ed58360f6 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.088469 27413 ts_tablet_manager.cc:1434] T 6b8d513ca0a647d5a716650ed58360f6 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:21:30.089488 27413 tablet_bootstrap.cc:492] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:30.090179 27417 tablet_bootstrap.cc:492] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:30.090739 27417 ts_tablet_manager.cc:1403] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.000s
I20260709 13:21:30.094053 27414 tablet_bootstrap.cc:492] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:30.093858 27417 raft_consensus.cc:359] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.094587 27414 ts_tablet_manager.cc:1403] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.094s	user 0.021s	sys 0.015s
I20260709 13:21:30.094587 27417 raft_consensus.cc:385] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.095183 27417 raft_consensus.cc:740] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.096019 27417 consensus_queue.cc:260] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.097800 27414 raft_consensus.cc:359] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.098212 27417 ts_tablet_manager.cc:1434] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:21:30.098564 27414 raft_consensus.cc:385] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.098935 27414 raft_consensus.cc:740] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.100111 27417 tablet_bootstrap.cc:492] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:30.099730 27414 consensus_queue.cc:260] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.102581 27414 ts_tablet_manager.cc:1434] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:21:30.104424 27414 tablet_bootstrap.cc:492] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:30.107461 27417 tablet_bootstrap.cc:654] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.110579 27411 tablet_bootstrap.cc:492] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:30.111116 27411 ts_tablet_manager.cc:1403] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.003s
I20260709 13:21:30.114135 27411 raft_consensus.cc:359] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.114751 27411 raft_consensus.cc:385] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.115008 27411 raft_consensus.cc:740] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.115672 27411 consensus_queue.cc:260] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.117703 27411 ts_tablet_manager.cc:1434] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:21:30.118813 27411 tablet_bootstrap.cc:492] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:30.121942 27478 raft_consensus.cc:493] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.122591 27478 raft_consensus.cc:515] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.125259 27411 tablet_bootstrap.cc:654] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.126415 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb491563d1a49ac99c74ae4f6553d26" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:30.126736 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb491563d1a49ac99c74ae4f6553d26" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:30.127255 27143 raft_consensus.cc:2468] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:30.129359 27478 leader_election.cc:290] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:30.133291 27183 leader_election.cc:304] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:30.135123 27413 tablet_bootstrap.cc:654] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:30.135377 27184 leader_election.cc:343] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.134665 27414 tablet_bootstrap.cc:654] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.140662 27478 raft_consensus.cc:2804] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:30.141384 27478 raft_consensus.cc:493] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.142139 27478 raft_consensus.cc:3060] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.153852 27417 tablet_bootstrap.cc:492] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:30.154436 27417 ts_tablet_manager.cc:1403] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.055s	user 0.006s	sys 0.007s
I20260709 13:21:30.157543 27417 raft_consensus.cc:359] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.158206 27417 raft_consensus.cc:385] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.158504 27417 raft_consensus.cc:740] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
W20260709 13:21:30.160127 27088 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:30.164811 27417 consensus_queue.cc:260] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.167652 27417 ts_tablet_manager.cc:1434] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:21:30.171581 27366 raft_consensus.cc:3060] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.173203 27417 tablet_bootstrap.cc:492] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:30.176789 27413 tablet_bootstrap.cc:492] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:30.179085 27413 ts_tablet_manager.cc:1403] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.090s	user 0.022s	sys 0.006s
I20260709 13:21:30.179345 27478 raft_consensus.cc:515] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.181988 27413 raft_consensus.cc:359] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.191067 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb491563d1a49ac99c74ae4f6553d26" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:30.192956 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb491563d1a49ac99c74ae4f6553d26" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:30.188060 27414 tablet_bootstrap.cc:492] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:30.193920 27365 raft_consensus.cc:3060] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.194124 27414 ts_tablet_manager.cc:1403] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.006s
I20260709 13:21:30.182377 27411 tablet_bootstrap.cc:492] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:30.195179 27411 ts_tablet_manager.cc:1403] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.077s	user 0.021s	sys 0.002s
I20260709 13:21:30.193982 27143 raft_consensus.cc:3060] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.202024 27414 raft_consensus.cc:359] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.202781 27414 raft_consensus.cc:385] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.203052 27414 raft_consensus.cc:740] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.203316 27411 raft_consensus.cc:359] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.204200 27411 raft_consensus.cc:385] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.191452 27478 leader_election.cc:290] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:30.204999 27413 raft_consensus.cc:385] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.205016 27411 raft_consensus.cc:740] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.209787 27143 raft_consensus.cc:2468] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:30.209712 27411 consensus_queue.cc:260] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.210804 27413 raft_consensus.cc:740] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.211694 27413 consensus_queue.cc:260] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.185998 27417 tablet_bootstrap.cc:654] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.204954 27414 consensus_queue.cc:260] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.216897 27505 raft_consensus.cc:493] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.219074 27505 raft_consensus.cc:515] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.221227 27505 leader_election.cc:290] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:30.223317 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e07aed35c54d449d6103728c481ab5" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:30.226382 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e07aed35c54d449d6103728c481ab5" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:30.224192 27143 raft_consensus.cc:2468] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:30.226966 27414 ts_tablet_manager.cc:1434] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 13:21:30.227128 27291 raft_consensus.cc:2468] T 93e07aed35c54d449d6103728c481ab5 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:30.228005 27414 tablet_bootstrap.cc:492] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:30.227922 27183 leader_election.cc:304] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:30.229056 27586 raft_consensus.cc:2804] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:30.229532 27586 raft_consensus.cc:697] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:30.230363 27586 consensus_queue.cc:237] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.216506 27365 raft_consensus.cc:2468] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:30.234117 27331 leader_election.cc:304] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:30.246668 27414 tablet_bootstrap.cc:654] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.245543 27505 raft_consensus.cc:2804] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:30.247401 27505 raft_consensus.cc:493] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.248093 27505 raft_consensus.cc:3060] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.253855 27411 ts_tablet_manager.cc:1434] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.002s
I20260709 13:21:30.259025 27546 raft_consensus.cc:493] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.269516 27546 raft_consensus.cc:515] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.270450 27411 tablet_bootstrap.cc:492] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:30.271581 27546 leader_election.cc:290] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:30.255683 27413 ts_tablet_manager.cc:1434] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.004s
I20260709 13:21:30.272944 27413 tablet_bootstrap.cc:492] T 966ee691db624d2bac9b9cfe639d8963 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:30.274441 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8d513ca0a647d5a716650ed58360f6" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:30.274634 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8d513ca0a647d5a716650ed58360f6" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:30.275126 27214 raft_consensus.cc:2468] T 6b8d513ca0a647d5a716650ed58360f6 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:30.276463 27258 leader_election.cc:304] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
W20260709 13:21:30.277904 27258 leader_election.cc:343] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.262039 27417 tablet_bootstrap.cc:492] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:30.279292 27417 ts_tablet_manager.cc:1403] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.106s	user 0.026s	sys 0.012s
I20260709 13:21:30.266302 27539 consensus_queue.cc:1048] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:30.281209 27489 consensus_queue.cc:1048] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:30.281529 27539 raft_consensus.cc:2804] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:30.281937 27539 raft_consensus.cc:493] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.282272 27539 raft_consensus.cc:3060] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.283704 27417 raft_consensus.cc:359] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.294086 27539 raft_consensus.cc:515] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.295367 27556 consensus_queue.cc:1048] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:30.296200 27539 leader_election.cc:290] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:30.298082 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8d513ca0a647d5a716650ed58360f6" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:30.268232 27505 raft_consensus.cc:515] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.304685 27559 raft_consensus.cc:493] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.334728 27559 raft_consensus.cc:515] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.336930 27559 leader_election.cc:290] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:30.337224 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e07aed35c54d449d6103728c481ab5" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:30.337841 27143 raft_consensus.cc:3060] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.344097 27547 consensus_queue.cc:1048] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:30.347697 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966ee691db624d2bac9b9cfe639d8963" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:30.350430 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e07aed35c54d449d6103728c481ab5" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:30.357131 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966ee691db624d2bac9b9cfe639d8963" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:30.351593 27291 raft_consensus.cc:3060] T 93e07aed35c54d449d6103728c481ab5 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:30.350539 27109 leader_election.cc:343] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:30.361629 27109 leader_election.cc:343] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.297483 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b8d513ca0a647d5a716650ed58360f6" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:30.362079 27109 leader_election.cc:304] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399
I20260709 13:21:30.362473 27215 raft_consensus.cc:3060] T 6b8d513ca0a647d5a716650ed58360f6 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.364703 27539 raft_consensus.cc:493] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.316655 27566 consensus_queue.cc:1048] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:30.330487 27546 consensus_queue.cc:1048] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:30.284796 27417 raft_consensus.cc:385] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.365579 27417 raft_consensus.cc:740] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.365340 27539 raft_consensus.cc:515] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.366469 27417 consensus_queue.cc:260] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.334954 27040 catalog_manager.cc:5697] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:30.367583 27539 leader_election.cc:290] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:30.298027 27411 tablet_bootstrap.cc:654] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.371817 27143 raft_consensus.cc:2468] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:30.372061 27417 ts_tablet_manager.cc:1434] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.092s	user 0.009s	sys 0.005s
I20260709 13:21:30.376632 27505 leader_election.cc:290] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:30.377444 27414 tablet_bootstrap.cc:492] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:30.377656 27417 tablet_bootstrap.cc:492] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:30.378093 27414 ts_tablet_manager.cc:1403] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.007s
I20260709 13:21:30.379333 27566 raft_consensus.cc:2749] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:30.380898 27414 raft_consensus.cc:359] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.381616 27414 raft_consensus.cc:385] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.381880 27414 raft_consensus.cc:740] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.382696 27414 consensus_queue.cc:260] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.328492 27413 tablet_bootstrap.cc:654] T 966ee691db624d2bac9b9cfe639d8963 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.388237 27414 ts_tablet_manager.cc:1434] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:21:30.389395 27414 tablet_bootstrap.cc:492] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:30.395108 27414 tablet_bootstrap.cc:654] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.397974 27331 leader_election.cc:304] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:30.399253 27417 tablet_bootstrap.cc:654] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.399137 27505 raft_consensus.cc:2804] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:30.400444 27505 raft_consensus.cc:697] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:30.400928 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c666107348f4678ba2161b66cd6d486" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:30.402053 27216 raft_consensus.cc:2468] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:30.401145 27557 raft_consensus.cc:493] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.403139 27557 raft_consensus.cc:515] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.403589 27539 consensus_queue.cc:1048] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:30.406247 27557 leader_election.cc:290] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:30.408336 27140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76efc04736174df4a18381faaf044830" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:30.408845 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76efc04736174df4a18381faaf044830" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:30.402171 27505 consensus_queue.cc:237] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.409678 27411 tablet_bootstrap.cc:492] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:30.409754 27292 raft_consensus.cc:2468] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:30.410379 27411 ts_tablet_manager.cc:1403] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.140s	user 0.008s	sys 0.015s
I20260709 13:21:30.409104 27140 raft_consensus.cc:2468] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:30.414976 27417 tablet_bootstrap.cc:492] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:30.415634 27417 ts_tablet_manager.cc:1403] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.003s
I20260709 13:21:30.418494 27332 leader_election.cc:304] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:30.425801 27411 raft_consensus.cc:359] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:30.427294 27411 raft_consensus.cc:385] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.427686 27411 raft_consensus.cc:740] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.435432 27411 consensus_queue.cc:260] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:30.441347 27417 raft_consensus.cc:359] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.442111 27417 raft_consensus.cc:385] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.442381 27417 raft_consensus.cc:740] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.443182 27417 consensus_queue.cc:260] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.445745 27417 ts_tablet_manager.cc:1434] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.004s
I20260709 13:21:30.425531 27557 raft_consensus.cc:2804] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:30.447846 27417 tablet_bootstrap.cc:492] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:30.447346 27566 consensus_queue.cc:1048] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:30.450460 27565 raft_consensus.cc:493] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.450935 27565 raft_consensus.cc:515] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.454150 27411 ts_tablet_manager.cc:1434] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 13:21:30.455631 27411 tablet_bootstrap.cc:492] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:30.452772 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c666107348f4678ba2161b66cd6d486" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:30.447623 27557 raft_consensus.cc:493] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.465348 27556 raft_consensus.cc:493] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.481684 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728a1fd5a8c84cb19f6691fc08e1eeef" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:30.471191 27557 raft_consensus.cc:3060] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.473325 27565 leader_election.cc:290] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
W20260709 13:21:30.484381 27258 leader_election.cc:343] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.506314 27258 leader_election.cc:304] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:30.508544 27546 raft_consensus.cc:2804] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:30.509034 27546 raft_consensus.cc:493] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.509393 27546 raft_consensus.cc:3060] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.488262 27556 raft_consensus.cc:515] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.513038 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728a1fd5a8c84cb19f6691fc08e1eeef" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:30.513916 27364 raft_consensus.cc:2468] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:30.516382 27556 leader_election.cc:290] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:30.523541 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c666107348f4678ba2161b66cd6d486" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:30.474669 27291 raft_consensus.cc:2468] T 93e07aed35c54d449d6103728c481ab5 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:30.524796 27556 raft_consensus.cc:493] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.528615 27556 raft_consensus.cc:515] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.544449 27413 tablet_bootstrap.cc:492] T 966ee691db624d2bac9b9cfe639d8963 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:30.545038 27413 ts_tablet_manager.cc:1403] T 966ee691db624d2bac9b9cfe639d8963 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.272s	user 0.019s	sys 0.025s
I20260709 13:21:30.547807 27413 raft_consensus.cc:359] T 966ee691db624d2bac9b9cfe639d8963 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.548723 27556 leader_election.cc:290] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:30.548463 27413 raft_consensus.cc:385] T 966ee691db624d2bac9b9cfe639d8963 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.550675 27413 raft_consensus.cc:740] T 966ee691db624d2bac9b9cfe639d8963 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.551101 27417 tablet_bootstrap.cc:654] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.553498 27411 tablet_bootstrap.cc:654] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:30.526300 27109 leader_election.cc:343] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.553602 27413 consensus_queue.cc:260] T 966ee691db624d2bac9b9cfe639d8963 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.552259 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966ee691db624d2bac9b9cfe639d8963" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:30.558892 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c666107348f4678ba2161b66cd6d486" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:30.559607 27142 raft_consensus.cc:2468] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:30.559631 27217 raft_consensus.cc:2468] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:30.561327 27331 leader_election.cc:304] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:30.568120 27215 raft_consensus.cc:2468] T 6b8d513ca0a647d5a716650ed58360f6 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
W20260709 13:21:30.561836 27109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:40225, user_credentials={real_user=slave}} blocked reactor thread for 62117.4us
I20260709 13:21:30.573504 27413 ts_tablet_manager.cc:1434] T 966ee691db624d2bac9b9cfe639d8963 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:21:30.578480 27413 tablet_bootstrap.cc:492] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:30.583969 27586 raft_consensus.cc:493] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.584628 27586 raft_consensus.cc:515] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.585611 27565 consensus_queue.cc:1048] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:30.585947 27546 raft_consensus.cc:515] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.587242 27586 leader_election.cc:290] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:30.588567 27292 raft_consensus.cc:2393] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1962786a39404929920d966805e48399 in current term 1: Already voted for candidate 2d8e002e04a74c2598405158a99d86c1 in this term.
I20260709 13:21:30.590667 27414 tablet_bootstrap.cc:492] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:30.591228 27414 ts_tablet_manager.cc:1403] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.202s	user 0.042s	sys 0.047s
I20260709 13:21:30.592543 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966ee691db624d2bac9b9cfe639d8963" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:30.593302 27218 raft_consensus.cc:2468] T 966ee691db624d2bac9b9cfe639d8963 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:30.594803 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76838dbe1fd4a4eac1e7d5740cf668f" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:30.595217 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c666107348f4678ba2161b66cd6d486" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:30.595888 27366 raft_consensus.cc:3060] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:30.599874 27184 leader_election.cc:343] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.588279 27546 leader_election.cc:290] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:30.578444 27505 raft_consensus.cc:2804] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:30.608078 27332 leader_election.cc:304] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:30.610778 27366 raft_consensus.cc:2468] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:30.611416 27556 raft_consensus.cc:2764] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:21:30.611958 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76838dbe1fd4a4eac1e7d5740cf668f" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:30.612223 27258 leader_election.cc:304] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:30.612759 27142 raft_consensus.cc:2468] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:30.613308 27546 raft_consensus.cc:2804] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:30.615875 27413 tablet_bootstrap.cc:654] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.616775 27546 raft_consensus.cc:697] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Becoming Leader. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Running, Role: LEADER
I20260709 13:21:30.603775 27557 raft_consensus.cc:515] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.621544 27414 raft_consensus.cc:359] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:30.622288 27414 raft_consensus.cc:385] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.622563 27414 raft_consensus.cc:740] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.623363 27414 consensus_queue.cc:260] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:30.623698 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76efc04736174df4a18381faaf044830" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:30.624306 27292 raft_consensus.cc:3060] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.624986 27183 leader_election.cc:304] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:30.625840 27478 raft_consensus.cc:2804] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:30.626282 27478 raft_consensus.cc:493] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.604847 27505 raft_consensus.cc:493] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.626622 27478 raft_consensus.cc:3060] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.629535 27414 ts_tablet_manager.cc:1434] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:21:30.630570 27546 consensus_queue.cc:237] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.633342 27414 tablet_bootstrap.cc:492] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:30.632567 27505 raft_consensus.cc:3060] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.633273 27041 catalog_manager.cc:5697] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.639209 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c666107348f4678ba2161b66cd6d486" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:30.640913 27258 leader_election.cc:304] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 1962786a39404929920d966805e48399
W20260709 13:21:30.643509 27109 leader_election.cc:343] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.646413 27411 tablet_bootstrap.cc:492] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:30.652473 27411 ts_tablet_manager.cc:1403] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.197s	user 0.020s	sys 0.011s
I20260709 13:21:30.646987 27414 tablet_bootstrap.cc:654] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.651508 27489 raft_consensus.cc:2804] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:30.651835 27215 raft_consensus.cc:3060] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.664815 27215 raft_consensus.cc:2468] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:30.667744 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76efc04736174df4a18381faaf044830" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:30.668740 27489 raft_consensus.cc:697] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Becoming Leader. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Running, Role: LEADER
I20260709 13:21:30.668781 27142 raft_consensus.cc:3060] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.669736 27489 consensus_queue.cc:237] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.654701 27109 leader_election.cc:304] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:30.673278 27557 leader_election.cc:290] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:30.685947 27565 raft_consensus.cc:2749] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:30.693181 27496 raft_consensus.cc:493] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.693810 27496 raft_consensus.cc:515] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:30.681136 27292 raft_consensus.cc:2468] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:30.699717 27417 tablet_bootstrap.cc:492] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:30.699615 27496 leader_election.cc:290] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:30.700361 27417 ts_tablet_manager.cc:1403] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.254s	user 0.014s	sys 0.038s
I20260709 13:21:30.699661 27332 leader_election.cc:304] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
W20260709 13:21:30.694736 27109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 51260us
I20260709 13:21:30.703104 27417 raft_consensus.cc:359] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.703787 27417 raft_consensus.cc:385] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.704059 27417 raft_consensus.cc:740] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.709391 27411 raft_consensus.cc:359] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:30.709995 27411 raft_consensus.cc:385] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.710269 27411 raft_consensus.cc:740] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.712982 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09320cdf2a440f789313b20646079a6" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:30.713725 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09320cdf2a440f789313b20646079a6" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:30.717835 27411 consensus_queue.cc:260] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:30.709506 27496 raft_consensus.cc:493] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.727311 27496 raft_consensus.cc:515] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.730122 27413 tablet_bootstrap.cc:492] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:30.730739 27413 ts_tablet_manager.cc:1403] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.152s	user 0.015s	sys 0.007s
I20260709 13:21:30.731782 27496 leader_election.cc:290] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:30.734247 27413 raft_consensus.cc:359] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:30.735288 27413 raft_consensus.cc:385] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.735600 27413 raft_consensus.cc:740] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.736383 27413 consensus_queue.cc:260] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:30.739099 27413 ts_tablet_manager.cc:1434] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.003s
I20260709 13:21:30.740262 27413 tablet_bootstrap.cc:492] T f28a920522f34d318c610b60571ca004 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:30.747257 27413 tablet_bootstrap.cc:654] T f28a920522f34d318c610b60571ca004 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.748540 27040 catalog_manager.cc:5697] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "2d8e002e04a74c2598405158a99d86c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.754613 27040 catalog_manager.cc:5697] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "2d8e002e04a74c2598405158a99d86c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.719131 27417 consensus_queue.cc:260] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.711114 27557 raft_consensus.cc:2804] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:30.720875 27478 raft_consensus.cc:515] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.773161 27557 raft_consensus.cc:697] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
W20260709 13:21:30.722921 27109 leader_election.cc:343] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.723143 27566 consensus_queue.cc:1048] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:30.724920 27411 ts_tablet_manager.cc:1434] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 13:21:30.725368 27142 raft_consensus.cc:2468] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:30.774086 27557 consensus_queue.cc:237] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.775166 27414 tablet_bootstrap.cc:492] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:30.775717 27414 ts_tablet_manager.cc:1403] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.143s	user 0.015s	sys 0.000s
I20260709 13:21:30.776702 27411 tablet_bootstrap.cc:492] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:30.779572 27417 ts_tablet_manager.cc:1434] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.079s	user 0.004s	sys 0.001s
I20260709 13:21:30.780779 27417 tablet_bootstrap.cc:492] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:30.781342 27586 consensus_queue.cc:1048] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:30.781854 27414 raft_consensus.cc:359] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.782565 27414 raft_consensus.cc:385] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.782823 27414 raft_consensus.cc:740] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.784148 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76838dbe1fd4a4eac1e7d5740cf668f" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:30.783469 27414 consensus_queue.cc:260] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.784933 27142 raft_consensus.cc:3060] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.785333 27505 raft_consensus.cc:515] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.787117 27414 ts_tablet_manager.cc:1434] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:21:30.788043 27414 tablet_bootstrap.cc:492] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
W20260709 13:21:30.788755 27109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:38009, user_credentials={real_user=slave}} blocked reactor thread for 65877.4us
I20260709 13:21:30.791481 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76838dbe1fd4a4eac1e7d5740cf668f" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
W20260709 13:21:30.791916 27109 leader_election.cc:343] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.794283 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a2e2e4269146dd8e2bf720a1c890d8" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:30.794903 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a2e2e4269146dd8e2bf720a1c890d8" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:30.782838 27478 leader_election.cc:290] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:30.795881 27478 consensus_queue.cc:1048] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:30.794926 27291 raft_consensus.cc:2468] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 0.
I20260709 13:21:30.792459 27109 leader_election.cc:304] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
W20260709 13:21:30.801689 27184 leader_election.cc:343] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.802162 27496 raft_consensus.cc:2749] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:30.816565 27411 tablet_bootstrap.cc:654] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:30.813820 27109 leader_election.cc:343] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.824580 27109 leader_election.cc:304] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:30.825569 27566 raft_consensus.cc:2804] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:30.826145 27566 raft_consensus.cc:493] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.829262 27566 raft_consensus.cc:3060] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.832742 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966ee691db624d2bac9b9cfe639d8963" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:30.833631 27143 raft_consensus.cc:3060] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.839537 27505 leader_election.cc:290] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:30.840265 27505 consensus_queue.cc:1048] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:30.841106 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "966ee691db624d2bac9b9cfe639d8963" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:30.842108 27218 raft_consensus.cc:3060] T 966ee691db624d2bac9b9cfe639d8963 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.858001 27414 tablet_bootstrap.cc:654] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.813201 27142 raft_consensus.cc:2468] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:30.863473 27218 raft_consensus.cc:2468] T 966ee691db624d2bac9b9cfe639d8963 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:30.865437 27332 leader_election.cc:304] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:30.874620 27417 tablet_bootstrap.cc:654] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.876230 27411 tablet_bootstrap.cc:492] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:30.876937 27411 ts_tablet_manager.cc:1403] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.101s	user 0.018s	sys 0.005s
I20260709 13:21:30.878971 27143 raft_consensus.cc:2468] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:30.879083 27183 leader_election.cc:304] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:30.883903 27478 raft_consensus.cc:2804] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:30.884475 27478 raft_consensus.cc:697] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:30.870383 27505 raft_consensus.cc:2804] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:30.887243 27505 raft_consensus.cc:697] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:30.888247 27505 consensus_queue.cc:237] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.885421 27478 consensus_queue.cc:237] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.880112 27411 raft_consensus.cc:359] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.895643 27411 raft_consensus.cc:385] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.896070 27411 raft_consensus.cc:740] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.902580 27411 consensus_queue.cc:260] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:30.904552 27411 ts_tablet_manager.cc:1434] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:21:30.911491 27411 tablet_bootstrap.cc:492] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:30.910111 27041 catalog_manager.cc:5697] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.913892 27414 tablet_bootstrap.cc:492] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:30.914654 27414 ts_tablet_manager.cc:1403] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.127s	user 0.024s	sys 0.003s
I20260709 13:21:30.915203 27413 tablet_bootstrap.cc:492] T f28a920522f34d318c610b60571ca004 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:30.915712 27413 ts_tablet_manager.cc:1403] T f28a920522f34d318c610b60571ca004 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.176s	user 0.031s	sys 0.023s
I20260709 13:21:30.924950 27413 raft_consensus.cc:359] T f28a920522f34d318c610b60571ca004 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.925781 27413 raft_consensus.cc:385] T f28a920522f34d318c610b60571ca004 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.926146 27413 raft_consensus.cc:740] T f28a920522f34d318c610b60571ca004 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.926926 27413 consensus_queue.cc:260] T f28a920522f34d318c610b60571ca004 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.928761 27413 ts_tablet_manager.cc:1434] T f28a920522f34d318c610b60571ca004 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:21:30.929870 27413 tablet_bootstrap.cc:492] T f09320cdf2a440f789313b20646079a6 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:30.874717 27566 raft_consensus.cc:515] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:30.941551 27556 consensus_queue.cc:1048] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:21:30.945047 27566 leader_election.cc:290] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:30.949436 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a2e2e4269146dd8e2bf720a1c890d8" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:30.950361 27291 raft_consensus.cc:3060] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.956617 27411 tablet_bootstrap.cc:654] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.937556 27496 raft_consensus.cc:493] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.967058 27414 raft_consensus.cc:359] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:30.967898 27414 raft_consensus.cc:385] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.968186 27414 raft_consensus.cc:740] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.960886 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a2e2e4269146dd8e2bf720a1c890d8" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:30.978941 27413 tablet_bootstrap.cc:654] T f09320cdf2a440f789313b20646079a6 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.959329 27496 raft_consensus.cc:515] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:30.981557 27496 leader_election.cc:290] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:30.985559 27291 raft_consensus.cc:2468] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 1.
I20260709 13:21:30.994282 27414 consensus_queue.cc:260] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:31.015637 27417 tablet_bootstrap.cc:492] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:31.015916 27411 tablet_bootstrap.cc:492] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:31.016419 27417 ts_tablet_manager.cc:1403] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.236s	user 0.013s	sys 0.003s
I20260709 13:21:31.016811 27411 ts_tablet_manager.cc:1403] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.106s	user 0.023s	sys 0.008s
I20260709 13:21:31.023447 27414 ts_tablet_manager.cc:1434] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.000s
I20260709 13:21:31.024746 27414 tablet_bootstrap.cc:492] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:31.028620 27417 raft_consensus.cc:359] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:31.029997 27417 raft_consensus.cc:385] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.030289 27417 raft_consensus.cc:740] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.024396 27629 raft_consensus.cc:493] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.030671 27556 raft_consensus.cc:493] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.030995 27417 consensus_queue.cc:260] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:31.031286 27556 raft_consensus.cc:515] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:31.032683 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976b5b49dae34fae8a725ff84ca47fe5" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:31.033272 27417 ts_tablet_manager.cc:1434] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:21:31.033857 27556 leader_election.cc:290] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:31.034250 27417 tablet_bootstrap.cc:492] T 6b8d513ca0a647d5a716650ed58360f6 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:31.036324 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976b5b49dae34fae8a725ff84ca47fe5" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:31.032825 27547 raft_consensus.cc:493] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.028970 27411 raft_consensus.cc:359] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:31.041623 27411 raft_consensus.cc:385] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.042047 27411 raft_consensus.cc:740] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.044652 27411 consensus_queue.cc:260] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:31.049222 27109 leader_election.cc:304] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:31.050390 27559 raft_consensus.cc:2804] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:21:31.050518 27109 leader_election.cc:343] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.051045 27559 raft_consensus.cc:697] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:31.051608 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a920522f34d318c610b60571ca004" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:31.052436 27214 raft_consensus.cc:2468] T f28a920522f34d318c610b60571ca004 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:31.054493 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a920522f34d318c610b60571ca004" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:31.055009 27332 leader_election.cc:304] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:31.044375 27547 raft_consensus.cc:515] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
W20260709 13:21:31.057406 27109 leader_election.cc:343] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.057842 27464 raft_consensus.cc:2804] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:31.058292 27464 raft_consensus.cc:493] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:31.058693 27464 raft_consensus.cc:3060] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.059100 27547 leader_election.cc:290] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:31.030922 27629 raft_consensus.cc:515] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.061141 27140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728a1fd5a8c84cb19f6691fc08e1eeef" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:31.061877 27140 raft_consensus.cc:2468] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
W20260709 13:21:31.058722 27109 leader_election.cc:343] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.062811 27109 leader_election.cc:304] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:31.052016 27559 consensus_queue.cc:237] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:31.064832 27496 raft_consensus.cc:2749] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:31.063218 27629 leader_election.cc:290] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:31.065234 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728a1fd5a8c84cb19f6691fc08e1eeef" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:31.065428 27331 leader_election.cc:304] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:31.067009 27411 ts_tablet_manager.cc:1434] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:21:31.067613 27413 tablet_bootstrap.cc:492] T f09320cdf2a440f789313b20646079a6 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:31.068172 27413 ts_tablet_manager.cc:1403] T f09320cdf2a440f789313b20646079a6 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.139s	user 0.027s	sys 0.017s
I20260709 13:21:31.068226 27411 tablet_bootstrap.cc:492] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:31.069257 27140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46295debdbf04af3ae614987b17bd03d" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:31.070017 27140 raft_consensus.cc:2468] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:31.076149 27183 leader_election.cc:304] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:31.077210 27547 raft_consensus.cc:2804] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:21:31.077368 27332 leader_election.cc:343] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.077766 27547 raft_consensus.cc:493] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:31.078250 27547 raft_consensus.cc:3060] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.078394 27629 raft_consensus.cc:2804] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:31.079074 27629 raft_consensus.cc:493] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:31.079531 27629 raft_consensus.cc:3060] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.094940 27489 consensus_queue.cc:1048] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:31.096068 27332 leader_election.cc:343] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.104279 27411 tablet_bootstrap.cc:654] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.101305 27041 catalog_manager.cc:5697] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:31.113274 27413 raft_consensus.cc:359] T f09320cdf2a440f789313b20646079a6 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.117062 27413 raft_consensus.cc:385] T f09320cdf2a440f789313b20646079a6 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.118193 27413 raft_consensus.cc:740] T f09320cdf2a440f789313b20646079a6 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.120739 27413 consensus_queue.cc:260] T f09320cdf2a440f789313b20646079a6 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.124562 27546 raft_consensus.cc:493] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.125131 27546 raft_consensus.cc:515] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.130959 27414 tablet_bootstrap.cc:654] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.128170 27546 leader_election.cc:290] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:31.094980 27547 raft_consensus.cc:515] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:31.137007 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46295debdbf04af3ae614987b17bd03d" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:31.130144 27464 raft_consensus.cc:515] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:31.120218 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46295debdbf04af3ae614987b17bd03d" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:31.141050 27290 raft_consensus.cc:2468] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:31.142927 27413 ts_tablet_manager.cc:1434] T f09320cdf2a440f789313b20646079a6 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.001s
I20260709 13:21:31.142760 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728a1fd5a8c84cb19f6691fc08e1eeef" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
W20260709 13:21:31.144132 27332 leader_election.cc:343] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.146409 27464 leader_election.cc:290] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:31.149729 27140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46295debdbf04af3ae614987b17bd03d" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:31.150494 27140 raft_consensus.cc:2468] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:31.152355 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a920522f34d318c610b60571ca004" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:31.153458 27215 raft_consensus.cc:3060] T f28a920522f34d318c610b60571ca004 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.154618 27257 leader_election.cc:304] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:31.157183 27547 leader_election.cc:290] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:31.159880 27140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728a1fd5a8c84cb19f6691fc08e1eeef" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:31.159344 27489 raft_consensus.cc:2804] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:31.158763 27038 catalog_manager.cc:5697] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 0 to 1, leader changed from <none> to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:31.160596 27140 raft_consensus.cc:3060] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.164171 27411 tablet_bootstrap.cc:492] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:31.164822 27411 ts_tablet_manager.cc:1403] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.097s	user 0.018s	sys 0.010s
I20260709 13:21:31.168076 27489 raft_consensus.cc:493] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:31.168730 27489 raft_consensus.cc:3060] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.113158 27629 raft_consensus.cc:515] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.174270 27417 tablet_bootstrap.cc:654] T 6b8d513ca0a647d5a716650ed58360f6 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.167995 27411 raft_consensus.cc:359] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.175886 27411 raft_consensus.cc:385] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.176232 27411 raft_consensus.cc:740] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.177161 27413 tablet_bootstrap.cc:492] T 706ddcc20d574055ac044c0ff3d638a0 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:31.177047 27411 consensus_queue.cc:260] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.173905 27040 catalog_manager.cc:5697] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:31.180591 27214 raft_consensus.cc:2393] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d8e002e04a74c2598405158a99d86c1 in current term 1: Already voted for candidate 05f7e02ff65b470591cb5d9565f123d6 in this term.
I20260709 13:21:31.183763 27629 leader_election.cc:290] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:31.184572 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46295debdbf04af3ae614987b17bd03d" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:31.185329 27142 raft_consensus.cc:3060] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.178551 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28a920522f34d318c610b60571ca004" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:31.187842 27411 ts_tablet_manager.cc:1434] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
W20260709 13:21:31.189600 27332 leader_election.cc:343] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.190704 27411 tablet_bootstrap.cc:492] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:31.199851 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46295debdbf04af3ae614987b17bd03d" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:31.198971 27546 consensus_queue.cc:1048] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:21:31.216600 27559 raft_consensus.cc:493] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.217166 27559 raft_consensus.cc:515] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.218364 27414 tablet_bootstrap.cc:492] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:31.218964 27414 ts_tablet_manager.cc:1403] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.194s	user 0.013s	sys 0.001s
I20260709 13:21:31.200350 27142 raft_consensus.cc:2468] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:31.226217 27559 leader_election.cc:290] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:31.239252 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548f20dfb71a4917ae7ba2f706241ec1" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:31.241830 27414 raft_consensus.cc:359] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.242722 27414 raft_consensus.cc:385] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.242601 27489 raft_consensus.cc:515] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.242579 27183 leader_election.cc:304] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:31.244287 27290 raft_consensus.cc:2393] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 05f7e02ff65b470591cb5d9565f123d6 in current term 1: Already voted for candidate 2d8e002e04a74c2598405158a99d86c1 in this term.
I20260709 13:21:31.245533 27215 raft_consensus.cc:2468] T f28a920522f34d318c610b60571ca004 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
W20260709 13:21:31.246346 27109 leader_election.cc:343] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.243335 27414 raft_consensus.cc:740] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.247711 27414 consensus_queue.cc:260] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.251699 27414 ts_tablet_manager.cc:1434] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:21:31.253101 27489 leader_election.cc:290] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:31.256709 27629 raft_consensus.cc:2804] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:31.258368 27417 tablet_bootstrap.cc:492] T 6b8d513ca0a647d5a716650ed58360f6 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:31.258908 27417 ts_tablet_manager.cc:1403] T 6b8d513ca0a647d5a716650ed58360f6 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.225s	user 0.009s	sys 0.025s
I20260709 13:21:31.260015 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548f20dfb71a4917ae7ba2f706241ec1" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:31.261772 27417 raft_consensus.cc:359] T 6b8d513ca0a647d5a716650ed58360f6 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:31.262430 27417 raft_consensus.cc:385] T 6b8d513ca0a647d5a716650ed58360f6 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.262676 27417 raft_consensus.cc:740] T 6b8d513ca0a647d5a716650ed58360f6 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.264477 27413 tablet_bootstrap.cc:654] T 706ddcc20d574055ac044c0ff3d638a0 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.264849 27417 consensus_queue.cc:260] T 6b8d513ca0a647d5a716650ed58360f6 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:31.267884 27417 ts_tablet_manager.cc:1434] T 6b8d513ca0a647d5a716650ed58360f6 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:21:31.269917 27332 leader_election.cc:304] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:31.271070 27411 tablet_bootstrap.cc:654] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.284121 27414 tablet_bootstrap.cc:492] T f28a920522f34d318c610b60571ca004 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:31.280823 27547 raft_consensus.cc:2804] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:31.285732 27450 raft_consensus.cc:493] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.285962 27547 raft_consensus.cc:697] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
W20260709 13:21:31.280392 27088 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:31.286458 27450 raft_consensus.cc:515] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:31.287050 27547 consensus_queue.cc:237] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:31.291090 27450 leader_election.cc:290] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:31.297086 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af7a5fd35f9478ba7387eec2ab4d036" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:31.297120 27546 raft_consensus.cc:493] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.280874 27417 tablet_bootstrap.cc:492] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:31.299762 27546 raft_consensus.cc:515] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:31.301766 27450 raft_consensus.cc:493] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.302541 27450 raft_consensus.cc:515] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:31.305231 27450 leader_election.cc:290] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:31.303064 27546 leader_election.cc:290] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:31.306850 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46295debdbf04af3ae614987b17bd03d" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:31.310905 27142 raft_consensus.cc:2393] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d8e002e04a74c2598405158a99d86c1 in current term 1: Already voted for candidate 05f7e02ff65b470591cb5d9565f123d6 in this term.
I20260709 13:21:31.313094 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69c998c37474f57b3b6d7355f0cc235" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
W20260709 13:21:31.311607 27109 leader_election.cc:343] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.309446 27464 consensus_queue.cc:1048] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:31.318867 27417 tablet_bootstrap.cc:654] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.258781 27629 raft_consensus.cc:697] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
W20260709 13:21:31.331562 27109 leader_election.cc:343] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.333709 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69c998c37474f57b3b6d7355f0cc235" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:31.338383 27629 consensus_queue.cc:237] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.350302 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46295debdbf04af3ae614987b17bd03d" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:31.355439 27414 tablet_bootstrap.cc:654] T f28a920522f34d318c610b60571ca004 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.357431 27258 leader_election.cc:304] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:31.365500 27413 tablet_bootstrap.cc:492] T 706ddcc20d574055ac044c0ff3d638a0 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:31.366187 27413 ts_tablet_manager.cc:1403] T 706ddcc20d574055ac044c0ff3d638a0 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.192s	user 0.013s	sys 0.027s
I20260709 13:21:31.358585 27140 raft_consensus.cc:2468] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
W20260709 13:21:31.346755 27109 leader_election.cc:343] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.362718 27539 raft_consensus.cc:2749] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:31.389685 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706ddcc20d574055ac044c0ff3d638a0" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:31.391680 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af7a5fd35f9478ba7387eec2ab4d036" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:31.393182 27489 consensus_queue.cc:1048] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:31.395534 27363 raft_consensus.cc:3060] T 6b8d513ca0a647d5a716650ed58360f6 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.402988 27331 leader_election.cc:304] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:31.427995 27464 raft_consensus.cc:2804] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:31.428907 27464 raft_consensus.cc:697] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:31.371783 27109 leader_election.cc:304] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399
I20260709 13:21:31.434849 27450 raft_consensus.cc:2749] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:31.435034 27109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:38009, user_credentials={real_user=slave}} blocked reactor thread for 88337.5us
I20260709 13:21:31.438506 27411 tablet_bootstrap.cc:492] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:31.438954 27411 ts_tablet_manager.cc:1403] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.250s	user 0.042s	sys 0.034s
I20260709 13:21:31.441705 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706ddcc20d574055ac044c0ff3d638a0" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:31.449400 27586 consensus_queue.cc:1048] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:31.452184 27109 leader_election.cc:343] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:31.461648 27184 consensus_peers.cc:597] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 -> Peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Couldn't send request to peer 1962786a39404929920d966805e48399. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:31.462797 27464 consensus_queue.cc:237] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:31.465941 27417 tablet_bootstrap.cc:492] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:31.466557 27417 ts_tablet_manager.cc:1403] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.192s	user 0.040s	sys 0.028s
I20260709 13:21:31.466341 27411 raft_consensus.cc:359] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:31.467113 27411 raft_consensus.cc:385] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.467494 27411 raft_consensus.cc:740] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.469653 27645 raft_consensus.cc:493] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:31.469156 27258 leader_election.cc:343] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.470223 27645 raft_consensus.cc:515] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.463928 27040 catalog_manager.cc:5697] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:31.475427 27645 leader_election.cc:290] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:31.477226 27557 consensus_queue.cc:1048] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:31.452739 27109 leader_election.cc:304] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:31.482054 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09320cdf2a440f789313b20646079a6" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:31.482874 27214 raft_consensus.cc:2468] T f09320cdf2a440f789313b20646079a6 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:31.468184 27411 consensus_queue.cc:260] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:31.484542 27559 raft_consensus.cc:2749] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:31.484186 27417 raft_consensus.cc:359] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:31.485960 27417 raft_consensus.cc:385] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.487363 27411 ts_tablet_manager.cc:1434] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:21:31.486337 27417 raft_consensus.cc:740] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.492304 27411 tablet_bootstrap.cc:492] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
W20260709 13:21:31.480248 27109 leader_election.cc:343] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.496935 27038 catalog_manager.cc:5697] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:31.510878 27417 consensus_queue.cc:260] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:31.518769 27413 raft_consensus.cc:359] T 706ddcc20d574055ac044c0ff3d638a0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:31.519304 27413 raft_consensus.cc:385] T 706ddcc20d574055ac044c0ff3d638a0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.519601 27413 raft_consensus.cc:740] T 706ddcc20d574055ac044c0ff3d638a0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.521523 27413 consensus_queue.cc:260] T 706ddcc20d574055ac044c0ff3d638a0 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:31.509406 27109 leader_election.cc:304] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
W20260709 13:21:31.534953 27258 leader_election.cc:343] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.543749 27413 ts_tablet_manager.cc:1434] T 706ddcc20d574055ac044c0ff3d638a0 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.177s	user 0.006s	sys 0.002s
I20260709 13:21:31.544903 27413 tablet_bootstrap.cc:492] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:31.546540 27417 ts_tablet_manager.cc:1434] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.005s
I20260709 13:21:31.544332 27450 raft_consensus.cc:2749] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:31.550034 27417 tablet_bootstrap.cc:492] T b76838dbe1fd4a4eac1e7d5740cf668f P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:31.553050 27556 consensus_queue.cc:1048] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:21:31.562095 27413 tablet_bootstrap.cc:654] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:31.553499 27109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 73303us
I20260709 13:21:31.542934 27258 leader_election.cc:304] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399
I20260709 13:21:31.572564 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09320cdf2a440f789313b20646079a6" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:31.573287 27143 raft_consensus.cc:2468] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
W20260709 13:21:31.579000 27258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:38009, user_credentials={real_user=slave}} blocked reactor thread for 56610.3us
I20260709 13:21:31.583571 27258 leader_election.cc:304] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:31.585647 27411 tablet_bootstrap.cc:654] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.585546 27539 raft_consensus.cc:2804] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:31.586205 27539 raft_consensus.cc:493] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:31.586613 27539 raft_consensus.cc:3060] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.573241 27547 consensus_queue.cc:1048] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:21:31.586366 27489 consensus_queue.cc:1048] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:31.592726 27655 log.cc:927] Time spent T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:21:31.580411 27645 raft_consensus.cc:2749] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:31.614174 27417 tablet_bootstrap.cc:654] T b76838dbe1fd4a4eac1e7d5740cf668f P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.622144 27566 consensus_queue.cc:1048] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:31.628088 27040 catalog_manager.cc:5697] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:31.645337 27414 tablet_bootstrap.cc:492] T f28a920522f34d318c610b60571ca004 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:31.646235 27414 ts_tablet_manager.cc:1403] T f28a920522f34d318c610b60571ca004 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.394s	user 0.030s	sys 0.042s
I20260709 13:21:31.653920 27414 raft_consensus.cc:359] T f28a920522f34d318c610b60571ca004 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:31.654206 27539 raft_consensus.cc:515] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.654714 27414 raft_consensus.cc:385] T f28a920522f34d318c610b60571ca004 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.655117 27414 raft_consensus.cc:740] T f28a920522f34d318c610b60571ca004 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.655841 27414 consensus_queue.cc:260] T f28a920522f34d318c610b60571ca004 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:31.675220 27414 ts_tablet_manager.cc:1434] T f28a920522f34d318c610b60571ca004 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:21:31.676328 27414 tablet_bootstrap.cc:492] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:31.673542 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09320cdf2a440f789313b20646079a6" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:31.686131 27143 raft_consensus.cc:3060] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:31.696085 27109 consensus_peers.cc:597] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 -> Peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Couldn't send request to peer 1962786a39404929920d966805e48399. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:31.697512 27143 raft_consensus.cc:2468] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:31.701020 27413 tablet_bootstrap.cc:492] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:31.701459 27413 ts_tablet_manager.cc:1403] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.157s	user 0.022s	sys 0.015s
I20260709 13:21:31.702800 27257 leader_election.cc:304] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:31.699271 27539 leader_election.cc:290] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:31.703912 27645 raft_consensus.cc:2804] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:31.704569 27645 raft_consensus.cc:697] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Becoming Leader. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Running, Role: LEADER
I20260709 13:21:31.705458 27645 consensus_queue.cc:237] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.706091 27417 tablet_bootstrap.cc:492] T b76838dbe1fd4a4eac1e7d5740cf668f P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:31.706828 27417 ts_tablet_manager.cc:1403] T b76838dbe1fd4a4eac1e7d5740cf668f P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.160s	user 0.018s	sys 0.012s
I20260709 13:21:31.709462 27417 raft_consensus.cc:359] T b76838dbe1fd4a4eac1e7d5740cf668f P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:31.709648 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09320cdf2a440f789313b20646079a6" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:31.705905 27413 raft_consensus.cc:359] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:31.717203 27417 raft_consensus.cc:385] T b76838dbe1fd4a4eac1e7d5740cf668f P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.717653 27411 tablet_bootstrap.cc:492] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:31.717967 27214 raft_consensus.cc:3060] T f09320cdf2a440f789313b20646079a6 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.717743 27417 raft_consensus.cc:740] T b76838dbe1fd4a4eac1e7d5740cf668f P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.719151 27417 consensus_queue.cc:260] T b76838dbe1fd4a4eac1e7d5740cf668f P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:31.720100 27411 ts_tablet_manager.cc:1403] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.230s	user 0.012s	sys 0.016s
I20260709 13:21:31.717638 27413 raft_consensus.cc:385] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.724810 27413 raft_consensus.cc:740] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.725792 27413 consensus_queue.cc:260] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:31.729275 27417 ts_tablet_manager.cc:1434] T b76838dbe1fd4a4eac1e7d5740cf668f P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:21:31.730306 27417 tablet_bootstrap.cc:492] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:31.732228 27413 ts_tablet_manager.cc:1434] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:21:31.710450 27414 tablet_bootstrap.cc:654] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.741117 27464 consensus_queue.cc:1048] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:31.745582 27413 tablet_bootstrap.cc:492] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:31.738924 27547 raft_consensus.cc:493] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.750450 27547 raft_consensus.cc:515] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:31.739423 27214 raft_consensus.cc:2468] T f09320cdf2a440f789313b20646079a6 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:31.736032 27417 tablet_bootstrap.cc:654] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.726028 27411 raft_consensus.cc:359] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:31.753902 27547 leader_election.cc:290] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:31.756705 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706ddcc20d574055ac044c0ff3d638a0" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:31.756970 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706ddcc20d574055ac044c0ff3d638a0" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:31.757498 27290 raft_consensus.cc:2468] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:31.757596 27215 raft_consensus.cc:2468] T 706ddcc20d574055ac044c0ff3d638a0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:31.758776 27332 leader_election.cc:304] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:31.755369 27411 raft_consensus.cc:385] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.764536 27411 raft_consensus.cc:740] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.768155 27413 tablet_bootstrap.cc:654] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.765353 27411 consensus_queue.cc:260] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:31.787555 27478 consensus_queue.cc:1048] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:31.789687 27547 raft_consensus.cc:2804] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:31.790244 27547 raft_consensus.cc:493] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:31.790632 27547 raft_consensus.cc:3060] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.791148 27292 raft_consensus.cc:3060] T f28a920522f34d318c610b60571ca004 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.791548 27411 ts_tablet_manager.cc:1434] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.000s
I20260709 13:21:31.799467 27411 tablet_bootstrap.cc:492] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:31.808094 27411 tablet_bootstrap.cc:654] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.816392 27478 consensus_queue.cc:1048] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:21:31.822099 27417 tablet_bootstrap.cc:492] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:31.822631 27417 ts_tablet_manager.cc:1403] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.007s
I20260709 13:21:31.824340 27414 tablet_bootstrap.cc:492] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:31.825026 27414 ts_tablet_manager.cc:1403] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.149s	user 0.005s	sys 0.014s
I20260709 13:21:31.835310 27414 raft_consensus.cc:359] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:31.836086 27414 raft_consensus.cc:385] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.836369 27414 raft_consensus.cc:740] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.838454 27038 catalog_manager.cc:5697] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "2d8e002e04a74c2598405158a99d86c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:31.840656 27413 tablet_bootstrap.cc:492] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:31.841189 27413 ts_tablet_manager.cc:1403] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.096s	user 0.019s	sys 0.005s
I20260709 13:21:31.851950 27414 consensus_queue.cc:260] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:31.844494 27505 consensus_queue.cc:1048] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:21:31.869364 27414 ts_tablet_manager.cc:1434] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.002s
I20260709 13:21:31.870685 27414 tablet_bootstrap.cc:492] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:31.873875 27417 raft_consensus.cc:359] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:31.882082 27417 raft_consensus.cc:385] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.868000 27547 raft_consensus.cc:515] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:31.885325 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706ddcc20d574055ac044c0ff3d638a0" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:31.885934 27215 raft_consensus.cc:3060] T 706ddcc20d574055ac044c0ff3d638a0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.873642 27291 raft_consensus.cc:3060] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.882366 27417 raft_consensus.cc:740] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.877380 27413 raft_consensus.cc:359] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.894002 27413 raft_consensus.cc:385] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.894284 27413 raft_consensus.cc:740] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.900746 27413 consensus_queue.cc:260] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.900982 27417 consensus_queue.cc:260] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:31.906349 27413 ts_tablet_manager.cc:1434] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.004s
I20260709 13:21:31.907200 27413 tablet_bootstrap.cc:492] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:31.902135 27547 leader_election.cc:290] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:31.910703 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "706ddcc20d574055ac044c0ff3d638a0" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:31.911407 27289 raft_consensus.cc:3060] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.915684 27414 tablet_bootstrap.cc:654] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.916590 27411 tablet_bootstrap.cc:492] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:31.917115 27411 ts_tablet_manager.cc:1403] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.118s	user 0.016s	sys 0.011s
I20260709 13:21:31.920176 27411 raft_consensus.cc:359] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.923266 27411 raft_consensus.cc:385] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.923583 27411 raft_consensus.cc:740] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.923943 27586 raft_consensus.cc:493] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.924283 27411 consensus_queue.cc:260] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.925108 27630 raft_consensus.cc:493] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.924436 27586 raft_consensus.cc:515] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:31.927709 27411 ts_tablet_manager.cc:1434] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:21:31.928284 27417 ts_tablet_manager.cc:1434] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.105s	user 0.003s	sys 0.008s
I20260709 13:21:31.926326 27630 raft_consensus.cc:515] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.932614 27586 leader_election.cc:290] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:31.934577 27630 leader_election.cc:290] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:31.937882 27547 consensus_queue.cc:1048] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:31.938090 27413 tablet_bootstrap.cc:654] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.938189 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548f20dfb71a4917ae7ba2f706241ec1" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:31.939154 27142 raft_consensus.cc:2468] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:31.940142 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69c998c37474f57b3b6d7355f0cc235" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:31.940984 27183 leader_election.cc:304] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:31.944846 27288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548f20dfb71a4917ae7ba2f706241ec1" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:31.945710 27630 raft_consensus.cc:2804] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:31.938026 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69c998c37474f57b3b6d7355f0cc235" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
W20260709 13:21:31.942598 27184 leader_election.cc:343] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.938396 27566 raft_consensus.cc:493] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.932320 27417 tablet_bootstrap.cc:492] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:31.931160 27411 tablet_bootstrap.cc:492] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:31.953037 27143 raft_consensus.cc:2468] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:31.958292 27566 raft_consensus.cc:515] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:31.962292 27566 leader_election.cc:290] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
W20260709 13:21:31.966892 27184 leader_election.cc:343] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.968935 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a24e48beb74b37aa9434f9d9be4a22" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
W20260709 13:21:31.972456 27109 leader_election.cc:343] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.974105 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a24e48beb74b37aa9434f9d9be4a22" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:31.951045 27630 raft_consensus.cc:493] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:21:31.984463 27109 leader_election.cc:343] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.985179 27109 leader_election.cc:304] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:31.977771 27630 raft_consensus.cc:3060] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.997632 27413 tablet_bootstrap.cc:492] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:31.998370 27413 ts_tablet_manager.cc:1403] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.091s	user 0.021s	sys 0.022s
I20260709 13:21:31.999138 27183 leader_election.cc:304] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:32.000547 27586 raft_consensus.cc:2804] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:32.000928 27586 raft_consensus.cc:493] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:32.001398 27586 raft_consensus.cc:3060] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.002218 27413 raft_consensus.cc:359] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.003044 27413 raft_consensus.cc:385] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.003377 27413 raft_consensus.cc:740] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.004094 27413 consensus_queue.cc:260] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:31.990348 27566 raft_consensus.cc:2749] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:32.010552 27414 tablet_bootstrap.cc:492] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:32.011148 27414 ts_tablet_manager.cc:1403] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.141s	user 0.011s	sys 0.016s
I20260709 13:21:32.012223 27413 ts_tablet_manager.cc:1434] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:21:32.013759 27413 tablet_bootstrap.cc:492] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:32.014312 27414 raft_consensus.cc:359] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.015149 27414 raft_consensus.cc:385] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.015437 27414 raft_consensus.cc:740] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.016268 27414 consensus_queue.cc:260] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.018407 27586 raft_consensus.cc:515] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.022145 27363 raft_consensus.cc:3060] T b76838dbe1fd4a4eac1e7d5740cf668f P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.024104 27417 tablet_bootstrap.cc:654] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.026705 27413 tablet_bootstrap.cc:654] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.018868 27414 ts_tablet_manager.cc:1434] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:32.037467 27414 tablet_bootstrap.cc:492] T 976b5b49dae34fae8a725ff84ca47fe5 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:32.038024 27411 tablet_bootstrap.cc:654] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.999398 27289 raft_consensus.cc:2468] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:32.064790 27505 consensus_queue.cc:1048] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:32.072587 27215 raft_consensus.cc:2468] T 706ddcc20d574055ac044c0ff3d638a0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:32.076176 27332 leader_election.cc:304] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:32.077373 27505 raft_consensus.cc:2804] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:32.078656 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69c998c37474f57b3b6d7355f0cc235" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:32.079147 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69c998c37474f57b3b6d7355f0cc235" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:32.079366 27143 raft_consensus.cc:3060] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.079995 27413 tablet_bootstrap.cc:492] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:32.080668 27505 raft_consensus.cc:697] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:32.082823 27413 ts_tablet_manager.cc:1403] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.017s
W20260709 13:21:32.080672 27184 leader_election.cc:343] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.091998 27505 consensus_queue.cc:237] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.083786 27586 leader_election.cc:290] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:32.142472 27411 tablet_bootstrap.cc:492] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:32.143025 27411 ts_tablet_manager.cc:1403] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.212s	user 0.014s	sys 0.013s
I20260709 13:21:32.149551 27411 raft_consensus.cc:359] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.150519 27411 raft_consensus.cc:385] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.150785 27411 raft_consensus.cc:740] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.151420 27411 consensus_queue.cc:260] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.152091 27646 consensus_queue.cc:1048] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:32.158914 27143 raft_consensus.cc:2468] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:32.162762 27411 ts_tablet_manager.cc:1434] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:21:32.163900 27411 tablet_bootstrap.cc:492] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:32.153235 27630 raft_consensus.cc:515] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.174096 27630 leader_election.cc:290] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:32.161531 27183 leader_election.cc:304] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:32.177276 27411 tablet_bootstrap.cc:654] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.178731 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548f20dfb71a4917ae7ba2f706241ec1" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:32.179525 27142 raft_consensus.cc:3060] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.182348 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548f20dfb71a4917ae7ba2f706241ec1" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:32.183913 27556 raft_consensus.cc:493] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.184470 27556 raft_consensus.cc:515] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
W20260709 13:21:32.187106 27184 leader_election.cc:343] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.187711 27630 raft_consensus.cc:2804] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:32.188006 27038 catalog_manager.cc:5697] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:32.188802 27413 raft_consensus.cc:359] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.190609 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a2e2e4269146dd8e2bf720a1c890d8" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:32.189836 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a2e2e4269146dd8e2bf720a1c890d8" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:32.194998 27413 raft_consensus.cc:385] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.199470 27413 raft_consensus.cc:740] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.200758 27413 consensus_queue.cc:260] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.197688 27331 leader_election.cc:304] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:32.188624 27630 raft_consensus.cc:697] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:32.188483 27556 leader_election.cc:290] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:32.205993 27505 raft_consensus.cc:2749] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:32.190986 27414 tablet_bootstrap.cc:654] T 976b5b49dae34fae8a725ff84ca47fe5 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.204176 27646 consensus_queue.cc:1048] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:32.206499 27630 consensus_queue.cc:237] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.211519 27142 raft_consensus.cc:2468] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:32.216064 27183 leader_election.cc:304] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:32.217427 27586 raft_consensus.cc:2804] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:32.217927 27586 raft_consensus.cc:697] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:32.218788 27586 consensus_queue.cc:237] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.212373 27413 ts_tablet_manager.cc:1434] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.128s	user 0.008s	sys 0.000s
I20260709 13:21:32.224089 27413 tablet_bootstrap.cc:492] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:32.214798 27417 tablet_bootstrap.cc:492] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:32.227854 27417 ts_tablet_manager.cc:1403] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.296s	user 0.020s	sys 0.001s
I20260709 13:21:32.238806 27417 raft_consensus.cc:359] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.239895 27417 raft_consensus.cc:385] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.241029 27417 raft_consensus.cc:740] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.245178 27417 consensus_queue.cc:260] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.245806 27414 tablet_bootstrap.cc:492] T 976b5b49dae34fae8a725ff84ca47fe5 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:32.246423 27414 ts_tablet_manager.cc:1403] T 976b5b49dae34fae8a725ff84ca47fe5 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.209s	user 0.017s	sys 0.004s
I20260709 13:21:32.247207 27417 ts_tablet_manager.cc:1434] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 13:21:32.247851 27413 tablet_bootstrap.cc:654] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.250808 27411 tablet_bootstrap.cc:492] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:32.251327 27411 ts_tablet_manager.cc:1403] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.002s
I20260709 13:21:32.251642 27417 tablet_bootstrap.cc:492] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:32.258685 27417 tablet_bootstrap.cc:654] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.263175 27566 raft_consensus.cc:493] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.263800 27566 raft_consensus.cc:515] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.266144 27566 leader_election.cc:290] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:32.268730 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dc2c568d9642a587b5741241562afe" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:32.269479 27218 raft_consensus.cc:2468] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 0.
I20260709 13:21:32.273118 27109 leader_election.cc:304] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:32.274571 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dc2c568d9642a587b5741241562afe" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:32.275023 27496 raft_consensus.cc:2804] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:32.275508 27496 raft_consensus.cc:493] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:32.275843 27496 raft_consensus.cc:3060] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:32.276854 27109 leader_election.cc:343] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.252776 27038 catalog_manager.cc:5697] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:32.281828 27038 catalog_manager.cc:5697] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:32.287495 27586 raft_consensus.cc:493] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.288030 27586 raft_consensus.cc:515] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.285373 27414 raft_consensus.cc:359] T 976b5b49dae34fae8a725ff84ca47fe5 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.291139 27414 raft_consensus.cc:385] T 976b5b49dae34fae8a725ff84ca47fe5 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.291460 27414 raft_consensus.cc:740] T 976b5b49dae34fae8a725ff84ca47fe5 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.291841 27140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976b5b49dae34fae8a725ff84ca47fe5" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:32.292215 27414 consensus_queue.cc:260] T 976b5b49dae34fae8a725ff84ca47fe5 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.292603 27140 raft_consensus.cc:2468] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:32.294103 27183 leader_election.cc:304] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:32.294876 27414 ts_tablet_manager.cc:1434] T 976b5b49dae34fae8a725ff84ca47fe5 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:21:32.295039 27629 raft_consensus.cc:2804] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:32.295457 27629 raft_consensus.cc:493] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:32.295825 27629 raft_consensus.cc:3060] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.295888 27496 raft_consensus.cc:515] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.296312 27411 raft_consensus.cc:359] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.297158 27411 raft_consensus.cc:385] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.297466 27411 raft_consensus.cc:740] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.299033 27411 consensus_queue.cc:260] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.300998 27566 raft_consensus.cc:493] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.301163 27586 leader_election.cc:290] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:32.301625 27411 ts_tablet_manager.cc:1434] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.004s
I20260709 13:21:32.301558 27566 raft_consensus.cc:515] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.304669 27413 tablet_bootstrap.cc:492] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:32.305269 27413 ts_tablet_manager.cc:1403] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.006s
I20260709 13:21:32.306553 27566 leader_election.cc:290] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:32.306879 27629 raft_consensus.cc:515] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.308461 27496 leader_election.cc:290] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:32.308318 27413 raft_consensus.cc:359] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.309242 27413 raft_consensus.cc:385] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.308632 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474c28d9650438ca267ba04bf79b5eb" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:32.309532 27413 raft_consensus.cc:740] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.310207 27413 consensus_queue.cc:260] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
W20260709 13:21:32.311314 27109 leader_election.cc:343] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.312662 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dc2c568d9642a587b5741241562afe" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:32.313486 27629 leader_election.cc:290] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:32.314321 27414 tablet_bootstrap.cc:492] T 2af7a5fd35f9478ba7387eec2ab4d036 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:32.315425 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976b5b49dae34fae8a725ff84ca47fe5" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:32.316138 27292 raft_consensus.cc:2468] T 976b5b49dae34fae8a725ff84ca47fe5 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:32.320218 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474c28d9650438ca267ba04bf79b5eb" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:32.321349 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976b5b49dae34fae8a725ff84ca47fe5" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:32.321995 27292 raft_consensus.cc:3060] T 976b5b49dae34fae8a725ff84ca47fe5 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.324813 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dc2c568d9642a587b5741241562afe" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:32.325446 27218 raft_consensus.cc:3060] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.329964 27292 raft_consensus.cc:2468] T 976b5b49dae34fae8a725ff84ca47fe5 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:32.312318 27413 ts_tablet_manager.cc:1434] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:21:32.331202 27184 leader_election.cc:304] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:32.331465 27413 tablet_bootstrap.cc:492] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:32.333405 27417 tablet_bootstrap.cc:492] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:32.333303 27140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976b5b49dae34fae8a725ff84ca47fe5" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:32.334220 27140 raft_consensus.cc:3060] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.336447 27417 ts_tablet_manager.cc:1403] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.001s
I20260709 13:21:32.332785 27414 tablet_bootstrap.cc:654] T 2af7a5fd35f9478ba7387eec2ab4d036 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:32.341022 27109 leader_election.cc:343] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.341595 27109 leader_election.cc:304] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:32.344136 27411 tablet_bootstrap.cc:492] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
W20260709 13:21:32.344642 27109 leader_election.cc:343] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.346733 27566 raft_consensus.cc:2749] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:32.339169 27645 raft_consensus.cc:493] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.350428 27645 raft_consensus.cc:515] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.352219 27413 tablet_bootstrap.cc:654] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.352700 27645 leader_election.cc:290] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:32.354817 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab38e5621004b79ad7c4f961d7e29ae" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:32.355629 27215 raft_consensus.cc:2468] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:32.348219 27630 raft_consensus.cc:2804] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:32.357137 27630 raft_consensus.cc:697] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:32.357857 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab38e5621004b79ad7c4f961d7e29ae" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:32.358114 27630 consensus_queue.cc:237] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
W20260709 13:21:32.359511 27258 leader_election.cc:343] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.361014 27258 leader_election.cc:304] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:32.362067 27645 raft_consensus.cc:2804] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:32.362428 27645 raft_consensus.cc:493] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:32.362771 27645 raft_consensus.cc:3060] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.382486 27411 tablet_bootstrap.cc:654] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.388839 27417 raft_consensus.cc:359] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.389922 27417 raft_consensus.cc:385] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.390249 27417 raft_consensus.cc:740] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.391103 27417 consensus_queue.cc:260] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.399191 27413 tablet_bootstrap.cc:492] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:32.399811 27413 ts_tablet_manager.cc:1403] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.012s
I20260709 13:21:32.399955 27411 tablet_bootstrap.cc:492] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:32.400653 27411 ts_tablet_manager.cc:1403] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.008s
I20260709 13:21:32.401019 27645 raft_consensus.cc:515] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.410936 27140 raft_consensus.cc:2468] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:32.411602 27363 raft_consensus.cc:3060] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.416133 27413 raft_consensus.cc:359] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.417001 27413 raft_consensus.cc:385] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.417241 27413 raft_consensus.cc:740] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.417951 27413 consensus_queue.cc:260] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.418812 27417 ts_tablet_manager.cc:1434] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
I20260709 13:21:32.419911 27417 tablet_bootstrap.cc:492] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:32.425271 27413 ts_tablet_manager.cc:1434] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.007s
I20260709 13:21:32.426373 27413 tablet_bootstrap.cc:492] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:32.427059 27417 tablet_bootstrap.cc:654] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.428102 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab38e5621004b79ad7c4f961d7e29ae" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:32.428790 27214 raft_consensus.cc:3060] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.429492 27645 leader_election.cc:290] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:32.430546 27365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab38e5621004b79ad7c4f961d7e29ae" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
W20260709 13:21:32.434401 27088 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:21:32.434356 27258 leader_election.cc:343] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.436206 27630 raft_consensus.cc:493] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.439829 27630 raft_consensus.cc:515] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.440419 27413 tablet_bootstrap.cc:654] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.442587 27630 leader_election.cc:290] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:32.443882 27411 raft_consensus.cc:359] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.444495 27411 raft_consensus.cc:385] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.444811 27411 raft_consensus.cc:740] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.447983 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46bbc4b2c88745c699787c5df44ed464" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:32.460098 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46bbc4b2c88745c699787c5df44ed464" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
W20260709 13:21:32.461472 27184 leader_election.cc:343] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:32.465672 27184 leader_election.cc:343] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.466176 27184 leader_election.cc:304] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:32.469347 27478 raft_consensus.cc:2749] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:32.458853 27411 consensus_queue.cc:260] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.473546 27414 tablet_bootstrap.cc:492] T 2af7a5fd35f9478ba7387eec2ab4d036 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:32.474293 27414 ts_tablet_manager.cc:1403] T 2af7a5fd35f9478ba7387eec2ab4d036 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.160s	user 0.027s	sys 0.012s
I20260709 13:21:32.471810 27218 raft_consensus.cc:2468] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 1.
I20260709 13:21:32.474912 27417 tablet_bootstrap.cc:492] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:32.475440 27417 ts_tablet_manager.cc:1403] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.056s	user 0.030s	sys 0.019s
I20260709 13:21:32.481170 27214 raft_consensus.cc:2468] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:32.480288 27566 raft_consensus.cc:493] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.484107 27566 raft_consensus.cc:515] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.484480 27411 ts_tablet_manager.cc:1434] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.083s	user 0.002s	sys 0.008s
I20260709 13:21:32.486121 27411 tablet_bootstrap.cc:492] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:32.486280 27566 leader_election.cc:290] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:32.487211 27037 catalog_manager.cc:5697] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:32.488109 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeabd510d2384d3dab2df8fa001a3400" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:32.489065 27258 leader_election.cc:304] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:32.489925 27645 raft_consensus.cc:2804] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:32.490432 27645 raft_consensus.cc:697] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Becoming Leader. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Running, Role: LEADER
W20260709 13:21:32.490775 27109 leader_election.cc:343] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.491568 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeabd510d2384d3dab2df8fa001a3400" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:32.491291 27645 consensus_queue.cc:237] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.483557 27417 raft_consensus.cc:359] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.500767 27417 raft_consensus.cc:385] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:32.497692 27109 leader_election.cc:343] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.503757 27417 raft_consensus.cc:740] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.504001 27109 leader_election.cc:304] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:32.505085 27417 consensus_queue.cc:260] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.510300 27417 ts_tablet_manager.cc:1434] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.005s
I20260709 13:21:32.507644 27566 raft_consensus.cc:2749] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:32.506418 27109 leader_election.cc:304] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:32.515393 27411 tablet_bootstrap.cc:654] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.515748 27566 raft_consensus.cc:2804] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:32.516093 27417 tablet_bootstrap.cc:492] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:32.516340 27566 raft_consensus.cc:697] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:32.517310 27566 consensus_queue.cc:237] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.524638 27413 tablet_bootstrap.cc:492] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:32.525424 27413 ts_tablet_manager.cc:1403] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.003s
I20260709 13:21:32.502194 27414 raft_consensus.cc:359] T 2af7a5fd35f9478ba7387eec2ab4d036 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.526714 27505 raft_consensus.cc:493] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.527150 27414 raft_consensus.cc:385] T 2af7a5fd35f9478ba7387eec2ab4d036 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.527791 27414 raft_consensus.cc:740] T 2af7a5fd35f9478ba7387eec2ab4d036 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.527424 27505 raft_consensus.cc:515] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.529794 27505 leader_election.cc:290] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:32.528612 27414 consensus_queue.cc:260] T 2af7a5fd35f9478ba7387eec2ab4d036 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.530769 27417 tablet_bootstrap.cc:654] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.530699 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dc2c568d9642a587b5741241562afe" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:32.531092 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dc2c568d9642a587b5741241562afe" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:32.532003 27214 raft_consensus.cc:2393] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1962786a39404929920d966805e48399 in current term 1: Already voted for candidate f79efe7c9e6a4384b765393621da6816 in this term.
I20260709 13:21:32.532557 27414 ts_tablet_manager.cc:1434] T 2af7a5fd35f9478ba7387eec2ab4d036 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:21:32.533826 27332 leader_election.cc:304] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:32.535934 27505 raft_consensus.cc:3060] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.533913 27414 tablet_bootstrap.cc:492] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:32.547021 27413 raft_consensus.cc:359] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.549736 27037 catalog_manager.cc:5697] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 0 to 1, leader changed from <none> to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:32.566457 27414 tablet_bootstrap.cc:654] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.562296 27413 raft_consensus.cc:385] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.570060 27413 raft_consensus.cc:740] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.570840 27413 consensus_queue.cc:260] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.574834 27557 consensus_queue.cc:1048] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:32.576471 27505 raft_consensus.cc:2749] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:32.577308 27413 ts_tablet_manager.cc:1434] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.001s
I20260709 13:21:32.557943 27041 catalog_manager.cc:5697] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "2d8e002e04a74c2598405158a99d86c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:32.600386 27557 consensus_queue.cc:1048] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:32.612746 27413 tablet_bootstrap.cc:492] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
W20260709 13:21:32.618573 27184 consensus_peers.cc:597] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Couldn't send request to peer 1962786a39404929920d966805e48399. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:32.623178 27411 tablet_bootstrap.cc:492] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:32.623834 27411 ts_tablet_manager.cc:1403] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.138s	user 0.019s	sys 0.008s
I20260709 13:21:32.627699 27411 raft_consensus.cc:359] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.628393 27411 raft_consensus.cc:385] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.628741 27411 raft_consensus.cc:740] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.629652 27411 consensus_queue.cc:260] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.633772 27417 tablet_bootstrap.cc:492] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:32.635836 27417 ts_tablet_manager.cc:1403] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.125s	user 0.026s	sys 0.029s
I20260709 13:21:32.635919 27547 raft_consensus.cc:493] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.636492 27547 raft_consensus.cc:515] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.638574 27547 leader_election.cc:290] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:32.638916 27417 raft_consensus.cc:359] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.639863 27417 raft_consensus.cc:385] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.640125 27417 raft_consensus.cc:740] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.641023 27417 consensus_queue.cc:260] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.641908 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af7a5fd35f9478ba7387eec2ab4d036" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:32.642586 27292 raft_consensus.cc:2468] T 2af7a5fd35f9478ba7387eec2ab4d036 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:32.643414 27417 ts_tablet_manager.cc:1434] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:32.644115 27496 raft_consensus.cc:493] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.644196 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af7a5fd35f9478ba7387eec2ab4d036" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:32.644789 27496 raft_consensus.cc:515] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.654919 27496 leader_election.cc:290] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:32.644917 27143 raft_consensus.cc:2468] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:32.656558 27414 tablet_bootstrap.cc:492] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:32.657332 27414 ts_tablet_manager.cc:1403] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.004s
I20260709 13:21:32.657168 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45fa14105f64435ae8fd7b34c0dc72c" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:32.658447 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45fa14105f64435ae8fd7b34c0dc72c" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
W20260709 13:21:32.658911 27109 leader_election.cc:343] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:32.661259 27109 leader_election.cc:343] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.661674 27109 leader_election.cc:304] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:32.662211 27414 raft_consensus.cc:359] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.662914 27566 raft_consensus.cc:2749] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:32.645359 27332 leader_election.cc:304] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:32.649340 27411 ts_tablet_manager.cc:1434] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:21:32.667929 27411 tablet_bootstrap.cc:492] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:32.670167 27547 raft_consensus.cc:2804] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:32.670711 27547 raft_consensus.cc:493] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:32.671051 27547 raft_consensus.cc:3060] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.680271 27411 tablet_bootstrap.cc:654] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.662914 27414 raft_consensus.cc:385] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.644528 27417 tablet_bootstrap.cc:492] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:32.684089 27414 raft_consensus.cc:740] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.647545 27413 tablet_bootstrap.cc:654] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.685267 27414 consensus_queue.cc:260] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.692652 27414 ts_tablet_manager.cc:1434] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:21:32.692373 27547 raft_consensus.cc:515] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.693775 27414 tablet_bootstrap.cc:492] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:32.695760 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af7a5fd35f9478ba7387eec2ab4d036" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:32.696424 27143 raft_consensus.cc:3060] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.699784 27411 tablet_bootstrap.cc:492] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:32.700362 27411 ts_tablet_manager.cc:1403] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.006s
I20260709 13:21:32.708068 27411 raft_consensus.cc:359] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.708822 27411 raft_consensus.cc:385] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.709136 27411 raft_consensus.cc:740] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.709949 27411 consensus_queue.cc:260] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.712216 27411 ts_tablet_manager.cc:1434] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:21:32.707796 27414 tablet_bootstrap.cc:654] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.716004 27411 tablet_bootstrap.cc:492] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:32.721669 27478 consensus_queue.cc:1048] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:32.724617 27547 leader_election.cc:290] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:32.726557 27417 tablet_bootstrap.cc:654] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:32.727555 27184 consensus_peers.cc:597] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:32.731102 27411 tablet_bootstrap.cc:654] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.732756 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af7a5fd35f9478ba7387eec2ab4d036" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:32.733415 27291 raft_consensus.cc:3060] T 2af7a5fd35f9478ba7387eec2ab4d036 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.734786 27414 tablet_bootstrap.cc:492] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:32.735340 27414 ts_tablet_manager.cc:1403] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.000s
I20260709 13:21:32.736162 27478 consensus_queue.cc:1048] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:32.738088 27414 raft_consensus.cc:359] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.738967 27414 raft_consensus.cc:385] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.739296 27414 raft_consensus.cc:740] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.741236 27414 consensus_queue.cc:260] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.741672 27709 raft_consensus.cc:493] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.742192 27709 raft_consensus.cc:515] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.742807 27496 raft_consensus.cc:493] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.743914 27414 ts_tablet_manager.cc:1434] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:21:32.743551 27496 raft_consensus.cc:515] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.744306 27709 leader_election.cc:290] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:32.745159 27414 tablet_bootstrap.cc:492] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:32.747826 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93a08da579844d4b341d52ce65113ce" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:32.748803 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab38e5621004b79ad7c4f961d7e29ae" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
W20260709 13:21:32.749475 27109 leader_election.cc:343] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.749648 27218 raft_consensus.cc:2393] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1962786a39404929920d966805e48399 in current term 1: Already voted for candidate 2d8e002e04a74c2598405158a99d86c1 in this term.
I20260709 13:21:32.750168 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ab38e5621004b79ad7c4f961d7e29ae" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:32.751739 27496 leader_election.cc:290] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:32.752029 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93a08da579844d4b341d52ce65113ce" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
W20260709 13:21:32.753695 27109 leader_election.cc:343] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.753880 27332 leader_election.cc:304] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:32.754148 27109 leader_election.cc:304] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:32.755199 27496 raft_consensus.cc:2749] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:32.756856 27708 raft_consensus.cc:3060] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.757025 27411 tablet_bootstrap.cc:492] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:32.757663 27411 ts_tablet_manager.cc:1403] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.005s
I20260709 13:21:32.760314 27411 raft_consensus.cc:359] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.763705 27411 raft_consensus.cc:385] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.764045 27411 raft_consensus.cc:740] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.763105 27417 tablet_bootstrap.cc:492] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:32.765101 27411 consensus_queue.cc:260] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.765851 27417 ts_tablet_manager.cc:1403] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.122s	user 0.013s	sys 0.000s
I20260709 13:21:32.763361 27414 tablet_bootstrap.cc:654] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.779241 27417 raft_consensus.cc:359] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.780047 27417 raft_consensus.cc:385] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.780323 27417 raft_consensus.cc:740] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.780241 27291 raft_consensus.cc:2468] T 2af7a5fd35f9478ba7387eec2ab4d036 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:32.781807 27332 leader_election.cc:304] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:32.766827 27411 ts_tablet_manager.cc:1434] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:21:32.782671 27547 raft_consensus.cc:2804] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:32.783234 27411 tablet_bootstrap.cc:492] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:32.784099 27417 consensus_queue.cc:260] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.783365 27547 raft_consensus.cc:697] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:32.785748 27547 consensus_queue.cc:237] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.786535 27417 ts_tablet_manager.cc:1434] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:21:32.787830 27417 tablet_bootstrap.cc:492] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:32.729270 27143 raft_consensus.cc:2468] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:32.789386 27496 raft_consensus.cc:493] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.789876 27496 raft_consensus.cc:515] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.779276 27708 raft_consensus.cc:2749] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:32.791141 27411 tablet_bootstrap.cc:654] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.792723 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d205fe2cb9d4d319c85bb33f59ca660" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
W20260709 13:21:32.794402 27109 leader_election.cc:343] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.794989 27413 tablet_bootstrap.cc:492] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:32.795552 27413 ts_tablet_manager.cc:1403] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.216s	user 0.012s	sys 0.012s
I20260709 13:21:32.797586 27417 tablet_bootstrap.cc:654] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.798581 27413 raft_consensus.cc:359] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.799333 27413 raft_consensus.cc:385] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.799620 27413 raft_consensus.cc:740] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.800501 27413 consensus_queue.cc:260] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.801337 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d205fe2cb9d4d319c85bb33f59ca660" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:32.802233 27218 raft_consensus.cc:2468] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 0.
I20260709 13:21:32.804912 27109 leader_election.cc:304] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:32.805879 27566 raft_consensus.cc:2804] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:32.806138 27496 leader_election.cc:290] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:32.806315 27566 raft_consensus.cc:493] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:32.806762 27566 raft_consensus.cc:3060] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.809948 27505 raft_consensus.cc:493] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.810472 27505 raft_consensus.cc:515] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.812491 27505 leader_election.cc:290] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:32.809957 27413 ts_tablet_manager.cc:1434] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.001s
I20260709 13:21:32.814426 27630 consensus_queue.cc:1048] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:32.815269 27413 tablet_bootstrap.cc:492] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:32.816114 27566 raft_consensus.cc:515] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.819792 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69c998c37474f57b3b6d7355f0cc235" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:32.820909 27557 raft_consensus.cc:493] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.821436 27557 raft_consensus.cc:515] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.814363 27417 tablet_bootstrap.cc:492] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:32.825109 27557 leader_election.cc:290] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:32.825313 27417 ts_tablet_manager.cc:1403] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.000s
I20260709 13:21:32.825917 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69c998c37474f57b3b6d7355f0cc235" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:32.827661 27331 leader_election.cc:304] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:32.827857 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46bbc4b2c88745c699787c5df44ed464" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:32.830359 27417 raft_consensus.cc:359] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.830842 27708 raft_consensus.cc:2749] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:32.831139 27417 raft_consensus.cc:385] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.831578 27417 raft_consensus.cc:740] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.830060 27218 raft_consensus.cc:2468] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:32.834431 27417 consensus_queue.cc:260] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.836403 27332 leader_election.cc:304] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:32.836757 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46bbc4b2c88745c699787c5df44ed464" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:32.837211 27413 tablet_bootstrap.cc:654] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.837270 27708 raft_consensus.cc:2804] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:32.837875 27708 raft_consensus.cc:493] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:32.838240 27708 raft_consensus.cc:3060] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.839684 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d205fe2cb9d4d319c85bb33f59ca660" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
W20260709 13:21:32.846139 27109 leader_election.cc:343] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.854637 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d205fe2cb9d4d319c85bb33f59ca660" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:32.855786 27218 raft_consensus.cc:3060] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.853984 27413 tablet_bootstrap.cc:492] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:32.856470 27708 raft_consensus.cc:515] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.857221 27413 ts_tablet_manager.cc:1403] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.005s
I20260709 13:21:32.858709 27708 leader_election.cc:290] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:32.860235 27413 raft_consensus.cc:359] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.860976 27413 raft_consensus.cc:385] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.861313 27413 raft_consensus.cc:740] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.861361 27566 leader_election.cc:290] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:32.862563 27417 ts_tablet_manager.cc:1434] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:21:32.863606 27417 tablet_bootstrap.cc:492] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:32.863931 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46bbc4b2c88745c699787c5df44ed464" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:32.864719 27214 raft_consensus.cc:3060] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.865162 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46bbc4b2c88745c699787c5df44ed464" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
W20260709 13:21:32.867743 27332 leader_election.cc:343] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:32.879720 27332 leader_election.cc:343] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.868707 27478 raft_consensus.cc:493] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.867686 27413 consensus_queue.cc:260] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.890825 27478 raft_consensus.cc:515] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.892282 27413 ts_tablet_manager.cc:1434] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:21:32.884728 27038 catalog_manager.cc:5697] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:32.886431 27547 raft_consensus.cc:493] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.895226 27413 tablet_bootstrap.cc:492] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:32.895900 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474c28d9650438ca267ba04bf79b5eb" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:32.896606 27645 raft_consensus.cc:493] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.897086 27645 raft_consensus.cc:515] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.897686 27630 consensus_queue.cc:1048] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:32.900254 27645 leader_election.cc:290] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:32.905087 27413 tablet_bootstrap.cc:654] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.908932 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a24e48beb74b37aa9434f9d9be4a22" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:32.894373 27547 raft_consensus.cc:515] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.912866 27141 raft_consensus.cc:2468] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:32.914414 27183 leader_election.cc:304] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:32.915678 27630 raft_consensus.cc:2804] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:32.915980 27363 raft_consensus.cc:2468] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:32.916124 27630 raft_consensus.cc:493] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:32.916903 27630 raft_consensus.cc:3060] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.917071 27413 tablet_bootstrap.cc:492] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:32.918738 27413 ts_tablet_manager.cc:1403] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.001s
I20260709 13:21:32.919337 27258 leader_election.cc:304] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:32.920126 27489 raft_consensus.cc:2804] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:32.920650 27489 raft_consensus.cc:493] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:32.921082 27489 raft_consensus.cc:3060] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.923707 27547 leader_election.cc:290] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:32.925205 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a24e48beb74b37aa9434f9d9be4a22" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:32.926015 27629 raft_consensus.cc:493] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.926155 27142 raft_consensus.cc:2468] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:32.926594 27629 raft_consensus.cc:515] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:32.928877 27331 leader_election.cc:304] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:32.930624 27629 leader_election.cc:290] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:32.931738 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fade412cd974138979c417dd233c35a" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:32.932410 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fade412cd974138979c417dd233c35a" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:32.934844 27214 raft_consensus.cc:2468] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:32.937371 27478 leader_election.cc:290] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:32.889458 27417 tablet_bootstrap.cc:654] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:32.940461 27708 raft_consensus.cc:2804] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:32.950537 27708 raft_consensus.cc:493] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:32.951017 27708 raft_consensus.cc:3060] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.952952 27414 tablet_bootstrap.cc:492] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:32.953577 27414 ts_tablet_manager.cc:1403] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.209s	user 0.008s	sys 0.006s
W20260709 13:21:32.940651 27184 leader_election.cc:343] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:32.957065 27184 leader_election.cc:343] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.957685 27184 leader_election.cc:304] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
W20260709 13:21:32.941553 27109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 52184.7us
I20260709 13:21:32.960965 27724 raft_consensus.cc:493] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.961478 27724 raft_consensus.cc:515] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:32.923470 27413 raft_consensus.cc:359] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.962426 27413 raft_consensus.cc:385] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.962087 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a24e48beb74b37aa9434f9d9be4a22" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:32.962777 27413 raft_consensus.cc:740] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:32.963141 27142 raft_consensus.cc:2468] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:32.963617 27413 consensus_queue.cc:260] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:32.946118 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474c28d9650438ca267ba04bf79b5eb" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:32.965163 27721 raft_consensus.cc:493] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:32.965766 27721 raft_consensus.cc:515] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.967928 27721 leader_election.cc:290] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:32.965301 27586 raft_consensus.cc:2749] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:32.973852 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32e5371db8c4a95ab423532604c6f33" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
W20260709 13:21:32.974135 27184 leader_election.cc:343] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.973888 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68051b3f1c40c9bcface09069e68e0" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
W20260709 13:21:32.976353 27332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 96665.7us
I20260709 13:21:32.975557 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32e5371db8c4a95ab423532604c6f33" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:32.980356 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a24e48beb74b37aa9434f9d9be4a22" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
W20260709 13:21:32.981118 27109 leader_election.cc:343] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:32.981827 27109 leader_election.cc:343] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:32.983470 27708 raft_consensus.cc:515] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:32.963739 27724 leader_election.cc:290] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:32.993151 27496 consensus_queue.cc:1048] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:32.950609 27489 raft_consensus.cc:515] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:33.005702 27289 raft_consensus.cc:2393] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1962786a39404929920d966805e48399 in current term 1: Already voted for candidate 2d8e002e04a74c2598405158a99d86c1 in this term.
I20260709 13:21:33.006939 27413 ts_tablet_manager.cc:1434] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.008s
I20260709 13:21:33.010243 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a24e48beb74b37aa9434f9d9be4a22" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:33.010924 27708 leader_election.cc:290] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:33.011096 27143 raft_consensus.cc:3060] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.011137 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68051b3f1c40c9bcface09069e68e0" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
W20260709 13:21:33.012790 27109 leader_election.cc:343] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:33.013357 27109 leader_election.cc:304] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399
I20260709 13:21:33.017848 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a24e48beb74b37aa9434f9d9be4a22" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:33.018929 27366 raft_consensus.cc:2393] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d8e002e04a74c2598405158a99d86c1 in current term 1: Already voted for candidate 1962786a39404929920d966805e48399 in this term.
I20260709 13:21:33.020557 27496 raft_consensus.cc:2749] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:33.021844 27413 tablet_bootstrap.cc:492] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:33.024613 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a24e48beb74b37aa9434f9d9be4a22" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:33.026392 27257 leader_election.cc:304] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:33.027609 27496 consensus_queue.cc:1048] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:33.022744 27489 leader_election.cc:290] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:33.029533 27489 raft_consensus.cc:2749] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:33.030814 27332 leader_election.cc:304] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:33.034148 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a24e48beb74b37aa9434f9d9be4a22" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:33.035218 27289 raft_consensus.cc:2393] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1962786a39404929920d966805e48399 in current term 1: Already voted for candidate 2d8e002e04a74c2598405158a99d86c1 in this term.
I20260709 13:21:33.040448 27557 raft_consensus.cc:2804] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:33.041172 27557 raft_consensus.cc:697] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:33.042088 27557 consensus_queue.cc:237] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:33.051962 27630 raft_consensus.cc:515] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.055723 27630 leader_election.cc:290] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:33.056166 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474c28d9650438ca267ba04bf79b5eb" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:33.056711 27363 raft_consensus.cc:3060] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.059283 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474c28d9650438ca267ba04bf79b5eb" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:32.956300 27414 raft_consensus.cc:359] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
W20260709 13:21:33.061883 27184 leader_election.cc:343] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:33.071403 27417 tablet_bootstrap.cc:492] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:33.071830 27141 raft_consensus.cc:3060] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.072036 27417 ts_tablet_manager.cc:1403] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.209s	user 0.022s	sys 0.001s
I20260709 13:21:33.075196 27417 raft_consensus.cc:359] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:33.075903 27417 raft_consensus.cc:385] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:33.076169 27417 raft_consensus.cc:740] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.081092 27411 tablet_bootstrap.cc:492] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:33.081656 27411 ts_tablet_manager.cc:1403] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.299s	user 0.048s	sys 0.084s
I20260709 13:21:33.082862 27417 consensus_queue.cc:260] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:33.084323 27411 raft_consensus.cc:359] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:33.085059 27411 raft_consensus.cc:385] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:33.085469 27411 raft_consensus.cc:740] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.086130 27411 consensus_queue.cc:260] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:33.088224 27417 ts_tablet_manager.cc:1434] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:21:33.088249 27411 ts_tablet_manager.cc:1434] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:21:33.089476 27411 tablet_bootstrap.cc:492] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:33.092059 27417 tablet_bootstrap.cc:492] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:33.095176 27141 raft_consensus.cc:2468] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:33.095796 27411 tablet_bootstrap.cc:654] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:33.096923 27183 leader_election.cc:304] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:33.099596 27417 tablet_bootstrap.cc:654] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:33.061841 27414 raft_consensus.cc:385] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:33.104913 27414 raft_consensus.cc:740] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
W20260709 13:21:33.107290 27184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 45442.2us
I20260709 13:21:33.107932 27731 raft_consensus.cc:2804] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:33.108799 27731 raft_consensus.cc:697] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:33.106135 27143 raft_consensus.cc:2468] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:32.888206 27218 raft_consensus.cc:2468] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 1.
I20260709 13:21:33.120023 27414 consensus_queue.cc:260] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:33.121424 27292 raft_consensus.cc:2468] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 0.
I20260709 13:21:33.124251 27109 leader_election.cc:304] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:33.120236 27331 leader_election.cc:304] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:33.132221 27708 raft_consensus.cc:2804] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:33.132776 27708 raft_consensus.cc:697] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:33.132360 27729 consensus_queue.cc:1048] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:33.133702 27708 consensus_queue.cc:237] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:33.134873 27496 raft_consensus.cc:2804] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:33.135306 27496 raft_consensus.cc:493] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:33.135634 27496 raft_consensus.cc:3060] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.137183 27414 ts_tablet_manager.cc:1434] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.183s	user 0.006s	sys 0.000s
I20260709 13:21:33.137132 27038 catalog_manager.cc:5697] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:33.144948 27729 consensus_queue.cc:1048] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:33.149380 27729 raft_consensus.cc:493] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.149906 27729 raft_consensus.cc:515] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.152590 27729 leader_election.cc:290] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:33.153026 27496 raft_consensus.cc:515] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:33.154381 27722 raft_consensus.cc:493] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.154870 27722 raft_consensus.cc:515] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:33.157524 27722 leader_election.cc:290] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:33.159094 27496 leader_election.cc:290] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:33.161032 27414 tablet_bootstrap.cc:492] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:33.162125 27109 leader_election.cc:304] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:33.163475 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548f20dfb71a4917ae7ba2f706241ec1" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:33.175971 27505 raft_consensus.cc:493] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.179200 27505 raft_consensus.cc:515] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:33.186980 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992029a58c6b4e9fae2a4024cda34dcd" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:33.187403 27505 leader_election.cc:290] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:33.190256 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992029a58c6b4e9fae2a4024cda34dcd" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:33.170910 27496 raft_consensus.cc:2804] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:33.193123 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32e5371db8c4a95ab423532604c6f33" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:33.196446 27292 raft_consensus.cc:3060] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.198719 27496 raft_consensus.cc:697] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
W20260709 13:21:33.210840 27109 leader_election.cc:343] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:33.214334 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32e5371db8c4a95ab423532604c6f33" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:33.215551 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68051b3f1c40c9bcface09069e68e0" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:33.218146 27143 raft_consensus.cc:2468] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
W20260709 13:21:33.217195 27109 leader_election.cc:343] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:33.219997 27109 leader_election.cc:343] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:33.220538 27109 leader_election.cc:304] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399
I20260709 13:21:33.167888 27731 consensus_queue.cc:237] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.227274 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548f20dfb71a4917ae7ba2f706241ec1" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:33.235445 27414 tablet_bootstrap.cc:654] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:33.237404 27331 leader_election.cc:304] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:33.238543 27737 raft_consensus.cc:2804] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:33.238958 27737 raft_consensus.cc:493] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:33.239291 27737 raft_consensus.cc:3060] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.240790 27258 leader_election.cc:304] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:33.242233 27489 raft_consensus.cc:2749] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:33.225888 27721 raft_consensus.cc:2749] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:33.222662 27478 raft_consensus.cc:493] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.243388 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68051b3f1c40c9bcface09069e68e0" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:33.243907 27478 raft_consensus.cc:515] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.247920 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeabd510d2384d3dab2df8fa001a3400" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:33.250519 27292 raft_consensus.cc:2468] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 1.
W20260709 13:21:33.252544 27332 leader_election.cc:343] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:33.251557 27184 leader_election.cc:343] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:33.253541 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeabd510d2384d3dab2df8fa001a3400" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:33.254263 27142 raft_consensus.cc:2468] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:33.246116 27478 leader_election.cc:290] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:33.255533 27183 leader_election.cc:304] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:33.257241 27478 raft_consensus.cc:2804] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:33.259414 27109 leader_election.cc:304] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:33.260301 27721 raft_consensus.cc:2804] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:33.261233 27721 raft_consensus.cc:697] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:33.262084 27721 consensus_queue.cc:237] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:33.260253 27478 raft_consensus.cc:493] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:33.268369 27478 raft_consensus.cc:3060] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.273841 27413 tablet_bootstrap.cc:654] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:33.273957 27556 consensus_queue.cc:1048] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:33.300911 27292 raft_consensus.cc:3060] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.251776 27737 raft_consensus.cc:515] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:33.277052 27496 consensus_queue.cc:237] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:33.332731 27411 tablet_bootstrap.cc:492] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:33.333540 27411 ts_tablet_manager.cc:1403] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.244s	user 0.009s	sys 0.008s
I20260709 13:21:33.342060 27414 tablet_bootstrap.cc:492] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:33.342562 27414 ts_tablet_manager.cc:1403] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.182s	user 0.014s	sys 0.002s
I20260709 13:21:33.363343 27556 consensus_queue.cc:1048] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:33.365144 27417 tablet_bootstrap.cc:492] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:33.365881 27417 ts_tablet_manager.cc:1403] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.274s	user 0.011s	sys 0.006s
W20260709 13:21:33.373492 27743 log.cc:927] Time spent T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:21:33.379514 27039 catalog_manager.cc:5697] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:33.381350 27736 log.cc:927] Time spent T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6: Append to log took a long time: real 0.085s	user 0.000s	sys 0.004s
I20260709 13:21:33.391776 27737 leader_election.cc:290] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:33.392556 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68051b3f1c40c9bcface09069e68e0" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:33.408092 27142 raft_consensus.cc:3060] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.395011 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68051b3f1c40c9bcface09069e68e0" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:33.395052 27417 raft_consensus.cc:359] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:33.413271 27417 raft_consensus.cc:385] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:33.413573 27417 raft_consensus.cc:740] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.414243 27417 consensus_queue.cc:260] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:33.416347 27417 ts_tablet_manager.cc:1434] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.001s
I20260709 13:21:33.417287 27417 tablet_bootstrap.cc:492] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:33.417908 27142 raft_consensus.cc:2468] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:33.419644 27331 leader_election.cc:304] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:33.425089 27708 raft_consensus.cc:2804] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:33.395954 27411 raft_consensus.cc:359] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.398017 27414 raft_consensus.cc:359] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.427793 27411 raft_consensus.cc:385] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:33.427855 27414 raft_consensus.cc:385] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:33.428162 27411 raft_consensus.cc:740] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.383018 27037 catalog_manager.cc:5697] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:33.428221 27414 raft_consensus.cc:740] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.429230 27414 consensus_queue.cc:260] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.431591 27414 ts_tablet_manager.cc:1434] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.003s
I20260709 13:21:33.432585 27414 tablet_bootstrap.cc:492] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:33.434163 27417 tablet_bootstrap.cc:654] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:33.398821 27478 raft_consensus.cc:515] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.431254 27411 consensus_queue.cc:260] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
W20260709 13:21:33.437882 27332 leader_election.cc:343] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:33.439517 27708 raft_consensus.cc:697] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:33.449151 27413 tablet_bootstrap.cc:492] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:33.449831 27413 ts_tablet_manager.cc:1403] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.428s	user 0.011s	sys 0.007s
I20260709 13:21:33.452811 27413 raft_consensus.cc:359] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:33.453902 27413 raft_consensus.cc:385] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:33.454182 27413 raft_consensus.cc:740] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.454846 27413 consensus_queue.cc:260] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:33.457949 27411 ts_tablet_manager.cc:1434] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.124s	user 0.007s	sys 0.000s
I20260709 13:21:33.466768 27737 raft_consensus.cc:493] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.467340 27737 raft_consensus.cc:515] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:33.469431 27737 leader_election.cc:290] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:33.471688 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d205fe2cb9d4d319c85bb33f59ca660" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:33.473122 27215 raft_consensus.cc:2393] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1962786a39404929920d966805e48399 in current term 1: Already voted for candidate f79efe7c9e6a4384b765393621da6816 in this term.
I20260709 13:21:33.474241 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d205fe2cb9d4d319c85bb33f59ca660" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:33.478245 27331 leader_election.cc:304] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:33.480918 27414 tablet_bootstrap.cc:654] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:33.482699 27547 raft_consensus.cc:3060] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.483702 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeabd510d2384d3dab2df8fa001a3400" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:33.484352 27141 raft_consensus.cc:3060] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.491621 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeabd510d2384d3dab2df8fa001a3400" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:33.484333 27478 leader_election.cc:290] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
W20260709 13:21:33.496945 27184 leader_election.cc:343] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:33.499138 27413 ts_tablet_manager.cc:1434] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:21:33.500280 27413 tablet_bootstrap.cc:492] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:33.509388 27737 consensus_queue.cc:1048] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:33.529484 27547 raft_consensus.cc:2749] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:33.531862 27417 tablet_bootstrap.cc:492] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:33.532415 27417 ts_tablet_manager.cc:1403] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.115s	user 0.015s	sys 0.011s
I20260709 13:21:33.534235 27141 raft_consensus.cc:2468] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:33.535508 27183 leader_election.cc:304] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:33.536741 27478 raft_consensus.cc:2804] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:33.537282 27478 raft_consensus.cc:697] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:33.538149 27478 consensus_queue.cc:237] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.542564 27708 consensus_queue.cc:237] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:33.547798 27417 raft_consensus.cc:359] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:33.548722 27417 raft_consensus.cc:385] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:33.549044 27417 raft_consensus.cc:740] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.557468 27417 consensus_queue.cc:260] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:33.559409 27414 tablet_bootstrap.cc:492] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:33.560045 27414 ts_tablet_manager.cc:1403] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.128s	user 0.006s	sys 0.010s
I20260709 13:21:33.563508 27411 tablet_bootstrap.cc:492] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:33.564291 27413 tablet_bootstrap.cc:654] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:33.564558 27417 ts_tablet_manager.cc:1434] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:21:33.565783 27417 tablet_bootstrap.cc:492] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:33.563212 27414 raft_consensus.cc:359] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:33.582674 27414 raft_consensus.cc:385] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:33.583051 27414 raft_consensus.cc:740] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.583927 27414 consensus_queue.cc:260] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:33.587615 27414 ts_tablet_manager.cc:1434] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.006s
I20260709 13:21:33.588670 27414 tablet_bootstrap.cc:492] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
W20260709 13:21:33.589409 27332 consensus_peers.cc:597] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.595810 27417 tablet_bootstrap.cc:654] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:33.599261 27414 tablet_bootstrap.cc:654] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:33.599852 27039 catalog_manager.cc:5697] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:33.606678 27413 tablet_bootstrap.cc:492] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:33.607307 27413 ts_tablet_manager.cc:1403] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.000s
I20260709 13:21:33.610299 27413 raft_consensus.cc:359] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.610984 27413 raft_consensus.cc:385] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:33.611368 27413 raft_consensus.cc:740] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.613296 27413 consensus_queue.cc:260] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.621270 27413 ts_tablet_manager.cc:1434] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:21:33.622373 27413 tablet_bootstrap.cc:492] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:33.623286 27411 tablet_bootstrap.cc:654] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:33.625370 27478 raft_consensus.cc:493] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.626096 27708 raft_consensus.cc:493] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.625921 27478 raft_consensus.cc:515] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.594444 27038 catalog_manager.cc:5697] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 0 to 1, leader changed from <none> to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:33.626749 27708 raft_consensus.cc:515] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:33.629037 27417 tablet_bootstrap.cc:492] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:33.629261 27708 leader_election.cc:290] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:33.630167 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93a08da579844d4b341d52ce65113ce" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:33.631981 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93a08da579844d4b341d52ce65113ce" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:33.632756 27143 raft_consensus.cc:2468] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
W20260709 13:21:33.637115 27184 leader_election.cc:343] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:33.638069 27041 catalog_manager.cc:5697] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:33.638847 27183 leader_election.cc:304] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:33.640302 27731 raft_consensus.cc:2804] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:33.640730 27731 raft_consensus.cc:493] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:33.641155 27731 raft_consensus.cc:3060] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.641793 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fade412cd974138979c417dd233c35a" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:33.642534 27214 raft_consensus.cc:2468] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:33.643949 27332 leader_election.cc:304] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:33.644783 27708 raft_consensus.cc:2804] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:33.645223 27708 raft_consensus.cc:493] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:33.645597 27708 raft_consensus.cc:3060] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.646127 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fade412cd974138979c417dd233c35a" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:33.646736 27417 ts_tablet_manager.cc:1403] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.001s
I20260709 13:21:33.650595 27478 leader_election.cc:290] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
W20260709 13:21:33.658159 27332 leader_election.cc:343] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:33.659713 27751 consensus_queue.cc:1048] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:33.655710 27708 raft_consensus.cc:515] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:33.665303 27414 tablet_bootstrap.cc:492] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:33.665850 27414 ts_tablet_manager.cc:1403] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.018s
I20260709 13:21:33.668241 27547 consensus_queue.cc:1048] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:33.668807 27414 raft_consensus.cc:359] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:33.669556 27414 raft_consensus.cc:385] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:33.669818 27414 raft_consensus.cc:740] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.670998 27414 consensus_queue.cc:260] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:33.673467 27414 ts_tablet_manager.cc:1434] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:33.674703 27414 tablet_bootstrap.cc:492] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:33.675581 27708 leader_election.cc:290] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:33.678040 27730 consensus_queue.cc:1048] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:33.680338 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fade412cd974138979c417dd233c35a" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:33.681088 27214 raft_consensus.cc:3060] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.688205 27414 tablet_bootstrap.cc:654] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:33.699699 27038 catalog_manager.cc:5697] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 0 to 1, leader changed from <none> to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:33.702898 27731 raft_consensus.cc:515] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.706634 27140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93a08da579844d4b341d52ce65113ce" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:33.706796 27417 raft_consensus.cc:359] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:33.707680 27417 raft_consensus.cc:385] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:33.708052 27417 raft_consensus.cc:740] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.709564 27413 tablet_bootstrap.cc:654] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:33.713480 27417 consensus_queue.cc:260] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:33.707311 27140 raft_consensus.cc:3060] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.724499 27731 leader_election.cc:290] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:33.727425 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93a08da579844d4b341d52ce65113ce" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
W20260709 13:21:33.729182 27184 leader_election.cc:343] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:33.735574 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fade412cd974138979c417dd233c35a" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:33.729274 27645 raft_consensus.cc:493] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.736438 27645 raft_consensus.cc:515] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:33.739176 27645 leader_election.cc:290] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:33.741379 27291 raft_consensus.cc:3060] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.746218 27417 ts_tablet_manager.cc:1434] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.001s
I20260709 13:21:33.748716 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fade412cd974138979c417dd233c35a" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:33.751380 27417 tablet_bootstrap.cc:492] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:33.748077 27737 consensus_queue.cc:1048] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:21:33.753921 27366 raft_consensus.cc:2393] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d8e002e04a74c2598405158a99d86c1 in current term 1: Already voted for candidate 1962786a39404929920d966805e48399 in this term.
I20260709 13:21:33.754050 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fade412cd974138979c417dd233c35a" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:33.762393 27291 raft_consensus.cc:2468] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:33.774545 27258 leader_election.cc:304] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399
I20260709 13:21:33.778584 27411 tablet_bootstrap.cc:492] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:33.779325 27411 ts_tablet_manager.cc:1403] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.216s	user 0.015s	sys 0.020s
I20260709 13:21:33.785036 27366 raft_consensus.cc:3060] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.787490 27214 raft_consensus.cc:2468] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:33.777558 27729 raft_consensus.cc:2749] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:33.797438 27292 raft_consensus.cc:3060] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.800380 27414 tablet_bootstrap.cc:492] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:33.800915 27414 ts_tablet_manager.cc:1403] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.000s
I20260709 13:21:33.803696 27414 raft_consensus.cc:359] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.804386 27751 raft_consensus.cc:493] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.804934 27751 raft_consensus.cc:515] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.797652 27413 tablet_bootstrap.cc:492] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:33.806975 27413 ts_tablet_manager.cc:1403] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.185s	user 0.018s	sys 0.011s
I20260709 13:21:33.808348 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ab667936414e288be72021cfbcbc1b" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
W20260709 13:21:33.809787 27109 leader_election.cc:343] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:33.810108 27413 raft_consensus.cc:359] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:33.810515 27140 raft_consensus.cc:2468] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:33.804382 27414 raft_consensus.cc:385] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:33.810925 27413 raft_consensus.cc:385] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:33.807016 27751 leader_election.cc:290] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:33.811663 27413 raft_consensus.cc:740] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.791429 27332 leader_election.cc:304] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:33.819664 27737 raft_consensus.cc:2804] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:33.820633 27413 consensus_queue.cc:260] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:33.811419 27414 raft_consensus.cc:740] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.820240 27737 raft_consensus.cc:697] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:33.825413 27414 consensus_queue.cc:260] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.825995 27737 consensus_queue.cc:237] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:33.826583 27413 ts_tablet_manager.cc:1434] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.003s
I20260709 13:21:33.827042 27414 ts_tablet_manager.cc:1434] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.001s
I20260709 13:21:33.828032 27414 tablet_bootstrap.cc:492] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:33.828047 27413 tablet_bootstrap.cc:492] T be748b869d8b48dfa56a49c838cc4818 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:33.828174 27496 consensus_queue.cc:1048] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:33.831148 27088 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:33.819357 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ab667936414e288be72021cfbcbc1b" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
W20260709 13:21:33.836736 27109 leader_election.cc:343] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:33.837347 27109 leader_election.cc:304] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:33.839218 27751 raft_consensus.cc:2749] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:33.851118 27183 leader_election.cc:304] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:33.852087 27730 raft_consensus.cc:2804] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:33.852658 27730 raft_consensus.cc:697] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:33.853526 27730 consensus_queue.cc:237] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.849345 27417 tablet_bootstrap.cc:654] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:33.860693 27765 log.cc:927] Time spent T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:21:33.861078 27496 consensus_queue.cc:1048] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:33.863334 27731 raft_consensus.cc:493] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.868098 27411 raft_consensus.cc:359] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:33.869086 27411 raft_consensus.cc:385] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:33.869438 27411 raft_consensus.cc:740] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.870896 27411 consensus_queue.cc:260] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:33.867159 27708 raft_consensus.cc:493] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.884799 27708 raft_consensus.cc:515] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:33.889257 27478 consensus_queue.cc:1048] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:33.863890 27731 raft_consensus.cc:515] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:33.889210 27411 ts_tablet_manager.cc:1434] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.002s
I20260709 13:21:33.893733 27411 tablet_bootstrap.cc:492] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:33.902395 27731 leader_election.cc:290] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:33.903775 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32e5371db8c4a95ab423532604c6f33" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:33.905663 27489 raft_consensus.cc:493] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:33.906175 27489 raft_consensus.cc:515] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:33.908100 27489 leader_election.cc:290] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:33.910568 27414 tablet_bootstrap.cc:654] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:33.913122 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68051b3f1c40c9bcface09069e68e0" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:33.913877 27143 raft_consensus.cc:2393] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05f7e02ff65b470591cb5d9565f123d6 in current term 1: Already voted for candidate 1962786a39404929920d966805e48399 in this term.
I20260709 13:21:33.917975 27708 leader_election.cc:290] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:33.924826 27140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32e5371db8c4a95ab423532604c6f33" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:33.926255 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474c28d9650438ca267ba04bf79b5eb" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:33.927237 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba68051b3f1c40c9bcface09069e68e0" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:33.930613 27184 leader_election.cc:304] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6; no voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:33.930933 27038 catalog_manager.cc:5697] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:33.928206 27331 leader_election.cc:304] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:33.931869 27731 raft_consensus.cc:3060] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:33.953342 27413 tablet_bootstrap.cc:654] T be748b869d8b48dfa56a49c838cc4818 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:33.960090 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474c28d9650438ca267ba04bf79b5eb" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:33.965725 27722 consensus_queue.cc:1048] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:21:34.000015 27411 tablet_bootstrap.cc:654] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.003376 27731 raft_consensus.cc:2749] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:34.004926 27041 catalog_manager.cc:5697] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:34.007700 27258 leader_election.cc:304] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:34.028446 27708 raft_consensus.cc:2749] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.024497 27547 consensus_queue.cc:1048] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:21:34.056897 27768 raft_consensus.cc:493] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.057567 27768 raft_consensus.cc:515] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:34.059887 27768 leader_election.cc:290] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:34.062383 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeabd510d2384d3dab2df8fa001a3400" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:34.064600 27417 tablet_bootstrap.cc:492] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:34.064757 27140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeabd510d2384d3dab2df8fa001a3400" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:34.065207 27417 ts_tablet_manager.cc:1403] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.314s	user 0.017s	sys 0.009s
I20260709 13:21:34.065611 27140 raft_consensus.cc:2393] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d8e002e04a74c2598405158a99d86c1 in current term 1: Already voted for candidate 05f7e02ff65b470591cb5d9565f123d6 in this term.
I20260709 13:21:34.067716 27257 leader_election.cc:304] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:34.068346 27417 raft_consensus.cc:359] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.069167 27417 raft_consensus.cc:385] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.069476 27417 raft_consensus.cc:740] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.068696 27773 raft_consensus.cc:3060] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:34.079643 27730 consensus_queue.cc:1048] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:34.070250 27413 tablet_bootstrap.cc:492] T be748b869d8b48dfa56a49c838cc4818 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:34.082592 27413 ts_tablet_manager.cc:1403] T be748b869d8b48dfa56a49c838cc4818 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.255s	user 0.010s	sys 0.004s
I20260709 13:21:34.083210 27768 raft_consensus.cc:493] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.085338 27768 raft_consensus.cc:515] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:34.088335 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46bbc4b2c88745c699787c5df44ed464" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:34.089207 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46bbc4b2c88745c699787c5df44ed464" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:34.090421 27413 raft_consensus.cc:359] T be748b869d8b48dfa56a49c838cc4818 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:34.087745 27768 leader_election.cc:290] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:34.091411 27413 raft_consensus.cc:385] T be748b869d8b48dfa56a49c838cc4818 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.091763 27413 raft_consensus.cc:740] T be748b869d8b48dfa56a49c838cc4818 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.089612 27417 consensus_queue.cc:260] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.092476 27258 leader_election.cc:304] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399
I20260709 13:21:34.103307 27411 tablet_bootstrap.cc:492] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:34.104069 27411 ts_tablet_manager.cc:1403] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.212s	user 0.022s	sys 0.010s
I20260709 13:21:34.107280 27729 raft_consensus.cc:2749] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:34.107909 27411 raft_consensus.cc:359] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:34.109683 27411 raft_consensus.cc:385] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.110059 27411 raft_consensus.cc:740] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.100399 27773 raft_consensus.cc:2749] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:34.116580 27411 consensus_queue.cc:260] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:34.123529 27737 consensus_queue.cc:1048] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:34.123951 27417 ts_tablet_manager.cc:1434] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 13:21:34.120141 27730 consensus_queue.cc:1048] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:21:34.125537 27417 tablet_bootstrap.cc:492] T be748b869d8b48dfa56a49c838cc4818 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:34.130205 27414 tablet_bootstrap.cc:492] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:34.127542 27413 consensus_queue.cc:260] T be748b869d8b48dfa56a49c838cc4818 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:34.142868 27411 ts_tablet_manager.cc:1434] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.038s	user 0.012s	sys 0.000s
I20260709 13:21:34.144573 27411 tablet_bootstrap.cc:492] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:34.146471 27292 raft_consensus.cc:3060] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:34.149214 27414 ts_tablet_manager.cc:1403] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.321s	user 0.017s	sys 0.015s
I20260709 13:21:34.153752 27413 ts_tablet_manager.cc:1434] T be748b869d8b48dfa56a49c838cc4818 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 13:21:34.154575 27413 tablet_bootstrap.cc:492] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:34.150288 27489 raft_consensus.cc:2749] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.176867 27414 raft_consensus.cc:359] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:34.177608 27414 raft_consensus.cc:385] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.177892 27414 raft_consensus.cc:740] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.178579 27414 consensus_queue.cc:260] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:34.186565 27417 tablet_bootstrap.cc:654] T be748b869d8b48dfa56a49c838cc4818 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.189095 27496 raft_consensus.cc:493] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.189652 27496 raft_consensus.cc:515] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.193694 27411 tablet_bootstrap.cc:654] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.192688 27547 raft_consensus.cc:493] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.192260 27496 leader_election.cc:290] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:34.195358 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b37122e3aa24369b6edfe70347b97e9" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:34.180171 27414 ts_tablet_manager.cc:1434] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.000s
W20260709 13:21:34.197280 27109 leader_election.cc:343] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.195977 27547 raft_consensus.cc:515] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.198366 27414 tablet_bootstrap.cc:492] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:34.200019 27547 leader_election.cc:290] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:34.201316 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45fa14105f64435ae8fd7b34c0dc72c" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:34.203050 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45fa14105f64435ae8fd7b34c0dc72c" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:34.203608 27142 raft_consensus.cc:2468] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:34.206550 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b37122e3aa24369b6edfe70347b97e9" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
W20260709 13:21:34.208644 27109 leader_election.cc:343] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.209187 27109 leader_election.cc:304] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:34.210381 27751 raft_consensus.cc:2749] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:34.208580 27331 leader_election.cc:304] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:34.211520 27547 raft_consensus.cc:2804] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:34.211902 27547 raft_consensus.cc:493] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:34.212316 27547 raft_consensus.cc:3060] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:34.214506 27413 tablet_bootstrap.cc:654] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:34.216873 27332 leader_election.cc:343] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.219400 27414 tablet_bootstrap.cc:654] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.223922 27547 raft_consensus.cc:515] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.228966 27630 raft_consensus.cc:493] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.242221 27630 raft_consensus.cc:515] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:34.244043 27630 leader_election.cc:290] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:34.248749 27291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180999038c4a4fa7912fea59dfabd4d4" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
W20260709 13:21:34.255126 27184 leader_election.cc:343] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.256932 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180999038c4a4fa7912fea59dfabd4d4" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:34.259487 27411 tablet_bootstrap.cc:492] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
W20260709 13:21:34.259702 27184 leader_election.cc:343] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.260226 27184 leader_election.cc:304] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:34.261364 27730 raft_consensus.cc:2749] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:34.261623 27547 leader_election.cc:290] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:34.261893 27288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45fa14105f64435ae8fd7b34c0dc72c" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:34.260897 27411 ts_tablet_manager.cc:1403] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.000s
I20260709 13:21:34.263886 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45fa14105f64435ae8fd7b34c0dc72c" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:34.264441 27142 raft_consensus.cc:3060] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:34.265425 27411 raft_consensus.cc:359] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.266120 27411 raft_consensus.cc:385] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.266407 27411 raft_consensus.cc:740] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
W20260709 13:21:34.268947 27332 leader_election.cc:343] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.268779 27411 consensus_queue.cc:260] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.267969 27417 tablet_bootstrap.cc:492] T be748b869d8b48dfa56a49c838cc4818 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:34.270099 27417 ts_tablet_manager.cc:1403] T be748b869d8b48dfa56a49c838cc4818 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.145s	user 0.018s	sys 0.001s
I20260709 13:21:34.273236 27142 raft_consensus.cc:2468] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:34.274755 27331 leader_election.cc:304] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:34.275997 27737 raft_consensus.cc:2804] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:34.276473 27737 raft_consensus.cc:697] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:34.277326 27737 consensus_queue.cc:237] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.284039 27413 tablet_bootstrap.cc:492] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:34.284871 27413 ts_tablet_manager.cc:1403] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.130s	user 0.011s	sys 0.014s
I20260709 13:21:34.289389 27411 ts_tablet_manager.cc:1434] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 13:21:34.289404 27413 raft_consensus.cc:359] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:34.290800 27413 raft_consensus.cc:385] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.291235 27413 raft_consensus.cc:740] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.292375 27413 consensus_queue.cc:260] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:34.293388 27417 raft_consensus.cc:359] T be748b869d8b48dfa56a49c838cc4818 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:34.294183 27417 raft_consensus.cc:385] T be748b869d8b48dfa56a49c838cc4818 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.294502 27417 raft_consensus.cc:740] T be748b869d8b48dfa56a49c838cc4818 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.290567 27411 tablet_bootstrap.cc:492] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:34.300588 27417 consensus_queue.cc:260] T be748b869d8b48dfa56a49c838cc4818 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:34.305610 27413 ts_tablet_manager.cc:1434] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:21:34.307005 27751 raft_consensus.cc:493] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.307518 27751 raft_consensus.cc:515] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:34.309803 27413 tablet_bootstrap.cc:492] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:34.311486 27751 leader_election.cc:290] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:34.311861 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f72db119dad434b84f9712dc1930f7f" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:34.314086 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f72db119dad434b84f9712dc1930f7f" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
W20260709 13:21:34.316375 27109 leader_election.cc:343] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:34.317078 27109 leader_election.cc:343] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.317461 27109 leader_election.cc:304] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399
I20260709 13:21:34.318646 27751 raft_consensus.cc:2749] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:34.321923 27414 tablet_bootstrap.cc:492] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:34.322495 27414 ts_tablet_manager.cc:1403] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.125s	user 0.012s	sys 0.014s
I20260709 13:21:34.322216 27038 catalog_manager.cc:5697] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:34.325321 27411 tablet_bootstrap.cc:654] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.363643 27413 tablet_bootstrap.cc:654] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.325412 27414 raft_consensus.cc:359] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.364405 27417 ts_tablet_manager.cc:1434] T be748b869d8b48dfa56a49c838cc4818 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.094s	user 0.005s	sys 0.002s
I20260709 13:21:34.369324 27417 tablet_bootstrap.cc:492] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:34.370965 27489 raft_consensus.cc:493] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.371553 27489 raft_consensus.cc:515] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:34.373989 27489 leader_election.cc:290] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:34.374966 27556 consensus_queue.cc:1048] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:34.380241 27417 tablet_bootstrap.cc:654] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.364774 27414 raft_consensus.cc:385] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.381762 27414 raft_consensus.cc:740] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.382359 27708 consensus_queue.cc:1048] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:34.384788 27414 consensus_queue.cc:260] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.393982 27414 ts_tablet_manager.cc:1434] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 13:21:34.395395 27414 tablet_bootstrap.cc:492] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:34.396597 27478 consensus_queue.cc:1048] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:34.398819 27413 tablet_bootstrap.cc:492] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:34.399483 27413 ts_tablet_manager.cc:1403] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.004s
I20260709 13:21:34.402822 27414 tablet_bootstrap.cc:654] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.402841 27413 raft_consensus.cc:359] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:34.403867 27413 raft_consensus.cc:385] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.404229 27413 raft_consensus.cc:740] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
W20260709 13:21:34.409781 27258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:40225, user_credentials={real_user=slave}} blocked reactor thread for 50112.6us
I20260709 13:21:34.412669 27413 consensus_queue.cc:260] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:34.416931 27413 ts_tablet_manager.cc:1434] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:21:34.419031 27214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be748b869d8b48dfa56a49c838cc4818" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:34.420106 27214 raft_consensus.cc:2468] T be748b869d8b48dfa56a49c838cc4818 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:34.421607 27751 raft_consensus.cc:493] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.422178 27411 tablet_bootstrap.cc:492] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:34.422312 27751 raft_consensus.cc:515] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.423005 27411 ts_tablet_manager.cc:1403] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.133s	user 0.021s	sys 0.055s
I20260709 13:21:34.426663 27751 leader_election.cc:290] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:34.430968 27288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178fe9f66bbf440780bf6f265626a054" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:34.428344 27411 raft_consensus.cc:359] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:34.432467 27411 raft_consensus.cc:385] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.432818 27411 raft_consensus.cc:740] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.433503 27411 consensus_queue.cc:260] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:34.433578 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be748b869d8b48dfa56a49c838cc4818" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:34.434427 27366 raft_consensus.cc:2468] T be748b869d8b48dfa56a49c838cc4818 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 0.
I20260709 13:21:34.435130 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178fe9f66bbf440780bf6f265626a054" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
W20260709 13:21:34.436995 27109 leader_election.cc:343] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.437142 27414 tablet_bootstrap.cc:492] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:34.438009 27414 ts_tablet_manager.cc:1403] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.000s
I20260709 13:21:34.438357 27411 ts_tablet_manager.cc:1434] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:21:34.439354 27411 tablet_bootstrap.cc:492] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:34.441088 27414 raft_consensus.cc:359] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.442215 27414 raft_consensus.cc:385] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:21:34.443358 27109 leader_election.cc:343] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.443873 27109 leader_election.cc:304] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
W20260709 13:21:34.443893 27184 consensus_peers.cc:597] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:34.450006 27566 raft_consensus.cc:2749] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:34.450877 27411 tablet_bootstrap.cc:654] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.442498 27414 raft_consensus.cc:740] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.455026 27414 consensus_queue.cc:260] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.460417 27258 leader_election.cc:304] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:34.419364 27413 tablet_bootstrap.cc:492] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:34.462217 27414 ts_tablet_manager.cc:1434] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:21:34.470115 27414 tablet_bootstrap.cc:492] T f3ab667936414e288be72021cfbcbc1b P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:34.484035 27768 raft_consensus.cc:2804] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:34.484632 27768 raft_consensus.cc:493] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:34.485018 27768 raft_consensus.cc:3060] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:34.485859 27414 tablet_bootstrap.cc:654] T f3ab667936414e288be72021cfbcbc1b P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.505250 27414 tablet_bootstrap.cc:492] T f3ab667936414e288be72021cfbcbc1b P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:34.505978 27414 ts_tablet_manager.cc:1403] T f3ab667936414e288be72021cfbcbc1b P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.008s
I20260709 13:21:34.513329 27630 raft_consensus.cc:493] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.513919 27630 raft_consensus.cc:515] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:34.515946 27630 leader_election.cc:290] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:34.518455 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ab667936414e288be72021cfbcbc1b" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:34.509291 27414 raft_consensus.cc:359] T f3ab667936414e288be72021cfbcbc1b P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:34.519125 27141 raft_consensus.cc:2468] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:34.520768 27414 raft_consensus.cc:385] T f3ab667936414e288be72021cfbcbc1b P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.520804 27183 leader_election.cc:304] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:34.521296 27414 raft_consensus.cc:740] T f3ab667936414e288be72021cfbcbc1b P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.521795 27287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ab667936414e288be72021cfbcbc1b" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:34.521801 27630 raft_consensus.cc:2804] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:34.495898 27768 raft_consensus.cc:515] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:34.522799 27630 raft_consensus.cc:493] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:34.523310 27411 tablet_bootstrap.cc:492] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:34.523315 27630 raft_consensus.cc:3060] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:34.523989 27411 ts_tablet_manager.cc:1403] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.085s	user 0.032s	sys 0.030s
I20260709 13:21:34.519387 27413 tablet_bootstrap.cc:654] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.522200 27414 consensus_queue.cc:260] T f3ab667936414e288be72021cfbcbc1b P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:34.526973 27417 tablet_bootstrap.cc:492] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:34.531272 27417 ts_tablet_manager.cc:1403] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.162s	user 0.006s	sys 0.009s
I20260709 13:21:34.531710 27414 ts_tablet_manager.cc:1434] T f3ab667936414e288be72021cfbcbc1b P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:21:34.533620 27414 tablet_bootstrap.cc:492] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:34.528088 27411 raft_consensus.cc:359] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:34.534096 27411 raft_consensus.cc:385] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.534463 27411 raft_consensus.cc:740] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.534220 27630 raft_consensus.cc:515] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:34.535400 27411 consensus_queue.cc:260] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:34.537269 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ab667936414e288be72021cfbcbc1b" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:34.537827 27141 raft_consensus.cc:3060] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:34.530476 27287 raft_consensus.cc:2468] T f3ab667936414e288be72021cfbcbc1b P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:34.540467 27417 raft_consensus.cc:359] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.541304 27417 raft_consensus.cc:385] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.541602 27417 raft_consensus.cc:740] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.542390 27417 consensus_queue.cc:260] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.544169 27417 ts_tablet_manager.cc:1434] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.003s
I20260709 13:21:34.548578 27141 raft_consensus.cc:2468] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:34.528867 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be748b869d8b48dfa56a49c838cc4818" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:34.549747 27218 raft_consensus.cc:3060] T be748b869d8b48dfa56a49c838cc4818 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:34.549901 27183 leader_election.cc:304] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:34.550653 27731 raft_consensus.cc:2804] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:34.550882 27768 leader_election.cc:290] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:34.551144 27731 raft_consensus.cc:697] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:34.551415 27630 leader_election.cc:290] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:34.552150 27731 consensus_queue.cc:237] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:34.537781 27411 ts_tablet_manager.cc:1434] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:21:34.554069 27411 tablet_bootstrap.cc:492] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:34.555863 27287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ab667936414e288be72021cfbcbc1b" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:34.565301 27411 tablet_bootstrap.cc:654] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.565834 27414 tablet_bootstrap.cc:654] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.565321 27287 raft_consensus.cc:3060] T f3ab667936414e288be72021cfbcbc1b P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:34.578172 27417 tablet_bootstrap.cc:492] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:34.588201 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be748b869d8b48dfa56a49c838cc4818" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:34.589605 27366 raft_consensus.cc:3060] T be748b869d8b48dfa56a49c838cc4818 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:34.596179 27366 raft_consensus.cc:2468] T be748b869d8b48dfa56a49c838cc4818 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:34.597452 27258 leader_election.cc:304] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:34.598320 27773 raft_consensus.cc:2804] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:34.598781 27773 raft_consensus.cc:697] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Becoming Leader. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Running, Role: LEADER
I20260709 13:21:34.599547 27773 consensus_queue.cc:237] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:34.597379 27287 raft_consensus.cc:2468] T f3ab667936414e288be72021cfbcbc1b P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:34.623869 27417 tablet_bootstrap.cc:654] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.643390 27413 tablet_bootstrap.cc:492] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:34.644091 27413 ts_tablet_manager.cc:1403] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.225s	user 0.016s	sys 0.004s
I20260709 13:21:34.653784 27411 tablet_bootstrap.cc:492] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816: No bootstrap required, opened a new log
I20260709 13:21:34.661232 27547 raft_consensus.cc:493] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.661450 27411 ts_tablet_manager.cc:1403] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.108s	user 0.038s	sys 0.043s
I20260709 13:21:34.661736 27547 raft_consensus.cc:515] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.664053 27547 leader_election.cc:290] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:34.665539 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b37122e3aa24369b6edfe70347b97e9" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:34.666222 27289 raft_consensus.cc:2468] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:34.666574 27417 tablet_bootstrap.cc:492] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:34.666926 27414 tablet_bootstrap.cc:492] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:34.666630 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b37122e3aa24369b6edfe70347b97e9" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:34.667536 27414 ts_tablet_manager.cc:1403] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.134s	user 0.029s	sys 0.050s
I20260709 13:21:34.667881 27141 raft_consensus.cc:2468] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:34.667704 27332 leader_election.cc:304] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:34.669240 27547 raft_consensus.cc:2804] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:34.670553 27547 raft_consensus.cc:493] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:34.670521 27411 raft_consensus.cc:359] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.671293 27547 raft_consensus.cc:3060] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:34.671607 27411 raft_consensus.cc:385] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.671317 27414 raft_consensus.cc:359] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:34.672173 27411 raft_consensus.cc:740] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.672277 27414 raft_consensus.cc:385] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.672748 27414 raft_consensus.cc:740] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.673130 27411 consensus_queue.cc:260] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.675783 27411 ts_tablet_manager.cc:1434] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:21:34.673532 27414 consensus_queue.cc:260] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:34.676250 27417 ts_tablet_manager.cc:1403] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.106s	user 0.016s	sys 0.002s
I20260709 13:21:34.679036 27413 raft_consensus.cc:359] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:34.679512 27414 ts_tablet_manager.cc:1434] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.001s
I20260709 13:21:34.679863 27413 raft_consensus.cc:385] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.680176 27413 raft_consensus.cc:740] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.680718 27414 tablet_bootstrap.cc:492] T 180999038c4a4fa7912fea59dfabd4d4 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:34.681033 27413 consensus_queue.cc:260] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:34.683483 27413 ts_tablet_manager.cc:1434] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 13:21:34.683529 27417 raft_consensus.cc:359] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:34.683918 27547 raft_consensus.cc:515] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.684670 27413 tablet_bootstrap.cc:492] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:34.687965 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b37122e3aa24369b6edfe70347b97e9" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:34.688120 27218 raft_consensus.cc:2468] T be748b869d8b48dfa56a49c838cc4818 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:34.688551 27414 tablet_bootstrap.cc:654] T 180999038c4a4fa7912fea59dfabd4d4 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.688572 27289 raft_consensus.cc:3060] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:34.685174 27417 raft_consensus.cc:385] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:34.692683 27417 raft_consensus.cc:740] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.693421 27417 consensus_queue.cc:260] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:34.695516 27417 ts_tablet_manager.cc:1434] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:21:34.696448 27417 tablet_bootstrap.cc:492] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:34.697233 27289 raft_consensus.cc:2468] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:34.698433 27332 leader_election.cc:304] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:34.699347 27708 raft_consensus.cc:2804] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:34.699892 27708 raft_consensus.cc:697] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:34.701089 27547 leader_election.cc:290] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:34.702633 27413 tablet_bootstrap.cc:654] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.704703 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b37122e3aa24369b6edfe70347b97e9" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:34.705276 27141 raft_consensus.cc:3060] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:34.706861 27417 tablet_bootstrap.cc:654] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:34.714041 27773 raft_consensus.cc:493] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.714699 27773 raft_consensus.cc:515] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.720602 27037 catalog_manager.cc:5697] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "2d8e002e04a74c2598405158a99d86c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:34.700731 27708 consensus_queue.cc:237] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.723009 27041 catalog_manager.cc:5697] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:34.732815 27773 leader_election.cc:290] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:34.733563 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45fa14105f64435ae8fd7b34c0dc72c" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:34.734874 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45fa14105f64435ae8fd7b34c0dc72c" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:34.735831 27142 raft_consensus.cc:2393] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d8e002e04a74c2598405158a99d86c1 in current term 1: Already voted for candidate 1962786a39404929920d966805e48399 in this term.
I20260709 13:21:34.739976 27722 raft_consensus.cc:493] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.740703 27257 leader_election.cc:304] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:34.740590 27722 raft_consensus.cc:515] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:34.743022 27722 leader_election.cc:290] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:34.744302 27768 raft_consensus.cc:3060] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:34.744457 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6df6aa2911c94954949e3b8283d1d2e1" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
W20260709 13:21:34.749018 27109 leader_election.cc:343] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.751143 27586 raft_consensus.cc:493] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.751753 27586 raft_consensus.cc:515] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:34.750912 27556 consensus_queue.cc:1048] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:34.757764 27586 leader_election.cc:290] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:34.751761 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6df6aa2911c94954949e3b8283d1d2e1" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:34.758512 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f72db119dad434b84f9712dc1930f7f" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
W20260709 13:21:34.759861 27184 leader_election.cc:343] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.791329 27722 raft_consensus.cc:493] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.792166 27722 raft_consensus.cc:515] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:34.795187 27722 leader_election.cc:290] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:34.798955 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8115282f2b1544e6a930473c43950bc4" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
W20260709 13:21:34.808904 27109 leader_election.cc:343] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.811681 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8115282f2b1544e6a930473c43950bc4" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:34.826244 27722 raft_consensus.cc:493] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:34.826912 27722 raft_consensus.cc:515] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:34.829070 27722 leader_election.cc:290] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:34.836081 27768 raft_consensus.cc:2749] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:34.850507 27140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f72db119dad434b84f9712dc1930f7f" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:34.851385 27140 raft_consensus.cc:2468] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:34.853981 27556 consensus_queue.cc:1048] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:34.867086 27109 leader_election.cc:343] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.867653 27109 leader_election.cc:304] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399
I20260709 13:21:34.868597 27751 raft_consensus.cc:2749] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:34.881843 27088 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:34.884125 27183 leader_election.cc:304] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
W20260709 13:21:34.954190 27184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 66271.7us
W20260709 13:21:34.953644 27183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:35935, user_credentials={real_user=slave}} blocked reactor thread for 67030.9us
I20260709 13:21:34.977492 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a377a6c91543278d51ac9a9db49050" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
W20260709 13:21:34.949060 27109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:38009, user_credentials={real_user=slave}} blocked reactor thread for 81997.7us
W20260709 13:21:34.979857 27109 leader_election.cc:343] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.980463 27109 leader_election.cc:304] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:34.981583 27751 raft_consensus.cc:2749] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:34.915160 27141 raft_consensus.cc:2468] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:34.918017 27287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a377a6c91543278d51ac9a9db49050" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:34.953267 27586 raft_consensus.cc:2804] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:34.988238 27586 raft_consensus.cc:493] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:34.988744 27586 raft_consensus.cc:3060] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:34.998770 27586 raft_consensus.cc:515] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:35.007912 27586 leader_election.cc:290] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:35.009905 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f72db119dad434b84f9712dc1930f7f" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
W20260709 13:21:35.011698 27184 leader_election.cc:343] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:35.015050 27287 raft_consensus.cc:3060] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:35.020444 27109 leader_election.cc:343] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:35.037420 27039 catalog_manager.cc:5697] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.057821 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f72db119dad434b84f9712dc1930f7f" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:35.058574 27142 raft_consensus.cc:3060] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:35.063494 27731 consensus_queue.cc:1048] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:35.066516 27109 leader_election.cc:343] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:35.067487 27109 leader_election.cc:304] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f79efe7c9e6a4384b765393621da6816; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:35.068424 27566 raft_consensus.cc:2749] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:35.084851 27413 tablet_bootstrap.cc:492] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:35.084786 27729 consensus_queue.cc:1048] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:35.085433 27413 ts_tablet_manager.cc:1403] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.401s	user 0.083s	sys 0.096s
I20260709 13:21:35.088198 27413 raft_consensus.cc:359] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:35.088869 27413 raft_consensus.cc:385] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:35.089129 27413 raft_consensus.cc:740] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.089864 27413 consensus_queue.cc:260] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:35.092310 27413 ts_tablet_manager.cc:1434] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:35.093322 27413 tablet_bootstrap.cc:492] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:35.101374 27413 tablet_bootstrap.cc:654] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:35.111336 27417 tablet_bootstrap.cc:492] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:35.112107 27417 ts_tablet_manager.cc:1403] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.416s	user 0.076s	sys 0.104s
I20260709 13:21:35.114295 27547 raft_consensus.cc:493] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:35.114814 27547 raft_consensus.cc:515] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:35.117367 27417 raft_consensus.cc:359] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:35.118587 27417 raft_consensus.cc:385] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:35.119032 27417 raft_consensus.cc:740] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.120325 27417 consensus_queue.cc:260] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:35.123135 27417 ts_tablet_manager.cc:1434] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:21:35.123335 27547 leader_election.cc:290] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:35.119326 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992029a58c6b4e9fae2a4024cda34dcd" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:35.127743 27141 raft_consensus.cc:2468] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:35.129294 27331 leader_election.cc:304] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:35.130445 27737 raft_consensus.cc:2804] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:35.130815 27737 raft_consensus.cc:493] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:35.131132 27737 raft_consensus.cc:3060] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:35.141713 27142 raft_consensus.cc:2468] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:35.143164 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992029a58c6b4e9fae2a4024cda34dcd" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:35.144068 27218 raft_consensus.cc:2468] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:35.146659 27413 tablet_bootstrap.cc:492] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:35.147176 27413 ts_tablet_manager.cc:1403] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.005s
I20260709 13:21:35.150146 27737 raft_consensus.cc:515] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:35.152720 27417 tablet_bootstrap.cc:492] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:35.153332 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992029a58c6b4e9fae2a4024cda34dcd" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:35.154224 27413 raft_consensus.cc:359] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:35.158416 27731 consensus_queue.cc:1048] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:35.159852 27183 leader_election.cc:304] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:35.166199 27586 raft_consensus.cc:2804] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:35.166711 27586 raft_consensus.cc:697] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:35.167632 27586 consensus_queue.cc:237] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:35.171140 27414 tablet_bootstrap.cc:492] T 180999038c4a4fa7912fea59dfabd4d4 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:35.171710 27414 ts_tablet_manager.cc:1403] T 180999038c4a4fa7912fea59dfabd4d4 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.491s	user 0.155s	sys 0.176s
I20260709 13:21:35.185006 27417 tablet_bootstrap.cc:654] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:35.165241 27142 raft_consensus.cc:3060] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:35.165273 27413 raft_consensus.cc:385] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:35.207943 27413 raft_consensus.cc:740] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.208722 27413 consensus_queue.cc:260] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:35.218274 27413 ts_tablet_manager.cc:1434] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.002s
I20260709 13:21:35.219434 27413 tablet_bootstrap.cc:492] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6: Bootstrap starting.
I20260709 13:21:35.162425 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992029a58c6b4e9fae2a4024cda34dcd" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:35.218612 27729 raft_consensus.cc:493] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05f7e02ff65b470591cb5d9565f123d6)
I20260709 13:21:35.224725 27729 raft_consensus.cc:515] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:35.225020 27414 raft_consensus.cc:359] T 180999038c4a4fa7912fea59dfabd4d4 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:35.225761 27414 raft_consensus.cc:385] T 180999038c4a4fa7912fea59dfabd4d4 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:35.226065 27414 raft_consensus.cc:740] T 180999038c4a4fa7912fea59dfabd4d4 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.231349 27729 leader_election.cc:290] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:35.160817 27768 consensus_queue.cc:1048] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.061s
I20260709 13:21:35.226799 27414 consensus_queue.cc:260] T 180999038c4a4fa7912fea59dfabd4d4 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:35.207633 27737 leader_election.cc:290] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:35.159533 27708 consensus_queue.cc:1048] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.061s
I20260709 13:21:35.242844 27218 raft_consensus.cc:3060] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:35.220724 27142 raft_consensus.cc:2468] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:35.265017 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93a08da579844d4b341d52ce65113ce" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
W20260709 13:21:35.269497 27258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:40225, user_credentials={real_user=slave}} blocked reactor thread for 105102us
I20260709 13:21:35.274138 27414 ts_tablet_manager.cc:1434] T 180999038c4a4fa7912fea59dfabd4d4 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.102s	user 0.010s	sys 0.000s
I20260709 13:21:35.278663 27414 tablet_bootstrap.cc:492] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:35.285902 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93a08da579844d4b341d52ce65113ce" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:35.287358 27413 tablet_bootstrap.cc:654] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:35.305832 27258 leader_election.cc:304] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:35.310501 27039 catalog_manager.cc:5697] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:35.275990 27586 raft_consensus.cc:493] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:35.313632 27331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:35935, user_credentials={real_user=slave}} blocked reactor thread for 106306us
I20260709 13:21:35.316847 27586 raft_consensus.cc:515] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:35.323155 27586 leader_election.cc:290] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:35.325120 27140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a377a6c91543278d51ac9a9db49050" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:35.325932 27140 raft_consensus.cc:2468] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:35.329743 27417 tablet_bootstrap.cc:492] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:35.330408 27417 ts_tablet_manager.cc:1403] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.178s	user 0.014s	sys 0.020s
I20260709 13:21:35.332638 27183 leader_election.cc:304] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:35.313588 27768 raft_consensus.cc:2749] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:35.339522 27708 raft_consensus.cc:493] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:35.340186 27708 raft_consensus.cc:515] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:35.344420 27708 leader_election.cc:290] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:35.344717 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180999038c4a4fa7912fea59dfabd4d4" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:35.346241 27290 raft_consensus.cc:2468] T 180999038c4a4fa7912fea59dfabd4d4 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:35.347899 27332 leader_election.cc:304] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:35.348866 27737 raft_consensus.cc:2804] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:35.349318 27737 raft_consensus.cc:493] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:35.345160 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180999038c4a4fa7912fea59dfabd4d4" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:35.349817 27737 raft_consensus.cc:3060] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:35.364154 27731 raft_consensus.cc:2804] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:35.364737 27731 raft_consensus.cc:493] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:35.365173 27731 raft_consensus.cc:3060] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:35.366923 27217 raft_consensus.cc:2468] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:35.368894 27417 raft_consensus.cc:359] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:35.369985 27417 raft_consensus.cc:385] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:35.370349 27417 raft_consensus.cc:740] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.371428 27417 consensus_queue.cc:260] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:35.376083 27414 tablet_bootstrap.cc:654] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:35.379976 27184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 89883us
I20260709 13:21:35.383765 27417 ts_tablet_manager.cc:1434] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.001s
I20260709 13:21:35.388744 27417 tablet_bootstrap.cc:492] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:35.404318 27413 tablet_bootstrap.cc:492] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6: No bootstrap required, opened a new log
I20260709 13:21:35.404681 27288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a377a6c91543278d51ac9a9db49050" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:35.404867 27413 ts_tablet_manager.cc:1403] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6: Time spent bootstrapping tablet: real 0.186s	user 0.014s	sys 0.000s
I20260709 13:21:35.389339 27331 leader_election.cc:304] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:35.407773 27708 raft_consensus.cc:2804] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:35.408320 27708 raft_consensus.cc:697] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:35.408860 27414 tablet_bootstrap.cc:492] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:35.409596 27414 ts_tablet_manager.cc:1403] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.134s	user 0.015s	sys 0.001s
I20260709 13:21:35.409176 27708 consensus_queue.cc:237] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
W20260709 13:21:35.449447 27184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 59875.6us
I20260709 13:21:35.445937 27413 raft_consensus.cc:359] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:35.450304 27413 raft_consensus.cc:385] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:35.450595 27413 raft_consensus.cc:740] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.420608 27218 raft_consensus.cc:2468] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
W20260709 13:21:35.451201 27184 leader_election.cc:343] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:35.454900 27413 consensus_queue.cc:260] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:35.468298 27413 ts_tablet_manager.cc:1434] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.002s
I20260709 13:21:35.468107 27414 raft_consensus.cc:359] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:35.468873 27414 raft_consensus.cc:385] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:35.469097 27414 raft_consensus.cc:740] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.473815 27414 consensus_queue.cc:260] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:35.472422 27417 tablet_bootstrap.cc:654] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:35.465193 27586 raft_consensus.cc:493] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:35.505702 27414 ts_tablet_manager.cc:1434] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.096s	user 0.009s	sys 0.000s
W20260709 13:21:35.541290 27332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 66093.4us
I20260709 13:21:35.507248 27586 raft_consensus.cc:515] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:35.543139 27827 raft_consensus.cc:493] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:35.572041 27414 tablet_bootstrap.cc:492] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:35.588358 27586 leader_election.cc:290] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:35.614516 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c475a8c029024e99b4377fdda1a27c2a" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:35.615388 27289 raft_consensus.cc:2468] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:35.618960 27184 leader_election.cc:304] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:35.563495 27827 raft_consensus.cc:515] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:35.623035 27630 raft_consensus.cc:2804] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:35.623507 27630 raft_consensus.cc:493] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:35.623852 27630 raft_consensus.cc:3060] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:35.628973 27827 leader_election.cc:290] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:35.630944 27731 raft_consensus.cc:515] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:35.636080 27414 tablet_bootstrap.cc:654] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:35.636221 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6df6aa2911c94954949e3b8283d1d2e1" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:35.636966 27143 raft_consensus.cc:2468] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 0.
I20260709 13:21:35.646770 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c475a8c029024e99b4377fdda1a27c2a" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:35.647444 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6df6aa2911c94954949e3b8283d1d2e1" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:35.652659 27183 leader_election.cc:304] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:35.654151 27586 raft_consensus.cc:2804] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:35.654567 27586 raft_consensus.cc:493] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:35.654874 27586 raft_consensus.cc:3060] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:35.655915 27417 tablet_bootstrap.cc:492] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:35.656461 27417 ts_tablet_manager.cc:1403] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.272s	user 0.039s	sys 0.036s
I20260709 13:21:35.668212 27731 leader_election.cc:290] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:35.671175 27708 raft_consensus.cc:493] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:35.671592 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a377a6c91543278d51ac9a9db49050" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:35.671841 27708 raft_consensus.cc:515] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:35.672222 27142 raft_consensus.cc:3060] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:35.682179 27142 raft_consensus.cc:2468] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
W20260709 13:21:35.691032 27332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 133360us
I20260709 13:21:35.692853 27183 leader_election.cc:304] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
W20260709 13:21:35.684999 27184 leader_election.cc:343] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:35.696344 27184 leader_election.cc:343] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:35.705440 27630 raft_consensus.cc:515] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:35.707485 27630 leader_election.cc:290] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:35.709259 27417 raft_consensus.cc:359] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:35.709636 27708 leader_election.cc:290] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:35.710048 27417 raft_consensus.cc:385] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:35.710513 27417 raft_consensus.cc:740] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.711484 27417 consensus_queue.cc:260] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:35.716091 27417 ts_tablet_manager.cc:1434] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.001s
I20260709 13:21:35.716485 27586 raft_consensus.cc:515] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:35.717005 27287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a377a6c91543278d51ac9a9db49050" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:35.720598 27827 raft_consensus.cc:2804] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:35.721405 27827 raft_consensus.cc:697] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:35.722609 27827 consensus_queue.cc:237] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:35.726375 27737 raft_consensus.cc:515] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
W20260709 13:21:35.731750 27184 leader_election.cc:343] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:35.740464 27417 tablet_bootstrap.cc:492] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:35.746030 27478 consensus_queue.cc:1048] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:35.744218 27109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:40225, user_credentials={real_user=slave}} blocked reactor thread for 74656.6us
I20260709 13:21:35.755803 27287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c475a8c029024e99b4377fdda1a27c2a" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:35.756543 27287 raft_consensus.cc:3060] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:35.771696 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178fe9f66bbf440780bf6f265626a054" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:35.773664 27737 leader_election.cc:290] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:35.775074 27586 leader_election.cc:290] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:35.775766 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180999038c4a4fa7912fea59dfabd4d4" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:35.776381 27217 raft_consensus.cc:3060] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:35.778925 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6df6aa2911c94954949e3b8283d1d2e1" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:35.779790 27143 raft_consensus.cc:3060] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:35.789930 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "180999038c4a4fa7912fea59dfabd4d4" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:35.790594 27292 raft_consensus.cc:3060] T 180999038c4a4fa7912fea59dfabd4d4 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:35.799935 27417 tablet_bootstrap.cc:654] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:35.804930 27361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6df6aa2911c94954949e3b8283d1d2e1" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
W20260709 13:21:35.807367 27184 consensus_peers.cc:597] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 -> Peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Couldn't send request to peer 1962786a39404929920d966805e48399. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.799968 27332 leader_election.cc:343] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:35.807518 27287 raft_consensus.cc:2468] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:35.813014 27138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178fe9f66bbf440780bf6f265626a054" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:35.820930 27138 raft_consensus.cc:2468] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 0.
I20260709 13:21:35.823194 27184 leader_election.cc:304] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:35.824174 27830 raft_consensus.cc:2804] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:35.824703 27830 raft_consensus.cc:697] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:35.825608 27830 consensus_queue.cc:237] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:35.814097 27217 raft_consensus.cc:2468] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:35.816056 27366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c475a8c029024e99b4377fdda1a27c2a" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:35.846589 27332 leader_election.cc:304] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:35.850780 27038 catalog_manager.cc:5697] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.872195 27836 raft_consensus.cc:2804] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:35.872942 27836 raft_consensus.cc:697] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:35.874080 27836 consensus_queue.cc:237] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:35.880709 27414 tablet_bootstrap.cc:492] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:35.884584 27414 ts_tablet_manager.cc:1403] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.313s	user 0.022s	sys 0.011s
I20260709 13:21:35.817044 27292 raft_consensus.cc:2468] T 180999038c4a4fa7912fea59dfabd4d4 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
W20260709 13:21:35.817874 27331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:35935, user_credentials={real_user=slave}} blocked reactor thread for 48225.9us
I20260709 13:21:35.830272 27737 consensus_queue.cc:1048] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:21:35.836392 27184 leader_election.cc:343] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:35.895107 27184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.132:40225, user_credentials={real_user=slave}} blocked reactor thread for 58792.4us
W20260709 13:21:35.897609 27184 leader_election.cc:343] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:35.897961 27331 leader_election.cc:304] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:35.912693 27556 raft_consensus.cc:2804] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:35.913050 27414 raft_consensus.cc:359] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:35.922019 27414 raft_consensus.cc:385] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:35.922359 27414 raft_consensus.cc:740] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.913298 27556 raft_consensus.cc:493] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:35.923787 27556 raft_consensus.cc:3060] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:35.923378 27414 consensus_queue.cc:260] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:35.918440 27143 raft_consensus.cc:2468] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:35.935169 27414 ts_tablet_manager.cc:1434] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
W20260709 13:21:35.944871 27332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 52291.3us
I20260709 13:21:35.951602 27183 leader_election.cc:304] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:35.961946 27547 consensus_queue.cc:1048] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:36.002051 27414 tablet_bootstrap.cc:492] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
W20260709 13:21:36.001930 27258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.132:40225, user_credentials={real_user=slave}} blocked reactor thread for 45483.3us
I20260709 13:21:36.001555 27841 raft_consensus.cc:2804] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:35.932422 27556 raft_consensus.cc:515] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:36.027278 27841 raft_consensus.cc:697] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
W20260709 13:21:36.064622 27088 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:36.068354 27547 raft_consensus.cc:493] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:36.069010 27547 raft_consensus.cc:515] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:36.071105 27547 leader_election.cc:290] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:36.072993 27841 consensus_queue.cc:237] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:36.074820 27556 leader_election.cc:290] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:36.078706 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178fe9f66bbf440780bf6f265626a054" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
W20260709 13:21:36.080749 27332 leader_election.cc:343] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:36.048636 27708 consensus_queue.cc:1048] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:21:36.093663 27361 raft_consensus.cc:3060] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:36.094497 27414 tablet_bootstrap.cc:654] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:36.100805 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f72db119dad434b84f9712dc1930f7f" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:36.171873 27417 tablet_bootstrap.cc:492] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:36.174755 27818 raft_consensus.cc:493] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:36.183378 27818 raft_consensus.cc:515] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:36.207820 27818 leader_election.cc:290] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:36.209990 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a377a6c91543278d51ac9a9db49050" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:36.235229 27288 raft_consensus.cc:3060] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:36.259215 27417 ts_tablet_manager.cc:1403] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.522s	user 0.020s	sys 0.007s
I20260709 13:21:36.289361 27841 consensus_queue.cc:1048] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:36.380023 27109 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:39829, user_credentials={real_user=slave}} blocked reactor thread for 301004us
I20260709 13:21:36.385360 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f72db119dad434b84f9712dc1930f7f" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:36.384222 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178fe9f66bbf440780bf6f265626a054" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:36.390925 27141 raft_consensus.cc:3060] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:36.263212 27417 raft_consensus.cc:359] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:36.431784 27417 raft_consensus.cc:385] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:36.432346 27417 raft_consensus.cc:740] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.433682 27417 consensus_queue.cc:260] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:36.437016 27417 ts_tablet_manager.cc:1434] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.177s	user 0.005s	sys 0.006s
I20260709 13:21:36.439862 27417 tablet_bootstrap.cc:492] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:36.474077 27414 tablet_bootstrap.cc:492] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:36.486871 27414 ts_tablet_manager.cc:1403] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.485s	user 0.070s	sys 0.087s
I20260709 13:21:36.533607 27137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07a377a6c91543278d51ac9a9db49050" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:36.535193 27137 raft_consensus.cc:2393] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d8e002e04a74c2598405158a99d86c1 in current term 1: Already voted for candidate 05f7e02ff65b470591cb5d9565f123d6 in this term.
I20260709 13:21:36.550058 27141 raft_consensus.cc:2468] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:36.563421 27414 raft_consensus.cc:359] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:36.566500 27414 raft_consensus.cc:385] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:36.566919 27414 raft_consensus.cc:740] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.568903 27414 consensus_queue.cc:260] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:36.591267 27331 leader_election.cc:304] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:36.621414 27417 tablet_bootstrap.cc:654] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:36.623703 27414 ts_tablet_manager.cc:1434] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.136s	user 0.012s	sys 0.000s
I20260709 13:21:36.627295 27878 raft_consensus.cc:2749] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:36.642195 27737 consensus_queue.cc:1048] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:36.668565 27331 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:35935, user_credentials={real_user=slave}} blocked reactor thread for 77721.8us
I20260709 13:21:36.699200 27331 leader_election.cc:304] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:36.713383 27414 tablet_bootstrap.cc:492] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1: Bootstrap starting.
I20260709 13:21:36.700591 27878 raft_consensus.cc:2804] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:36.722395 27878 raft_consensus.cc:697] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:36.723968 27878 consensus_queue.cc:237] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:36.767309 27827 consensus_queue.cc:1048] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:21:36.771023 27870 consensus_queue.cc:1048] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:36.777927 27361 raft_consensus.cc:3060] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:36.788167 27184 consensus_peers.cc:597] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Couldn't send request to peer 1962786a39404929920d966805e48399. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:36.788808 27257 leader_election.cc:304] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:36.796397 27773 raft_consensus.cc:2749] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:36.856896 27872 consensus_queue.cc:1048] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:36.868755 27837 raft_consensus.cc:493] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:36.869657 27837 raft_consensus.cc:515] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:36.884473 27832 consensus_queue.cc:1048] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:36.886569 27837 leader_election.cc:290] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:36.894608 27037 catalog_manager.cc:5697] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } }
I20260709 13:21:36.896844 27414 tablet_bootstrap.cc:654] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:36.897617 27737 raft_consensus.cc:493] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:36.898312 27737 raft_consensus.cc:515] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:36.902101 27737 leader_election.cc:290] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:36.912894 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c475a8c029024e99b4377fdda1a27c2a" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
W20260709 13:21:36.918973 27887 log.cc:927] Time spent T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:21:36.942852 27871 consensus_queue.cc:1048] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:21:36.959074 27138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178fe9f66bbf440780bf6f265626a054" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:36.960146 27138 raft_consensus.cc:2393] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d8e002e04a74c2598405158a99d86c1 in current term 1: Already voted for candidate 1962786a39404929920d966805e48399 in this term.
I20260709 13:21:36.965538 27417 tablet_bootstrap.cc:492] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:36.966054 27417 ts_tablet_manager.cc:1403] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.527s	user 0.024s	sys 0.049s
I20260709 13:21:36.979369 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c475a8c029024e99b4377fdda1a27c2a" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:36.994132 27332 leader_election.cc:304] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1
I20260709 13:21:36.996703 27846 raft_consensus.cc:2749] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:36.997083 27414 tablet_bootstrap.cc:492] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1: No bootstrap required, opened a new log
I20260709 13:21:36.997723 27414 ts_tablet_manager.cc:1403] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1: Time spent bootstrapping tablet: real 0.285s	user 0.026s	sys 0.020s
I20260709 13:21:36.999330 27417 raft_consensus.cc:359] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:37.000761 27417 raft_consensus.cc:385] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:37.001030 27417 raft_consensus.cc:740] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.010077 27417 consensus_queue.cc:260] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:37.011044 27361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178fe9f66bbf440780bf6f265626a054" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:37.039024 27414 raft_consensus.cc:359] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:37.041036 27414 raft_consensus.cc:385] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:37.041419 27414 raft_consensus.cc:740] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.052114 27414 consensus_queue.cc:260] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:37.059744 27258 leader_election.cc:304] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:37.062667 27773 raft_consensus.cc:3060] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:37.066053 27417 ts_tablet_manager.cc:1434] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.002s
I20260709 13:21:37.102108 27417 tablet_bootstrap.cc:492] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399: Bootstrap starting.
I20260709 13:21:37.105723 27414 ts_tablet_manager.cc:1434] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.000s
I20260709 13:21:37.132876 27362 raft_consensus.cc:3060] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:37.209544 27773 raft_consensus.cc:2749] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:37.212953 27417 tablet_bootstrap.cc:654] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:37.273408 27566 raft_consensus.cc:493] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:37.274102 27566 raft_consensus.cc:515] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:37.276392 27566 leader_election.cc:290] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:37.280197 27361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8115282f2b1544e6a930473c43950bc4" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:37.283540 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8115282f2b1544e6a930473c43950bc4" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:37.284304 27292 raft_consensus.cc:2468] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 0.
I20260709 13:21:37.284601 27903 consensus_queue.cc:1048] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:37.291247 27109 leader_election.cc:304] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:37.291486 27901 consensus_queue.cc:1048] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:37.292795 27566 raft_consensus.cc:2804] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:37.293334 27566 raft_consensus.cc:493] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:37.293782 27566 raft_consensus.cc:3060] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:37.296958 27109 leader_election.cc:343] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:37.296802 27039 catalog_manager.cc:5697] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:37.340335 27566 raft_consensus.cc:515] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:37.349941 27039 catalog_manager.cc:5697] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:37.358642 27566 leader_election.cc:290] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:37.360682 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8115282f2b1544e6a930473c43950bc4" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:37.360771 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8115282f2b1544e6a930473c43950bc4" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:37.362509 27290 raft_consensus.cc:3060] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:37.362922 27109 leader_election.cc:343] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1962786a39404929920d966805e48399 (127.16.188.132:40225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:37.379316 27417 tablet_bootstrap.cc:492] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399: No bootstrap required, opened a new log
I20260709 13:21:37.380007 27417 ts_tablet_manager.cc:1403] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399: Time spent bootstrapping tablet: real 0.278s	user 0.016s	sys 0.008s
I20260709 13:21:37.383061 27417 raft_consensus.cc:359] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:37.383802 27417 raft_consensus.cc:385] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:37.384094 27417 raft_consensus.cc:740] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Initialized, Role: FOLLOWER
I20260709 13:21:37.391899 27290 raft_consensus.cc:2468] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 1.
I20260709 13:21:37.393110 27109 leader_election.cc:304] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816; no voters: 1962786a39404929920d966805e48399
I20260709 13:21:37.393900 27566 raft_consensus.cc:2804] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:37.394608 27566 raft_consensus.cc:697] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:37.396489 27566 consensus_queue.cc:237] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:37.398916 27041 catalog_manager.cc:5697] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:37.402133 27041 catalog_manager.cc:5697] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 1 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:37.404048 27417 consensus_queue.cc:260] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:37.415798 27417 ts_tablet_manager.cc:1434] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
W20260709 13:21:37.471843 27088 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:37.478012 27038 catalog_manager.cc:5697] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 0 to 1, leader changed from <none> to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:37.543569 27901 raft_consensus.cc:493] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:37.544137 27901 raft_consensus.cc:515] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:37.546159 27901 leader_election.cc:290] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:37.547137 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8115282f2b1544e6a930473c43950bc4" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:37.547427 27138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8115282f2b1544e6a930473c43950bc4" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:37.547900 27292 raft_consensus.cc:2393] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1962786a39404929920d966805e48399 in current term 1: Already voted for candidate f79efe7c9e6a4384b765393621da6816 in this term.
I20260709 13:21:37.549414 27331 leader_election.cc:304] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:37.550283 27901 raft_consensus.cc:3060] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:37.558713 27901 raft_consensus.cc:2749] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:37.801113 27566 consensus_queue.cc:1048] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:37.822317 27566 consensus_queue.cc:1048] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:38.676298 17138 tablet_server.cc:179] TabletServer@127.16.188.129:0 shutting down...
W20260709 13:21:38.684953 27183 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:21:38.690932 27183 consensus_peers.cc:597] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:38.709446 27257 consensus_peers.cc:597] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:38.710971 27183 consensus_peers.cc:597] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:38.715152 27257 consensus_peers.cc:597] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:38.728363 27257 consensus_peers.cc:597] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.733956 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:21:38.737082 27183 consensus_peers.cc:597] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.738153 17138 tablet_replica.cc:333] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.739050 17138 raft_consensus.cc:2243] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.739454 17138 raft_consensus.cc:2272] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.741777 17138 tablet_replica.cc:333] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.742340 17138 raft_consensus.cc:2243] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.742703 17138 raft_consensus.cc:2272] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.744733 17138 tablet_replica.cc:333] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.745293 17138 raft_consensus.cc:2243] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.745739 17138 raft_consensus.cc:2272] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.748435 17138 tablet_replica.cc:333] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.749255 17138 raft_consensus.cc:2243] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.749869 17138 raft_consensus.cc:2272] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.752985 17138 tablet_replica.cc:333] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.753877 17138 raft_consensus.cc:2243] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.754933 17138 raft_consensus.cc:2272] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.757264 17138 tablet_replica.cc:333] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.757901 17138 raft_consensus.cc:2243] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.758422 17138 raft_consensus.cc:2272] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.761971 17138 tablet_replica.cc:333] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.763238 17138 raft_consensus.cc:2243] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.764842 17138 raft_consensus.cc:2272] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:38.768744 27183 consensus_peers.cc:597] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.770031 17138 tablet_replica.cc:333] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.771379 17138 raft_consensus.cc:2243] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.772008 17138 raft_consensus.cc:2272] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.774719 17138 tablet_replica.cc:333] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.775527 17138 raft_consensus.cc:2243] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:21:38.775687 27331 consensus_peers.cc:597] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.776597 17138 raft_consensus.cc:2272] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.779495 17138 tablet_replica.cc:333] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.780318 17138 raft_consensus.cc:2243] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.780941 17138 raft_consensus.cc:2272] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.783397 17138 tablet_replica.cc:333] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.783949 17138 raft_consensus.cc:2243] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.784384 17138 raft_consensus.cc:2272] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.786401 17138 tablet_replica.cc:333] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.786969 17138 raft_consensus.cc:2243] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.787412 17138 raft_consensus.cc:2272] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.790057 17138 tablet_replica.cc:333] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.790819 17138 raft_consensus.cc:2243] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.791373 17138 raft_consensus.cc:2272] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.794528 17138 tablet_replica.cc:333] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.795169 17138 raft_consensus.cc:2243] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.795604 17138 raft_consensus.cc:2272] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.797921 17138 tablet_replica.cc:333] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.798517 17138 raft_consensus.cc:2243] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.799371 17138 raft_consensus.cc:2272] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.802062 17138 tablet_replica.cc:333] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.802834 17138 raft_consensus.cc:2243] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:38.803277 27331 consensus_peers.cc:597] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.803412 17138 raft_consensus.cc:2272] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.806595 17138 tablet_replica.cc:333] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
W20260709 13:21:38.806943 27331 consensus_peers.cc:597] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.807500 17138 raft_consensus.cc:2243] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.807994 17138 raft_consensus.cc:2272] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.810635 17138 tablet_replica.cc:333] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.811455 17138 raft_consensus.cc:2243] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.812115 17138 raft_consensus.cc:2272] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.817742 17138 tablet_replica.cc:333] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.818572 17138 raft_consensus.cc:2243] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:21:38.818956 27331 consensus_peers.cc:597] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.819767 17138 raft_consensus.cc:2272] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.823025 17138 tablet_replica.cc:333] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.823828 17138 raft_consensus.cc:2243] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.824427 17138 raft_consensus.cc:2272] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.828938 17138 tablet_replica.cc:333] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.829980 17138 raft_consensus.cc:2243] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.831437 17138 raft_consensus.cc:2272] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.834240 17138 tablet_replica.cc:333] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.834846 17138 raft_consensus.cc:2243] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.835615 17138 raft_consensus.cc:2272] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.838290 17138 tablet_replica.cc:333] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.839134 17138 raft_consensus.cc:2243] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.839766 17138 raft_consensus.cc:2272] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.842795 17138 tablet_replica.cc:333] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.843444 17138 raft_consensus.cc:2243] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.844008 17138 raft_consensus.cc:2272] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.846356 17138 tablet_replica.cc:333] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.847163 17138 raft_consensus.cc:2243] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.847783 17138 raft_consensus.cc:2272] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:38.849856 27183 consensus_peers.cc:597] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.851056 17138 tablet_replica.cc:333] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.851877 17138 raft_consensus.cc:2243] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.852403 17138 raft_consensus.cc:2272] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:38.854964 27183 consensus_peers.cc:597] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.855672 17138 tablet_replica.cc:333] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.856377 17138 raft_consensus.cc:2243] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.856998 17138 raft_consensus.cc:2272] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.859555 17138 tablet_replica.cc:333] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.860354 17138 raft_consensus.cc:2243] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.860909 17138 raft_consensus.cc:2272] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:38.862454 27331 consensus_peers.cc:597] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.863665 17138 tablet_replica.cc:333] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.864625 17138 raft_consensus.cc:2243] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.865324 17138 raft_consensus.cc:2272] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:38.867126 27331 consensus_peers.cc:597] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.868395 17138 tablet_replica.cc:333] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
W20260709 13:21:38.869309 27331 consensus_peers.cc:597] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.869400 17138 raft_consensus.cc:2243] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.870128 17138 raft_consensus.cc:2272] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.873443 17138 tablet_replica.cc:333] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
W20260709 13:21:38.873873 27183 consensus_peers.cc:597] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.874310 17138 raft_consensus.cc:2243] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.874806 17138 raft_consensus.cc:2272] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.876928 17138 tablet_replica.cc:333] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.877487 17138 raft_consensus.cc:2243] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.877898 17138 raft_consensus.cc:2272] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.880445 17138 tablet_replica.cc:333] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.881026 17138 raft_consensus.cc:2243] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.881407 17138 raft_consensus.cc:2272] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.883795 17138 tablet_replica.cc:333] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.884657 17138 raft_consensus.cc:2243] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.885310 17138 raft_consensus.cc:2272] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:38.887897 27183 consensus_peers.cc:597] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.888437 17138 tablet_replica.cc:333] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.889386 17138 raft_consensus.cc:2243] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.890630 17138 raft_consensus.cc:2272] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.896662 17138 tablet_replica.cc:333] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.897282 17138 raft_consensus.cc:2243] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.897730 17138 raft_consensus.cc:2272] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.899921 17138 tablet_replica.cc:333] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.900473 17138 raft_consensus.cc:2243] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.900957 17138 raft_consensus.cc:2272] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.903329 17138 tablet_replica.cc:333] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.903853 17138 raft_consensus.cc:2243] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.904461 17138 raft_consensus.cc:2272] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.907428 17138 tablet_replica.cc:333] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.908087 17138 raft_consensus.cc:2243] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.908602 17138 raft_consensus.cc:2272] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.911501 17138 tablet_replica.cc:333] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.912097 17138 raft_consensus.cc:2243] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.913177 17138 raft_consensus.cc:2272] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:38.915323 27331 consensus_peers.cc:597] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.916020 17138 tablet_replica.cc:333] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
W20260709 13:21:38.916433 27257 consensus_peers.cc:597] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:38.916771 17138 raft_consensus.cc:2243] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.917870 17138 raft_consensus.cc:2272] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.920490 17138 tablet_replica.cc:333] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.921047 17138 raft_consensus.cc:2243] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.921514 17138 raft_consensus.cc:2272] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.923511 17138 tablet_replica.cc:333] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.924146 17138 raft_consensus.cc:2243] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.924669 17138 raft_consensus.cc:2272] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.927037 17138 tablet_replica.cc:333] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.927634 17138 raft_consensus.cc:2243] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:38.928644 17138 raft_consensus.cc:2272] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:38.931087 17138 tablet_replica.cc:333] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816: stopping tablet replica
I20260709 13:21:38.931520 17138 raft_consensus.cc:2243] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:38.931926 17138 raft_consensus.cc:2272] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:38.951320 27183 consensus_peers.cc:597] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:39.009289 17138 tablet_server.cc:196] TabletServer@127.16.188.129:0 shutdown complete.
W20260709 13:21:39.056376 27331 consensus_peers.cc:597] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:39.072726 27183 consensus_peers.cc:597] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:39.083983 27183 consensus_peers.cc:597] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:39.107261 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:39.117342 27919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:39.117475 27920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:39.120168 17138 server_base.cc:1061] running on GCE node
W20260709 13:21:39.121027 27923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:39.122529 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:39.122864 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:39.123095 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603299123073 us; error 0 us; skew 500 ppm
I20260709 13:21:39.123900 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:21:39.132356 27331 consensus_peers.cc:597] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:39.134132 27183 consensus_peers.cc:597] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:39.134642 17138 webserver.cc:533] Webserver started at http://127.16.188.129:41217/ using document root <none> and password file <none>
I20260709 13:21:39.135309 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:39.135480 17138 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:21:39.140666 17138 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:21:39.148455 27927 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:39.149706 17138 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:21:39.150223 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-0-root
uuid: "f79efe7c9e6a4384b765393621da6816"
format_stamp: "Formatted at 2026-07-09 13:21:25 on dist-test-slave-2hqk"
I20260709 13:21:39.150822 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602984839783-17138-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:21:39.155601 27331 consensus_peers.cc:597] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:39.164659 27183 consensus_peers.cc:597] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:39.166447 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:39.168280 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:39.170353 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:39.177608 27934 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:21:39.190975 27331 consensus_peers.cc:597] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:39.197434 27331 consensus_peers.cc:597] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:39.201099 27183 consensus_peers.cc:597] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:39.218561 27183 consensus_peers.cc:597] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:39.240797 27183 consensus_peers.cc:597] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:39.313721 27183 consensus_peers.cc:597] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:39.514285 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:21:39.514688 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.339s	user 0.004s	sys 0.007s
I20260709 13:21:39.514966 17138 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:21:39.520154 27934 tablet_bootstrap.cc:492] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:39.550650 27934 tablet_bootstrap.cc:492] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:39.551635 27934 tablet_bootstrap.cc:492] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:39.552248 27934 ts_tablet_manager.cc:1403] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.011s
I20260709 13:21:39.554872 27934 raft_consensus.cc:359] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:39.555605 27934 raft_consensus.cc:740] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.556340 27934 consensus_queue.cc:260] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:39.566324 27934 ts_tablet_manager.cc:1434] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:21:39.567306 27934 tablet_bootstrap.cc:492] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:39.599287 27934 tablet_bootstrap.cc:492] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:39.600296 27934 tablet_bootstrap.cc:492] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:39.601071 27934 ts_tablet_manager.cc:1403] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.004s
I20260709 13:21:39.603459 27934 raft_consensus.cc:359] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:39.604177 27934 raft_consensus.cc:740] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.604976 27934 consensus_queue.cc:260] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:39.606978 27934 ts_tablet_manager.cc:1434] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:39.607793 27934 tablet_bootstrap.cc:492] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:39.643797 27934 tablet_bootstrap.cc:492] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:39.644785 27934 tablet_bootstrap.cc:492] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:39.645512 27934 ts_tablet_manager.cc:1403] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.016s
I20260709 13:21:39.654891 27934 raft_consensus.cc:359] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:39.655544 27934 raft_consensus.cc:740] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.656229 27934 consensus_queue.cc:260] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:39.658154 27934 ts_tablet_manager.cc:1434] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.004s
I20260709 13:21:39.658917 27934 tablet_bootstrap.cc:492] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:39.673303 27934 tablet_bootstrap.cc:492] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:39.674181 27934 tablet_bootstrap.cc:492] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:39.674764 27934 ts_tablet_manager.cc:1403] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:21:39.677101 27934 raft_consensus.cc:359] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:39.677713 27934 raft_consensus.cc:740] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.678965 27934 consensus_queue.cc:260] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:39.681023 27934 ts_tablet_manager.cc:1434] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:39.681777 27934 tablet_bootstrap.cc:492] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:39.728224 27934 tablet_bootstrap.cc:492] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:39.729660 27934 tablet_bootstrap.cc:492] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:39.730397 27934 ts_tablet_manager.cc:1403] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.005s
I20260709 13:21:39.733180 27934 raft_consensus.cc:359] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:39.733877 27934 raft_consensus.cc:740] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.736979 27934 consensus_queue.cc:260] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:39.739346 27934 ts_tablet_manager.cc:1434] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:21:39.740101 27934 tablet_bootstrap.cc:492] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:39.760955 27934 tablet_bootstrap.cc:492] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:39.761966 27934 tablet_bootstrap.cc:492] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:39.762642 27934 ts_tablet_manager.cc:1403] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 13:21:39.765276 27934 raft_consensus.cc:359] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:39.765946 27939 raft_consensus.cc:493] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:39.765990 27934 raft_consensus.cc:740] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.766636 27939 raft_consensus.cc:515] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:39.767261 27934 consensus_queue.cc:260] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:39.769595 27939 leader_election.cc:290] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:39.770020 27934 ts_tablet_manager.cc:1434] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.001s
I20260709 13:21:39.770970 27934 tablet_bootstrap.cc:492] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:39.774482 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f684c9c7b4874567b690e70a7ddae640" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
W20260709 13:21:39.781895 27331 leader_election.cc:336] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:39.782372 27331 leader_election.cc:304] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:39.783398 27940 raft_consensus.cc:2749] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:39.789062 27934 tablet_bootstrap.cc:492] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:39.792394 27934 tablet_bootstrap.cc:492] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:39.793301 27934 ts_tablet_manager.cc:1403] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260709 13:21:39.794211 17138 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:21:39.794598 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.280s	user 0.248s	sys 0.009s
I20260709 13:21:39.796375 27934 raft_consensus.cc:359] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:39.797395 27934 raft_consensus.cc:740] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.798707 27934 consensus_queue.cc:260] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:39.801083 27934 ts_tablet_manager.cc:1434] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:21:39.802047 27934 tablet_bootstrap.cc:492] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:39.820132 27934 tablet_bootstrap.cc:492] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:39.821168 27934 tablet_bootstrap.cc:492] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:39.821902 27934 ts_tablet_manager.cc:1403] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:21:39.824925 27934 raft_consensus.cc:359] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:39.825707 27934 raft_consensus.cc:740] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.826493 27934 consensus_queue.cc:260] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:39.828986 27934 ts_tablet_manager.cc:1434] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:39.829921 27934 tablet_bootstrap.cc:492] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:39.851732 27934 tablet_bootstrap.cc:492] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:39.853175 27934 tablet_bootstrap.cc:492] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:39.854022 27934 ts_tablet_manager.cc:1403] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.010s
I20260709 13:21:39.857024 27940 raft_consensus.cc:493] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:39.857874 27940 raft_consensus.cc:515] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:39.857079 27934 raft_consensus.cc:359] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:39.859027 27934 raft_consensus.cc:740] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.860042 27934 consensus_queue.cc:260] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:39.861294 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a2e2e4269146dd8e2bf720a1c890d8" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:39.862802 27934 ts_tablet_manager.cc:1434] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:39.864117 27934 tablet_bootstrap.cc:492] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
W20260709 13:21:39.869216 27331 leader_election.cc:336] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:39.869803 27331 leader_election.cc:304] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:39.870822 27940 leader_election.cc:290] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:39.872750 27843 raft_consensus.cc:2749] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:39.873994 27940 raft_consensus.cc:493] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:39.875012 27940 raft_consensus.cc:515] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:39.879364 27843 raft_consensus.cc:493] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:39.880250 27843 raft_consensus.cc:515] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:39.882642 27940 leader_election.cc:290] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:39.883708 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d205fe2cb9d4d319c85bb33f59ca660" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:39.888410 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32e5371db8c4a95ab423532604c6f33" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:39.891000 27843 leader_election.cc:290] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
W20260709 13:21:39.894650 27331 leader_election.cc:336] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:39.895292 27331 leader_election.cc:304] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:39.896143 27843 raft_consensus.cc:2749] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:39.899336 27331 leader_election.cc:336] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:39.899873 27331 leader_election.cc:304] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:39.900655 27843 raft_consensus.cc:2749] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:39.904237 27934 tablet_bootstrap.cc:492] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:39.905743 27934 tablet_bootstrap.cc:492] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:39.906678 27934 ts_tablet_manager.cc:1403] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.043s	user 0.029s	sys 0.007s
I20260709 13:21:39.910331 27934 raft_consensus.cc:359] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:39.911334 27934 raft_consensus.cc:740] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.912436 27934 consensus_queue.cc:260] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:39.915648 27934 ts_tablet_manager.cc:1434] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:21:39.917635 27934 tablet_bootstrap.cc:492] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:39.928194 27877 raft_consensus.cc:493] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:39.928951 27877 raft_consensus.cc:515] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:39.940554 27362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8115282f2b1544e6a930473c43950bc4" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:39.944038 27934 tablet_bootstrap.cc:492] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:39.945580 27934 tablet_bootstrap.cc:492] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:39.946506 27934 ts_tablet_manager.cc:1403] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.008s
I20260709 13:21:39.950295 27934 raft_consensus.cc:359] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:39.951346 27934 raft_consensus.cc:740] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.952546 27934 consensus_queue.cc:260] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:39.955832 27934 ts_tablet_manager.cc:1434] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:21:39.956883 27934 tablet_bootstrap.cc:492] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:39.946611 27877 leader_election.cc:290] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:39.976804 27934 tablet_bootstrap.cc:492] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:21:39.980207 27257 leader_election.cc:336] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:39.980902 27934 tablet_bootstrap.cc:492] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:39.981194 27257 leader_election.cc:304] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:39.981901 27934 ts_tablet_manager.cc:1403] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.000s
I20260709 13:21:39.982667 27996 raft_consensus.cc:2749] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:39.984562 27939 raft_consensus.cc:493] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:39.985553 27934 raft_consensus.cc:359] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:39.986234 27934 raft_consensus.cc:740] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:39.986941 27934 consensus_queue.cc:260] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:39.988984 27934 ts_tablet_manager.cc:1434] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:39.989835 27934 tablet_bootstrap.cc:492] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:39.985214 27939 raft_consensus.cc:515] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:39.994576 27630 raft_consensus.cc:493] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:39.995128 27630 raft_consensus.cc:515] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:39.996899 27630 leader_election.cc:290] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:39.998288 27362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2097666912334a53a80b648a0fad2786" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
W20260709 13:21:39.999995 27331 leader_election.cc:336] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
W20260709 13:21:40.006062 27183 leader_election.cc:336] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:40.006758 27183 leader_election.cc:304] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6; no voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:40.008306 27938 raft_consensus.cc:2749] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:40.010231 27939 leader_election.cc:290] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:40.013866 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ad970eae96417783396e7accb1b834" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:40.015980 27332 leader_election.cc:304] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:40.017179 27843 raft_consensus.cc:2749] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:40.018563 27934 tablet_bootstrap.cc:492] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:40.019440 27934 tablet_bootstrap.cc:492] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:40.020026 27934 ts_tablet_manager.cc:1403] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.007s
I20260709 13:21:40.022962 27934 raft_consensus.cc:359] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.023772 27934 raft_consensus.cc:740] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:40.024684 27934 consensus_queue.cc:260] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.026846 27934 ts_tablet_manager.cc:1434] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:21:40.027781 27934 tablet_bootstrap.cc:492] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:40.035030 27938 raft_consensus.cc:493] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.036244 27938 raft_consensus.cc:515] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.037643 27843 raft_consensus.cc:493] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.038381 27843 raft_consensus.cc:515] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.038749 27938 leader_election.cc:290] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
W20260709 13:21:40.045513 27183 leader_election.cc:336] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:40.050638 27938 raft_consensus.cc:493] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.051159 27843 leader_election.cc:290] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:40.051237 27938 raft_consensus.cc:515] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.051710 27941 raft_consensus.cc:493] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.052425 27941 raft_consensus.cc:515] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:40.053599 27938 leader_election.cc:290] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:40.054564 27941 leader_election.cc:290] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:40.051182 27362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d205fe2cb9d4d319c85bb33f59ca660" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:40.055439 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dc2c568d9642a587b5741241562afe" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:40.056236 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1665cdc23c4af782f4111587dbf68f" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:40.055527 27362 raft_consensus.cc:2468] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:40.059527 27184 leader_election.cc:304] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: f79efe7c9e6a4384b765393621da6816
I20260709 13:21:40.060338 27941 raft_consensus.cc:2804] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:40.060737 27941 raft_consensus.cc:493] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.061100 27941 raft_consensus.cc:3060] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:40.064586 27183 leader_election.cc:336] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:40.065258 27183 leader_election.cc:304] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6; no voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816
W20260709 13:21:40.065474 27331 leader_election.cc:336] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:40.066013 27331 leader_election.cc:304] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:40.066082 27630 raft_consensus.cc:2749] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:40.066205 27183 leader_election.cc:336] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:40.067171 27843 raft_consensus.cc:2749] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:40.063390 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd74c5033db646ea91b4ca463507c3a3" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:40.069308 27996 raft_consensus.cc:493] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.069861 27996 raft_consensus.cc:515] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.070334 27184 leader_election.cc:304] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6; no voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:40.071235 27938 raft_consensus.cc:2749] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:40.072101 27996 leader_election.cc:290] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:40.074920 27362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f684c9c7b4874567b690e70a7ddae640" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:40.075671 27362 raft_consensus.cc:2468] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:40.077998 27934 tablet_bootstrap.cc:492] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:21:40.078655 27257 leader_election.cc:336] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:40.082463 27934 tablet_bootstrap.cc:492] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:40.083225 27934 ts_tablet_manager.cc:1403] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.056s	user 0.023s	sys 0.004s
I20260709 13:21:40.083485 27258 leader_election.cc:304] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: f79efe7c9e6a4384b765393621da6816
I20260709 13:21:40.085884 27996 raft_consensus.cc:2804] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:40.086313 27996 raft_consensus.cc:493] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.086757 27996 raft_consensus.cc:3060] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.084679 27941 raft_consensus.cc:515] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.090238 27934 raft_consensus.cc:359] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.091035 27362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d205fe2cb9d4d319c85bb33f59ca660" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:40.091362 27934 raft_consensus.cc:740] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:40.091732 27362 raft_consensus.cc:3060] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.092411 27934 consensus_queue.cc:260] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.095707 27934 ts_tablet_manager.cc:1434] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:21:40.095530 27996 raft_consensus.cc:515] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.096927 27934 tablet_bootstrap.cc:492] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:40.098737 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f684c9c7b4874567b690e70a7ddae640" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:40.099571 27363 raft_consensus.cc:3060] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.100754 27362 raft_consensus.cc:2468] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 2.
I20260709 13:21:40.105816 27996 leader_election.cc:290] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:40.113626 27941 leader_election.cc:290] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:40.117631 27184 leader_election.cc:304] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:40.120195 27941 raft_consensus.cc:2804] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:40.120791 27941 raft_consensus.cc:697] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:40.121625 27941 consensus_queue.cc:237] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
W20260709 13:21:40.124984 27183 leader_election.cc:336] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
W20260709 13:21:40.123077 27257 leader_election.cc:336] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:40.129542 27843 raft_consensus.cc:493] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.130123 27843 raft_consensus.cc:515] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.132426 27843 leader_election.cc:290] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:40.133800 27843 raft_consensus.cc:493] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.135710 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dc2c568d9642a587b5741241562afe" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:40.136499 27218 raft_consensus.cc:2468] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:40.137336 27363 raft_consensus.cc:2468] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 2.
I20260709 13:21:40.137650 27843 raft_consensus.cc:515] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.138466 27039 catalog_manager.cc:5697] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 1 to 2, leader changed from f79efe7c9e6a4384b765393621da6816 (127.16.188.129) to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:40.139892 27843 leader_election.cc:290] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:40.139860 27332 leader_election.cc:304] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:40.153157 27940 raft_consensus.cc:2804] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:40.153638 27940 raft_consensus.cc:493] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.154090 27940 raft_consensus.cc:3060] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.154913 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2097666912334a53a80b648a0fad2786" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:40.155833 27218 raft_consensus.cc:2468] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:40.157666 27332 leader_election.cc:304] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:40.141701 27258 leader_election.cc:304] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: f79efe7c9e6a4384b765393621da6816
I20260709 13:21:40.158722 27843 raft_consensus.cc:2804] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:40.159291 27843 raft_consensus.cc:493] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.159708 27843 raft_consensus.cc:3060] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.160553 27877 raft_consensus.cc:2804] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:40.161154 27877 raft_consensus.cc:697] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 2 LEADER]: Becoming Leader. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Running, Role: LEADER
W20260709 13:21:40.161185 27331 leader_election.cc:336] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:40.162463 27877 consensus_queue.cc:237] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.140662 27996 raft_consensus.cc:493] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.166128 27996 raft_consensus.cc:515] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:40.173832 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.129:35935
I20260709 13:21:40.175081 28017 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.129:35935 every 8 connection(s)
I20260709 13:21:40.175284 27996 leader_election.cc:290] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:40.178269 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd74c5033db646ea91b4ca463507c3a3" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
W20260709 13:21:40.176138 27331 leader_election.cc:336] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:40.179014 27215 raft_consensus.cc:2468] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:40.180546 27843 raft_consensus.cc:515] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.185108 27843 leader_election.cc:290] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:40.187837 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2097666912334a53a80b648a0fad2786" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:40.188459 27215 raft_consensus.cc:3060] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.192312 27258 leader_election.cc:304] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:40.196456 27935 raft_consensus.cc:2804] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:40.197116 27935 raft_consensus.cc:493] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.197661 27935 raft_consensus.cc:3060] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.208810 27941 raft_consensus.cc:493] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.209452 27941 raft_consensus.cc:515] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.211550 27940 raft_consensus.cc:515] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.212147 27941 leader_election.cc:290] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:40.214774 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ad970eae96417783396e7accb1b834" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:40.219269 27363 raft_consensus.cc:2468] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:40.208199 27215 raft_consensus.cc:2468] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 2.
I20260709 13:21:40.221000 27184 leader_election.cc:304] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:40.222245 27941 raft_consensus.cc:2804] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:40.222741 27941 raft_consensus.cc:493] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.223296 27941 raft_consensus.cc:3060] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.223989 28019 raft_consensus.cc:493] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.224938 28019 raft_consensus.cc:515] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.228498 28019 leader_election.cc:290] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:40.231580 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32e5371db8c4a95ab423532604c6f33" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:40.232600 27363 raft_consensus.cc:2468] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:40.234874 27258 leader_election.cc:304] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:40.236343 28019 raft_consensus.cc:2804] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:40.236869 28019 raft_consensus.cc:493] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.237278 28019 raft_consensus.cc:3060] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.240274 27940 leader_election.cc:290] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:40.241192 27996 raft_consensus.cc:493] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.243103 27996 raft_consensus.cc:515] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.244598 27934 tablet_bootstrap.cc:492] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:40.245122 27996 leader_election.cc:290] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:40.245570 27934 tablet_bootstrap.cc:492] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:40.246246 27934 ts_tablet_manager.cc:1403] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.150s	user 0.022s	sys 0.002s
I20260709 13:21:40.248261 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a2e2e4269146dd8e2bf720a1c890d8" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:40.248961 27363 raft_consensus.cc:2468] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:40.248847 27934 raft_consensus.cc:359] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.249640 27934 raft_consensus.cc:740] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:40.250406 27934 consensus_queue.cc:260] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.243642 27332 leader_election.cc:304] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:40.254897 27258 leader_election.cc:304] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:40.241719 27935 raft_consensus.cc:515] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:40.263255 27996 raft_consensus.cc:2804] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:40.252743 27934 ts_tablet_manager.cc:1434] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:21:40.266027 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dc2c568d9642a587b5741241562afe" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:40.266707 27218 raft_consensus.cc:3060] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.268146 27934 tablet_bootstrap.cc:492] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:40.263803 27996 raft_consensus.cc:493] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.281072 27996 raft_consensus.cc:3060] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.280158 27877 raft_consensus.cc:493] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.302145 27218 raft_consensus.cc:2468] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 2.
I20260709 13:21:40.303369 27332 leader_election.cc:304] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:40.305016 27843 raft_consensus.cc:2804] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:40.305505 27843 raft_consensus.cc:697] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 2 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:40.306380 27843 consensus_queue.cc:237] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.310285 27941 raft_consensus.cc:515] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.316210 27041 catalog_manager.cc:5697] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 1 to 2, leader changed from f79efe7c9e6a4384b765393621da6816 (127.16.188.129) to 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "2d8e002e04a74c2598405158a99d86c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:40.320474 28024 raft_consensus.cc:2804] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:40.331147 27827 raft_consensus.cc:493] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.331873 27827 raft_consensus.cc:515] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:40.334544 27827 leader_election.cc:290] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:40.291572 27877 raft_consensus.cc:515] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:40.366056 27288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:40.367465 27288 raft_consensus.cc:2468] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:40.367590 27941 leader_election.cc:290] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:40.367946 27877 leader_election.cc:290] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:40.369400 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ad970eae96417783396e7accb1b834" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:40.370004 27363 raft_consensus.cc:3060] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.331017 27996 raft_consensus.cc:515] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.383670 28019 raft_consensus.cc:515] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.394289 27836 raft_consensus.cc:493] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.394958 27836 raft_consensus.cc:515] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.395581 27941 raft_consensus.cc:493] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.397127 27935 leader_election.cc:290] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:40.397451 27981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ad970eae96417783396e7accb1b834" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:40.398280 27981 raft_consensus.cc:2468] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:40.399689 27978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:40.396229 27941 raft_consensus.cc:515] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.415572 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:40.427654 27218 raft_consensus.cc:2468] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:40.416180 27184 leader_election.cc:304] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:40.419682 27836 leader_election.cc:290] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:40.420318 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8115282f2b1544e6a930473c43950bc4" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1" is_pre_election: true
I20260709 13:21:40.429145 27292 raft_consensus.cc:2468] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
I20260709 13:21:40.421490 27977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42ad970eae96417783396e7accb1b834" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:40.423257 27215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd74c5033db646ea91b4ca463507c3a3" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
W20260709 13:21:40.428503 27183 leader_election.cc:343] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:40.418421 28024 raft_consensus.cc:697] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 2 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:40.431303 27215 raft_consensus.cc:3060] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.432987 28035 raft_consensus.cc:2804] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:40.433548 28035 raft_consensus.cc:493] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.434090 28035 raft_consensus.cc:3060] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.441005 27361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32e5371db8c4a95ab423532604c6f33" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:40.441931 27361 raft_consensus.cc:3060] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.443392 28024 consensus_queue.cc:237] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.445091 27996 leader_election.cc:290] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:40.445417 27941 leader_election.cc:290] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:40.449065 27934 tablet_bootstrap.cc:492] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:40.453475 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1665cdc23c4af782f4111587dbf68f" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:40.454382 27364 raft_consensus.cc:2468] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 1.
I20260709 13:21:40.460239 27184 leader_election.cc:304] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:40.461810 27827 raft_consensus.cc:2804] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:40.462311 27827 raft_consensus.cc:493] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.462786 27827 raft_consensus.cc:3060] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.470669 27982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1665cdc23c4af782f4111587dbf68f" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:40.460711 27363 raft_consensus.cc:2468] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 2.
I20260709 13:21:40.473062 28035 raft_consensus.cc:515] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:40.475241 27039 catalog_manager.cc:5697] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 reported cstate change: term changed from 1 to 2, leader changed from f79efe7c9e6a4384b765393621da6816 (127.16.188.129) to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 2 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:40.474745 27183 leader_election.cc:343] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:40.477607 27184 leader_election.cc:304] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:40.462085 27977 raft_consensus.cc:3060] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.480448 28034 raft_consensus.cc:2804] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:40.481021 28034 raft_consensus.cc:697] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:40.481957 28034 consensus_queue.cc:237] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.484009 27979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2097666912334a53a80b648a0fad2786" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:40.486387 27983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dc2c568d9642a587b5741241562afe" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:40.487113 27983 raft_consensus.cc:3060] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.487592 27361 raft_consensus.cc:2468] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 2.
I20260709 13:21:40.493924 27934 tablet_bootstrap.cc:492] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:40.494971 27934 ts_tablet_manager.cc:1403] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.229s	user 0.023s	sys 0.000s
I20260709 13:21:40.510609 27215 raft_consensus.cc:2468] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 2.
I20260709 13:21:40.490464 27827 raft_consensus.cc:515] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:40.514636 27981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8115282f2b1544e6a930473c43950bc4" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:40.515525 27981 raft_consensus.cc:2468] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 1.
W20260709 13:21:40.520955 27331 leader_election.cc:343] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:40.525260 28019 leader_election.cc:290] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:40.528789 27973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32e5371db8c4a95ab423532604c6f33" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:40.544194 27039 catalog_manager.cc:5697] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 1 to 2, leader changed from f79efe7c9e6a4384b765393621da6816 (127.16.188.129) to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 2 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:40.529713 27332 leader_election.cc:304] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:40.530611 27980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:40.550702 28037 raft_consensus.cc:2804] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:40.551170 28037 raft_consensus.cc:493] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.551553 28037 raft_consensus.cc:3060] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.550823 27041 catalog_manager.cc:5697] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 1 to 2, leader changed from f79efe7c9e6a4384b765393621da6816 (127.16.188.129) to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:40.555639 27977 raft_consensus.cc:2468] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 2.
I20260709 13:21:40.529717 27978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd74c5033db646ea91b4ca463507c3a3" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:40.533946 27976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd74c5033db646ea91b4ca463507c3a3" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:40.534200 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a2e2e4269146dd8e2bf720a1c890d8" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:40.537254 27979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a2e2e4269146dd8e2bf720a1c890d8" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:40.559044 27363 raft_consensus.cc:3060] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.559139 27979 raft_consensus.cc:3060] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.543479 27981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32e5371db8c4a95ab423532604c6f33" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:40.563315 28035 leader_election.cc:290] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:40.543640 27258 leader_election.cc:304] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:40.528842 27975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a2e2e4269146dd8e2bf720a1c890d8" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:40.567209 27258 leader_election.cc:304] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:40.569031 27934 raft_consensus.cc:359] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.569754 27934 raft_consensus.cc:740] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:40.570556 28019 raft_consensus.cc:2804] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:40.570848 27361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1665cdc23c4af782f4111587dbf68f" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:40.571708 27361 raft_consensus.cc:3060] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.573582 27827 leader_election.cc:290] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:40.575071 28039 raft_consensus.cc:2804] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:40.575498 28039 raft_consensus.cc:493] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:40.575867 28039 raft_consensus.cc:3060] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.579417 27363 raft_consensus.cc:2468] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 2.
I20260709 13:21:40.568501 27983 raft_consensus.cc:2468] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 2.
I20260709 13:21:40.582332 27258 leader_election.cc:304] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:40.583148 28028 raft_consensus.cc:2804] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:40.583631 28028 raft_consensus.cc:697] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 2 LEADER]: Becoming Leader. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Running, Role: LEADER
I20260709 13:21:40.584483 28028 consensus_queue.cc:237] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:40.587894 27983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:40.592453 27361 raft_consensus.cc:2468] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 2.
I20260709 13:21:40.601140 27184 leader_election.cc:304] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:40.602032 27938 raft_consensus.cc:2804] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:40.602845 27938 raft_consensus.cc:697] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:40.603766 27938 consensus_queue.cc:237] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
W20260709 13:21:40.604156 27257 leader_election.cc:343] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:40.605971 27979 raft_consensus.cc:2468] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 2.
I20260709 13:21:40.602043 27976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1665cdc23c4af782f4111587dbf68f" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:40.597026 27934 consensus_queue.cc:260] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
W20260709 13:21:40.606041 27257 leader_election.cc:343] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:40.607134 28037 raft_consensus.cc:515] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.608682 27934 ts_tablet_manager.cc:1434] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.113s	user 0.006s	sys 0.003s
I20260709 13:21:40.609580 27934 tablet_bootstrap.cc:492] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:40.610143 28037 leader_election.cc:290] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:40.593155 28019 raft_consensus.cc:697] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 2 LEADER]: Becoming Leader. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Running, Role: LEADER
I20260709 13:21:40.597936 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:40.611747 27288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8115282f2b1544e6a930473c43950bc4" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:40.611621 28019 consensus_queue.cc:237] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.612397 27288 raft_consensus.cc:3060] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:40.617836 27183 leader_election.cc:343] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:40.621388 27288 raft_consensus.cc:2468] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 2.
W20260709 13:21:40.621897 27257 leader_election.cc:343] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:40.627308 27258 leader_election.cc:304] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:40.625917 28039 raft_consensus.cc:515] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
W20260709 13:21:40.630390 27183 leader_election.cc:343] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:40.631431 27292 raft_consensus.cc:2393] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 05f7e02ff65b470591cb5d9565f123d6 in current term 2: Already voted for candidate 2d8e002e04a74c2598405158a99d86c1 in this term.
I20260709 13:21:40.628204 27996 raft_consensus.cc:2804] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:40.634892 27996 raft_consensus.cc:697] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 2 LEADER]: Becoming Leader. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Running, Role: LEADER
I20260709 13:21:40.636062 27996 consensus_queue.cc:237] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.640959 27979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8115282f2b1544e6a930473c43950bc4" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:40.641749 27979 raft_consensus.cc:3060] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:40.654361 27979 raft_consensus.cc:2468] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 2.
I20260709 13:21:40.655897 27361 raft_consensus.cc:1275] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer 2d8e002e04a74c2598405158a99d86c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:21:40.639539 27257 leader_election.cc:343] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:40.655334 28039 leader_election.cc:290] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:40.657245 27184 leader_election.cc:304] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6; no voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:40.657869 27331 leader_election.cc:304] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:40.658469 27827 raft_consensus.cc:2749] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:40.660470 28039 consensus_queue.cc:1048] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:40.661350 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:40.662425 27217 raft_consensus.cc:2393] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d8e002e04a74c2598405158a99d86c1 in current term 2: Already voted for candidate 05f7e02ff65b470591cb5d9565f123d6 in this term.
I20260709 13:21:40.663986 28041 raft_consensus.cc:2804] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:40.664615 28041 raft_consensus.cc:697] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 2 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:40.665632 28041 consensus_queue.cc:237] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.661298 27041 catalog_manager.cc:5697] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 1 to 2, leader changed from f79efe7c9e6a4384b765393621da6816 (127.16.188.129) to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:40.678104 27257 leader_election.cc:343] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:40.698618 27039 catalog_manager.cc:5697] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 1 to 2, leader changed from f79efe7c9e6a4384b765393621da6816 (127.16.188.129) to 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "2d8e002e04a74c2598405158a99d86c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:40.715401 27979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:40.718950 28021 heartbeater.cc:344] Connected to a master server at 127.16.188.190:42581
I20260709 13:21:40.719470 28021 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:40.720558 28021 heartbeater.cc:507] Master 127.16.188.190:42581 requested a full tablet report, sending...
W20260709 13:21:40.720662 27257 consensus_peers.cc:597] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:40.721376 27257 leader_election.cc:343] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:40.721756 27257 leader_election.cc:304] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:40.723455 27996 raft_consensus.cc:2749] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:40.732864 27363 raft_consensus.cc:1275] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer 05f7e02ff65b470591cb5d9565f123d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:40.730985 27041 catalog_manager.cc:5697] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 reported cstate change: term changed from 1 to 2, leader changed from f79efe7c9e6a4384b765393621da6816 (127.16.188.129) to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 2 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:40.734400 27827 consensus_queue.cc:1048] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:40.752529 27039 ts_manager.cc:194] Re-registered known tserver with Master: f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
W20260709 13:21:40.749603 27183 consensus_peers.cc:597] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.762177 27983 raft_consensus.cc:1275] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Refusing update from remote peer 1962786a39404929920d966805e48399: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:40.764710 28041 consensus_queue.cc:1048] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:40.770051 27934 tablet_bootstrap.cc:492] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:40.771248 27934 tablet_bootstrap.cc:492] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:40.771994 27934 ts_tablet_manager.cc:1403] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.163s	user 0.026s	sys 0.016s
I20260709 13:21:40.783349 27038 catalog_manager.cc:5697] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 1 to 2, leader changed from f79efe7c9e6a4384b765393621da6816 (127.16.188.129) to 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "2d8e002e04a74c2598405158a99d86c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:40.785787 27038 catalog_manager.cc:5697] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 1 to 2, leader changed from f79efe7c9e6a4384b765393621da6816 (127.16.188.129) to 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "2d8e002e04a74c2598405158a99d86c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:40.792115 27934 raft_consensus.cc:359] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:40.792991 27934 raft_consensus.cc:740] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:40.793695 27934 consensus_queue.cc:260] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:40.810846 27934 ts_tablet_manager.cc:1434] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:21:40.811841 27934 tablet_bootstrap.cc:492] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:40.818145 27217 raft_consensus.cc:1275] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Refusing update from remote peer 1962786a39404929920d966805e48399: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:40.819736 27940 consensus_queue.cc:1048] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:40.877499 27331 consensus_peers.cc:597] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:40.893414 27934 tablet_bootstrap.cc:492] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:40.894692 27934 tablet_bootstrap.cc:492] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:40.899590 27934 ts_tablet_manager.cc:1403] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.008s
I20260709 13:21:40.903404 27215 raft_consensus.cc:1275] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Refusing update from remote peer 1962786a39404929920d966805e48399: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:40.903723 27934 raft_consensus.cc:359] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.904625 27934 raft_consensus.cc:740] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:40.905467 27934 consensus_queue.cc:260] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.905941 28041 consensus_queue.cc:1048] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:40.907312 27934 ts_tablet_manager.cc:1434] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:40.908120 27934 tablet_bootstrap.cc:492] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:40.928726 27934 tablet_bootstrap.cc:492] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:40.929626 27934 tablet_bootstrap.cc:492] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:40.930233 27934 ts_tablet_manager.cc:1403] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 13:21:40.932637 27934 raft_consensus.cc:359] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:40.935039 27934 raft_consensus.cc:740] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:40.935791 27934 consensus_queue.cc:260] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:40.938354 27934 ts_tablet_manager.cc:1434] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:40.939175 27934 tablet_bootstrap.cc:492] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:40.951331 27039 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43066
I20260709 13:21:40.958293 28021 heartbeater.cc:499] Master 127.16.188.190:42581 was elected leader, sending a full tablet report...
I20260709 13:21:40.966923 27934 tablet_bootstrap.cc:492] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:40.967895 27934 tablet_bootstrap.cc:492] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:40.968549 27934 ts_tablet_manager.cc:1403] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.008s
I20260709 13:21:40.970587 27934 raft_consensus.cc:359] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.971225 27934 raft_consensus.cc:740] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:40.972271 27934 consensus_queue.cc:260] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:40.974202 27934 ts_tablet_manager.cc:1434] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:40.975005 27934 tablet_bootstrap.cc:492] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:40.987305 27934 tablet_bootstrap.cc:492] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:40.987983 27934 tablet_bootstrap.cc:492] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:40.988461 27934 ts_tablet_manager.cc:1403] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:21:40.990314 27934 raft_consensus.cc:359] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:40.990787 27934 raft_consensus.cc:740] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:40.991284 27934 consensus_queue.cc:260] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:40.992740 27934 ts_tablet_manager.cc:1434] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:40.993347 27934 tablet_bootstrap.cc:492] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.005336 27934 tablet_bootstrap.cc:492] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.006042 27934 tablet_bootstrap.cc:492] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.006521 27934 ts_tablet_manager.cc:1403] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.002s
I20260709 13:21:41.008190 27934 raft_consensus.cc:359] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.008719 27934 raft_consensus.cc:740] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.009227 27934 consensus_queue.cc:260] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.010788 27934 ts_tablet_manager.cc:1434] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:21:41.011389 27934 tablet_bootstrap.cc:492] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.022660 27934 tablet_bootstrap.cc:492] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.023538 27934 tablet_bootstrap.cc:492] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.024188 27934 ts_tablet_manager.cc:1403] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:21:41.026504 27934 raft_consensus.cc:359] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.027107 27934 raft_consensus.cc:740] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.027742 27934 consensus_queue.cc:260] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.029788 27934 ts_tablet_manager.cc:1434] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:21:41.030620 27934 tablet_bootstrap.cc:492] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
W20260709 13:21:41.045046 27257 consensus_peers.cc:597] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:41.046423 27361 raft_consensus.cc:1275] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer 05f7e02ff65b470591cb5d9565f123d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:41.046532 27934 tablet_bootstrap.cc:492] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.047598 27934 tablet_bootstrap.cc:492] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.047924 28035 consensus_queue.cc:1048] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:41.048269 27934 ts_tablet_manager.cc:1403] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 13:21:41.052697 27934 raft_consensus.cc:359] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.053644 27934 raft_consensus.cc:740] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.054574 27934 consensus_queue.cc:260] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.056859 27934 ts_tablet_manager.cc:1434] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:41.057915 27934 tablet_bootstrap.cc:492] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.061483 27979 raft_consensus.cc:1275] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Refusing update from remote peer 05f7e02ff65b470591cb5d9565f123d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:41.071401 27938 consensus_queue.cc:1048] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:41.079322 27363 raft_consensus.cc:1275] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer 2d8e002e04a74c2598405158a99d86c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:41.080696 28019 consensus_queue.cc:1048] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:41.081470 27183 consensus_peers.cc:597] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:41.106081 27976 raft_consensus.cc:1275] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Refusing update from remote peer 2d8e002e04a74c2598405158a99d86c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:41.107939 27877 consensus_queue.cc:1048] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:41.111889 27934 tablet_bootstrap.cc:492] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.112923 27934 tablet_bootstrap.cc:492] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.113557 27934 ts_tablet_manager.cc:1403] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.031s
I20260709 13:21:41.116255 27934 raft_consensus.cc:359] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.116950 27934 raft_consensus.cc:740] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.117573 27934 consensus_queue.cc:260] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.119062 27934 ts_tablet_manager.cc:1434] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:21:41.119920 27934 tablet_bootstrap.cc:492] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.120249 27363 raft_consensus.cc:1275] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer 05f7e02ff65b470591cb5d9565f123d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:41.122123 27827 consensus_queue.cc:1048] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:41.148324 27215 raft_consensus.cc:1275] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Refusing update from remote peer 2d8e002e04a74c2598405158a99d86c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:41.150295 27877 consensus_queue.cc:1048] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:41.152365 27983 raft_consensus.cc:1275] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Refusing update from remote peer 1962786a39404929920d966805e48399: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:41.154131 28041 consensus_queue.cc:1048] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:41.180017 27292 raft_consensus.cc:1275] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Refusing update from remote peer 1962786a39404929920d966805e48399: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:41.204056 28041 consensus_queue.cc:1048] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:41.205143 27361 raft_consensus.cc:1275] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer 2d8e002e04a74c2598405158a99d86c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:21:41.207430 28073 log.cc:927] Time spent T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:21:41.207711 28019 consensus_queue.cc:1048] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:41.215258 27934 tablet_bootstrap.cc:492] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.216289 27934 tablet_bootstrap.cc:492] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.216951 27934 ts_tablet_manager.cc:1403] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.097s	user 0.031s	sys 0.039s
I20260709 13:21:41.242251 27977 raft_consensus.cc:3060] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:41.244604 27934 raft_consensus.cc:359] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.245674 27934 raft_consensus.cc:740] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.247118 27934 consensus_queue.cc:260] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.249861 27934 ts_tablet_manager.cc:1434] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:21:41.253331 27934 tablet_bootstrap.cc:492] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.270744 27977 raft_consensus.cc:1275] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Refusing update from remote peer 2d8e002e04a74c2598405158a99d86c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:41.279632 28028 consensus_queue.cc:1048] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:41.291795 27934 tablet_bootstrap.cc:492] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:21:41.292501 27183 consensus_peers.cc:597] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:41.292780 27934 tablet_bootstrap.cc:492] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.293476 27934 ts_tablet_manager.cc:1403] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.015s
I20260709 13:21:41.296030 27934 raft_consensus.cc:359] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:41.297012 27934 raft_consensus.cc:740] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.297642 27934 consensus_queue.cc:260] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:41.299599 27934 ts_tablet_manager.cc:1434] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:21:41.300328 27934 tablet_bootstrap.cc:492] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.325167 27934 tablet_bootstrap.cc:492] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:21:41.326084 27183 consensus_peers.cc:597] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:41.326316 27934 tablet_bootstrap.cc:492] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.327307 27934 ts_tablet_manager.cc:1403] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.004s
I20260709 13:21:41.330087 27934 raft_consensus.cc:359] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:41.330819 27934 raft_consensus.cc:740] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.331473 27934 consensus_queue.cc:260] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:41.333568 27934 ts_tablet_manager.cc:1434] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:41.334412 27934 tablet_bootstrap.cc:492] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.350834 27934 tablet_bootstrap.cc:492] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.351605 27934 tablet_bootstrap.cc:492] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.352150 27934 ts_tablet_manager.cc:1403] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.008s
I20260709 13:21:41.354395 27934 raft_consensus.cc:359] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:41.354888 27934 raft_consensus.cc:740] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.355510 27934 consensus_queue.cc:260] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:41.357560 27934 ts_tablet_manager.cc:1434] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:21:41.358686 27934 tablet_bootstrap.cc:492] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
W20260709 13:21:41.371125 27257 consensus_peers.cc:597] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:41.372851 27934 tablet_bootstrap.cc:492] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.373848 27934 tablet_bootstrap.cc:492] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.374455 27934 ts_tablet_manager.cc:1403] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:21:41.376997 27934 raft_consensus.cc:359] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.377638 27934 raft_consensus.cc:740] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.378285 27934 consensus_queue.cc:260] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.379827 27934 ts_tablet_manager.cc:1434] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:21:41.381101 27934 tablet_bootstrap.cc:492] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.400887 27934 tablet_bootstrap.cc:492] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.401963 27934 tablet_bootstrap.cc:492] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.402745 27934 ts_tablet_manager.cc:1403] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 13:21:41.405771 27934 raft_consensus.cc:359] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.406533 27934 raft_consensus.cc:740] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.407238 27934 consensus_queue.cc:260] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.409601 27934 ts_tablet_manager.cc:1434] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:21:41.410780 27934 tablet_bootstrap.cc:492] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
W20260709 13:21:41.415980 27183 consensus_peers.cc:597] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:41.421465 27983 raft_consensus.cc:3060] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:41.433148 27934 tablet_bootstrap.cc:492] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.434386 27934 tablet_bootstrap.cc:492] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.435910 27934 ts_tablet_manager.cc:1403] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 13:21:41.438975 27934 raft_consensus.cc:359] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.439743 27934 raft_consensus.cc:740] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.440567 27934 consensus_queue.cc:260] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.442946 27934 ts_tablet_manager.cc:1434] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:41.447306 27934 tablet_bootstrap.cc:492] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.486599 27934 tablet_bootstrap.cc:492] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.487823 27934 tablet_bootstrap.cc:492] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.488639 27934 ts_tablet_manager.cc:1403] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.008s
I20260709 13:21:41.492748 27934 raft_consensus.cc:359] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:41.493530 27934 raft_consensus.cc:740] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.494354 27934 consensus_queue.cc:260] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
W20260709 13:21:41.498328 27183 consensus_peers.cc:597] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:41.497092 27934 ts_tablet_manager.cc:1434] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:41.509588 27934 tablet_bootstrap.cc:492] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.526265 27934 tablet_bootstrap.cc:492] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.527119 27934 tablet_bootstrap.cc:492] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.527778 27934 ts_tablet_manager.cc:1403] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:21:41.530134 27934 raft_consensus.cc:359] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.530721 27934 raft_consensus.cc:740] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.531446 27934 consensus_queue.cc:260] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.533800 27934 ts_tablet_manager.cc:1434] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:21:41.535481 27934 tablet_bootstrap.cc:492] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
W20260709 13:21:41.544914 27331 consensus_peers.cc:597] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:41.551666 27934 tablet_bootstrap.cc:492] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.552754 27934 tablet_bootstrap.cc:492] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.553550 27934 ts_tablet_manager.cc:1403] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:21:41.555620 27934 raft_consensus.cc:359] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.556138 27934 raft_consensus.cc:740] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.556851 27934 consensus_queue.cc:260] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.559401 27934 ts_tablet_manager.cc:1434] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:41.565578 27934 tablet_bootstrap.cc:492] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.582188 27934 tablet_bootstrap.cc:492] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.583189 27934 tablet_bootstrap.cc:492] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.583811 27934 ts_tablet_manager.cc:1403] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:21:41.586165 27934 raft_consensus.cc:359] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.586953 27934 raft_consensus.cc:740] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.587668 27934 consensus_queue.cc:260] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.590267 27934 ts_tablet_manager.cc:1434] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:21:41.592389 27934 tablet_bootstrap.cc:492] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.608323 27934 tablet_bootstrap.cc:492] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.609309 27934 tablet_bootstrap.cc:492] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.610010 27934 ts_tablet_manager.cc:1403] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:21:41.612663 27934 raft_consensus.cc:359] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.613401 27934 raft_consensus.cc:740] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.614019 27934 consensus_queue.cc:260] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.616096 27934 ts_tablet_manager.cc:1434] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:41.617244 27934 tablet_bootstrap.cc:492] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.620031 27983 raft_consensus.cc:3060] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:41.652479 27934 tablet_bootstrap.cc:492] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.653666 27934 tablet_bootstrap.cc:492] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.654352 27934 ts_tablet_manager.cc:1403] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.025s
I20260709 13:21:41.657310 27934 raft_consensus.cc:359] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.657922 27934 raft_consensus.cc:740] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.658560 27934 consensus_queue.cc:260] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.660252 27934 ts_tablet_manager.cc:1434] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:41.661111 27934 tablet_bootstrap.cc:492] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.677573 27934 tablet_bootstrap.cc:492] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.678438 27934 tablet_bootstrap.cc:492] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.679235 27934 ts_tablet_manager.cc:1403] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.008s
I20260709 13:21:41.683218 27934 raft_consensus.cc:359] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.683815 27934 raft_consensus.cc:740] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.684574 27934 consensus_queue.cc:260] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.686358 27934 ts_tablet_manager.cc:1434] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:21:41.686986 27934 tablet_bootstrap.cc:492] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.697784 27983 raft_consensus.cc:3060] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:41.702663 27934 tablet_bootstrap.cc:492] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.703632 27934 tablet_bootstrap.cc:492] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.704223 27934 ts_tablet_manager.cc:1403] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.005s
I20260709 13:21:41.706527 27934 raft_consensus.cc:359] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:41.707278 27934 raft_consensus.cc:740] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.707998 27934 consensus_queue.cc:260] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:41.710486 27934 ts_tablet_manager.cc:1434] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:41.715298 27934 tablet_bootstrap.cc:492] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.751310 27934 tablet_bootstrap.cc:492] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.752345 27934 tablet_bootstrap.cc:492] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.753144 27934 ts_tablet_manager.cc:1403] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.038s	user 0.030s	sys 0.004s
I20260709 13:21:41.755769 27934 raft_consensus.cc:359] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:41.756456 27934 raft_consensus.cc:740] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.757184 27934 consensus_queue.cc:260] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:41.768306 27934 ts_tablet_manager.cc:1434] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:21:41.769918 27934 tablet_bootstrap.cc:492] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.788488 27934 tablet_bootstrap.cc:492] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.789383 27934 tablet_bootstrap.cc:492] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.789986 27934 ts_tablet_manager.cc:1403] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.003s
I20260709 13:21:41.791985 27934 raft_consensus.cc:359] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.792507 27934 raft_consensus.cc:740] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.793211 27934 consensus_queue.cc:260] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.795173 27934 ts_tablet_manager.cc:1434] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:41.796407 27934 tablet_bootstrap.cc:492] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.816632 27934 tablet_bootstrap.cc:492] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.817715 27934 tablet_bootstrap.cc:492] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.818305 27934 ts_tablet_manager.cc:1403] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:21:41.820693 27934 raft_consensus.cc:359] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:41.821344 27934 raft_consensus.cc:740] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.822227 27934 consensus_queue.cc:260] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:41.824833 27934 ts_tablet_manager.cc:1434] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:21:41.826366 27934 tablet_bootstrap.cc:492] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.842047 27934 tablet_bootstrap.cc:492] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.843030 27934 tablet_bootstrap.cc:492] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.843971 27934 ts_tablet_manager.cc:1403] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:21:41.846648 27934 raft_consensus.cc:359] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.847333 27934 raft_consensus.cc:740] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.848101 27934 consensus_queue.cc:260] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:41.850524 27934 ts_tablet_manager.cc:1434] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:41.851316 27934 tablet_bootstrap.cc:492] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816: Bootstrap starting.
I20260709 13:21:41.880661 27934 tablet_bootstrap.cc:492] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:41.882261 27934 tablet_bootstrap.cc:492] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816: Bootstrap complete.
I20260709 13:21:41.882992 27934 ts_tablet_manager.cc:1403] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.009s
I20260709 13:21:41.886667 27934 raft_consensus.cc:359] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.887377 27934 raft_consensus.cc:740] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Initialized, Role: FOLLOWER
I20260709 13:21:41.888047 27934 consensus_queue.cc:260] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:41.890615 27934 ts_tablet_manager.cc:1434] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:42.093973 27977 raft_consensus.cc:3060] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:42.148772 27977 raft_consensus.cc:3060] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:42.286931 28028 raft_consensus.cc:493] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:42.287412 28028 raft_consensus.cc:515] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:42.289539 28028 leader_election.cc:290] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:42.290302 27977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816" is_pre_election: true
I20260709 13:21:42.290449 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6" is_pre_election: true
I20260709 13:21:42.291162 27217 raft_consensus.cc:2468] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 2.
I20260709 13:21:42.291136 27977 raft_consensus.cc:2468] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 1.
I20260709 13:21:42.292647 27258 leader_election.cc:304] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:42.293380 28028 raft_consensus.cc:2804] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:42.293773 28028 raft_consensus.cc:493] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:42.294085 28028 raft_consensus.cc:3060] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:42.302309 28028 raft_consensus.cc:515] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:42.304486 28028 leader_election.cc:290] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 3 election: Requested vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:42.310072 27977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f79efe7c9e6a4384b765393621da6816"
I20260709 13:21:42.310848 27977 raft_consensus.cc:3060] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:21:42.315264 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "add22a21c5bf424390df6d87617a47e7" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:42.315958 27217 raft_consensus.cc:3060] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:42.319134 27977 raft_consensus.cc:2468] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 3.
I20260709 13:21:42.320439 27257 leader_election.cc:304] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:42.321331 28028 raft_consensus.cc:2804] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:42.321893 28028 raft_consensus.cc:697] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 3 LEADER]: Becoming Leader. State: Replica: 2d8e002e04a74c2598405158a99d86c1, State: Running, Role: LEADER
I20260709 13:21:42.322916 27217 raft_consensus.cc:2468] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 3.
I20260709 13:21:42.322796 28028 consensus_queue.cc:237] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:42.333783 27037 catalog_manager.cc:5697] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 reported cstate change: term changed from 1 to 3, leader changed from f79efe7c9e6a4384b765393621da6816 (127.16.188.129) to 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131). New cstate: current_term: 3 leader_uuid: "2d8e002e04a74c2598405158a99d86c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:42.707691 27977 raft_consensus.cc:1275] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 3 FOLLOWER]: Refusing update from remote peer 2d8e002e04a74c2598405158a99d86c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:42.708979 28028 consensus_queue.cc:1048] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:42.723699 27216 raft_consensus.cc:1275] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Refusing update from remote peer 2d8e002e04a74c2598405158a99d86c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:42.730901 28039 consensus_queue.cc:1048] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:46.687493 27183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:35935, user_credentials={real_user=slave}} blocked reactor thread for 56565.5us
I20260709 13:21:50.437866 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:50.504739 27217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fb491563d1a49ac99c74ae4f6553d26"
dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
mode: GRACEFUL
new_leader_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:49720
I20260709 13:21:50.505561 27217 raft_consensus.cc:606] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Received request to transfer leadership to TS f79efe7c9e6a4384b765393621da6816
I20260709 13:21:50.508704 27217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "315d4de5fc5940f9b5f1d3206e7028c0"
dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
mode: GRACEFUL
new_leader_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:49720
I20260709 13:21:50.509214 27217 raft_consensus.cc:606] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Received request to transfer leadership to TS f79efe7c9e6a4384b765393621da6816
I20260709 13:21:50.511688 27217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d205fe2cb9d4d319c85bb33f59ca660"
dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
mode: GRACEFUL
new_leader_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:49720
I20260709 13:21:50.512048 27217 raft_consensus.cc:606] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Received request to transfer leadership to TS f79efe7c9e6a4384b765393621da6816
I20260709 13:21:50.525261 27361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "992029a58c6b4e9fae2a4024cda34dcd"
dest_uuid: "1962786a39404929920d966805e48399"
mode: GRACEFUL
new_leader_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:38918
I20260709 13:21:50.525972 27361 raft_consensus.cc:606] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 1 LEADER]: Received request to transfer leadership to TS f79efe7c9e6a4384b765393621da6816
I20260709 13:21:50.527529 27940 raft_consensus.cc:993] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399: : Instructing follower f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:50.527982 27940 raft_consensus.cc:1081] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 1 LEADER]: Signalling peer f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:50.529827 27979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "992029a58c6b4e9fae2a4024cda34dcd"
dest_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:46134
I20260709 13:21:50.530475 27217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f72db119dad434b84f9712dc1930f7f"
dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
mode: GRACEFUL
new_leader_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:49720
I20260709 13:21:50.530570 27979 raft_consensus.cc:493] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:50.531275 27979 raft_consensus.cc:3060] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.531312 27217 raft_consensus.cc:606] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Received request to transfer leadership to TS f79efe7c9e6a4384b765393621da6816
I20260709 13:21:50.535936 27217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d93a08da579844d4b341d52ce65113ce"
dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
mode: GRACEFUL
new_leader_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:49720
I20260709 13:21:50.536724 27217 raft_consensus.cc:606] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Received request to transfer leadership to TS f79efe7c9e6a4384b765393621da6816
I20260709 13:21:50.538460 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:21:50.540817 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:50.542313 27979 raft_consensus.cc:515] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:50.544711 27979 leader_election.cc:290] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:50.558480 27361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992029a58c6b4e9fae2a4024cda34dcd" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:50.559301 27361 raft_consensus.cc:3055] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:50.559605 27361 raft_consensus.cc:740] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:50.560482 27361 consensus_queue.cc:260] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:50.561872 27361 raft_consensus.cc:3060] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.569285 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "992029a58c6b4e9fae2a4024cda34dcd" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:50.569828 27217 raft_consensus.cc:3060] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.570641 28137 raft_consensus.cc:993] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6: : Instructing follower f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:50.571313 28137 raft_consensus.cc:1081] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Signalling peer f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:50.573518 27979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "315d4de5fc5940f9b5f1d3206e7028c0"
dest_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:46112
I20260709 13:21:50.574024 27979 raft_consensus.cc:493] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:50.574321 27979 raft_consensus.cc:3060] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.583217 27979 raft_consensus.cc:515] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:50.586107 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315d4de5fc5940f9b5f1d3206e7028c0" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:50.586336 27979 leader_election.cc:290] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:50.586866 27363 raft_consensus.cc:3060] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.587507 27217 raft_consensus.cc:2468] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:50.587898 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315d4de5fc5940f9b5f1d3206e7028c0" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:50.588563 27361 raft_consensus.cc:2468] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:50.588593 27216 raft_consensus.cc:3055] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:50.589816 27931 leader_election.cc:304] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:50.590094 27216 raft_consensus.cc:740] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:50.597890 27363 raft_consensus.cc:2468] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:50.599509 28146 raft_consensus.cc:2804] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:50.600836 27931 leader_election.cc:304] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:50.603128 28148 raft_consensus.cc:2804] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:50.603725 28148 raft_consensus.cc:697] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:50.591109 27216 consensus_queue.cc:260] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:50.604879 28148 consensus_queue.cc:237] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:50.605723 28146 raft_consensus.cc:697] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:50.605892 27216 raft_consensus.cc:3060] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.606917 28146 consensus_queue.cc:237] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:50.617514 27216 raft_consensus.cc:2468] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:50.619652 27037 catalog_manager.cc:5697] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 1 to 2, leader changed from 1962786a39404929920d966805e48399 (127.16.188.132) to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:50.642568 27037 catalog_manager.cc:5697] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 1 to 2, leader changed from 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130) to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:50.756213 28138 raft_consensus.cc:993] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6: : Instructing follower f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:50.756825 28137 raft_consensus.cc:1081] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Signalling peer f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:50.757431 28145 raft_consensus.cc:993] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6: : Instructing follower f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:50.758572 28145 raft_consensus.cc:1081] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Signalling peer f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:50.759482 27979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d93a08da579844d4b341d52ce65113ce"
dest_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:46112
I20260709 13:21:50.760571 27983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f72db119dad434b84f9712dc1930f7f"
dest_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:46112
I20260709 13:21:50.761154 27983 raft_consensus.cc:493] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:50.761497 27983 raft_consensus.cc:3060] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.760164 27979 raft_consensus.cc:493] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:50.764729 27979 raft_consensus.cc:3060] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.767962 28145 raft_consensus.cc:993] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6: : Instructing follower f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:50.768621 28145 raft_consensus.cc:1081] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Signalling peer f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:50.770116 27983 raft_consensus.cc:515] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:50.770597 27977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d205fe2cb9d4d319c85bb33f59ca660"
dest_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:46112
I20260709 13:21:50.771210 27977 raft_consensus.cc:493] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:50.771557 27977 raft_consensus.cc:3060] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:50.772353 27983 leader_election.cc:290] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:50.775622 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f72db119dad434b84f9712dc1930f7f" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:50.776206 27363 raft_consensus.cc:3060] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.779775 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f72db119dad434b84f9712dc1930f7f" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:50.780367 27216 raft_consensus.cc:3055] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:50.780676 27216 raft_consensus.cc:740] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:50.781584 27216 consensus_queue.cc:260] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:50.781675 27977 raft_consensus.cc:515] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:50.782873 27216 raft_consensus.cc:3060] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.785543 27361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d205fe2cb9d4d319c85bb33f59ca660" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:50.786244 27361 raft_consensus.cc:3060] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:50.786214 27979 raft_consensus.cc:515] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:50.788818 27979 leader_election.cc:290] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:50.791290 27216 raft_consensus.cc:2468] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:50.793028 27363 raft_consensus.cc:2468] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:50.794587 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93a08da579844d4b341d52ce65113ce" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:50.794808 27931 leader_election.cc:304] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:50.795812 27217 raft_consensus.cc:3055] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:50.796627 27217 raft_consensus.cc:740] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:50.797672 27217 consensus_queue.cc:260] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:50.799207 27217 raft_consensus.cc:3060] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.799304 27361 raft_consensus.cc:2468] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 3.
I20260709 13:21:50.796152 28148 raft_consensus.cc:2804] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:50.800653 27977 leader_election.cc:290] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 3 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:50.801493 28148 raft_consensus.cc:697] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:50.800788 27931 leader_election.cc:304] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:50.803128 28148 consensus_queue.cc:237] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:50.806272 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d205fe2cb9d4d319c85bb33f59ca660" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:50.806775 27216 raft_consensus.cc:3055] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:50.807260 27216 raft_consensus.cc:740] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:50.807679 28146 raft_consensus.cc:2804] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:50.808109 27216 consensus_queue.cc:260] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:50.808415 28146 raft_consensus.cc:697] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 3 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:50.809870 27216 raft_consensus.cc:3060] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:50.809613 28146 consensus_queue.cc:237] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:50.816850 27216 raft_consensus.cc:2468] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 3.
I20260709 13:21:50.819321 27217 raft_consensus.cc:2468] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:50.820813 27931 leader_election.cc:304] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:50.820907 27292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93a08da579844d4b341d52ce65113ce" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:50.821624 27292 raft_consensus.cc:3060] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.821663 28148 raft_consensus.cc:2804] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:50.822484 28148 raft_consensus.cc:697] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:50.823699 28148 consensus_queue.cc:237] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:50.831331 27292 raft_consensus.cc:2468] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:50.840245 27037 catalog_manager.cc:5697] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 1 to 2, leader changed from 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130) to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:50.842015 27037 catalog_manager.cc:5697] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 2 to 3, leader changed from 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130) to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 3 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:50.844408 27037 catalog_manager.cc:5697] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 1 to 2, leader changed from 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130) to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:50.959545 28145 raft_consensus.cc:993] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6: : Instructing follower f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:50.960184 28137 raft_consensus.cc:1081] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Signalling peer f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:50.962042 27977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fb491563d1a49ac99c74ae4f6553d26"
dest_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:46112
I20260709 13:21:50.962684 27977 raft_consensus.cc:493] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:50.963068 27977 raft_consensus.cc:3060] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.971552 27977 raft_consensus.cc:515] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:50.974136 27361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb491563d1a49ac99c74ae4f6553d26" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:50.974613 27361 raft_consensus.cc:3060] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.975029 27977 leader_election.cc:290] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:50.976243 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fb491563d1a49ac99c74ae4f6553d26" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:50.976960 27217 raft_consensus.cc:3055] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:50.977277 27217 raft_consensus.cc:740] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:50.978191 27217 consensus_queue.cc:260] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:50.979806 27217 raft_consensus.cc:3060] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:50.982347 27361 raft_consensus.cc:2468] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:50.983711 27931 leader_election.cc:304] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:50.985498 28148 raft_consensus.cc:2804] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:50.986093 28148 raft_consensus.cc:697] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:50.987154 28148 consensus_queue.cc:237] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:51.003104 27217 raft_consensus.cc:2468] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:51.006228 27037 catalog_manager.cc:5697] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 1 to 2, leader changed from 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130) to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:51.094631 27361 raft_consensus.cc:1275] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:51.096135 28148 consensus_queue.cc:1048] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:51.109304 27216 raft_consensus.cc:1275] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:51.115125 28146 consensus_queue.cc:1048] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:51.191394 27361 raft_consensus.cc:1275] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:51.192662 28146 consensus_queue.cc:1048] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:51.202838 27216 raft_consensus.cc:1275] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:51.204733 28166 consensus_queue.cc:1048] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:51.210203 27217 raft_consensus.cc:1275] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:51.215806 28146 consensus_queue.cc:1048] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:51.223059 27292 raft_consensus.cc:1275] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:51.226424 28146 consensus_queue.cc:1048] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:51.314769 27217 raft_consensus.cc:1275] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:51.315992 28166 consensus_queue.cc:1048] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:51.324994 27361 raft_consensus.cc:1275] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:51.326519 28146 consensus_queue.cc:1048] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:51.342124 27363 raft_consensus.cc:1275] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:51.344595 28166 consensus_queue.cc:1048] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:51.357486 27217 raft_consensus.cc:1275] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:51.358871 28146 consensus_queue.cc:1048] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:51.478544 27217 raft_consensus.cc:1275] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:51.479882 28146 consensus_queue.cc:1048] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:51.491600 27361 raft_consensus.cc:1275] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:51.493520 28146 consensus_queue.cc:1048] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:51.541996 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:51.619079 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:51.660754 27363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fade412cd974138979c417dd233c35a"
dest_uuid: "1962786a39404929920d966805e48399"
mode: GRACEFUL
new_leader_uuid: "05f7e02ff65b470591cb5d9565f123d6"
 from {username='slave'} at 127.0.0.1:38918
I20260709 13:21:51.661307 27363 raft_consensus.cc:606] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 1 LEADER]: Received request to transfer leadership to TS 05f7e02ff65b470591cb5d9565f123d6
I20260709 13:21:51.665361 27217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6df6aa2911c94954949e3b8283d1d2e1"
dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
mode: GRACEFUL
new_leader_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:49720
I20260709 13:21:51.665867 27217 raft_consensus.cc:606] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Received request to transfer leadership to TS f79efe7c9e6a4384b765393621da6816
I20260709 13:21:51.668411 27363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "728a1fd5a8c84cb19f6691fc08e1eeef"
dest_uuid: "1962786a39404929920d966805e48399"
mode: GRACEFUL
new_leader_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:38918
I20260709 13:21:51.668931 27363 raft_consensus.cc:606] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 1 LEADER]: Received request to transfer leadership to TS f79efe7c9e6a4384b765393621da6816
I20260709 13:21:51.671262 27363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76efc04736174df4a18381faaf044830"
dest_uuid: "1962786a39404929920d966805e48399"
mode: GRACEFUL
new_leader_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:38918
I20260709 13:21:51.671703 27363 raft_consensus.cc:606] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Received request to transfer leadership to TS f79efe7c9e6a4384b765393621da6816
I20260709 13:21:51.674206 27217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8bc3f6a11ae4b85870951a4ef079571"
dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
mode: GRACEFUL
new_leader_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:49720
I20260709 13:21:51.674721 27217 raft_consensus.cc:606] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Received request to transfer leadership to TS f79efe7c9e6a4384b765393621da6816
I20260709 13:21:51.675825 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:51.677793 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:51.797964 28132 raft_consensus.cc:993] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399: : Instructing follower f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:51.798619 27940 raft_consensus.cc:1081] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Signalling peer f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:51.799947 27979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76efc04736174df4a18381faaf044830"
dest_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:46134
I20260709 13:21:51.800390 27979 raft_consensus.cc:493] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:51.800717 27979 raft_consensus.cc:3060] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:51.805469 27979 raft_consensus.cc:515] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:51.807221 27979 leader_election.cc:290] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:51.808997 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76efc04736174df4a18381faaf044830" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:51.809409 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76efc04736174df4a18381faaf044830" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:51.809720 27290 raft_consensus.cc:3060] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:51.810115 27363 raft_consensus.cc:3055] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:51.810442 27363 raft_consensus.cc:740] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:51.812978 27363 consensus_queue.cc:260] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:51.814146 27363 raft_consensus.cc:3060] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:51.823506 27363 raft_consensus.cc:2468] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:51.825150 27931 leader_election.cc:304] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:51.826745 28166 raft_consensus.cc:2804] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:51.827230 28166 raft_consensus.cc:697] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:51.828127 28166 consensus_queue.cc:237] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:51.829911 27290 raft_consensus.cc:2468] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:51.843804 27039 catalog_manager.cc:5697] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 1 to 2, leader changed from 1962786a39404929920d966805e48399 (127.16.188.132) to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:51.861430 28145 raft_consensus.cc:993] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6: : Instructing follower f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:51.861940 28137 raft_consensus.cc:1081] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Signalling peer f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:51.863386 27979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8bc3f6a11ae4b85870951a4ef079571"
dest_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:46112
I20260709 13:21:51.863909 27979 raft_consensus.cc:493] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:51.864213 27979 raft_consensus.cc:3060] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:51.870611 27979 raft_consensus.cc:515] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:51.872061 27979 leader_election.cc:290] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:51.872792 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bc3f6a11ae4b85870951a4ef079571" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:51.873088 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bc3f6a11ae4b85870951a4ef079571" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:51.873620 27363 raft_consensus.cc:3060] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:51.873759 27217 raft_consensus.cc:3055] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:51.874202 27217 raft_consensus.cc:740] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:51.875178 27217 consensus_queue.cc:260] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:51.876487 27217 raft_consensus.cc:3060] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:51.879734 27363 raft_consensus.cc:2468] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:51.881115 27931 leader_election.cc:304] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:51.881871 28166 raft_consensus.cc:2804] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:51.882378 28166 raft_consensus.cc:697] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:51.883235 28166 consensus_queue.cc:237] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:51.883939 27217 raft_consensus.cc:2468] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:51.894501 27039 catalog_manager.cc:5697] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 1 to 2, leader changed from 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130) to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:51.968231 28175 raft_consensus.cc:993] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399: : Instructing follower f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:51.968775 28175 raft_consensus.cc:1081] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 1 LEADER]: Signalling peer f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:51.970497 27977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "728a1fd5a8c84cb19f6691fc08e1eeef"
dest_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:46134
I20260709 13:21:51.971072 27977 raft_consensus.cc:493] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:51.971467 27977 raft_consensus.cc:3060] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:51.977499 27977 raft_consensus.cc:515] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:51.979043 27977 leader_election.cc:290] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:51.979840 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728a1fd5a8c84cb19f6691fc08e1eeef" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:51.980171 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728a1fd5a8c84cb19f6691fc08e1eeef" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:51.980568 27290 raft_consensus.cc:3060] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:51.980702 27363 raft_consensus.cc:3055] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:51.981087 27363 raft_consensus.cc:740] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:51.981827 27363 consensus_queue.cc:260] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:51.983107 27363 raft_consensus.cc:3060] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:51.990700 27290 raft_consensus.cc:2468] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:51.990739 27363 raft_consensus.cc:2468] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:51.991968 27931 leader_election.cc:304] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:51.992758 28166 raft_consensus.cc:2804] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:51.993273 28166 raft_consensus.cc:697] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:51.994112 28166 consensus_queue.cc:237] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:52.006794 27039 catalog_manager.cc:5697] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 1 to 2, leader changed from 1962786a39404929920d966805e48399 (127.16.188.132) to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:52.135288 28132 raft_consensus.cc:993] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399: : Instructing follower 05f7e02ff65b470591cb5d9565f123d6 to start an election
I20260709 13:21:52.135722 28175 raft_consensus.cc:1081] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 1 LEADER]: Signalling peer 05f7e02ff65b470591cb5d9565f123d6 to start an election
I20260709 13:21:52.137020 27217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fade412cd974138979c417dd233c35a"
dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
 from {username='slave'} at 127.0.0.1:56492
I20260709 13:21:52.137468 27217 raft_consensus.cc:493] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:52.137806 27217 raft_consensus.cc:3060] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:52.140964 28137 raft_consensus.cc:993] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6: : Instructing follower f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:52.141588 28184 raft_consensus.cc:1081] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Signalling peer f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:52.143178 27979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6df6aa2911c94954949e3b8283d1d2e1"
dest_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:46112
I20260709 13:21:52.143777 27979 raft_consensus.cc:493] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:52.143679 27217 raft_consensus.cc:515] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:52.144248 27979 raft_consensus.cc:3060] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:52.145996 27217 leader_election.cc:290] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:52.147009 27363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fade412cd974138979c417dd233c35a" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:52.147285 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fade412cd974138979c417dd233c35a" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:52.147598 27363 raft_consensus.cc:3055] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:52.147843 27290 raft_consensus.cc:3060] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:52.147925 27363 raft_consensus.cc:740] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:52.148790 27363 consensus_queue.cc:260] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:52.151229 27363 raft_consensus.cc:3060] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:52.154142 27979 raft_consensus.cc:515] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:52.154781 27290 raft_consensus.cc:2468] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 2.
I20260709 13:21:52.156080 27184 leader_election.cc:304] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:52.157392 27361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6df6aa2911c94954949e3b8283d1d2e1" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:52.157640 27363 raft_consensus.cc:2468] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 2.
I20260709 13:21:52.158095 27361 raft_consensus.cc:3060] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:52.158627 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6df6aa2911c94954949e3b8283d1d2e1" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:52.159261 27217 raft_consensus.cc:3055] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:52.159549 27217 raft_consensus.cc:740] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:52.160391 27217 consensus_queue.cc:260] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:52.161546 27217 raft_consensus.cc:3060] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:52.156038 27979 leader_election.cc:290] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:52.168917 28137 raft_consensus.cc:2804] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:52.169432 28137 raft_consensus.cc:697] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:52.170317 28137 consensus_queue.cc:237] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:52.172168 27361 raft_consensus.cc:2468] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:52.173779 27931 leader_election.cc:304] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:52.174540 28166 raft_consensus.cc:2804] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:52.174983 28166 raft_consensus.cc:697] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:52.175762 28166 consensus_queue.cc:237] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:52.188988 27039 catalog_manager.cc:5697] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 1 to 2, leader changed from 1962786a39404929920d966805e48399 (127.16.188.132) to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.190930 27217 raft_consensus.cc:2468] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:52.192317 27037 catalog_manager.cc:5697] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 1 to 2, leader changed from 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130) to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:52.240720 27289 raft_consensus.cc:1275] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:52.241979 28166 consensus_queue.cc:1048] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:52.262950 27361 raft_consensus.cc:1275] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:52.264894 28166 consensus_queue.cc:1048] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:52.324419 27361 raft_consensus.cc:1275] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:52.325780 28166 consensus_queue.cc:1048] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:52.338627 27217 raft_consensus.cc:1275] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:52.340236 28146 consensus_queue.cc:1048] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:52.497750 27361 raft_consensus.cc:1275] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:52.499051 28146 consensus_queue.cc:1048] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:52.517275 27290 raft_consensus.cc:1275] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:52.528651 28166 consensus_queue.cc:1048] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:52.594826 27215 raft_consensus.cc:1275] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:52.595988 28166 consensus_queue.cc:1048] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:52.607038 27363 raft_consensus.cc:1275] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:52.608670 28147 consensus_queue.cc:1048] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:52.662523 27290 raft_consensus.cc:1275] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Refusing update from remote peer 05f7e02ff65b470591cb5d9565f123d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:52.666388 28145 consensus_queue.cc:1048] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:52.678699 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:52.720295 27361 raft_consensus.cc:1275] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer 05f7e02ff65b470591cb5d9565f123d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:52.723446 28137 consensus_queue.cc:1048] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:52.776283 27183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:35935, user_credentials={real_user=slave}} blocked reactor thread for 56193us
I20260709 13:21:52.800808 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:52.834995 27362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b37122e3aa24369b6edfe70347b97e9"
dest_uuid: "1962786a39404929920d966805e48399"
mode: GRACEFUL
new_leader_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:38918
I20260709 13:21:52.835767 27362 raft_consensus.cc:606] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Received request to transfer leadership to TS f79efe7c9e6a4384b765393621da6816
I20260709 13:21:52.838734 27362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2a24e48beb74b37aa9434f9d9be4a22"
dest_uuid: "1962786a39404929920d966805e48399"
mode: GRACEFUL
new_leader_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:38918
I20260709 13:21:52.839231 27362 raft_consensus.cc:606] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Received request to transfer leadership to TS f79efe7c9e6a4384b765393621da6816
I20260709 13:21:52.841935 27361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be5dc6e054a74138af98e26f08cd76e0"
dest_uuid: "1962786a39404929920d966805e48399"
mode: GRACEFUL
new_leader_uuid: "05f7e02ff65b470591cb5d9565f123d6"
 from {username='slave'} at 127.0.0.1:38918
I20260709 13:21:52.842455 27361 raft_consensus.cc:606] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Received request to transfer leadership to TS 05f7e02ff65b470591cb5d9565f123d6
I20260709 13:21:52.845017 27217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd1665cdc23c4af782f4111587dbf68f"
dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
mode: GRACEFUL
new_leader_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:49720
I20260709 13:21:52.845579 27217 raft_consensus.cc:606] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Received request to transfer leadership to TS f79efe7c9e6a4384b765393621da6816
I20260709 13:21:52.846750 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:21:52.848356 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:53.168377 28197 raft_consensus.cc:993] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6: : Instructing follower f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:53.169269 28202 raft_consensus.cc:1081] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Signalling peer f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:53.171132 27977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd1665cdc23c4af782f4111587dbf68f"
dest_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:46112
I20260709 13:21:53.171705 27977 raft_consensus.cc:493] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:53.171986 27977 raft_consensus.cc:3060] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:53.177846 27977 raft_consensus.cc:515] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:53.179518 27977 leader_election.cc:290] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 3 election: Requested vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:53.180311 27361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1665cdc23c4af782f4111587dbf68f" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:53.181069 27361 raft_consensus.cc:3060] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:53.180895 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1665cdc23c4af782f4111587dbf68f" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:53.181945 27217 raft_consensus.cc:3055] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:53.182261 27217 raft_consensus.cc:740] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:53.183001 27217 consensus_queue.cc:260] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:53.184278 27217 raft_consensus.cc:3060] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:53.191092 27361 raft_consensus.cc:2468] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 3.
I20260709 13:21:53.192414 27931 leader_election.cc:304] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:53.193344 28166 raft_consensus.cc:2804] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:53.192440 27217 raft_consensus.cc:2468] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 3.
I20260709 13:21:53.194087 28166 raft_consensus.cc:697] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 3 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:53.195211 28166 consensus_queue.cc:237] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:53.205119 27037 catalog_manager.cc:5697] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 2 to 3, leader changed from 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130) to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 3 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.310962 28175 raft_consensus.cc:993] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399: : Instructing follower f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:53.311476 27940 raft_consensus.cc:1081] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Signalling peer f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:53.313011 27977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2a24e48beb74b37aa9434f9d9be4a22"
dest_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:46134
I20260709 13:21:53.313619 27977 raft_consensus.cc:493] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:53.313971 27977 raft_consensus.cc:3060] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.320430 27977 raft_consensus.cc:515] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:53.322470 27977 leader_election.cc:290] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:53.323810 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a24e48beb74b37aa9434f9d9be4a22" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:53.323648 27361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a24e48beb74b37aa9434f9d9be4a22" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:53.324481 27289 raft_consensus.cc:3060] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.324615 27361 raft_consensus.cc:3055] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:53.325136 27361 raft_consensus.cc:740] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:53.325892 27361 consensus_queue.cc:260] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:53.326901 27361 raft_consensus.cc:3060] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.330603 27289 raft_consensus.cc:2468] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:53.331702 27931 leader_election.cc:304] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:53.331962 27361 raft_consensus.cc:2468] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:53.332425 28166 raft_consensus.cc:2804] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:53.332991 28166 raft_consensus.cc:697] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:53.333794 28166 consensus_queue.cc:237] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:53.345399 27037 catalog_manager.cc:5697] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 1 to 2, leader changed from 1962786a39404929920d966805e48399 (127.16.188.132) to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:53.363593 27940 raft_consensus.cc:993] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399: : Instructing follower f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:53.364079 28175 raft_consensus.cc:1081] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Signalling peer f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:53.365521 27977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b37122e3aa24369b6edfe70347b97e9"
dest_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:46134
I20260709 13:21:53.366037 27977 raft_consensus.cc:493] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:53.366334 27977 raft_consensus.cc:3060] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.371021 27977 raft_consensus.cc:515] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:53.372815 27977 leader_election.cc:290] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:53.373590 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b37122e3aa24369b6edfe70347b97e9" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:53.373898 27361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b37122e3aa24369b6edfe70347b97e9" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:53.374358 27289 raft_consensus.cc:3060] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.374423 27361 raft_consensus.cc:3055] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:53.374889 27361 raft_consensus.cc:740] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:53.375725 27361 consensus_queue.cc:260] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:53.377056 27361 raft_consensus.cc:3060] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.384152 27361 raft_consensus.cc:2468] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:53.382975 27289 raft_consensus.cc:2468] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:53.385380 27931 leader_election.cc:304] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:53.386111 28166 raft_consensus.cc:2804] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:53.386582 28166 raft_consensus.cc:697] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:53.387488 28166 consensus_queue.cc:237] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:53.394274 27940 raft_consensus.cc:993] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399: : Instructing follower 05f7e02ff65b470591cb5d9565f123d6 to start an election
I20260709 13:21:53.394893 27940 raft_consensus.cc:1081] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Signalling peer 05f7e02ff65b470591cb5d9565f123d6 to start an election
I20260709 13:21:53.396566 27217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be5dc6e054a74138af98e26f08cd76e0"
dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
 from {username='slave'} at 127.0.0.1:56492
I20260709 13:21:53.397141 27217 raft_consensus.cc:493] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:53.397472 27217 raft_consensus.cc:3060] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.402824 27037 catalog_manager.cc:5697] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 1 to 2, leader changed from 1962786a39404929920d966805e48399 (127.16.188.132) to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:53.405170 27217 raft_consensus.cc:515] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:53.406836 27217 leader_election.cc:290] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:53.407717 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5dc6e054a74138af98e26f08cd76e0" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:53.408030 27361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5dc6e054a74138af98e26f08cd76e0" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:53.408370 27289 raft_consensus.cc:3060] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.408615 27361 raft_consensus.cc:3055] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:53.408932 27361 raft_consensus.cc:740] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:53.409757 27361 consensus_queue.cc:260] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:53.411125 27361 raft_consensus.cc:3060] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:53.418277 27361 raft_consensus.cc:2468] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 2.
I20260709 13:21:53.419291 27184 leader_election.cc:304] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 1962786a39404929920d966805e48399; no voters: 
I20260709 13:21:53.420076 27289 raft_consensus.cc:2468] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 2.
I20260709 13:21:53.420099 28197 raft_consensus.cc:2804] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:53.420919 28197 raft_consensus.cc:697] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:53.421801 28197 consensus_queue.cc:237] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:53.431561 27037 catalog_manager.cc:5697] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 1 to 2, leader changed from 1962786a39404929920d966805e48399 (127.16.188.132) to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:53.708227 27362 raft_consensus.cc:1275] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:53.709470 28147 consensus_queue.cc:1048] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:53.724144 27217 raft_consensus.cc:1275] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:53.726759 28147 consensus_queue.cc:1048] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:53.742009 27290 raft_consensus.cc:1275] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:53.743214 28215 consensus_queue.cc:1048] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:53.755777 27361 raft_consensus.cc:1275] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:53.759449 28147 consensus_queue.cc:1048] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:53.799300 27290 raft_consensus.cc:1275] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:53.800767 28215 consensus_queue.cc:1048] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:53.817068 27361 raft_consensus.cc:1275] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:53.819993 28166 consensus_queue.cc:1048] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:53.849277 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:53.891139 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:53.928457 27217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fade412cd974138979c417dd233c35a"
dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
mode: GRACEFUL
new_leader_uuid: "1962786a39404929920d966805e48399"
 from {username='slave'} at 127.0.0.1:49720
I20260709 13:21:53.929111 27217 raft_consensus.cc:606] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Received request to transfer leadership to TS 1962786a39404929920d966805e48399
I20260709 13:21:53.930461 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:21:53.931984 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:53.984603 27290 raft_consensus.cc:1275] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Refusing update from remote peer 05f7e02ff65b470591cb5d9565f123d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:53.986121 28202 consensus_queue.cc:1048] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:53.993122 27362 raft_consensus.cc:1275] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer 05f7e02ff65b470591cb5d9565f123d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:53.996296 28197 consensus_queue.cc:1048] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:54.198647 28202 raft_consensus.cc:993] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6: : Instructing follower 1962786a39404929920d966805e48399 to start an election
I20260709 13:21:54.199244 28197 raft_consensus.cc:1081] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Signalling peer 1962786a39404929920d966805e48399 to start an election
I20260709 13:21:54.200776 27361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fade412cd974138979c417dd233c35a"
dest_uuid: "1962786a39404929920d966805e48399"
 from {username='slave'} at 127.0.0.1:39738
I20260709 13:21:54.201357 27361 raft_consensus.cc:493] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:54.201718 27361 raft_consensus.cc:3060] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:54.206889 27361 raft_consensus.cc:515] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:54.208688 27361 leader_election.cc:290] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:54.209573 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fade412cd974138979c417dd233c35a" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:54.209764 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fade412cd974138979c417dd233c35a" candidate_uuid: "1962786a39404929920d966805e48399" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:54.210210 27218 raft_consensus.cc:3055] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:54.210471 27289 raft_consensus.cc:3060] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:54.210654 27218 raft_consensus.cc:740] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:54.211575 27218 consensus_queue.cc:260] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:54.212769 27218 raft_consensus.cc:3060] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:54.217279 27289 raft_consensus.cc:2468] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 3.
I20260709 13:21:54.218390 27332 leader_election.cc:304] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:54.219127 27940 raft_consensus.cc:2804] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:54.219631 27940 raft_consensus.cc:697] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 3 LEADER]: Becoming Leader. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:54.220042 27218 raft_consensus.cc:2468] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1962786a39404929920d966805e48399 in term 3.
I20260709 13:21:54.220459 27940 consensus_queue.cc:237] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:54.230122 27039 catalog_manager.cc:5697] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 reported cstate change: term changed from 2 to 3, leader changed from 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130) to 1962786a39404929920d966805e48399 (127.16.188.132). New cstate: current_term: 3 leader_uuid: "1962786a39404929920d966805e48399" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:54.755419 27215 raft_consensus.cc:1275] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Refusing update from remote peer 1962786a39404929920d966805e48399: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:54.756716 28175 consensus_queue.cc:1048] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:54.769236 27289 raft_consensus.cc:1275] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 3 FOLLOWER]: Refusing update from remote peer 1962786a39404929920d966805e48399: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:54.771348 28175 consensus_queue.cc:1048] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:21:54.932988 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:54.980980 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:55.016958 27362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46bbc4b2c88745c699787c5df44ed464"
dest_uuid: "1962786a39404929920d966805e48399"
mode: GRACEFUL
new_leader_uuid: "05f7e02ff65b470591cb5d9565f123d6"
 from {username='slave'} at 127.0.0.1:38918
I20260709 13:21:55.017583 27362 raft_consensus.cc:606] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Received request to transfer leadership to TS 05f7e02ff65b470591cb5d9565f123d6
I20260709 13:21:55.018868 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:21:55.021100 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:55.034565 28175 raft_consensus.cc:993] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399: : Instructing follower 05f7e02ff65b470591cb5d9565f123d6 to start an election
I20260709 13:21:55.035130 28231 raft_consensus.cc:1081] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Signalling peer 05f7e02ff65b470591cb5d9565f123d6 to start an election
I20260709 13:21:55.036636 27218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46bbc4b2c88745c699787c5df44ed464"
dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
 from {username='slave'} at 127.0.0.1:56492
I20260709 13:21:55.037181 27218 raft_consensus.cc:493] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:55.037483 27218 raft_consensus.cc:3060] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:55.044021 27218 raft_consensus.cc:515] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:55.045811 27218 leader_election.cc:290] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Requested vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), 1962786a39404929920d966805e48399 (127.16.188.132:40225)
I20260709 13:21:55.046535 27289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46bbc4b2c88745c699787c5df44ed464" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:55.046777 27361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46bbc4b2c88745c699787c5df44ed464" candidate_uuid: "05f7e02ff65b470591cb5d9565f123d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1962786a39404929920d966805e48399"
I20260709 13:21:55.047211 27289 raft_consensus.cc:3060] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:55.047272 27361 raft_consensus.cc:3055] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:55.047657 27361 raft_consensus.cc:740] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1962786a39404929920d966805e48399, State: Running, Role: LEADER
I20260709 13:21:55.048461 27361 consensus_queue.cc:260] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:55.049605 27361 raft_consensus.cc:3060] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:55.055766 27289 raft_consensus.cc:2468] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 2.
I20260709 13:21:55.057175 27361 raft_consensus.cc:2468] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f7e02ff65b470591cb5d9565f123d6 in term 2.
I20260709 13:21:55.057379 27184 leader_election.cc:304] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:55.058276 28226 raft_consensus.cc:2804] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:55.058758 28226 raft_consensus.cc:697] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Becoming Leader. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:55.059540 28226 consensus_queue.cc:237] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } }
I20260709 13:21:55.067960 27037 catalog_manager.cc:5697] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 reported cstate change: term changed from 1 to 2, leader changed from 1962786a39404929920d966805e48399 (127.16.188.132) to 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "05f7e02ff65b470591cb5d9565f123d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.462798 27361 raft_consensus.cc:1275] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Refusing update from remote peer 05f7e02ff65b470591cb5d9565f123d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:55.464183 28226 consensus_queue.cc:1048] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:55.485558 27290 raft_consensus.cc:1275] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Refusing update from remote peer 05f7e02ff65b470591cb5d9565f123d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:55.488245 28202 consensus_queue.cc:1048] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:56.186033 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:56.236828 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:56.276225 27217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eeabd510d2384d3dab2df8fa001a3400"
dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
mode: GRACEFUL
new_leader_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:49720
I20260709 13:21:56.276787 27217 raft_consensus.cc:606] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Received request to transfer leadership to TS f79efe7c9e6a4384b765393621da6816
I20260709 13:21:56.277932 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:21:56.279390 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:56.641280 28226 raft_consensus.cc:993] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6: : Instructing follower f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:56.642462 28226 raft_consensus.cc:1081] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Signalling peer f79efe7c9e6a4384b765393621da6816 to start an election
I20260709 13:21:56.644953 27983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eeabd510d2384d3dab2df8fa001a3400"
dest_uuid: "f79efe7c9e6a4384b765393621da6816"
 from {username='slave'} at 127.0.0.1:46112
I20260709 13:21:56.645898 27983 raft_consensus.cc:493] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:56.646369 27983 raft_consensus.cc:3060] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.660194 27983 raft_consensus.cc:515] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:56.662988 27983 leader_election.cc:290] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Requested vote from peers 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009), 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829)
I20260709 13:21:56.672042 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeabd510d2384d3dab2df8fa001a3400" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05f7e02ff65b470591cb5d9565f123d6"
I20260709 13:21:56.673055 27290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeabd510d2384d3dab2df8fa001a3400" candidate_uuid: "f79efe7c9e6a4384b765393621da6816" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d8e002e04a74c2598405158a99d86c1"
I20260709 13:21:56.673557 27217 raft_consensus.cc:3055] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:56.674083 27217 raft_consensus.cc:740] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05f7e02ff65b470591cb5d9565f123d6, State: Running, Role: LEADER
I20260709 13:21:56.674219 27290 raft_consensus.cc:3060] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.676832 27217 consensus_queue.cc:260] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
I20260709 13:21:56.680723 27217 raft_consensus.cc:3060] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.719085 27217 raft_consensus.cc:2468] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:56.720779 27931 leader_election.cc:304] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816; no voters: 
I20260709 13:21:56.721925 28257 raft_consensus.cc:2804] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:56.722432 28257 raft_consensus.cc:697] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Becoming Leader. State: Replica: f79efe7c9e6a4384b765393621da6816, State: Running, Role: LEADER
I20260709 13:21:56.723989 27290 raft_consensus.cc:2468] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f79efe7c9e6a4384b765393621da6816 in term 2.
I20260709 13:21:56.723886 28257 consensus_queue.cc:237] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } }
W20260709 13:21:56.740883 27072 debug-util.cc:398] Leaking SignalData structure 0x7b0800333ec0 after lost signal to thread 17141
W20260709 13:21:56.743875 27072 debug-util.cc:398] Leaking SignalData structure 0x7b0800295da0 after lost signal to thread 27075
I20260709 13:21:56.745008 27039 catalog_manager.cc:5697] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 reported cstate change: term changed from 1 to 2, leader changed from 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130) to f79efe7c9e6a4384b765393621da6816 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "f79efe7c9e6a4384b765393621da6816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:56.749447 27072 debug-util.cc:398] Leaking SignalData structure 0x7b08001b2760 after lost signal to thread 27242
W20260709 13:21:56.752102 27072 debug-util.cc:398] Leaking SignalData structure 0x7b0800287840 after lost signal to thread 27316
W20260709 13:21:56.755225 27072 debug-util.cc:398] Leaking SignalData structure 0x7b0800242620 after lost signal to thread 27390
W20260709 13:21:56.759042 27072 debug-util.cc:398] Leaking SignalData structure 0x7b08000e60e0 after lost signal to thread 28017
I20260709 13:21:57.253289 27217 raft_consensus.cc:1275] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:57.254762 28166 consensus_queue.cc:1048] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:57.273885 27290 raft_consensus.cc:1275] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Refusing update from remote peer f79efe7c9e6a4384b765393621da6816: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:57.276036 28268 consensus_queue.cc:1048] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:57.281389 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:57.389596 17138 tablet_server.cc:179] TabletServer@127.16.188.129:35935 shutting down...
W20260709 13:21:57.413511 27257 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 112 similar messages]
W20260709 13:21:57.425064 27257 consensus_peers.cc:597] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.452394 27257 consensus_peers.cc:597] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.454697 27331 consensus_peers.cc:597] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.468079 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:57.469352 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.470640 17138 raft_consensus.cc:2243] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:57.471933 17138 raft_consensus.cc:2272] T d93a08da579844d4b341d52ce65113ce P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.475438 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.476078 17138 raft_consensus.cc:2243] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:57.477049 17138 raft_consensus.cc:2272] T dd1665cdc23c4af782f4111587dbf68f P f79efe7c9e6a4384b765393621da6816 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.479965 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.480803 17138 raft_consensus.cc:2243] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:57.481788 17138 raft_consensus.cc:2272] T 6df6aa2911c94954949e3b8283d1d2e1 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.485639 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.487569 17138 raft_consensus.cc:2243] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:57.487632 27331 consensus_peers.cc:597] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.488233 17138 raft_consensus.cc:2272] T c942513b146c4cfeba8bdfc1baac288e P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.492280 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.493441 17138 raft_consensus.cc:2243] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.493933 17138 raft_consensus.cc:2272] T b76838dbe1fd4a4eac1e7d5740cf668f P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.499187 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.499961 17138 raft_consensus.cc:2243] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:21:57.500478 27257 consensus_peers.cc:597] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.500995 17138 raft_consensus.cc:2272] T 7d205fe2cb9d4d319c85bb33f59ca660 P f79efe7c9e6a4384b765393621da6816 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.504662 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.505671 17138 raft_consensus.cc:2243] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.506563 17138 raft_consensus.cc:2272] T f684c9c7b4874567b690e70a7ddae640 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.510041 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.510967 17138 raft_consensus.cc:2243] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.511492 17138 raft_consensus.cc:2272] T 46295debdbf04af3ae614987b17bd03d P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.519523 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.520635 17138 raft_consensus.cc:2243] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.521373 17138 raft_consensus.cc:2272] T 26ef473dee144c5dbc7086d2b983cb59 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.524634 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.525794 17138 raft_consensus.cc:2243] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:57.527041 17138 raft_consensus.cc:2272] T 992029a58c6b4e9fae2a4024cda34dcd P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.530773 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.531509 17138 raft_consensus.cc:2243] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.532040 17138 raft_consensus.cc:2272] T d45fa14105f64435ae8fd7b34c0dc72c P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.535461 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.536276 17138 raft_consensus.cc:2243] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.536839 17138 raft_consensus.cc:2272] T 501b61a3989144c5a902cbf9ddbab055 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.540194 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.541045 17138 raft_consensus.cc:2243] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.541589 17138 raft_consensus.cc:2272] T 8474c28d9650438ca267ba04bf79b5eb P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:57.541422 27331 consensus_peers.cc:597] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.545322 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.545959 17138 raft_consensus.cc:2243] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.546449 17138 raft_consensus.cc:2272] T 548f20dfb71a4917ae7ba2f706241ec1 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.549597 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.550366 17138 raft_consensus.cc:2243] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.550885 17138 raft_consensus.cc:2272] T 07a377a6c91543278d51ac9a9db49050 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.553469 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.554246 17138 raft_consensus.cc:2243] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.554781 17138 raft_consensus.cc:2272] T c32e5371db8c4a95ab423532604c6f33 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.557931 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.558835 17138 raft_consensus.cc:2243] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.559428 17138 raft_consensus.cc:2272] T 976b5b49dae34fae8a725ff84ca47fe5 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:57.561520 27331 consensus_peers.cc:597] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.562536 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.563133 17138 raft_consensus.cc:2243] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:57.563935 17138 raft_consensus.cc:2272] T eeabd510d2384d3dab2df8fa001a3400 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.566617 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.567327 17138 raft_consensus.cc:2243] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.567772 17138 raft_consensus.cc:2272] T 2097666912334a53a80b648a0fad2786 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.570600 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.571400 17138 raft_consensus.cc:2243] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.571910 17138 raft_consensus.cc:2272] T 178fe9f66bbf440780bf6f265626a054 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.575022 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.575798 17138 raft_consensus.cc:2243] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.576387 17138 raft_consensus.cc:2272] T 2af7a5fd35f9478ba7387eec2ab4d036 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.579516 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.580317 17138 raft_consensus.cc:2243] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:57.581585 17138 raft_consensus.cc:2272] T 9f72db119dad434b84f9712dc1930f7f P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.592541 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.593415 17138 raft_consensus.cc:2243] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:57.594624 17138 raft_consensus.cc:2272] T 76efc04736174df4a18381faaf044830 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:57.595736 27183 consensus_peers.cc:597] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.602578 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.603637 17138 raft_consensus.cc:2243] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.604188 17138 raft_consensus.cc:2272] T f09320cdf2a440f789313b20646079a6 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.607925 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.608880 17138 raft_consensus.cc:2243] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.609432 17138 raft_consensus.cc:2272] T 15e3484b734c41099e53b3f518789f39 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.613086 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.613843 17138 raft_consensus.cc:2243] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:57.615118 17138 raft_consensus.cc:2272] T 315d4de5fc5940f9b5f1d3206e7028c0 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.617514 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.618258 17138 raft_consensus.cc:2243] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.618831 17138 raft_consensus.cc:2272] T 966ee691db624d2bac9b9cfe639d8963 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.622864 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.623703 17138 raft_consensus.cc:2243] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.624291 17138 raft_consensus.cc:2272] T b1a9e5ac221b44be83106f28e32dc20e P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:57.626660 27183 consensus_peers.cc:597] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.627591 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.628538 17138 raft_consensus.cc:2243] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:57.629703 17138 raft_consensus.cc:2272] T 8b37122e3aa24369b6edfe70347b97e9 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:57.630398 27183 consensus_peers.cc:597] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.633723 17138 tablet_replica.cc:333] stopping tablet replica
W20260709 13:21:57.634539 27183 consensus_peers.cc:597] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.634652 17138 raft_consensus.cc:2243] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:57.635922 17138 raft_consensus.cc:2272] T b8bc3f6a11ae4b85870951a4ef079571 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:57.635910 27331 consensus_peers.cc:597] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.639485 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.640331 17138 raft_consensus.cc:2243] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.640997 17138 raft_consensus.cc:2272] T 98dc2c568d9642a587b5741241562afe P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.644366 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.645015 17138 raft_consensus.cc:2243] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.645597 17138 raft_consensus.cc:2272] T f3ab667936414e288be72021cfbcbc1b P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.648300 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.649045 17138 raft_consensus.cc:2243] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.649606 17138 raft_consensus.cc:2272] T 00a2e2e4269146dd8e2bf720a1c890d8 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:57.651988 27331 consensus_peers.cc:597] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.652591 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.653250 17138 raft_consensus.cc:2243] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.653705 17138 raft_consensus.cc:2272] T e69c998c37474f57b3b6d7355f0cc235 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.655963 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.656577 17138 raft_consensus.cc:2243] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.657012 17138 raft_consensus.cc:2272] T add22a21c5bf424390df6d87617a47e7 P f79efe7c9e6a4384b765393621da6816 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.659330 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.659875 17138 raft_consensus.cc:2243] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.660281 17138 raft_consensus.cc:2272] T 148eb001e9854043a2ad74dc8af08ae0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.663424 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.664093 17138 raft_consensus.cc:2243] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.664620 17138 raft_consensus.cc:2272] T 93e07aed35c54d449d6103728c481ab5 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.667356 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.667856 17138 raft_consensus.cc:2243] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.668262 17138 raft_consensus.cc:2272] T 2809a3a620544e7f8ce472b3563c2df9 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.670472 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.671017 17138 raft_consensus.cc:2243] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.671487 17138 raft_consensus.cc:2272] T dd74c5033db646ea91b4ca463507c3a3 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.673945 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.674430 17138 raft_consensus.cc:2243] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.674919 17138 raft_consensus.cc:2272] T 8115282f2b1544e6a930473c43950bc4 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.677400 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.677910 17138 raft_consensus.cc:2243] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:57.678903 17138 raft_consensus.cc:2272] T 0fb491563d1a49ac99c74ae4f6553d26 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.681403 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.681902 17138 raft_consensus.cc:2243] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:57.682780 17138 raft_consensus.cc:2272] T a2a24e48beb74b37aa9434f9d9be4a22 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.685349 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.686048 17138 raft_consensus.cc:2243] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.686574 17138 raft_consensus.cc:2272] T ba68051b3f1c40c9bcface09069e68e0 P f79efe7c9e6a4384b765393621da6816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.689704 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.690455 17138 raft_consensus.cc:2243] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:57.690896 17138 raft_consensus.cc:2272] T 42ad970eae96417783396e7accb1b834 P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:57.693409 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:57.693852 17138 raft_consensus.cc:2243] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:57.694695 17138 raft_consensus.cc:2272] T 728a1fd5a8c84cb19f6691fc08e1eeef P f79efe7c9e6a4384b765393621da6816 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:57.746805 27183 consensus_peers.cc:597] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.748495 27331 consensus_peers.cc:597] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.749488 27183 consensus_peers.cc:597] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.759735 27331 consensus_peers.cc:597] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.774781 27183 consensus_peers.cc:597] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.786312 27331 consensus_peers.cc:597] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.797142 17138 tablet_server.cc:196] TabletServer@127.16.188.129:35935 shutdown complete.
W20260709 13:21:57.825700 27257 consensus_peers.cc:597] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.826300 27257 consensus_peers.cc:597] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.826705 27257 consensus_peers.cc:597] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.843243 27257 consensus_peers.cc:597] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.859611 27331 consensus_peers.cc:597] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.887066 27331 consensus_peers.cc:597] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.907147 27183 consensus_peers.cc:597] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.907855 27183 consensus_peers.cc:597] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.908411 27183 consensus_peers.cc:597] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.901561 27257 consensus_peers.cc:597] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.929507 27257 consensus_peers.cc:597] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.938426 17138 tablet_server.cc:179] TabletServer@127.16.188.130:0 shutting down...
W20260709 13:21:57.948382 27258 consensus_peers.cc:597] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.959503 27183 consensus_peers.cc:597] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 -> Peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Couldn't send request to peer f79efe7c9e6a4384b765393621da6816. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:58.006935 27258 consensus_peers.cc:597] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.008980 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:58.010011 17138 tablet_replica.cc:333] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.010885 17138 raft_consensus.cc:2243] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.011515 17138 raft_consensus.cc:2272] T 6df6aa2911c94954949e3b8283d1d2e1 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.014467 17138 tablet_replica.cc:333] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.015156 17138 raft_consensus.cc:2243] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.016129 17138 raft_consensus.cc:2272] T c475a8c029024e99b4377fdda1a27c2a P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.018776 17138 tablet_replica.cc:333] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.019464 17138 raft_consensus.cc:2243] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.019969 17138 raft_consensus.cc:2272] T 992029a58c6b4e9fae2a4024cda34dcd P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.022650 17138 tablet_replica.cc:333] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.023350 17138 raft_consensus.cc:2243] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.023867 17138 raft_consensus.cc:2272] T d93a08da579844d4b341d52ce65113ce P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.026743 17138 tablet_replica.cc:333] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.027485 17138 raft_consensus.cc:2243] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.028048 17138 raft_consensus.cc:2272] T 4fade412cd974138979c417dd233c35a P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.029239 27332 consensus_peers.cc:597] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.030875 17138 tablet_replica.cc:333] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.031625 17138 raft_consensus.cc:2243] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.032137 17138 raft_consensus.cc:2272] T 7d205fe2cb9d4d319c85bb33f59ca660 P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.034729 17138 tablet_replica.cc:333] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.035346 17138 raft_consensus.cc:2243] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.036408 17138 raft_consensus.cc:2272] T 8474c28d9650438ca267ba04bf79b5eb P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.039357 17138 tablet_replica.cc:333] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.040177 17138 raft_consensus.cc:2243] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.041201 17138 raft_consensus.cc:2272] T 46bbc4b2c88745c699787c5df44ed464 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.044269 17138 tablet_replica.cc:333] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.045147 17138 raft_consensus.cc:2243] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.045672 17138 raft_consensus.cc:2272] T 5ab38e5621004b79ad7c4f961d7e29ae P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.049223 17138 tablet_replica.cc:333] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.050233 17138 raft_consensus.cc:2243] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.051369 17138 raft_consensus.cc:2272] T f3ab667936414e288be72021cfbcbc1b P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.054608 17138 tablet_replica.cc:333] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.055181 17138 raft_consensus.cc:2243] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.055624 17138 raft_consensus.cc:2272] T 98dc2c568d9642a587b5741241562afe P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.058034 27258 consensus_peers.cc:597] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.058751 17138 tablet_replica.cc:333] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.059670 17138 raft_consensus.cc:2243] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.060230 17138 raft_consensus.cc:2272] T eeabd510d2384d3dab2df8fa001a3400 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.064495 17138 tablet_replica.cc:333] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.065701 17138 raft_consensus.cc:2243] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.066882 17138 raft_consensus.cc:2272] T 976b5b49dae34fae8a725ff84ca47fe5 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.070034 17138 tablet_replica.cc:333] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.073020 17138 raft_consensus.cc:2243] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.074314 17138 raft_consensus.cc:2272] T 07a377a6c91543278d51ac9a9db49050 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.077252 27332 consensus_peers.cc:597] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.077889 17138 tablet_replica.cc:333] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
W20260709 13:21:58.078092 27332 consensus_peers.cc:597] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:58.078783 27258 consensus_peers.cc:597] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:58.081074 27258 consensus_peers.cc:597] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.079003 17138 raft_consensus.cc:2243] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.082649 17138 raft_consensus.cc:2272] T 548f20dfb71a4917ae7ba2f706241ec1 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.086241 17138 tablet_replica.cc:333] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.087363 17138 raft_consensus.cc:2243] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.088625 17138 raft_consensus.cc:2272] T e69c998c37474f57b3b6d7355f0cc235 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.093562 17138 tablet_replica.cc:333] T 706ddcc20d574055ac044c0ff3d638a0 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.094515 17138 raft_consensus.cc:2243] T 706ddcc20d574055ac044c0ff3d638a0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.095140 17138 raft_consensus.cc:2272] T 706ddcc20d574055ac044c0ff3d638a0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.098222 17138 tablet_replica.cc:333] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.099102 17138 raft_consensus.cc:2243] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.100330 17138 raft_consensus.cc:2272] T 46295debdbf04af3ae614987b17bd03d P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.100797 27258 consensus_peers.cc:597] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.103929 17138 tablet_replica.cc:333] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.105109 17138 raft_consensus.cc:2243] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.105856 17138 raft_consensus.cc:2272] T 315d4de5fc5940f9b5f1d3206e7028c0 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.109402 17138 tablet_replica.cc:333] T 966ee691db624d2bac9b9cfe639d8963 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.110261 17138 raft_consensus.cc:2243] T 966ee691db624d2bac9b9cfe639d8963 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.110869 17138 raft_consensus.cc:2272] T 966ee691db624d2bac9b9cfe639d8963 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.114295 17138 tablet_replica.cc:333] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.115113 17138 raft_consensus.cc:2243] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.116356 17138 raft_consensus.cc:2272] T b76838dbe1fd4a4eac1e7d5740cf668f P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.119589 17138 tablet_replica.cc:333] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.120452 17138 raft_consensus.cc:2243] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.121124 17138 raft_consensus.cc:2272] T 9f72db119dad434b84f9712dc1930f7f P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.124146 17138 tablet_replica.cc:333] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.125062 17138 raft_consensus.cc:2243] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.126248 17138 raft_consensus.cc:2272] T 15e3484b734c41099e53b3f518789f39 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.129482 17138 tablet_replica.cc:333] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.130374 17138 raft_consensus.cc:2243] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.130988 17138 raft_consensus.cc:2272] T 2c666107348f4678ba2161b66cd6d486 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.134397 17138 tablet_replica.cc:333] T f09320cdf2a440f789313b20646079a6 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.135207 17138 raft_consensus.cc:2243] T f09320cdf2a440f789313b20646079a6 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.135737 17138 raft_consensus.cc:2272] T f09320cdf2a440f789313b20646079a6 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.135865 27258 consensus_peers.cc:597] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.138787 17138 tablet_replica.cc:333] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.139760 17138 raft_consensus.cc:2243] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.140329 17138 raft_consensus.cc:2272] T dd74c5033db646ea91b4ca463507c3a3 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.143752 17138 tablet_replica.cc:333] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.144624 17138 raft_consensus.cc:2243] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.145161 17138 raft_consensus.cc:2272] T ba68051b3f1c40c9bcface09069e68e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.148334 17138 tablet_replica.cc:333] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.149150 17138 raft_consensus.cc:2243] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.150205 17138 raft_consensus.cc:2272] T 42ad970eae96417783396e7accb1b834 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.153232 17138 tablet_replica.cc:333] T 960bc3fba4dc481e9602d13cd4a0b5ae P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.154098 17138 raft_consensus.cc:2243] T 960bc3fba4dc481e9602d13cd4a0b5ae P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.154678 17138 raft_consensus.cc:2272] T 960bc3fba4dc481e9602d13cd4a0b5ae P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.156029 27332 consensus_peers.cc:597] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:58.157552 27258 consensus_peers.cc:597] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.157997 17138 tablet_replica.cc:333] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.158910 17138 raft_consensus.cc:2243] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.160048 17138 raft_consensus.cc:2272] T be5dc6e054a74138af98e26f08cd76e0 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.161751 27258 consensus_peers.cc:597] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.163254 17138 tablet_replica.cc:333] T f28a920522f34d318c610b60571ca004 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.164134 17138 raft_consensus.cc:2243] T f28a920522f34d318c610b60571ca004 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.164731 17138 raft_consensus.cc:2272] T f28a920522f34d318c610b60571ca004 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.168061 17138 tablet_replica.cc:333] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.168946 17138 raft_consensus.cc:2243] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.169628 17138 raft_consensus.cc:2272] T 0fb491563d1a49ac99c74ae4f6553d26 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.172569 17138 tablet_replica.cc:333] T be748b869d8b48dfa56a49c838cc4818 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.173342 17138 raft_consensus.cc:2243] T be748b869d8b48dfa56a49c838cc4818 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.173847 17138 raft_consensus.cc:2272] T be748b869d8b48dfa56a49c838cc4818 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.177168 17138 tablet_replica.cc:333] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.177910 17138 raft_consensus.cc:2243] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.178439 17138 raft_consensus.cc:2272] T add22a21c5bf424390df6d87617a47e7 P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.182366 17138 tablet_replica.cc:333] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.183158 17138 raft_consensus.cc:2243] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.183770 17138 raft_consensus.cc:2272] T 180999038c4a4fa7912fea59dfabd4d4 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.187158 17138 tablet_replica.cc:333] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.187975 17138 raft_consensus.cc:2243] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.188549 17138 raft_consensus.cc:2272] T 2809a3a620544e7f8ce472b3563c2df9 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.191359 17138 tablet_replica.cc:333] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.192107 17138 raft_consensus.cc:2243] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.192739 17138 raft_consensus.cc:2272] T ff5e8ee488ee4e18adea644ba22ed683 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.195801 17138 tablet_replica.cc:333] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.196586 17138 raft_consensus.cc:2243] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.197247 17138 raft_consensus.cc:2272] T b8bc3f6a11ae4b85870951a4ef079571 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.197527 27258 consensus_peers.cc:597] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.200452 17138 tablet_replica.cc:333] T 6b8d513ca0a647d5a716650ed58360f6 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.201308 17138 raft_consensus.cc:2243] T 6b8d513ca0a647d5a716650ed58360f6 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.201864 17138 raft_consensus.cc:2272] T 6b8d513ca0a647d5a716650ed58360f6 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.205015 17138 tablet_replica.cc:333] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.205593 17138 raft_consensus.cc:2243] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.206477 17138 raft_consensus.cc:2272] T 7109f14a616b49939aa2fbd96d6ad458 P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.209547 17138 tablet_replica.cc:333] T b1a9e5ac221b44be83106f28e32dc20e P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.210294 17138 raft_consensus.cc:2243] T b1a9e5ac221b44be83106f28e32dc20e P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.210852 17138 raft_consensus.cc:2272] T b1a9e5ac221b44be83106f28e32dc20e P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.213912 17138 tablet_replica.cc:333] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.214637 17138 raft_consensus.cc:2243] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.215229 17138 raft_consensus.cc:2272] T dd1665cdc23c4af782f4111587dbf68f P 05f7e02ff65b470591cb5d9565f123d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.218350 17138 tablet_replica.cc:333] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.219029 17138 raft_consensus.cc:2243] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.219648 17138 raft_consensus.cc:2272] T 2097666912334a53a80b648a0fad2786 P 05f7e02ff65b470591cb5d9565f123d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.222615 17138 tablet_replica.cc:333] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6: stopping tablet replica
I20260709 13:21:58.223228 17138 raft_consensus.cc:2243] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.224445 17138 raft_consensus.cc:2272] T c942513b146c4cfeba8bdfc1baac288e P 05f7e02ff65b470591cb5d9565f123d6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.241598 27332 consensus_peers.cc:597] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:58.257485 27258 consensus_peers.cc:597] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:58.298667 27332 consensus_peers.cc:597] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.327013 17138 tablet_server.cc:196] TabletServer@127.16.188.130:0 shutdown complete.
W20260709 13:21:58.359354 27332 consensus_peers.cc:597] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:38009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:58.372483 27332 consensus_peers.cc:597] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 -> Peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Couldn't send request to peer 05f7e02ff65b470591cb5d9565f123d6. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:38009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.463038 17138 tablet_server.cc:179] TabletServer@127.16.188.131:0 shutting down...
I20260709 13:21:58.502218 28282 raft_consensus.cc:493] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:58.503140 28282 raft_consensus.cc:515] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:58.511943 28250 raft_consensus.cc:493] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:58.512760 28250 raft_consensus.cc:515] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:58.566221 28231 raft_consensus.cc:493] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:58.568020 28231 raft_consensus.cc:515] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:58.571501 28231 leader_election.cc:290] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
W20260709 13:21:58.574914 27332 consensus_peers.cc:597] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:58.576918 27332 consensus_peers.cc:597] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.568275 28282 leader_election.cc:290] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:58.581272 28250 leader_election.cc:290] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
W20260709 13:21:58.587560 27331 leader_election.cc:336] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
W20260709 13:21:58.588361 27332 consensus_peers.cc:597] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:58.589984 27332 leader_election.cc:336] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Network error: Client connection negotiation failed: client connection to 127.16.188.130:38009: connect: Connection refused (error 111)
I20260709 13:21:58.591565 27332 leader_election.cc:304] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:58.592809 28282 raft_consensus.cc:2749] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:58.598963 27332 leader_election.cc:336] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Network error: Client connection negotiation failed: client connection to 127.16.188.130:38009: connect: Connection refused (error 111)
W20260709 13:21:58.598954 27331 leader_election.cc:336] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
W20260709 13:21:58.600427 27331 leader_election.cc:336] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
W20260709 13:21:58.600440 27332 leader_election.cc:336] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Network error: Client connection negotiation failed: client connection to 127.16.188.130:38009: connect: Connection refused (error 111)
I20260709 13:21:58.602218 27332 leader_election.cc:304] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:58.602312 27331 leader_election.cc:304] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:58.603235 28282 raft_consensus.cc:2749] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:58.603359 28231 raft_consensus.cc:2749] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:58.612213 27332 consensus_peers.cc:597] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.628918 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:58.630290 17138 tablet_replica.cc:333] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.631184 17138 raft_consensus.cc:2243] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.631815 17138 raft_consensus.cc:2272] T 178fe9f66bbf440780bf6f265626a054 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.635257 17138 tablet_replica.cc:333] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.636126 17138 raft_consensus.cc:2243] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.637291 17138 raft_consensus.cc:2272] T c475a8c029024e99b4377fdda1a27c2a P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.640439 17138 tablet_replica.cc:333] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.641302 17138 raft_consensus.cc:2243] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.641957 17138 raft_consensus.cc:2272] T d93a08da579844d4b341d52ce65113ce P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.644804 17138 tablet_replica.cc:333] T f3ab667936414e288be72021cfbcbc1b P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.645561 17138 raft_consensus.cc:2243] T f3ab667936414e288be72021cfbcbc1b P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.646180 17138 raft_consensus.cc:2272] T f3ab667936414e288be72021cfbcbc1b P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.649073 17138 tablet_replica.cc:333] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.649590 17138 raft_consensus.cc:2243] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.649991 17138 raft_consensus.cc:2272] T d45fa14105f64435ae8fd7b34c0dc72c P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.652251 17138 tablet_replica.cc:333] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.653082 17138 raft_consensus.cc:2243] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.653626 17138 raft_consensus.cc:2272] T 4fade412cd974138979c417dd233c35a P 2d8e002e04a74c2598405158a99d86c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.656703 17138 tablet_replica.cc:333] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.657735 17138 raft_consensus.cc:2243] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.658268 17138 raft_consensus.cc:2272] T 46bbc4b2c88745c699787c5df44ed464 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.660982 17138 tablet_replica.cc:333] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.661787 17138 raft_consensus.cc:2243] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.662350 17138 raft_consensus.cc:2272] T 07a377a6c91543278d51ac9a9db49050 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.665266 17138 tablet_replica.cc:333] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.666028 17138 raft_consensus.cc:2243] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.667049 17138 raft_consensus.cc:2272] T c32e5371db8c4a95ab423532604c6f33 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.668800 28250 raft_consensus.cc:493] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:58.669293 28250 raft_consensus.cc:515] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:58.669782 17138 tablet_replica.cc:333] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.670650 17138 raft_consensus.cc:2243] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.671288 28250 leader_election.cc:290] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:58.671139 17138 raft_consensus.cc:2272] T 548f20dfb71a4917ae7ba2f706241ec1 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.675648 17138 tablet_replica.cc:333] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.676448 17138 raft_consensus.cc:2243] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.677855 17138 raft_consensus.cc:2272] T a2a24e48beb74b37aa9434f9d9be4a22 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.679944 27332 leader_election.cc:336] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:58.680827 17138 tablet_replica.cc:333] T 2af7a5fd35f9478ba7387eec2ab4d036 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.681638 17138 raft_consensus.cc:2243] T 2af7a5fd35f9478ba7387eec2ab4d036 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.682140 17138 raft_consensus.cc:2272] T 2af7a5fd35f9478ba7387eec2ab4d036 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.682885 28282 raft_consensus.cc:493] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:58.683398 28282 raft_consensus.cc:515] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:58.685364 28282 leader_election.cc:290] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:58.688146 17138 tablet_replica.cc:333] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.689033 17138 raft_consensus.cc:2243] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.689519 17138 raft_consensus.cc:2272] T eeabd510d2384d3dab2df8fa001a3400 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.691684 17138 tablet_replica.cc:333] T 976b5b49dae34fae8a725ff84ca47fe5 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.692260 17138 raft_consensus.cc:2243] T 976b5b49dae34fae8a725ff84ca47fe5 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.692755 17138 raft_consensus.cc:2272] T 976b5b49dae34fae8a725ff84ca47fe5 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.695333 17138 tablet_replica.cc:333] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.696045 17138 raft_consensus.cc:2243] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.697079 17138 raft_consensus.cc:2272] T 5ab38e5621004b79ad7c4f961d7e29ae P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.699936 17138 tablet_replica.cc:333] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.701020 17138 raft_consensus.cc:2243] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.701784 17138 raft_consensus.cc:2272] T 728a1fd5a8c84cb19f6691fc08e1eeef P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.704491 27332 leader_election.cc:336] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:58.703780 27331 leader_election.cc:336] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:58.705914 17138 tablet_replica.cc:333] T f28a920522f34d318c610b60571ca004 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.706173 27331 leader_election.cc:304] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:58.707154 28282 raft_consensus.cc:2749] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:58.707921 17138 raft_consensus.cc:2243] T f28a920522f34d318c610b60571ca004 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.708695 17138 raft_consensus.cc:2272] T f28a920522f34d318c610b60571ca004 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.712082 17138 tablet_replica.cc:333] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
W20260709 13:21:58.712484 27331 leader_election.cc:336] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:58.712988 17138 raft_consensus.cc:2243] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.713099 27331 leader_election.cc:304] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:58.714179 28282 raft_consensus.cc:2749] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:58.713636 17138 raft_consensus.cc:2272] T 706ddcc20d574055ac044c0ff3d638a0 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.715221 27332 consensus_peers.cc:597] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.717797 17138 tablet_replica.cc:333] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.718672 17138 raft_consensus.cc:2243] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.719743 17138 raft_consensus.cc:2272] T 00a2e2e4269146dd8e2bf720a1c890d8 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.721997 17138 tablet_replica.cc:333] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.722764 17138 raft_consensus.cc:2243] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.723819 17138 raft_consensus.cc:2272] T f684c9c7b4874567b690e70a7ddae640 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.726639 27332 consensus_peers.cc:597] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.727084 17138 tablet_replica.cc:333] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.727705 17138 raft_consensus.cc:2243] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.728111 17138 raft_consensus.cc:2272] T 46295debdbf04af3ae614987b17bd03d P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.730309 17138 tablet_replica.cc:333] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.730876 17138 raft_consensus.cc:2243] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.731282 17138 raft_consensus.cc:2272] T 15e3484b734c41099e53b3f518789f39 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.733636 17138 tablet_replica.cc:333] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.734392 17138 raft_consensus.cc:2243] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.735424 17138 raft_consensus.cc:2272] T 2c666107348f4678ba2161b66cd6d486 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.738026 17138 tablet_replica.cc:333] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.738796 17138 raft_consensus.cc:2243] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.739084 28282 raft_consensus.cc:493] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:58.740240 17138 raft_consensus.cc:2272] T 76efc04736174df4a18381faaf044830 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.740231 28282 raft_consensus.cc:515] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:58.743115 28282 leader_election.cc:290] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:58.743287 17138 tablet_replica.cc:333] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.744172 17138 raft_consensus.cc:2243] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.745311 17138 raft_consensus.cc:2272] T f09320cdf2a440f789313b20646079a6 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.747956 17138 tablet_replica.cc:333] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.748685 17138 raft_consensus.cc:2243] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.749249 17138 raft_consensus.cc:2272] T 8115282f2b1544e6a930473c43950bc4 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.749361 28284 raft_consensus.cc:493] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:58.750080 28284 raft_consensus.cc:515] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:58.752117 17138 tablet_replica.cc:333] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.752911 17138 raft_consensus.cc:2243] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.753662 28284 leader_election.cc:290] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1962786a39404929920d966805e48399 (127.16.188.132:40225), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:58.753896 17138 raft_consensus.cc:2272] T dd74c5033db646ea91b4ca463507c3a3 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.756953 17138 tablet_replica.cc:333] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.757697 17138 raft_consensus.cc:2243] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.758248 17138 raft_consensus.cc:2272] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.759584 27364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b37122e3aa24369b6edfe70347b97e9" candidate_uuid: "2d8e002e04a74c2598405158a99d86c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1962786a39404929920d966805e48399" is_pre_election: true
I20260709 13:21:58.760468 27364 raft_consensus.cc:2468] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d8e002e04a74c2598405158a99d86c1 in term 2.
I20260709 13:21:58.760833 17138 tablet_replica.cc:333] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.761698 17138 raft_consensus.cc:2243] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.763091 17138 raft_consensus.cc:2272] T b1a9e5ac221b44be83106f28e32dc20e P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.761670 27331 leader_election.cc:336] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:58.765374 27258 leader_election.cc:304] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1962786a39404929920d966805e48399, 2d8e002e04a74c2598405158a99d86c1; no voters: 
I20260709 13:21:58.765803 17138 tablet_replica.cc:333] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
W20260709 13:21:58.766177 27258 raft_consensus.cc:2686] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:21:58.766474 27332 leader_election.cc:336] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Network error: Client connection negotiation failed: client connection to 127.16.188.130:38009: connect: Connection refused (error 111)
I20260709 13:21:58.766641 17138 raft_consensus.cc:2243] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:58.766151 27257 leader_election.cc:336] T 8b37122e3aa24369b6edfe70347b97e9 P 2d8e002e04a74c2598405158a99d86c1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:58.767540 17138 raft_consensus.cc:2272] T 8474c28d9650438ca267ba04bf79b5eb P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.769527 27332 leader_election.cc:304] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:58.770140 17138 tablet_replica.cc:333] T 501b61a3989144c5a902cbf9ddbab055 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.770462 28282 raft_consensus.cc:2749] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:58.770987 17138 raft_consensus.cc:2243] T 501b61a3989144c5a902cbf9ddbab055 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.771600 17138 raft_consensus.cc:2272] T 501b61a3989144c5a902cbf9ddbab055 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.774344 17138 tablet_replica.cc:333] T 26ef473dee144c5dbc7086d2b983cb59 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.775074 17138 raft_consensus.cc:2243] T 26ef473dee144c5dbc7086d2b983cb59 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.775550 17138 raft_consensus.cc:2272] T 26ef473dee144c5dbc7086d2b983cb59 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.775514 27332 consensus_peers.cc:597] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.778118 17138 tablet_replica.cc:333] T 180999038c4a4fa7912fea59dfabd4d4 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.778668 17138 raft_consensus.cc:2243] T 180999038c4a4fa7912fea59dfabd4d4 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.779098 17138 raft_consensus.cc:2272] T 180999038c4a4fa7912fea59dfabd4d4 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.779697 28282 raft_consensus.cc:493] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:58.781648 17138 tablet_replica.cc:333] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.782830 17138 raft_consensus.cc:2243] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.783628 17138 raft_consensus.cc:2272] T 2809a3a620544e7f8ce472b3563c2df9 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.780481 28282 raft_consensus.cc:515] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:58.786309 17138 tablet_replica.cc:333] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.786909 17138 raft_consensus.cc:2243] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.787653 17138 raft_consensus.cc:2272] T 148eb001e9854043a2ad74dc8af08ae0 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.790271 17138 tablet_replica.cc:333] T 93e07aed35c54d449d6103728c481ab5 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.790948 17138 raft_consensus.cc:2243] T 93e07aed35c54d449d6103728c481ab5 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.791414 17138 raft_consensus.cc:2272] T 93e07aed35c54d449d6103728c481ab5 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.793712 17138 tablet_replica.cc:333] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.794196 17138 raft_consensus.cc:2243] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.794401 28282 leader_election.cc:290] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
I20260709 13:21:58.795267 17138 raft_consensus.cc:2272] T 960bc3fba4dc481e9602d13cd4a0b5ae P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.797431 27331 leader_election.cc:336] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:58.798127 17138 tablet_replica.cc:333] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.798733 17138 raft_consensus.cc:2243] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.799628 17138 raft_consensus.cc:2272] T ff5e8ee488ee4e18adea644ba22ed683 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.802309 17138 tablet_replica.cc:333] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
W20260709 13:21:58.802089 27332 leader_election.cc:336] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Network error: Client connection negotiation failed: client connection to 127.16.188.130:38009: connect: Connection refused (error 111)
I20260709 13:21:58.802948 17138 raft_consensus.cc:2243] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.802778 27332 leader_election.cc:304] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:58.803748 28282 raft_consensus.cc:2749] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:58.803865 17138 raft_consensus.cc:2272] T 6b8d513ca0a647d5a716650ed58360f6 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:58.804425 27332 consensus_peers.cc:597] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.806107 17138 tablet_replica.cc:333] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.806759 17138 raft_consensus.cc:2243] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.807226 17138 raft_consensus.cc:2272] T 7109f14a616b49939aa2fbd96d6ad458 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.809330 17138 tablet_replica.cc:333] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.809828 17138 raft_consensus.cc:2243] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.810562 17138 raft_consensus.cc:2272] T be748b869d8b48dfa56a49c838cc4818 P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.812752 17138 tablet_replica.cc:333] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.813223 17138 raft_consensus.cc:2243] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:58.813936 17138 raft_consensus.cc:2272] T add22a21c5bf424390df6d87617a47e7 P 2d8e002e04a74c2598405158a99d86c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.816172 17138 tablet_replica.cc:333] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.816849 17138 raft_consensus.cc:2243] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.817402 17138 raft_consensus.cc:2272] T be5dc6e054a74138af98e26f08cd76e0 P 2d8e002e04a74c2598405158a99d86c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.819888 17138 tablet_replica.cc:333] T c942513b146c4cfeba8bdfc1baac288e P 2d8e002e04a74c2598405158a99d86c1: stopping tablet replica
I20260709 13:21:58.820379 17138 raft_consensus.cc:2243] T c942513b146c4cfeba8bdfc1baac288e P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:58.820856 17138 raft_consensus.cc:2272] T c942513b146c4cfeba8bdfc1baac288e P 2d8e002e04a74c2598405158a99d86c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:58.822010 28282 raft_consensus.cc:493] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:58.822625 28282 raft_consensus.cc:515] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:58.826536 28282 leader_election.cc:290] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
W20260709 13:21:58.828078 27332 consensus_peers.cc:597] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:58.832047 27331 leader_election.cc:336] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
W20260709 13:21:58.832916 27332 leader_election.cc:336] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Network error: Client connection negotiation failed: client connection to 127.16.188.130:38009: connect: Connection refused (error 111)
I20260709 13:21:58.833384 27332 leader_election.cc:304] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:58.834208 28282 raft_consensus.cc:2749] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:58.883378 27332 consensus_peers.cc:597] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:58.886819 27257 connection.cc:466] server connection from 127.0.0.1:42550 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42550 (request call id 877) could send its response
W20260709 13:21:58.888562 27332 consensus_peers.cc:597] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 -> Peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Couldn't send request to peer 2d8e002e04a74c2598405158a99d86c1. Status: Network error: recv got EOF from 127.16.188.131:39829 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:58.905184 17138 tablet_server.cc:196] TabletServer@127.16.188.131:0 shutdown complete.
I20260709 13:21:58.934707 28282 raft_consensus.cc:493] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:58.935648 28282 raft_consensus.cc:515] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:58.938773 28282 leader_election.cc:290] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
W20260709 13:21:58.943941 27331 leader_election.cc:336] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
W20260709 13:21:58.945870 27332 leader_election.cc:336] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Network error: Client connection negotiation failed: client connection to 127.16.188.130:38009: connect: Connection refused (error 111)
I20260709 13:21:58.947588 27332 leader_election.cc:304] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:58.948374 28282 raft_consensus.cc:2749] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:58.971877 28282 raft_consensus.cc:493] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:58.972702 28282 raft_consensus.cc:515] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:58.975684 28282 leader_election.cc:290] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
W20260709 13:21:58.982065 27332 leader_election.cc:336] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Network error: Client connection negotiation failed: client connection to 127.16.188.131:39829: connect: Connection refused (error 111)
W20260709 13:21:58.982992 27331 leader_election.cc:336] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:58.983494 27331 leader_election.cc:304] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:58.984338 28282 raft_consensus.cc:2749] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:58.993889 17138 tablet_server.cc:179] TabletServer@127.16.188.132:0 shutting down...
I20260709 13:21:59.058494 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:59.060645 17138 tablet_replica.cc:333] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.061556 17138 raft_consensus.cc:2243] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.062678 17138 raft_consensus.cc:2272] T 8115282f2b1544e6a930473c43950bc4 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.065311 17138 tablet_replica.cc:333] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.065915 17138 raft_consensus.cc:2243] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.066373 17138 raft_consensus.cc:2272] T 6df6aa2911c94954949e3b8283d1d2e1 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.068481 17138 tablet_replica.cc:333] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.069111 17138 raft_consensus.cc:2243] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.069532 17138 raft_consensus.cc:2272] T c475a8c029024e99b4377fdda1a27c2a P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.071707 17138 tablet_replica.cc:333] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.072301 17138 raft_consensus.cc:2243] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.073362 17138 raft_consensus.cc:2272] T 178fe9f66bbf440780bf6f265626a054 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.075949 17138 tablet_replica.cc:333] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.077164 17138 raft_consensus.cc:2243] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.077679 17138 raft_consensus.cc:2272] T 8b37122e3aa24369b6edfe70347b97e9 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.080343 17138 tablet_replica.cc:333] T be748b869d8b48dfa56a49c838cc4818 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.080931 17138 raft_consensus.cc:2243] T be748b869d8b48dfa56a49c838cc4818 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.081409 17138 raft_consensus.cc:2272] T be748b869d8b48dfa56a49c838cc4818 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.083711 17138 tablet_replica.cc:333] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.084293 17138 raft_consensus.cc:2243] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.085143 17138 raft_consensus.cc:2272] T d45fa14105f64435ae8fd7b34c0dc72c P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.087406 17138 tablet_replica.cc:333] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.087965 17138 raft_consensus.cc:2243] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.088433 17138 raft_consensus.cc:2272] T c32e5371db8c4a95ab423532604c6f33 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.090689 17138 tablet_replica.cc:333] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.091300 17138 raft_consensus.cc:2243] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.092113 17138 raft_consensus.cc:2272] T 4fade412cd974138979c417dd233c35a P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.094461 17138 tablet_replica.cc:333] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.095055 17138 raft_consensus.cc:2243] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.095484 17138 raft_consensus.cc:2272] T 7d205fe2cb9d4d319c85bb33f59ca660 P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.098097 17138 tablet_replica.cc:333] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.098677 17138 raft_consensus.cc:2243] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.099140 17138 raft_consensus.cc:2272] T 46bbc4b2c88745c699787c5df44ed464 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.101579 17138 tablet_replica.cc:333] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.102208 17138 raft_consensus.cc:2243] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.103047 17138 raft_consensus.cc:2272] T 98dc2c568d9642a587b5741241562afe P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.104984 28282 raft_consensus.cc:493] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:59.105574 17138 tablet_replica.cc:333] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.105638 28282 raft_consensus.cc:515] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } } peers { permanent_uuid: "05f7e02ff65b470591cb5d9565f123d6" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38009 } }
I20260709 13:21:59.106326 17138 raft_consensus.cc:2243] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.107285 17138 raft_consensus.cc:2272] T 2af7a5fd35f9478ba7387eec2ab4d036 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.110160 17138 tablet_replica.cc:333] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.112746 17138 raft_consensus.cc:2243] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.113329 17138 raft_consensus.cc:2272] T e69c998c37474f57b3b6d7355f0cc235 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:59.113361 27331 leader_election.cc:336] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:59.108422 28282 leader_election.cc:290] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935), 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009)
W20260709 13:21:59.116281 27332 leader_election.cc:336] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 05f7e02ff65b470591cb5d9565f123d6 (127.16.188.130:38009): Network error: Client connection negotiation failed: client connection to 127.16.188.130:38009: connect: Connection refused (error 111)
I20260709 13:21:59.116463 17138 tablet_replica.cc:333] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.116824 27332 leader_election.cc:304] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 05f7e02ff65b470591cb5d9565f123d6, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:59.117268 17138 raft_consensus.cc:2243] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.117770 28282 raft_consensus.cc:2749] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:59.117983 17138 raft_consensus.cc:2272] T 00a2e2e4269146dd8e2bf720a1c890d8 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.120461 17138 tablet_replica.cc:333] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.121193 17138 raft_consensus.cc:2243] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.122066 17138 raft_consensus.cc:2272] T 706ddcc20d574055ac044c0ff3d638a0 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.124234 17138 tablet_replica.cc:333] T b76838dbe1fd4a4eac1e7d5740cf668f P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.124894 17138 raft_consensus.cc:2243] T b76838dbe1fd4a4eac1e7d5740cf668f P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.125334 17138 raft_consensus.cc:2272] T b76838dbe1fd4a4eac1e7d5740cf668f P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.127442 17138 tablet_replica.cc:333] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.128021 17138 raft_consensus.cc:2243] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.128556 17138 raft_consensus.cc:2272] T 315d4de5fc5940f9b5f1d3206e7028c0 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.129405 28282 raft_consensus.cc:493] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f79efe7c9e6a4384b765393621da6816)
I20260709 13:21:59.130131 28282 raft_consensus.cc:515] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d8e002e04a74c2598405158a99d86c1" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39829 } } peers { permanent_uuid: "1962786a39404929920d966805e48399" member_type: VOTER last_known_addr { host: "127.16.188.132" port: 40225 } } peers { permanent_uuid: "f79efe7c9e6a4384b765393621da6816" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 35935 } }
I20260709 13:21:59.131199 17138 tablet_replica.cc:333] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.131860 17138 raft_consensus.cc:2243] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.132822 17138 raft_consensus.cc:2272] T 966ee691db624d2bac9b9cfe639d8963 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.133203 28282 leader_election.cc:290] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829), f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935)
I20260709 13:21:59.135967 17138 tablet_replica.cc:333] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.136970 17138 raft_consensus.cc:2243] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.137544 17138 raft_consensus.cc:2272] T 0fb491563d1a49ac99c74ae4f6553d26 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:59.138754 27332 leader_election.cc:336] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2d8e002e04a74c2598405158a99d86c1 (127.16.188.131:39829): Network error: Client connection negotiation failed: client connection to 127.16.188.131:39829: connect: Connection refused (error 111)
W20260709 13:21:59.139846 27331 leader_election.cc:336] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f79efe7c9e6a4384b765393621da6816 (127.16.188.129:35935): Network error: Client connection negotiation failed: client connection to 127.16.188.129:35935: connect: Connection refused (error 111)
I20260709 13:21:59.140265 27331 leader_election.cc:304] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1962786a39404929920d966805e48399; no voters: 2d8e002e04a74c2598405158a99d86c1, f79efe7c9e6a4384b765393621da6816
I20260709 13:21:59.140640 17138 tablet_replica.cc:333] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.141151 28282 raft_consensus.cc:2749] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:59.141511 17138 raft_consensus.cc:2243] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.142460 17138 raft_consensus.cc:2272] T f28a920522f34d318c610b60571ca004 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.144496 17138 tablet_replica.cc:333] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.145062 17138 raft_consensus.cc:2243] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.145483 17138 raft_consensus.cc:2272] T dd1665cdc23c4af782f4111587dbf68f P 1962786a39404929920d966805e48399 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.147576 17138 tablet_replica.cc:333] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.148068 17138 raft_consensus.cc:2243] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.148484 17138 raft_consensus.cc:2272] T 9f72db119dad434b84f9712dc1930f7f P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.150796 17138 tablet_replica.cc:333] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.151293 17138 raft_consensus.cc:2243] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.151701 17138 raft_consensus.cc:2272] T 2c666107348f4678ba2161b66cd6d486 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.153849 17138 tablet_replica.cc:333] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.154407 17138 raft_consensus.cc:2243] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.154840 17138 raft_consensus.cc:2272] T 76efc04736174df4a18381faaf044830 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.156999 17138 tablet_replica.cc:333] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.157508 17138 raft_consensus.cc:2243] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.158264 17138 raft_consensus.cc:2272] T ba68051b3f1c40c9bcface09069e68e0 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.160566 17138 tablet_replica.cc:333] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.161314 17138 raft_consensus.cc:2243] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.161804 17138 raft_consensus.cc:2272] T a2a24e48beb74b37aa9434f9d9be4a22 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.164434 17138 tablet_replica.cc:333] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.164994 17138 raft_consensus.cc:2243] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.165443 17138 raft_consensus.cc:2272] T 42ad970eae96417783396e7accb1b834 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.167677 17138 tablet_replica.cc:333] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.168231 17138 raft_consensus.cc:2243] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.169036 17138 raft_consensus.cc:2272] T 180999038c4a4fa7912fea59dfabd4d4 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.171211 17138 tablet_replica.cc:333] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.171723 17138 raft_consensus.cc:2243] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.172588 17138 raft_consensus.cc:2272] T 93e07aed35c54d449d6103728c481ab5 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.174796 17138 tablet_replica.cc:333] T 148eb001e9854043a2ad74dc8af08ae0 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.175334 17138 raft_consensus.cc:2243] T 148eb001e9854043a2ad74dc8af08ae0 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.175735 17138 raft_consensus.cc:2272] T 148eb001e9854043a2ad74dc8af08ae0 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.178122 17138 tablet_replica.cc:333] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.178633 17138 raft_consensus.cc:2243] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.179152 17138 raft_consensus.cc:2272] T be5dc6e054a74138af98e26f08cd76e0 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.181618 17138 tablet_replica.cc:333] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.182166 17138 raft_consensus.cc:2243] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.182598 17138 raft_consensus.cc:2272] T 992029a58c6b4e9fae2a4024cda34dcd P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.184578 17138 tablet_replica.cc:333] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.185117 17138 raft_consensus.cc:2243] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.185899 17138 raft_consensus.cc:2272] T 26ef473dee144c5dbc7086d2b983cb59 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.188136 17138 tablet_replica.cc:333] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.188709 17138 raft_consensus.cc:2243] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.189469 17138 raft_consensus.cc:2272] T 2097666912334a53a80b648a0fad2786 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.191586 17138 tablet_replica.cc:333] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.192181 17138 raft_consensus.cc:2243] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.192646 17138 raft_consensus.cc:2272] T ff5e8ee488ee4e18adea644ba22ed683 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.194727 17138 tablet_replica.cc:333] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.195205 17138 raft_consensus.cc:2243] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.195591 17138 raft_consensus.cc:2272] T b8bc3f6a11ae4b85870951a4ef079571 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.197746 17138 tablet_replica.cc:333] T 6b8d513ca0a647d5a716650ed58360f6 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.198226 17138 raft_consensus.cc:2243] T 6b8d513ca0a647d5a716650ed58360f6 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.198650 17138 raft_consensus.cc:2272] T 6b8d513ca0a647d5a716650ed58360f6 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.200814 17138 tablet_replica.cc:333] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.201320 17138 raft_consensus.cc:2243] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.201782 17138 raft_consensus.cc:2272] T 7109f14a616b49939aa2fbd96d6ad458 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.203994 17138 tablet_replica.cc:333] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.204501 17138 raft_consensus.cc:2243] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.204890 17138 raft_consensus.cc:2272] T 5ab38e5621004b79ad7c4f961d7e29ae P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.206940 17138 tablet_replica.cc:333] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.207442 17138 raft_consensus.cc:2243] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.207886 17138 raft_consensus.cc:2272] T 728a1fd5a8c84cb19f6691fc08e1eeef P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.210410 17138 tablet_replica.cc:333] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.210903 17138 raft_consensus.cc:2243] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.211717 17138 raft_consensus.cc:2272] T 501b61a3989144c5a902cbf9ddbab055 P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.213804 17138 tablet_replica.cc:333] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.214323 17138 raft_consensus.cc:2243] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.214804 17138 raft_consensus.cc:2272] T 960bc3fba4dc481e9602d13cd4a0b5ae P 1962786a39404929920d966805e48399 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.216895 17138 tablet_replica.cc:333] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399: stopping tablet replica
I20260709 13:21:59.217392 17138 raft_consensus.cc:2243] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:59.217831 17138 raft_consensus.cc:2272] T f684c9c7b4874567b690e70a7ddae640 P 1962786a39404929920d966805e48399 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.310886 17138 tablet_server.cc:196] TabletServer@127.16.188.132:0 shutdown complete.
I20260709 13:21:59.412629 17138 master.cc:562] Master@127.16.188.190:42581 shutting down...
I20260709 13:21:59.460361 17138 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:59.461086 17138 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:59.461524 17138 tablet_replica.cc:333] T 00000000000000000000000000000000 P e7e8a36e61cb4fc38ccf440704df6ccd: stopping tablet replica
W20260709 13:22:00.481710 17138 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 27072)
I20260709 13:22:00.667446 17138 master.cc:584] Master@127.16.188.190:42581 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (35873 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:22:00.766407 17138 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.188.190:39015
I20260709 13:22:00.767699 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:00.774186 28287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:00.774366 28288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:00.776265 28290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:00.776906 17138 server_base.cc:1061] running on GCE node
I20260709 13:22:00.778040 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:00.778223 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:00.778339 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603320778328 us; error 0 us; skew 500 ppm
I20260709 13:22:00.778825 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:00.781342 17138 webserver.cc:533] Webserver started at http://127.16.188.190:37277/ using document root <none> and password file <none>
I20260709 13:22:00.781802 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:00.781961 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:00.782186 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:00.783341 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/master-0-root/instance:
uuid: "7769f809450840e8b77e67c1108fe969"
format_stamp: "Formatted at 2026-07-09 13:22:00 on dist-test-slave-2hqk"
I20260709 13:22:00.787806 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:00.791278 28295 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:00.792127 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:00.792419 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/master-0-root
uuid: "7769f809450840e8b77e67c1108fe969"
format_stamp: "Formatted at 2026-07-09 13:22:00 on dist-test-slave-2hqk"
I20260709 13:22:00.792762 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:00.806258 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:00.807457 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:00.848704 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.190:39015
I20260709 13:22:00.848834 28346 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.190:39015 every 8 connection(s)
I20260709 13:22:00.852840 28347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:00.864343 28347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969: Bootstrap starting.
I20260709 13:22:00.869742 28347 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:00.874455 28347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969: No bootstrap required, opened a new log
I20260709 13:22:00.876952 28347 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7769f809450840e8b77e67c1108fe969" member_type: VOTER }
I20260709 13:22:00.877346 28347 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:00.877601 28347 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7769f809450840e8b77e67c1108fe969, State: Initialized, Role: FOLLOWER
I20260709 13:22:00.878309 28347 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7769f809450840e8b77e67c1108fe969" member_type: VOTER }
I20260709 13:22:00.878773 28347 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:00.878993 28347 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:00.879287 28347 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:00.884438 28347 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7769f809450840e8b77e67c1108fe969" member_type: VOTER }
I20260709 13:22:00.885049 28347 leader_election.cc:304] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7769f809450840e8b77e67c1108fe969; no voters: 
I20260709 13:22:00.886394 28347 leader_election.cc:290] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:00.886914 28350 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:00.888427 28350 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [term 1 LEADER]: Becoming Leader. State: Replica: 7769f809450840e8b77e67c1108fe969, State: Running, Role: LEADER
I20260709 13:22:00.889164 28350 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7769f809450840e8b77e67c1108fe969" member_type: VOTER }
I20260709 13:22:00.889678 28347 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:00.894821 28352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7769f809450840e8b77e67c1108fe969. Latest consensus state: current_term: 1 leader_uuid: "7769f809450840e8b77e67c1108fe969" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7769f809450840e8b77e67c1108fe969" member_type: VOTER } }
I20260709 13:22:00.895661 28352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:00.898587 28351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7769f809450840e8b77e67c1108fe969" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7769f809450840e8b77e67c1108fe969" member_type: VOTER } }
I20260709 13:22:00.899358 28351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:00.905049 28357 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:00.910492 28357 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:00.913422 17138 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:00.920403 28357 catalog_manager.cc:1383] Generated new cluster ID: 03144eba1e4d40aabd05feec230721ec
I20260709 13:22:00.920720 28357 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:00.952162 28357 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:00.953442 28357 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:00.973407 28357 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969: Generated new TSK 0
I20260709 13:22:00.974089 28357 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:00.982796 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:00.989609 28368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:00.990875 28369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:00.992712 28371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:00.993044 17138 server_base.cc:1061] running on GCE node
I20260709 13:22:00.994269 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:00.994469 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:00.994626 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603320994606 us; error 0 us; skew 500 ppm
I20260709 13:22:00.995221 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:00.997941 17138 webserver.cc:533] Webserver started at http://127.16.188.129:44239/ using document root <none> and password file <none>
I20260709 13:22:00.998499 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:00.998709 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:00.999027 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:01.000202 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-0-root/instance:
uuid: "004f456252b8484eb43b4ce94ac3ff5e"
format_stamp: "Formatted at 2026-07-09 13:22:00 on dist-test-slave-2hqk"
I20260709 13:22:01.005311 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:01.009145 28376 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:01.010134 17138 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:22:01.010484 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-0-root
uuid: "004f456252b8484eb43b4ce94ac3ff5e"
format_stamp: "Formatted at 2026-07-09 13:22:00 on dist-test-slave-2hqk"
I20260709 13:22:01.010802 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:01.028163 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:01.029685 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:01.031400 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:01.034025 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:01.034274 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:01.034575 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:01.034732 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:01.083369 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.129:37681
I20260709 13:22:01.083494 28438 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.129:37681 every 8 connection(s)
I20260709 13:22:01.088754 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:01.097020 28443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:01.098311 28444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:01.112316 28446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:01.112577 17138 server_base.cc:1061] running on GCE node
I20260709 13:22:01.114398 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:01.114698 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:01.114948 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603321114921 us; error 0 us; skew 500 ppm
I20260709 13:22:01.115674 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:01.119266 17138 webserver.cc:533] Webserver started at http://127.16.188.130:34441/ using document root <none> and password file <none>
I20260709 13:22:01.119598 28439 heartbeater.cc:344] Connected to a master server at 127.16.188.190:39015
I20260709 13:22:01.120021 28439 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:01.120078 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:01.120493 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:01.120793 28439 heartbeater.cc:507] Master 127.16.188.190:39015 requested a full tablet report, sending...
I20260709 13:22:01.120914 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:01.122901 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-1-root/instance:
uuid: "03ba0ee779824f1887cc4012724105af"
format_stamp: "Formatted at 2026-07-09 13:22:01 on dist-test-slave-2hqk"
I20260709 13:22:01.123662 28312 ts_manager.cc:194] Registered new tserver with Master: 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681)
I20260709 13:22:01.126353 28312 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36482
I20260709 13:22:01.129417 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.005s
I20260709 13:22:01.133112 28451 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:01.133909 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:22:01.134191 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-1-root
uuid: "03ba0ee779824f1887cc4012724105af"
format_stamp: "Formatted at 2026-07-09 13:22:01 on dist-test-slave-2hqk"
I20260709 13:22:01.134449 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:01.151533 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:01.152856 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:01.154400 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:01.156786 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:01.157012 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:01.157256 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:01.157446 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:01.203537 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.130:39033
I20260709 13:22:01.203681 28513 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.130:39033 every 8 connection(s)
I20260709 13:22:01.209080 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:01.217077 28517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:01.219558 28518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:01.221166 28520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:01.222864 17138 server_base.cc:1061] running on GCE node
I20260709 13:22:01.223397 28514 heartbeater.cc:344] Connected to a master server at 127.16.188.190:39015
I20260709 13:22:01.223959 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:22:01.223969 28514 heartbeater.cc:461] Registering TS with master...
W20260709 13:22:01.224372 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:01.224735 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603321224708 us; error 0 us; skew 500 ppm
I20260709 13:22:01.225333 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:01.225360 28514 heartbeater.cc:507] Master 127.16.188.190:39015 requested a full tablet report, sending...
I20260709 13:22:01.228106 28312 ts_manager.cc:194] Registered new tserver with Master: 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:01.228248 17138 webserver.cc:533] Webserver started at http://127.16.188.131:44465/ using document root <none> and password file <none>
I20260709 13:22:01.229045 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:01.229278 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:01.229559 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:01.230120 28312 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36488
I20260709 13:22:01.230800 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-2-root/instance:
uuid: "23cc304460b3447092ff00d64430af73"
format_stamp: "Formatted at 2026-07-09 13:22:01 on dist-test-slave-2hqk"
I20260709 13:22:01.235493 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:22:01.239058 28525 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:01.239980 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:01.240298 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-2-root
uuid: "23cc304460b3447092ff00d64430af73"
format_stamp: "Formatted at 2026-07-09 13:22:01 on dist-test-slave-2hqk"
I20260709 13:22:01.240624 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:01.260895 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:01.262511 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:01.264163 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:01.266666 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:01.266906 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:01.267179 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:01.267371 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:01.315941 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.131:40363
I20260709 13:22:01.316082 28587 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.131:40363 every 8 connection(s)
I20260709 13:22:01.330474 28588 heartbeater.cc:344] Connected to a master server at 127.16.188.190:39015
I20260709 13:22:01.330893 28588 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:01.331605 28588 heartbeater.cc:507] Master 127.16.188.190:39015 requested a full tablet report, sending...
I20260709 13:22:01.333807 28312 ts_manager.cc:194] Registered new tserver with Master: 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:01.334324 17138 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014842069s
I20260709 13:22:01.335263 28312 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36498
I20260709 13:22:01.361824 28312 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36504:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:01.364981 28312 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:01.448715 28404 tablet_service.cc:1511] Processing CreateTablet for tablet 16ffc2091e8940379a8d55961701e74f (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:22:01.449730 28403 tablet_service.cc:1511] Processing CreateTablet for tablet 926cdbc0c6bb47c4880a8511ca063e01 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:22:01.449862 28401 tablet_service.cc:1511] Processing CreateTablet for tablet 0d29d8ce48ef406888dad00e902e7be0 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:22:01.448724 28402 tablet_service.cc:1511] Processing CreateTablet for tablet 281b7e55fe1e4bbda42f5d1bd309c807 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:22:01.450484 28404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ffc2091e8940379a8d55961701e74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.453825 28400 tablet_service.cc:1511] Processing CreateTablet for tablet 22f57744b40647d09ed70cc4ee340c7e (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:22:01.454535 28403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926cdbc0c6bb47c4880a8511ca063e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.455260 28400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22f57744b40647d09ed70cc4ee340c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.456017 28401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d29d8ce48ef406888dad00e902e7be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.457777 28553 tablet_service.cc:1511] Processing CreateTablet for tablet 16ffc2091e8940379a8d55961701e74f (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:22:01.458786 28402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281b7e55fe1e4bbda42f5d1bd309c807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.459190 28553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ffc2091e8940379a8d55961701e74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.458868 28399 tablet_service.cc:1511] Processing CreateTablet for tablet 1737010745e144fab6b8fc54f74434d0 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:22:01.461680 28552 tablet_service.cc:1511] Processing CreateTablet for tablet 926cdbc0c6bb47c4880a8511ca063e01 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:22:01.463047 28552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926cdbc0c6bb47c4880a8511ca063e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.465710 28551 tablet_service.cc:1511] Processing CreateTablet for tablet 281b7e55fe1e4bbda42f5d1bd309c807 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:22:01.466418 28479 tablet_service.cc:1511] Processing CreateTablet for tablet 16ffc2091e8940379a8d55961701e74f (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:22:01.467103 28551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281b7e55fe1e4bbda42f5d1bd309c807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.467866 28479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ffc2091e8940379a8d55961701e74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.469799 28550 tablet_service.cc:1511] Processing CreateTablet for tablet 0d29d8ce48ef406888dad00e902e7be0 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:22:01.471318 28550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d29d8ce48ef406888dad00e902e7be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.472790 28476 tablet_service.cc:1511] Processing CreateTablet for tablet 0d29d8ce48ef406888dad00e902e7be0 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:22:01.473696 28549 tablet_service.cc:1511] Processing CreateTablet for tablet 22f57744b40647d09ed70cc4ee340c7e (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:22:01.474277 28476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d29d8ce48ef406888dad00e902e7be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.475390 28549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22f57744b40647d09ed70cc4ee340c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.477711 28475 tablet_service.cc:1511] Processing CreateTablet for tablet 22f57744b40647d09ed70cc4ee340c7e (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:22:01.479169 28475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22f57744b40647d09ed70cc4ee340c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.481611 28474 tablet_service.cc:1511] Processing CreateTablet for tablet 1737010745e144fab6b8fc54f74434d0 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:22:01.482985 28474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1737010745e144fab6b8fc54f74434d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.469689 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 926cdbc0c6bb47c4880a8511ca063e01 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:22:01.471228 28477 tablet_service.cc:1511] Processing CreateTablet for tablet 281b7e55fe1e4bbda42f5d1bd309c807 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:22:01.485111 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 926cdbc0c6bb47c4880a8511ca063e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.485920 28477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281b7e55fe1e4bbda42f5d1bd309c807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.488103 28399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1737010745e144fab6b8fc54f74434d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.520642 28548 tablet_service.cc:1511] Processing CreateTablet for tablet 1737010745e144fab6b8fc54f74434d0 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:22:01.522778 28548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1737010745e144fab6b8fc54f74434d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.537433 28398 tablet_service.cc:1511] Processing CreateTablet for tablet f3df851215834fc0aecdbf1378ee50f7 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:22:01.539106 28398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3df851215834fc0aecdbf1378ee50f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.565992 28478 tablet_service.cc:1511] Processing CreateTablet for tablet f3df851215834fc0aecdbf1378ee50f7 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:22:01.567526 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3df851215834fc0aecdbf1378ee50f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.611171 28603 tablet_bootstrap.cc:492] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:01.612196 28547 tablet_service.cc:1511] Processing CreateTablet for tablet f3df851215834fc0aecdbf1378ee50f7 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:22:01.613917 28547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3df851215834fc0aecdbf1378ee50f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.623173 28603 tablet_bootstrap.cc:654] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.629700 28604 tablet_bootstrap.cc:492] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af: Bootstrap starting.
I20260709 13:22:01.635438 28605 tablet_bootstrap.cc:492] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73: Bootstrap starting.
I20260709 13:22:01.638432 28403 tablet_service.cc:1511] Processing CreateTablet for tablet 1057cc07cc2a4d4e8ede3957ef8b7a8f (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:22:01.640384 28403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1057cc07cc2a4d4e8ede3957ef8b7a8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.645911 28550 tablet_service.cc:1511] Processing CreateTablet for tablet 1057cc07cc2a4d4e8ede3957ef8b7a8f (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:22:01.659812 28550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1057cc07cc2a4d4e8ede3957ef8b7a8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.642493 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 1057cc07cc2a4d4e8ede3957ef8b7a8f (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:22:01.671819 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1057cc07cc2a4d4e8ede3957ef8b7a8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.653236 28605 tablet_bootstrap.cc:654] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.655422 28474 tablet_service.cc:1511] Processing CreateTablet for tablet 8152c1181a174c798146de84c401aa35 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:22:01.651981 28399 tablet_service.cc:1511] Processing CreateTablet for tablet 8152c1181a174c798146de84c401aa35 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:22:01.683820 28399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8152c1181a174c798146de84c401aa35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.677840 28603 tablet_bootstrap.cc:492] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e: No bootstrap required, opened a new log
I20260709 13:22:01.685702 28603 ts_tablet_manager.cc:1403] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.075s	user 0.029s	sys 0.022s
I20260709 13:22:01.687708 28605 tablet_bootstrap.cc:492] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73: No bootstrap required, opened a new log
I20260709 13:22:01.688280 28605 ts_tablet_manager.cc:1403] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.004s
I20260709 13:22:01.689133 28604 tablet_bootstrap.cc:654] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.689090 28603 raft_consensus.cc:359] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.690006 28603 raft_consensus.cc:385] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.690335 28603 raft_consensus.cc:740] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.691452 28605 raft_consensus.cc:359] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.692976 28474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8152c1181a174c798146de84c401aa35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.692308 28605 raft_consensus.cc:385] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.693451 28605 raft_consensus.cc:740] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23cc304460b3447092ff00d64430af73, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.700748 28603 consensus_queue.cc:260] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.701915 28553 tablet_service.cc:1511] Processing CreateTablet for tablet 8152c1181a174c798146de84c401aa35 (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:22:01.703673 28439 heartbeater.cc:499] Master 127.16.188.190:39015 was elected leader, sending a full tablet report...
I20260709 13:22:01.710037 28399 tablet_service.cc:1511] Processing CreateTablet for tablet 83274898c08c4f33845ec447c714f61b (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:22:01.711521 28399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83274898c08c4f33845ec447c714f61b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.711643 28553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8152c1181a174c798146de84c401aa35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.704155 28603 ts_tablet_manager.cc:1434] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:22:01.704722 28605 consensus_queue.cc:260] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.720494 28603 tablet_bootstrap.cc:492] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:01.725744 28605 ts_tablet_manager.cc:1434] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73: Time spent starting tablet: real 0.037s	user 0.013s	sys 0.003s
I20260709 13:22:01.726621 28588 heartbeater.cc:499] Master 127.16.188.190:39015 was elected leader, sending a full tablet report...
I20260709 13:22:01.728019 28603 tablet_bootstrap.cc:654] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.738072 28478 tablet_service.cc:1511] Processing CreateTablet for tablet 83274898c08c4f33845ec447c714f61b (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:22:01.739580 28478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83274898c08c4f33845ec447c714f61b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.741108 28550 tablet_service.cc:1511] Processing CreateTablet for tablet 83274898c08c4f33845ec447c714f61b (DEFAULT_TABLE table=test-workload [id=8c852f8991e248c29f8af98ed40a824d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:22:01.741850 28605 tablet_bootstrap.cc:492] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73: Bootstrap starting.
I20260709 13:22:01.742540 28550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83274898c08c4f33845ec447c714f61b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:01.753722 28604 tablet_bootstrap.cc:492] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af: No bootstrap required, opened a new log
I20260709 13:22:01.754390 28604 ts_tablet_manager.cc:1403] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af: Time spent bootstrapping tablet: real 0.125s	user 0.010s	sys 0.006s
I20260709 13:22:01.757403 28604 raft_consensus.cc:359] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.758124 28604 raft_consensus.cc:385] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.758414 28604 raft_consensus.cc:740] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.763531 28604 consensus_queue.cc:260] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.766525 28603 tablet_bootstrap.cc:492] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e: No bootstrap required, opened a new log
I20260709 13:22:01.767196 28603 ts_tablet_manager.cc:1403] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.018s
I20260709 13:22:01.771047 28605 tablet_bootstrap.cc:654] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.771075 28514 heartbeater.cc:499] Master 127.16.188.190:39015 was elected leader, sending a full tablet report...
I20260709 13:22:01.771549 28604 ts_tablet_manager.cc:1434] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.002s
I20260709 13:22:01.770779 28603 raft_consensus.cc:359] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.772080 28603 raft_consensus.cc:385] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.772559 28604 tablet_bootstrap.cc:492] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af: Bootstrap starting.
I20260709 13:22:01.772452 28603 raft_consensus.cc:740] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.773756 28603 consensus_queue.cc:260] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.776654 28603 ts_tablet_manager.cc:1434] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.002s
I20260709 13:22:01.777770 28603 tablet_bootstrap.cc:492] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:01.779177 28604 tablet_bootstrap.cc:654] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.786800 28603 tablet_bootstrap.cc:654] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.807885 28603 tablet_bootstrap.cc:492] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e: No bootstrap required, opened a new log
I20260709 13:22:01.808431 28603 ts_tablet_manager.cc:1403] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.017s
I20260709 13:22:01.809285 28604 tablet_bootstrap.cc:492] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af: No bootstrap required, opened a new log
I20260709 13:22:01.809439 28605 tablet_bootstrap.cc:492] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73: No bootstrap required, opened a new log
I20260709 13:22:01.810362 28604 ts_tablet_manager.cc:1403] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.020s
I20260709 13:22:01.810493 28605 ts_tablet_manager.cc:1403] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73: Time spent bootstrapping tablet: real 0.069s	user 0.022s	sys 0.020s
I20260709 13:22:01.811638 28603 raft_consensus.cc:359] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.812538 28603 raft_consensus.cc:385] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.812834 28603 raft_consensus.cc:740] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.813616 28603 consensus_queue.cc:260] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.813957 28605 raft_consensus.cc:359] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.815595 28603 ts_tablet_manager.cc:1434] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:01.816725 28603 tablet_bootstrap.cc:492] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:01.816566 28604 raft_consensus.cc:359] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.817459 28604 raft_consensus.cc:385] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.817796 28604 raft_consensus.cc:740] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.818483 28605 raft_consensus.cc:385] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.818869 28605 raft_consensus.cc:740] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23cc304460b3447092ff00d64430af73, State: Initialized, Role: FOLLOWER
W20260709 13:22:01.820333 28589 tablet.cc:2406] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:22:01.820462 28604 consensus_queue.cc:260] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.819694 28605 consensus_queue.cc:260] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.823105 28604 ts_tablet_manager.cc:1434] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:22:01.823901 28603 tablet_bootstrap.cc:654] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.824213 28604 tablet_bootstrap.cc:492] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af: Bootstrap starting.
I20260709 13:22:01.829489 28605 ts_tablet_manager.cc:1434] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:22:01.830679 28605 tablet_bootstrap.cc:492] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73: Bootstrap starting.
I20260709 13:22:01.831970 28604 tablet_bootstrap.cc:654] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.838212 28605 tablet_bootstrap.cc:654] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.843772 28603 tablet_bootstrap.cc:492] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e: No bootstrap required, opened a new log
I20260709 13:22:01.844332 28603 ts_tablet_manager.cc:1403] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.016s
I20260709 13:22:01.847452 28603 raft_consensus.cc:359] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.848181 28603 raft_consensus.cc:385] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.848466 28603 raft_consensus.cc:740] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.849316 28603 consensus_queue.cc:260] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.849725 28604 tablet_bootstrap.cc:492] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af: No bootstrap required, opened a new log
I20260709 13:22:01.850435 28604 ts_tablet_manager.cc:1403] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.006s
I20260709 13:22:01.851524 28603 ts_tablet_manager.cc:1434] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:01.852638 28603 tablet_bootstrap.cc:492] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:01.855243 28604 raft_consensus.cc:359] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.855988 28604 raft_consensus.cc:385] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.856328 28604 raft_consensus.cc:740] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.857262 28604 consensus_queue.cc:260] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.858422 28605 tablet_bootstrap.cc:492] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73: No bootstrap required, opened a new log
I20260709 13:22:01.859097 28605 ts_tablet_manager.cc:1403] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.008s
I20260709 13:22:01.860761 28603 tablet_bootstrap.cc:654] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.861723 28604 ts_tablet_manager.cc:1434] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:22:01.862838 28604 tablet_bootstrap.cc:492] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af: Bootstrap starting.
I20260709 13:22:01.862694 28605 raft_consensus.cc:359] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.863718 28605 raft_consensus.cc:385] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.864099 28605 raft_consensus.cc:740] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23cc304460b3447092ff00d64430af73, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.865085 28605 consensus_queue.cc:260] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.867484 28605 ts_tablet_manager.cc:1434] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:22:01.868579 28605 tablet_bootstrap.cc:492] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73: Bootstrap starting.
I20260709 13:22:01.875540 28605 tablet_bootstrap.cc:654] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.876088 28604 tablet_bootstrap.cc:654] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.878752 28603 tablet_bootstrap.cc:492] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e: No bootstrap required, opened a new log
I20260709 13:22:01.879455 28603 ts_tablet_manager.cc:1403] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.016s
I20260709 13:22:01.882484 28612 raft_consensus.cc:493] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:01.882723 28603 raft_consensus.cc:359] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.883780 28603 raft_consensus.cc:385] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.883288 28612 raft_consensus.cc:515] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.884219 28603 raft_consensus.cc:740] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.885314 28603 consensus_queue.cc:260] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.888104 28603 ts_tablet_manager.cc:1434] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:01.889325 28603 tablet_bootstrap.cc:492] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:01.896912 28608 raft_consensus.cc:493] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:01.897462 28608 raft_consensus.cc:515] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.903622 28608 leader_election.cc:290] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:01.904912 28608 raft_consensus.cc:493] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:01.905493 28608 raft_consensus.cc:515] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.906646 28612 leader_election.cc:290] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
W20260709 13:22:01.907621 28360 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:01.908466 28608 leader_election.cc:290] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:01.896587 28603 tablet_bootstrap.cc:654] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.915633 28605 tablet_bootstrap.cc:492] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73: No bootstrap required, opened a new log
I20260709 13:22:01.916289 28605 ts_tablet_manager.cc:1403] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.005s
I20260709 13:22:01.916923 28604 tablet_bootstrap.cc:492] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af: No bootstrap required, opened a new log
I20260709 13:22:01.917784 28604 ts_tablet_manager.cc:1403] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af: Time spent bootstrapping tablet: real 0.055s	user 0.028s	sys 0.012s
I20260709 13:22:01.927649 28604 raft_consensus.cc:359] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.952315 28608 raft_consensus.cc:493] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:01.951285 28563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d29d8ce48ef406888dad00e902e7be0" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73" is_pre_election: true
I20260709 13:22:01.970662 28604 raft_consensus.cc:385] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.952332 28612 raft_consensus.cc:493] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:01.971169 28604 raft_consensus.cc:740] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.929663 28489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d29d8ce48ef406888dad00e902e7be0" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af" is_pre_election: true
I20260709 13:22:01.925220 28605 raft_consensus.cc:359] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.971757 28612 raft_consensus.cc:515] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.971294 28563 raft_consensus.cc:2468] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 004f456252b8484eb43b4ce94ac3ff5e in term 0.
I20260709 13:22:01.931031 28603 tablet_bootstrap.cc:492] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e: No bootstrap required, opened a new log
I20260709 13:22:01.972333 28604 consensus_queue.cc:260] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.930270 28488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926cdbc0c6bb47c4880a8511ca063e01" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af" is_pre_election: true
I20260709 13:22:01.974920 28488 raft_consensus.cc:2468] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 004f456252b8484eb43b4ce94ac3ff5e in term 0.
I20260709 13:22:01.977108 28612 leader_election.cc:290] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:01.974066 28603 ts_tablet_manager.cc:1403] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.085s	user 0.026s	sys 0.014s
I20260709 13:22:01.981408 28628 raft_consensus.cc:493] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:01.981940 28628 raft_consensus.cc:515] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.982072 28603 raft_consensus.cc:359] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.982652 28604 ts_tablet_manager.cc:1434] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af: Time spent starting tablet: real 0.064s	user 0.026s	sys 0.028s
I20260709 13:22:01.982959 28603 raft_consensus.cc:385] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.983301 28603 raft_consensus.cc:740] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.983877 28604 tablet_bootstrap.cc:492] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af: Bootstrap starting.
I20260709 13:22:01.984592 28628 leader_election.cc:290] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:01.973349 28605 raft_consensus.cc:385] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:01.985268 28605 raft_consensus.cc:740] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23cc304460b3447092ff00d64430af73, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.986137 28605 consensus_queue.cc:260] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.951869 28562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926cdbc0c6bb47c4880a8511ca063e01" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73" is_pre_election: true
I20260709 13:22:01.989336 28562 raft_consensus.cc:2468] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 004f456252b8484eb43b4ce94ac3ff5e in term 0.
I20260709 13:22:01.991412 28604 tablet_bootstrap.cc:654] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:01.992304 28414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926cdbc0c6bb47c4880a8511ca063e01" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e" is_pre_election: true
I20260709 13:22:01.992591 28413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1737010745e144fab6b8fc54f74434d0" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e" is_pre_election: true
I20260709 13:22:01.993144 28414 raft_consensus.cc:2468] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 0.
I20260709 13:22:01.994392 28452 leader_election.cc:304] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af; no voters: 
I20260709 13:22:01.971024 28608 raft_consensus.cc:515] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.995402 28629 raft_consensus.cc:2804] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:01.995859 28629 raft_consensus.cc:493] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:01.995896 28413 raft_consensus.cc:2468] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 0.
I20260709 13:22:01.996327 28629 raft_consensus.cc:3060] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.997188 28608 leader_election.cc:290] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:01.999156 28605 ts_tablet_manager.cc:1434] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.001s
I20260709 13:22:01.999259 28452 leader_election.cc:304] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af; no voters: 
I20260709 13:22:02.000456 28563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1737010745e144fab6b8fc54f74434d0" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73" is_pre_election: true
I20260709 13:22:02.001190 28605 tablet_bootstrap.cc:492] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73: Bootstrap starting.
W20260709 13:22:02.002444 28453 leader_election.cc:343] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:02.003348 28612 raft_consensus.cc:2804] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:02.003791 28612 raft_consensus.cc:493] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:02.004156 28612 raft_consensus.cc:3060] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.004729 28562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926cdbc0c6bb47c4880a8511ca063e01" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73" is_pre_election: true
I20260709 13:22:02.005409 28562 raft_consensus.cc:2468] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 0.
I20260709 13:22:02.005620 28629 raft_consensus.cc:515] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.009413 28604 tablet_bootstrap.cc:492] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af: No bootstrap required, opened a new log
I20260709 13:22:02.010028 28604 ts_tablet_manager.cc:1403] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 13:22:02.010056 28413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926cdbc0c6bb47c4880a8511ca063e01" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:02.010565 28562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926cdbc0c6bb47c4880a8511ca063e01" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73"
I20260709 13:22:02.010922 28413 raft_consensus.cc:3060] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.011356 28562 raft_consensus.cc:3060] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:01.984285 28603 consensus_queue.cc:260] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:01.974797 28378 leader_election.cc:304] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 23cc304460b3447092ff00d64430af73; no voters: 
W20260709 13:22:02.013052 28377 leader_election.cc:343] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:02.013753 28378 leader_election.cc:304] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:02.013888 28604 raft_consensus.cc:359] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.014717 28604 raft_consensus.cc:385] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.015054 28604 raft_consensus.cc:740] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.016124 28561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1737010745e144fab6b8fc54f74434d0" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73" is_pre_election: true
I20260709 13:22:02.015883 28604 consensus_queue.cc:260] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.016816 28629 leader_election.cc:290] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:02.017851 28488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f57744b40647d09ed70cc4ee340c7e" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af" is_pre_election: true
I20260709 13:22:02.020895 28488 raft_consensus.cc:2468] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 004f456252b8484eb43b4ce94ac3ff5e in term 0.
W20260709 13:22:02.017928 28378 leader_election.cc:343] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:02.018654 28489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1737010745e144fab6b8fc54f74434d0" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af" is_pre_election: true
I20260709 13:22:02.016310 28628 raft_consensus.cc:2804] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:02.022548 28628 raft_consensus.cc:493] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:02.022933 28628 raft_consensus.cc:3060] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.024215 28377 leader_election.cc:304] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af; no voters: 
I20260709 13:22:02.026611 28605 tablet_bootstrap.cc:654] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.019003 28563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f57744b40647d09ed70cc4ee340c7e" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73" is_pre_election: true
I20260709 13:22:02.029366 28563 raft_consensus.cc:2468] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 004f456252b8484eb43b4ce94ac3ff5e in term 0.
I20260709 13:22:02.031332 28413 raft_consensus.cc:2468] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 1.
I20260709 13:22:02.032799 28608 raft_consensus.cc:2764] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:22:02.034971 28633 raft_consensus.cc:2804] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:02.037423 28633 raft_consensus.cc:493] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:02.037882 28612 raft_consensus.cc:515] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.038463 28603 ts_tablet_manager.cc:1434] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.060s	user 0.013s	sys 0.001s
I20260709 13:22:02.030335 28628 raft_consensus.cc:515] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.020169 28562 raft_consensus.cc:2468] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 1.
I20260709 13:22:02.042150 28563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1737010745e144fab6b8fc54f74434d0" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73"
I20260709 13:22:02.042929 28603 tablet_bootstrap.cc:492] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:02.044018 28628 leader_election.cc:290] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 election: Requested vote from peers 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:02.044730 28488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d29d8ce48ef406888dad00e902e7be0" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af"
I20260709 13:22:02.045328 28488 raft_consensus.cc:3060] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.045040 28563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d29d8ce48ef406888dad00e902e7be0" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73"
I20260709 13:22:02.045948 28563 raft_consensus.cc:3060] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.038316 28633 raft_consensus.cc:3060] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.039822 28489 raft_consensus.cc:2393] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 004f456252b8484eb43b4ce94ac3ff5e in current term 1: Already voted for candidate 03ba0ee779824f1887cc4012724105af in this term.
I20260709 13:22:02.040606 28452 leader_election.cc:304] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af; no voters: 
I20260709 13:22:02.051159 28413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1737010745e144fab6b8fc54f74434d0" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:02.051723 28413 raft_consensus.cc:3060] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.052007 28629 raft_consensus.cc:2804] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:02.052500 28629 raft_consensus.cc:697] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Becoming Leader. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Running, Role: LEADER
I20260709 13:22:02.053382 28629 consensus_queue.cc:237] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.054529 28604 ts_tablet_manager.cc:1434] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af: Time spent starting tablet: real 0.044s	user 0.020s	sys 0.008s
I20260709 13:22:02.057083 28563 raft_consensus.cc:2468] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004f456252b8484eb43b4ce94ac3ff5e in term 1.
I20260709 13:22:02.057286 28377 leader_election.cc:304] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e; no voters: 03ba0ee779824f1887cc4012724105af, 23cc304460b3447092ff00d64430af73
I20260709 13:22:02.058468 28378 leader_election.cc:304] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:02.058933 28413 raft_consensus.cc:2468] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 1.
I20260709 13:22:02.059723 28632 raft_consensus.cc:2749] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:02.060218 28452 leader_election.cc:304] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af; no voters: 
I20260709 13:22:02.060621 28632 raft_consensus.cc:2804] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:02.061239 28632 raft_consensus.cc:697] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 LEADER]: Becoming Leader. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Running, Role: LEADER
W20260709 13:22:02.061715 28453 leader_election.cc:343] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:02.062184 28632 consensus_queue.cc:237] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.063285 28603 tablet_bootstrap.cc:654] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.067572 28488 raft_consensus.cc:2468] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004f456252b8484eb43b4ce94ac3ff5e in term 1.
I20260709 13:22:02.068104 28612 leader_election.cc:290] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:02.068969 28631 raft_consensus.cc:2804] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:02.072180 28631 raft_consensus.cc:697] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Becoming Leader. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Running, Role: LEADER
I20260709 13:22:02.073935 28631 consensus_queue.cc:237] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.069511 28604 tablet_bootstrap.cc:492] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af: Bootstrap starting.
I20260709 13:22:02.080961 28633 raft_consensus.cc:515] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.084097 28488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f57744b40647d09ed70cc4ee340c7e" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af"
I20260709 13:22:02.084709 28488 raft_consensus.cc:3060] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.093400 28604 tablet_bootstrap.cc:654] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.094108 28633 leader_election.cc:290] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 election: Requested vote from peers 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:02.095069 28562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f57744b40647d09ed70cc4ee340c7e" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73"
I20260709 13:22:02.095944 28562 raft_consensus.cc:3060] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.098951 28488 raft_consensus.cc:2468] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004f456252b8484eb43b4ce94ac3ff5e in term 1.
I20260709 13:22:02.085932 28311 catalog_manager.cc:5697] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af reported cstate change: term changed from 0 to 1, leader changed from <none> to 03ba0ee779824f1887cc4012724105af (127.16.188.130). New cstate: current_term: 1 leader_uuid: "03ba0ee779824f1887cc4012724105af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.100718 28377 leader_election.cc:304] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af; no voters: 
I20260709 13:22:02.107447 28628 raft_consensus.cc:2804] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:02.108104 28628 raft_consensus.cc:697] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 1 LEADER]: Becoming Leader. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Running, Role: LEADER
I20260709 13:22:02.109228 28628 consensus_queue.cc:237] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.110450 28608 raft_consensus.cc:493] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:02.111208 28608 raft_consensus.cc:515] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.114235 28608 leader_election.cc:290] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:02.115969 28609 raft_consensus.cc:493] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:02.116693 28609 raft_consensus.cc:515] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.121640 28562 raft_consensus.cc:2468] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004f456252b8484eb43b4ce94ac3ff5e in term 1.
I20260709 13:22:02.135622 28609 leader_election.cc:290] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:02.136127 28488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281b7e55fe1e4bbda42f5d1bd309c807" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af" is_pre_election: true
W20260709 13:22:02.137221 28638 log.cc:927] Time spent T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:22:02.138919 28563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281b7e55fe1e4bbda42f5d1bd309c807" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73" is_pre_election: true
W20260709 13:22:02.137676 28377 leader_election.cc:343] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:02.144047 28378 leader_election.cc:343] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:02.144683 28378 leader_election.cc:304] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e; no voters: 03ba0ee779824f1887cc4012724105af, 23cc304460b3447092ff00d64430af73
I20260709 13:22:02.146680 28628 raft_consensus.cc:2749] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:02.151959 28603 tablet_bootstrap.cc:492] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e: No bootstrap required, opened a new log
I20260709 13:22:02.152623 28605 tablet_bootstrap.cc:492] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73: No bootstrap required, opened a new log
I20260709 13:22:02.152696 28603 ts_tablet_manager.cc:1403] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.031s
I20260709 13:22:02.153313 28605 ts_tablet_manager.cc:1403] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73: Time spent bootstrapping tablet: real 0.152s	user 0.027s	sys 0.024s
I20260709 13:22:02.156417 28603 raft_consensus.cc:359] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.179454 28603 raft_consensus.cc:385] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.179881 28603 raft_consensus.cc:740] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.160682 28604 tablet_bootstrap.cc:492] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af: No bootstrap required, opened a new log
I20260709 13:22:02.174335 28311 catalog_manager.cc:5697] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af reported cstate change: term changed from 0 to 1, leader changed from <none> to 03ba0ee779824f1887cc4012724105af (127.16.188.130). New cstate: current_term: 1 leader_uuid: "03ba0ee779824f1887cc4012724105af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.166036 28310 catalog_manager.cc:5697] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129). New cstate: current_term: 1 leader_uuid: "004f456252b8484eb43b4ce94ac3ff5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.181555 28603 consensus_queue.cc:260] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.180981 28604 ts_tablet_manager.cc:1403] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af: Time spent bootstrapping tablet: real 0.113s	user 0.028s	sys 0.006s
I20260709 13:22:02.162119 28605 raft_consensus.cc:359] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.183202 28605 raft_consensus.cc:385] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.186872 28605 raft_consensus.cc:740] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23cc304460b3447092ff00d64430af73, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.186685 28604 raft_consensus.cc:359] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.187561 28604 raft_consensus.cc:385] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.187898 28604 raft_consensus.cc:740] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.187754 28605 consensus_queue.cc:260] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.188894 28604 consensus_queue.cc:260] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.190330 28605 ts_tablet_manager.cc:1434] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.006s
I20260709 13:22:02.190526 28488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ffc2091e8940379a8d55961701e74f" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af" is_pre_election: true
I20260709 13:22:02.191289 28488 raft_consensus.cc:2468] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 0.
I20260709 13:22:02.191881 28604 ts_tablet_manager.cc:1434] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:22:02.192368 28603 ts_tablet_manager.cc:1434] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:22:02.193100 28604 tablet_bootstrap.cc:492] T f3df851215834fc0aecdbf1378ee50f7 P 03ba0ee779824f1887cc4012724105af: Bootstrap starting.
I20260709 13:22:02.193593 28603 tablet_bootstrap.cc:492] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:02.194000 28413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ffc2091e8940379a8d55961701e74f" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e" is_pre_election: true
I20260709 13:22:02.194396 28605 tablet_bootstrap.cc:492] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73: Bootstrap starting.
I20260709 13:22:02.194759 28413 raft_consensus.cc:2468] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 0.
I20260709 13:22:02.196435 28526 leader_election.cc:304] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03ba0ee779824f1887cc4012724105af, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:02.198393 28609 raft_consensus.cc:2804] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:02.198732 28609 raft_consensus.cc:493] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:02.199008 28609 raft_consensus.cc:3060] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.202026 28604 tablet_bootstrap.cc:654] T f3df851215834fc0aecdbf1378ee50f7 P 03ba0ee779824f1887cc4012724105af: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.202029 28605 tablet_bootstrap.cc:654] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.210209 28609 raft_consensus.cc:515] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.215011 28609 leader_election.cc:290] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 1 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:02.215691 28603 tablet_bootstrap.cc:654] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.217326 28488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ffc2091e8940379a8d55961701e74f" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af"
I20260709 13:22:02.217970 28488 raft_consensus.cc:3060] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.221385 28413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ffc2091e8940379a8d55961701e74f" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:02.222023 28413 raft_consensus.cc:3060] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.222625 28310 catalog_manager.cc:5697] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129). New cstate: current_term: 1 leader_uuid: "004f456252b8484eb43b4ce94ac3ff5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.224010 28604 tablet_bootstrap.cc:492] T f3df851215834fc0aecdbf1378ee50f7 P 03ba0ee779824f1887cc4012724105af: No bootstrap required, opened a new log
I20260709 13:22:02.224824 28604 ts_tablet_manager.cc:1403] T f3df851215834fc0aecdbf1378ee50f7 P 03ba0ee779824f1887cc4012724105af: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.004s
I20260709 13:22:02.230533 28605 tablet_bootstrap.cc:492] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73: No bootstrap required, opened a new log
I20260709 13:22:02.231338 28605 ts_tablet_manager.cc:1403] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.002s
I20260709 13:22:02.232949 28413 raft_consensus.cc:2468] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 1.
I20260709 13:22:02.234262 28526 leader_election.cc:304] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:02.235280 28609 raft_consensus.cc:2804] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:02.235641 28488 raft_consensus.cc:2468] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 1.
I20260709 13:22:02.239099 28609 raft_consensus.cc:697] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 1 LEADER]: Becoming Leader. State: Replica: 23cc304460b3447092ff00d64430af73, State: Running, Role: LEADER
I20260709 13:22:02.240080 28603 tablet_bootstrap.cc:492] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e: No bootstrap required, opened a new log
I20260709 13:22:02.240890 28603 ts_tablet_manager.cc:1403] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.011s
I20260709 13:22:02.240088 28609 consensus_queue.cc:237] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.242304 28604 raft_consensus.cc:359] T f3df851215834fc0aecdbf1378ee50f7 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.243412 28605 raft_consensus.cc:359] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.243651 28603 raft_consensus.cc:359] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.244479 28605 raft_consensus.cc:385] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.244594 28603 raft_consensus.cc:385] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.244329 28604 raft_consensus.cc:385] T f3df851215834fc0aecdbf1378ee50f7 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.245293 28605 raft_consensus.cc:740] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23cc304460b3447092ff00d64430af73, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.245397 28603 raft_consensus.cc:740] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.245592 28604 raft_consensus.cc:740] T f3df851215834fc0aecdbf1378ee50f7 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.246332 28603 consensus_queue.cc:260] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.246332 28605 consensus_queue.cc:260] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.246977 28604 consensus_queue.cc:260] T f3df851215834fc0aecdbf1378ee50f7 P 03ba0ee779824f1887cc4012724105af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.248759 28603 ts_tablet_manager.cc:1434] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:02.249922 28603 tablet_bootstrap.cc:492] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:02.250471 28604 ts_tablet_manager.cc:1434] T f3df851215834fc0aecdbf1378ee50f7 P 03ba0ee779824f1887cc4012724105af: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:22:02.254381 28605 ts_tablet_manager.cc:1434] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 13:22:02.256690 28605 tablet_bootstrap.cc:492] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73: Bootstrap starting.
I20260709 13:22:02.256954 28604 tablet_bootstrap.cc:492] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af: Bootstrap starting.
I20260709 13:22:02.260092 28603 tablet_bootstrap.cc:654] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.261842 28312 catalog_manager.cc:5697] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23cc304460b3447092ff00d64430af73 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "23cc304460b3447092ff00d64430af73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:02.263777 28605 tablet_bootstrap.cc:654] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.264233 28604 tablet_bootstrap.cc:654] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.277455 28605 tablet_bootstrap.cc:492] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73: No bootstrap required, opened a new log
I20260709 13:22:02.278214 28605 ts_tablet_manager.cc:1403] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.002s
I20260709 13:22:02.282596 28605 raft_consensus.cc:359] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.283635 28605 raft_consensus.cc:385] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.284055 28605 raft_consensus.cc:740] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23cc304460b3447092ff00d64430af73, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.285573 28605 consensus_queue.cc:260] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.289279 28605 ts_tablet_manager.cc:1434] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:22:02.290670 28605 tablet_bootstrap.cc:492] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73: Bootstrap starting.
I20260709 13:22:02.295532 28603 tablet_bootstrap.cc:492] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e: No bootstrap required, opened a new log
I20260709 13:22:02.296056 28603 ts_tablet_manager.cc:1403] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.026s
I20260709 13:22:02.296480 28604 tablet_bootstrap.cc:492] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af: No bootstrap required, opened a new log
I20260709 13:22:02.297133 28604 ts_tablet_manager.cc:1403] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af: Time spent bootstrapping tablet: real 0.040s	user 0.027s	sys 0.008s
I20260709 13:22:02.297394 28605 tablet_bootstrap.cc:654] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.298749 28603 raft_consensus.cc:359] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.299443 28603 raft_consensus.cc:385] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.299691 28603 raft_consensus.cc:740] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.300668 28603 consensus_queue.cc:260] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.300721 28604 raft_consensus.cc:359] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.302162 28604 raft_consensus.cc:385] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.302577 28604 raft_consensus.cc:740] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.303153 28603 ts_tablet_manager.cc:1434] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:02.304232 28603 tablet_bootstrap.cc:492] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:02.303658 28604 consensus_queue.cc:260] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.305743 28605 tablet_bootstrap.cc:492] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73: No bootstrap required, opened a new log
I20260709 13:22:02.306362 28604 ts_tablet_manager.cc:1434] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:22:02.307678 28605 ts_tablet_manager.cc:1403] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.003s
I20260709 13:22:02.307900 28604 tablet_bootstrap.cc:492] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af: Bootstrap starting.
I20260709 13:22:02.311201 28603 tablet_bootstrap.cc:654] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.311100 28605 raft_consensus.cc:359] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.312296 28605 raft_consensus.cc:385] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.312762 28605 raft_consensus.cc:740] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23cc304460b3447092ff00d64430af73, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.313687 28605 consensus_queue.cc:260] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.315223 28604 tablet_bootstrap.cc:654] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.317183 28605 ts_tablet_manager.cc:1434] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:22:02.318513 28605 tablet_bootstrap.cc:492] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73: Bootstrap starting.
I20260709 13:22:02.327139 28605 tablet_bootstrap.cc:654] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.330545 28603 tablet_bootstrap.cc:492] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e: No bootstrap required, opened a new log
I20260709 13:22:02.330752 28604 tablet_bootstrap.cc:492] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af: No bootstrap required, opened a new log
I20260709 13:22:02.331162 28603 ts_tablet_manager.cc:1403] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.009s
I20260709 13:22:02.331311 28604 ts_tablet_manager.cc:1403] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 13:22:02.334758 28603 raft_consensus.cc:359] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.335481 28603 raft_consensus.cc:385] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.335788 28603 raft_consensus.cc:740] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.336431 28605 tablet_bootstrap.cc:492] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73: No bootstrap required, opened a new log
I20260709 13:22:02.337001 28605 ts_tablet_manager.cc:1403] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:22:02.336719 28603 consensus_queue.cc:260] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.337673 28604 raft_consensus.cc:359] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.338459 28604 raft_consensus.cc:385] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.338840 28604 raft_consensus.cc:740] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.339409 28603 ts_tablet_manager.cc:1434] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:02.339788 28605 raft_consensus.cc:359] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.339658 28604 consensus_queue.cc:260] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.340894 28605 raft_consensus.cc:385] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.341331 28605 raft_consensus.cc:740] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23cc304460b3447092ff00d64430af73, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.342134 28605 consensus_queue.cc:260] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.348670 28605 ts_tablet_manager.cc:1434] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:22:02.348814 28604 ts_tablet_manager.cc:1434] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.001s
I20260709 13:22:02.349251 28609 raft_consensus.cc:493] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:02.349783 28609 raft_consensus.cc:515] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.350111 28604 tablet_bootstrap.cc:492] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af: Bootstrap starting.
I20260709 13:22:02.351994 28609 leader_election.cc:290] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:02.354288 28413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3df851215834fc0aecdbf1378ee50f7" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e" is_pre_election: true
I20260709 13:22:02.354986 28413 raft_consensus.cc:2468] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 0.
I20260709 13:22:02.356020 28488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3df851215834fc0aecdbf1378ee50f7" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af" is_pre_election: true
I20260709 13:22:02.356668 28488 raft_consensus.cc:2468] T f3df851215834fc0aecdbf1378ee50f7 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 0.
I20260709 13:22:02.357702 28526 leader_election.cc:304] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:02.358070 28604 tablet_bootstrap.cc:654] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.358973 28609 raft_consensus.cc:2804] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:02.360067 28605 tablet_bootstrap.cc:492] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73: Bootstrap starting.
I20260709 13:22:02.359404 28609 raft_consensus.cc:493] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:02.360954 28609 raft_consensus.cc:3060] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.363816 28604 tablet_bootstrap.cc:492] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af: No bootstrap required, opened a new log
I20260709 13:22:02.364342 28604 ts_tablet_manager.cc:1403] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:22:02.366217 28605 tablet_bootstrap.cc:654] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:02.367100 28604 raft_consensus.cc:359] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.367933 28604 raft_consensus.cc:385] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.368249 28604 raft_consensus.cc:740] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.369071 28604 consensus_queue.cc:260] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.371073 28605 tablet_bootstrap.cc:492] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73: No bootstrap required, opened a new log
I20260709 13:22:02.371500 28604 ts_tablet_manager.cc:1434] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:02.371592 28605 ts_tablet_manager.cc:1403] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:22:02.372323 28609 raft_consensus.cc:515] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.374624 28605 raft_consensus.cc:359] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.375119 28609 leader_election.cc:290] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 1 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:02.375392 28605 raft_consensus.cc:385] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:02.376358 28413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3df851215834fc0aecdbf1378ee50f7" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:02.376780 28488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3df851215834fc0aecdbf1378ee50f7" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af"
I20260709 13:22:02.376996 28413 raft_consensus.cc:3060] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.377607 28488 raft_consensus.cc:3060] T f3df851215834fc0aecdbf1378ee50f7 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.375768 28605 raft_consensus.cc:740] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23cc304460b3447092ff00d64430af73, State: Initialized, Role: FOLLOWER
I20260709 13:22:02.382042 28605 consensus_queue.cc:260] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.384548 28605 ts_tablet_manager.cc:1434] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:22:02.384680 28413 raft_consensus.cc:2468] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 1.
I20260709 13:22:02.386059 28526 leader_election.cc:304] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:02.386632 28488 raft_consensus.cc:2468] T f3df851215834fc0aecdbf1378ee50f7 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 1.
I20260709 13:22:02.386986 28609 raft_consensus.cc:2804] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:02.388360 28609 raft_consensus.cc:697] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [term 1 LEADER]: Becoming Leader. State: Replica: 23cc304460b3447092ff00d64430af73, State: Running, Role: LEADER
I20260709 13:22:02.388856 28636 raft_consensus.cc:493] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:02.389357 28636 raft_consensus.cc:515] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.389261 28609 consensus_queue.cc:237] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.392761 28636 leader_election.cc:290] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:02.392926 28563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281b7e55fe1e4bbda42f5d1bd309c807" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73" is_pre_election: true
I20260709 13:22:02.393316 28413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281b7e55fe1e4bbda42f5d1bd309c807" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e" is_pre_election: true
I20260709 13:22:02.393955 28563 raft_consensus.cc:2468] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 0.
I20260709 13:22:02.394338 28413 raft_consensus.cc:2468] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 0.
I20260709 13:22:02.395700 28453 leader_election.cc:304] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03ba0ee779824f1887cc4012724105af, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:02.396721 28636 raft_consensus.cc:2804] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:02.397091 28636 raft_consensus.cc:493] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:02.397428 28636 raft_consensus.cc:3060] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.401861 28310 catalog_manager.cc:5697] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23cc304460b3447092ff00d64430af73 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "23cc304460b3447092ff00d64430af73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:02.404883 28636 raft_consensus.cc:515] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.407838 28413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281b7e55fe1e4bbda42f5d1bd309c807" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:02.408500 28413 raft_consensus.cc:3060] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.407963 28636 leader_election.cc:290] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:02.408613 28563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281b7e55fe1e4bbda42f5d1bd309c807" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73"
I20260709 13:22:02.409325 28563 raft_consensus.cc:3060] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.416574 28563 raft_consensus.cc:2468] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 1.
I20260709 13:22:02.417042 28413 raft_consensus.cc:2468] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 1.
I20260709 13:22:02.417762 28453 leader_election.cc:304] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03ba0ee779824f1887cc4012724105af, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:02.418715 28636 raft_consensus.cc:2804] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:02.419293 28636 raft_consensus.cc:697] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Becoming Leader. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Running, Role: LEADER
I20260709 13:22:02.420367 28636 consensus_queue.cc:237] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.428982 28310 catalog_manager.cc:5697] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af reported cstate change: term changed from 0 to 1, leader changed from <none> to 03ba0ee779824f1887cc4012724105af (127.16.188.130). New cstate: current_term: 1 leader_uuid: "03ba0ee779824f1887cc4012724105af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.465824 28636 consensus_queue.cc:1048] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:02.469712 28609 raft_consensus.cc:493] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:02.470717 28609 raft_consensus.cc:515] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.473970 28628 consensus_queue.cc:1048] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:02.476886 28413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e" is_pre_election: true
I20260709 13:22:02.477617 28413 raft_consensus.cc:2468] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 0.
I20260709 13:22:02.478693 28609 leader_election.cc:290] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:02.479048 28562 raft_consensus.cc:3060] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.479291 28526 leader_election.cc:304] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:02.480032 28488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af" is_pre_election: true
I20260709 13:22:02.480764 28488 raft_consensus.cc:2468] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 0.
I20260709 13:22:02.480397 28609 raft_consensus.cc:2804] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:02.481294 28609 raft_consensus.cc:493] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:02.481652 28609 raft_consensus.cc:3060] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.488698 28631 consensus_queue.cc:1048] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:02.502995 28632 consensus_queue.cc:1048] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:02.504021 28609 raft_consensus.cc:515] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.517047 28413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:02.517858 28413 raft_consensus.cc:3060] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.519856 28609 leader_election.cc:290] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 1 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:02.520080 28489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af"
I20260709 13:22:02.520816 28489 raft_consensus.cc:3060] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.529186 28489 raft_consensus.cc:2468] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 1.
I20260709 13:22:02.530841 28526 leader_election.cc:304] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03ba0ee779824f1887cc4012724105af, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:02.531199 28413 raft_consensus.cc:2468] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 1.
I20260709 13:22:02.531821 28632 raft_consensus.cc:493] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:02.532723 28609 raft_consensus.cc:2804] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:02.532379 28632 raft_consensus.cc:515] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.537545 28632 leader_election.cc:290] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:02.538430 28609 raft_consensus.cc:697] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 1 LEADER]: Becoming Leader. State: Replica: 23cc304460b3447092ff00d64430af73, State: Running, Role: LEADER
I20260709 13:22:02.539487 28489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8152c1181a174c798146de84c401aa35" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af" is_pre_election: true
I20260709 13:22:02.540548 28489 raft_consensus.cc:2468] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 004f456252b8484eb43b4ce94ac3ff5e in term 0.
I20260709 13:22:02.541239 28609 consensus_queue.cc:237] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.542234 28377 leader_election.cc:304] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af; no voters: 
I20260709 13:22:02.543557 28632 raft_consensus.cc:2804] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:02.544166 28632 raft_consensus.cc:493] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:02.544795 28632 raft_consensus.cc:3060] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.544904 28562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8152c1181a174c798146de84c401aa35" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73" is_pre_election: true
I20260709 13:22:02.545934 28562 raft_consensus.cc:2468] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 004f456252b8484eb43b4ce94ac3ff5e in term 0.
I20260709 13:22:02.554375 28310 catalog_manager.cc:5697] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23cc304460b3447092ff00d64430af73 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "23cc304460b3447092ff00d64430af73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:02.555327 28632 raft_consensus.cc:515] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.557152 28632 leader_election.cc:290] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 election: Requested vote from peers 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:02.557796 28489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8152c1181a174c798146de84c401aa35" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af"
I20260709 13:22:02.558301 28489 raft_consensus.cc:3060] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.558751 28562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8152c1181a174c798146de84c401aa35" candidate_uuid: "004f456252b8484eb43b4ce94ac3ff5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73"
I20260709 13:22:02.559424 28562 raft_consensus.cc:3060] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.564464 28489 raft_consensus.cc:2468] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004f456252b8484eb43b4ce94ac3ff5e in term 1.
I20260709 13:22:02.565519 28377 leader_election.cc:304] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af; no voters: 
I20260709 13:22:02.566211 28632 raft_consensus.cc:2804] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:02.566584 28632 raft_consensus.cc:697] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 LEADER]: Becoming Leader. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Running, Role: LEADER
I20260709 13:22:02.566491 28562 raft_consensus.cc:2468] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004f456252b8484eb43b4ce94ac3ff5e in term 1.
I20260709 13:22:02.567435 28632 consensus_queue.cc:237] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.575693 28310 catalog_manager.cc:5697] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129). New cstate: current_term: 1 leader_uuid: "004f456252b8484eb43b4ce94ac3ff5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.603020 28631 raft_consensus.cc:493] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:02.603571 28631 raft_consensus.cc:515] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.605762 28631 leader_election.cc:290] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:02.606654 28413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83274898c08c4f33845ec447c714f61b" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e" is_pre_election: true
I20260709 13:22:02.607041 28562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83274898c08c4f33845ec447c714f61b" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73" is_pre_election: true
I20260709 13:22:02.607581 28413 raft_consensus.cc:2468] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 0.
I20260709 13:22:02.607718 28562 raft_consensus.cc:2468] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 0.
I20260709 13:22:02.608877 28453 leader_election.cc:304] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03ba0ee779824f1887cc4012724105af, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:02.609663 28631 raft_consensus.cc:2804] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:02.610077 28631 raft_consensus.cc:493] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:02.610361 28631 raft_consensus.cc:3060] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.616150 28631 raft_consensus.cc:515] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.617938 28631 leader_election.cc:290] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:02.618983 28413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83274898c08c4f33845ec447c714f61b" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:02.619206 28562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83274898c08c4f33845ec447c714f61b" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73"
I20260709 13:22:02.619590 28413 raft_consensus.cc:3060] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.619886 28562 raft_consensus.cc:3060] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:02.625064 28413 raft_consensus.cc:2468] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 1.
I20260709 13:22:02.625969 28562 raft_consensus.cc:2468] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 1.
I20260709 13:22:02.626324 28452 leader_election.cc:304] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af; no voters: 
I20260709 13:22:02.627235 28631 raft_consensus.cc:2804] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:02.627749 28631 raft_consensus.cc:697] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Becoming Leader. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Running, Role: LEADER
I20260709 13:22:02.628925 28633 consensus_queue.cc:1048] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:02.628682 28631 consensus_queue.cc:237] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:02.633744 28633 consensus_queue.cc:1048] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:02.644397 28309 catalog_manager.cc:5697] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af reported cstate change: term changed from 0 to 1, leader changed from <none> to 03ba0ee779824f1887cc4012724105af (127.16.188.130). New cstate: current_term: 1 leader_uuid: "03ba0ee779824f1887cc4012724105af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.663805 28609 consensus_queue.cc:1048] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:02.666693 28631 consensus_queue.cc:1048] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:02.677932 28609 consensus_queue.cc:1048] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:02.682173 28636 consensus_queue.cc:1048] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:02.798194 28679 consensus_queue.cc:1048] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:02.811769 28679 consensus_queue.cc:1048] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:02.825866 17138 ts_manager.cc:295] Set tserver state for 004f456252b8484eb43b4ce94ac3ff5e to MAINTENANCE_MODE
I20260709 13:22:02.826858 17138 tablet_server.cc:179] TabletServer@127.16.188.129:0 shutting down...
I20260709 13:22:02.840628 28636 consensus_queue.cc:1048] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:22:02.869221 28452 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 151 similar messages]
W20260709 13:22:02.878440 28452 consensus_peers.cc:597] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:02.879295 28452 consensus_peers.cc:597] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:02.900218 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:02.901062 17138 tablet_replica.cc:333] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e: stopping tablet replica
I20260709 13:22:02.901706 17138 raft_consensus.cc:2243] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:02.902340 17138 pending_rounds.cc:70] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e: Trying to abort 1 pending ops.
I20260709 13:22:02.902550 17138 pending_rounds.cc:77] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305639209243848704 op_type: NO_OP noop_request { }
I20260709 13:22:02.902853 17138 raft_consensus.cc:2889] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:22:02.903136 17138 raft_consensus.cc:2272] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.905804 17138 tablet_replica.cc:333] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e: stopping tablet replica
I20260709 13:22:02.906373 17138 raft_consensus.cc:2243] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.906858 17138 raft_consensus.cc:2272] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:02.908737 28360 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:02.909425 17138 tablet_replica.cc:333] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e: stopping tablet replica
I20260709 13:22:02.909969 17138 raft_consensus.cc:2243] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.910320 17138 raft_consensus.cc:2272] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.912406 17138 tablet_replica.cc:333] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e: stopping tablet replica
I20260709 13:22:02.912932 17138 raft_consensus.cc:2243] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:02.913635 17138 raft_consensus.cc:2272] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.915674 17138 tablet_replica.cc:333] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e: stopping tablet replica
I20260709 13:22:02.916148 17138 raft_consensus.cc:2243] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.916468 17138 raft_consensus.cc:2272] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.918654 17138 tablet_replica.cc:333] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e: stopping tablet replica
I20260709 13:22:02.919122 17138 raft_consensus.cc:2243] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.919425 17138 raft_consensus.cc:2272] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.921154 17138 tablet_replica.cc:333] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e: stopping tablet replica
I20260709 13:22:02.921619 17138 raft_consensus.cc:2243] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.922032 17138 raft_consensus.cc:2272] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.924121 17138 tablet_replica.cc:333] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e: stopping tablet replica
I20260709 13:22:02.924750 17138 raft_consensus.cc:2243] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.925117 17138 raft_consensus.cc:2272] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.927032 17138 tablet_replica.cc:333] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e: stopping tablet replica
I20260709 13:22:02.927634 17138 raft_consensus.cc:2243] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:02.928143 17138 raft_consensus.cc:2272] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.930910 17138 tablet_replica.cc:333] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e: stopping tablet replica
I20260709 13:22:02.931597 17138 raft_consensus.cc:2243] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:02.932425 17138 raft_consensus.cc:2272] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:02.933694 28679 consensus_queue.cc:1048] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:22:02.949482 28526 consensus_peers.cc:597] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:02.971419 17138 tablet_server.cc:196] TabletServer@127.16.188.129:0 shutdown complete.
I20260709 13:22:03.087144 28631 consensus_queue.cc:1048] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:22:03.106940 28452 consensus_peers.cc:597] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:03.145466 28526 consensus_peers.cc:597] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:03.212626 28526 consensus_peers.cc:597] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:03.281064 28452 consensus_peers.cc:597] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:03.909910 28360 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:03.998553 28679 raft_consensus.cc:493] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 004f456252b8484eb43b4ce94ac3ff5e)
I20260709 13:22:03.999243 28679 raft_consensus.cc:515] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:04.001183 28679 leader_election.cc:290] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:04.003089 28489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d29d8ce48ef406888dad00e902e7be0" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af" is_pre_election: true
W20260709 13:22:04.005127 28526 leader_election.cc:336] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111)
I20260709 13:22:04.005558 28526 leader_election.cc:304] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23cc304460b3447092ff00d64430af73; no voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af
I20260709 13:22:04.006204 28679 raft_consensus.cc:2749] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:04.008665 28694 raft_consensus.cc:493] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 004f456252b8484eb43b4ce94ac3ff5e)
I20260709 13:22:04.009138 28694 raft_consensus.cc:515] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:04.010777 28694 leader_election.cc:290] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:04.011842 28563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d29d8ce48ef406888dad00e902e7be0" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73" is_pre_election: true
I20260709 13:22:04.012576 28563 raft_consensus.cc:2468] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 1.
I20260709 13:22:04.013760 28453 leader_election.cc:304] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03ba0ee779824f1887cc4012724105af, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:04.014678 28694 raft_consensus.cc:2804] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:04.014993 28694 raft_consensus.cc:493] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Starting leader election (detected failure of leader 004f456252b8484eb43b4ce94ac3ff5e)
I20260709 13:22:04.015331 28694 raft_consensus.cc:3060] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:04.015268 28452 leader_election.cc:336] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111)
I20260709 13:22:04.020797 28694 raft_consensus.cc:515] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:04.022404 28694 leader_election.cc:290] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 2 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:04.023499 28563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d29d8ce48ef406888dad00e902e7be0" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73"
I20260709 13:22:04.024083 28563 raft_consensus.cc:3060] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:04.026352 28452 leader_election.cc:336] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111)
I20260709 13:22:04.028968 28563 raft_consensus.cc:2468] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 2.
I20260709 13:22:04.029937 28453 leader_election.cc:304] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03ba0ee779824f1887cc4012724105af, 23cc304460b3447092ff00d64430af73; no voters: 004f456252b8484eb43b4ce94ac3ff5e
I20260709 13:22:04.030661 28694 raft_consensus.cc:2804] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:04.031159 28694 raft_consensus.cc:697] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [term 2 LEADER]: Becoming Leader. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Running, Role: LEADER
I20260709 13:22:04.032011 28694 consensus_queue.cc:237] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:04.039696 28310 catalog_manager.cc:5697] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af reported cstate change: term changed from 1 to 2, leader changed from 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129) to 03ba0ee779824f1887cc4012724105af (127.16.188.130). New cstate: current_term: 2 leader_uuid: "03ba0ee779824f1887cc4012724105af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:04.144496 28679 raft_consensus.cc:493] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 004f456252b8484eb43b4ce94ac3ff5e)
I20260709 13:22:04.145056 28679 raft_consensus.cc:515] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:04.146968 28679 leader_election.cc:290] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:04.148662 28489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f57744b40647d09ed70cc4ee340c7e" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af" is_pre_election: true
I20260709 13:22:04.149492 28489 raft_consensus.cc:2468] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 1.
I20260709 13:22:04.150012 28694 raft_consensus.cc:493] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 004f456252b8484eb43b4ce94ac3ff5e)
I20260709 13:22:04.150492 28694 raft_consensus.cc:515] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
W20260709 13:22:04.151089 28526 leader_election.cc:336] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111)
I20260709 13:22:04.152064 28526 leader_election.cc:304] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03ba0ee779824f1887cc4012724105af, 23cc304460b3447092ff00d64430af73; no voters: 004f456252b8484eb43b4ce94ac3ff5e
I20260709 13:22:04.152915 28679 raft_consensus.cc:2804] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:04.153098 28694 leader_election.cc:290] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:04.153358 28679 raft_consensus.cc:493] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 004f456252b8484eb43b4ce94ac3ff5e)
I20260709 13:22:04.153754 28679 raft_consensus.cc:3060] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.154336 28563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f57744b40647d09ed70cc4ee340c7e" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23cc304460b3447092ff00d64430af73" is_pre_election: true
W20260709 13:22:04.156339 28452 leader_election.cc:336] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111)
I20260709 13:22:04.159906 28679 raft_consensus.cc:515] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:04.160930 28563 raft_consensus.cc:2393] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03ba0ee779824f1887cc4012724105af in current term 2: Already voted for candidate 23cc304460b3447092ff00d64430af73 in this term.
I20260709 13:22:04.161828 28679 leader_election.cc:290] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:04.162837 28453 leader_election.cc:304] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03ba0ee779824f1887cc4012724105af; no voters: 004f456252b8484eb43b4ce94ac3ff5e, 23cc304460b3447092ff00d64430af73
I20260709 13:22:04.163468 28489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f57744b40647d09ed70cc4ee340c7e" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af"
I20260709 13:22:04.163951 28694 raft_consensus.cc:3060] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:04.166044 28526 leader_election.cc:336] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111)
I20260709 13:22:04.169827 28694 raft_consensus.cc:2749] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:22:04.175594 28489 raft_consensus.cc:2468] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 2.
I20260709 13:22:04.177237 28526 leader_election.cc:304] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03ba0ee779824f1887cc4012724105af, 23cc304460b3447092ff00d64430af73; no voters: 004f456252b8484eb43b4ce94ac3ff5e
I20260709 13:22:04.177964 28679 raft_consensus.cc:2804] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:04.178449 28679 raft_consensus.cc:697] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Becoming Leader. State: Replica: 23cc304460b3447092ff00d64430af73, State: Running, Role: LEADER
I20260709 13:22:04.179160 28679 consensus_queue.cc:237] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:04.186633 28310 catalog_manager.cc:5697] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 reported cstate change: term changed from 1 to 2, leader changed from 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129) to 23cc304460b3447092ff00d64430af73 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "23cc304460b3447092ff00d64430af73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:04.452849 28563 raft_consensus.cc:1275] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Refusing update from remote peer 03ba0ee779824f1887cc4012724105af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:04.454236 28694 consensus_queue.cc:1048] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:04.468864 28452 consensus_peers.cc:597] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.583878 28489 raft_consensus.cc:1275] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Refusing update from remote peer 23cc304460b3447092ff00d64430af73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:04.585321 28679 consensus_queue.cc:1048] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:04.599422 28526 consensus_peers.cc:597] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:04.675436 28679 raft_consensus.cc:493] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:04.675953 28679 raft_consensus.cc:515] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:04.677752 28679 leader_election.cc:290] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:04.679610 28489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8152c1181a174c798146de84c401aa35" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af" is_pre_election: true
I20260709 13:22:04.680455 28489 raft_consensus.cc:2468] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 1.
I20260709 13:22:04.681675 28526 leader_election.cc:304] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03ba0ee779824f1887cc4012724105af, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:04.682384 28679 raft_consensus.cc:2804] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:22:04.682420 28526 leader_election.cc:336] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111)
I20260709 13:22:04.682860 28679 raft_consensus.cc:493] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:04.683286 28679 raft_consensus.cc:3060] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:04.688246 28679 raft_consensus.cc:515] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:04.689807 28679 leader_election.cc:290] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:04.691738 28489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8152c1181a174c798146de84c401aa35" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ba0ee779824f1887cc4012724105af"
I20260709 13:22:04.692386 28489 raft_consensus.cc:3060] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:04.694129 28526 leader_election.cc:336] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111)
I20260709 13:22:04.698772 28489 raft_consensus.cc:2468] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 2.
I20260709 13:22:04.699848 28526 leader_election.cc:304] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03ba0ee779824f1887cc4012724105af, 23cc304460b3447092ff00d64430af73; no voters: 004f456252b8484eb43b4ce94ac3ff5e
I20260709 13:22:04.700659 28679 raft_consensus.cc:2804] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:04.701018 28679 raft_consensus.cc:697] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Becoming Leader. State: Replica: 23cc304460b3447092ff00d64430af73, State: Running, Role: LEADER
I20260709 13:22:04.701820 28679 consensus_queue.cc:237] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:04.708681 28309 catalog_manager.cc:5697] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 reported cstate change: term changed from 1 to 2, leader changed from 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129) to 23cc304460b3447092ff00d64430af73 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "23cc304460b3447092ff00d64430af73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: HEALTHY } } }
W20260709 13:22:04.910877 28360 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:05.092238 28526 consensus_peers.cc:597] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:05.279314 28489 raft_consensus.cc:1275] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Refusing update from remote peer 23cc304460b3447092ff00d64430af73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:22:05.280839 28679 consensus_queue.cc:1048] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:22:05.309350 28452 consensus_peers.cc:597] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:05.369242 28452 consensus_peers.cc:597] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:05.465013 28526 consensus_peers.cc:597] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:05.756309 28452 consensus_peers.cc:597] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:05.775056 28526 consensus_peers.cc:597] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:05.778929 28526 consensus_peers.cc:597] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:05.790580 28452 consensus_peers.cc:597] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:05.911813 28360 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:06.913204 28360 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:07.048938 28526 consensus_peers.cc:597] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:07.108989 28452 consensus_peers.cc:597] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:07.578795 28526 consensus_peers.cc:597] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:07.821566 28526 consensus_peers.cc:597] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:07.914196 28452 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111) [suppressed 98 similar messages]
W20260709 13:22:07.914331 28360 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:07.916427 28452 consensus_peers.cc:597] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:07.990089 28526 consensus_peers.cc:597] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:07.996461 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:07.997397 28452 consensus_peers.cc:597] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:08.005416 28718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:08.006289 28719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:08.011869 28721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:08.011910 17138 server_base.cc:1061] running on GCE node
I20260709 13:22:08.014743 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:08.014971 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:08.015201 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603328015163 us; error 0 us; skew 500 ppm
I20260709 13:22:08.015857 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:08.018962 17138 webserver.cc:533] Webserver started at http://127.16.188.129:44239/ using document root <none> and password file <none>
I20260709 13:22:08.019520 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:08.019681 17138 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:22:08.023936 17138 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:22:08.029263 28726 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:08.030426 17138 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:22:08.030802 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-0-root
uuid: "004f456252b8484eb43b4ce94ac3ff5e"
format_stamp: "Formatted at 2026-07-09 13:22:00 on dist-test-slave-2hqk"
I20260709 13:22:08.031479 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602984839783-17138-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:08.063095 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:08.064553 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:08.066313 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:08.070657 28733 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:22:08.143293 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:22:08.143611 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.074s	user 0.001s	sys 0.002s
I20260709 13:22:08.143888 17138 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:22:08.150252 28733 tablet_bootstrap.cc:492] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:08.163374 28733 tablet_bootstrap.cc:492] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:08.164134 28733 tablet_bootstrap.cc:492] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap complete.
I20260709 13:22:08.164812 28733 ts_tablet_manager.cc:1403] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:22:08.167379 28733 raft_consensus.cc:359] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.168260 28733 raft_consensus.cc:740] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.169046 28733 consensus_queue.cc:260] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.171664 28733 ts_tablet_manager.cc:1434] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:08.172462 28733 tablet_bootstrap.cc:492] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:08.183403 17138 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:22:08.183866 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.040s	user 0.030s	sys 0.007s
I20260709 13:22:08.187224 28733 tablet_bootstrap.cc:492] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:08.188127 28733 tablet_bootstrap.cc:492] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap complete.
I20260709 13:22:08.188808 28733 ts_tablet_manager.cc:1403] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:22:08.191219 28733 raft_consensus.cc:359] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.191900 28733 raft_consensus.cc:740] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.192677 28733 consensus_queue.cc:260] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.195531 28733 ts_tablet_manager.cc:1434] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:22:08.196424 28733 tablet_bootstrap.cc:492] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
W20260709 13:22:08.204782 28452 consensus_peers.cc:597] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:08.205382 28452 consensus_peers.cc:597] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:08.224611 28733 tablet_bootstrap.cc:492] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:08.225878 28733 tablet_bootstrap.cc:492] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap complete.
I20260709 13:22:08.226755 28733 ts_tablet_manager.cc:1403] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.011s
I20260709 13:22:08.230674 28733 raft_consensus.cc:359] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.231397 28733 raft_consensus.cc:740] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.232208 28733 consensus_queue.cc:260] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.234858 28733 ts_tablet_manager.cc:1434] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:22:08.235716 28733 tablet_bootstrap.cc:492] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:08.251969 28733 tablet_bootstrap.cc:492] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:08.253145 28733 tablet_bootstrap.cc:492] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap complete.
I20260709 13:22:08.253957 28733 ts_tablet_manager.cc:1403] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 13:22:08.257146 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.129:37681
I20260709 13:22:08.257375 28795 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.129:37681 every 8 connection(s)
I20260709 13:22:08.259001 28733 raft_consensus.cc:359] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.259833 28733 raft_consensus.cc:740] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.260648 28733 consensus_queue.cc:260] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.264099 28733 ts_tablet_manager.cc:1434] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:22:08.265030 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:08.265404 28733 tablet_bootstrap.cc:492] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:08.298345 28796 heartbeater.cc:344] Connected to a master server at 127.16.188.190:39015
I20260709 13:22:08.299117 28796 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:08.300462 28796 heartbeater.cc:507] Master 127.16.188.190:39015 requested a full tablet report, sending...
I20260709 13:22:08.302591 28733 tablet_bootstrap.cc:492] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:08.303730 28733 tablet_bootstrap.cc:492] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap complete.
I20260709 13:22:08.304476 28733 ts_tablet_manager.cc:1403] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.011s
I20260709 13:22:08.307261 28733 raft_consensus.cc:359] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.307921 28733 raft_consensus.cc:740] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.308651 28733 consensus_queue.cc:260] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.312608 28563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16ffc2091e8940379a8d55961701e74f"
dest_uuid: "23cc304460b3447092ff00d64430af73"
mode: GRACEFUL
new_leader_uuid: "03ba0ee779824f1887cc4012724105af"
 from {username='slave'} at 127.0.0.1:44514
I20260709 13:22:08.313530 28563 raft_consensus.cc:606] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 1 LEADER]: Received request to transfer leadership to TS 03ba0ee779824f1887cc4012724105af
I20260709 13:22:08.314188 28310 ts_manager.cc:194] Re-registered known tserver with Master: 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681)
I20260709 13:22:08.316476 28733 ts_tablet_manager.cc:1434] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:22:08.319125 28733 tablet_bootstrap.cc:492] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:08.346836 28310 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56156
I20260709 13:22:08.347600 28733 tablet_bootstrap.cc:492] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:08.348670 28733 tablet_bootstrap.cc:492] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap complete.
I20260709 13:22:08.349380 28733 ts_tablet_manager.cc:1403] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.003s
I20260709 13:22:08.351967 28796 heartbeater.cc:499] Master 127.16.188.190:39015 was elected leader, sending a full tablet report...
I20260709 13:22:08.352252 28733 raft_consensus.cc:359] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.352977 28733 raft_consensus.cc:740] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.353936 28733 consensus_queue.cc:260] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.357990 28733 ts_tablet_manager.cc:1434] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:22:08.359328 28733 tablet_bootstrap.cc:492] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:08.374773 28733 tablet_bootstrap.cc:492] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:08.375664 28733 tablet_bootstrap.cc:492] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap complete.
I20260709 13:22:08.376426 28733 ts_tablet_manager.cc:1403] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.001s
I20260709 13:22:08.377079 28489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83274898c08c4f33845ec447c714f61b"
dest_uuid: "03ba0ee779824f1887cc4012724105af"
mode: GRACEFUL
new_leader_uuid: "23cc304460b3447092ff00d64430af73"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:22:08.377729 28489 raft_consensus.cc:606] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Received request to transfer leadership to TS 23cc304460b3447092ff00d64430af73
I20260709 13:22:08.379081 28733 raft_consensus.cc:359] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.379339 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:08.379676 28733 raft_consensus.cc:740] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.380159 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:08.380379 28733 consensus_queue.cc:260] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.381067 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:08.382031 28733 ts_tablet_manager.cc:1434] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:08.382845 28733 tablet_bootstrap.cc:492] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:08.396384 28733 tablet_bootstrap.cc:492] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:08.397147 28733 tablet_bootstrap.cc:492] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap complete.
I20260709 13:22:08.397660 28733 ts_tablet_manager.cc:1403] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.015s	user 0.003s	sys 0.010s
I20260709 13:22:08.399435 28733 raft_consensus.cc:359] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.399922 28733 raft_consensus.cc:740] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.400549 28733 consensus_queue.cc:260] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.402078 28733 ts_tablet_manager.cc:1434] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:22:08.402750 28733 tablet_bootstrap.cc:492] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:08.415940 28733 tablet_bootstrap.cc:492] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:22:08.416778 28733 tablet_bootstrap.cc:492] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap complete.
I20260709 13:22:08.417309 28733 ts_tablet_manager.cc:1403] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:22:08.419133 28733 raft_consensus.cc:359] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.419792 28733 raft_consensus.cc:740] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.420418 28733 consensus_queue.cc:260] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.421943 28733 ts_tablet_manager.cc:1434] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:08.422746 28733 tablet_bootstrap.cc:492] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap starting.
I20260709 13:22:08.441530 28733 tablet_bootstrap.cc:492] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:08.442765 28733 tablet_bootstrap.cc:492] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e: Bootstrap complete.
I20260709 13:22:08.443660 28733 ts_tablet_manager.cc:1403] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.008s
I20260709 13:22:08.446698 28733 raft_consensus.cc:359] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.447414 28733 raft_consensus.cc:740] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004f456252b8484eb43b4ce94ac3ff5e, State: Initialized, Role: FOLLOWER
I20260709 13:22:08.448256 28733 consensus_queue.cc:260] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.450109 28733 ts_tablet_manager.cc:1434] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:22:08.497364 28769 raft_consensus.cc:3060] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.511549 28770 raft_consensus.cc:3060] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.614737 28770 raft_consensus.cc:3060] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.619910 28770 pending_rounds.cc:85] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e: Aborting all ops after (but not including) 0
I20260709 13:22:08.620128 28770 pending_rounds.cc:107] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:22:08.620422 28770 raft_consensus.cc:2889] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:22:08.636451 28717 raft_consensus.cc:993] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73: : Instructing follower 03ba0ee779824f1887cc4012724105af to start an election
I20260709 13:22:08.637138 28679 raft_consensus.cc:1081] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 1 LEADER]: Signalling peer 03ba0ee779824f1887cc4012724105af to start an election
I20260709 13:22:08.638793 28489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16ffc2091e8940379a8d55961701e74f"
dest_uuid: "03ba0ee779824f1887cc4012724105af"
 from {username='slave'} at 127.0.0.1:55292
I20260709 13:22:08.639381 28489 raft_consensus.cc:493] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:08.639710 28489 raft_consensus.cc:3060] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.645723 28489 raft_consensus.cc:515] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.647387 28489 leader_election.cc:290] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 2 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:08.648442 28770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ffc2091e8940379a8d55961701e74f" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:08.648756 28563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ffc2091e8940379a8d55961701e74f" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23cc304460b3447092ff00d64430af73"
I20260709 13:22:08.649401 28770 raft_consensus.cc:3060] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.649406 28563 raft_consensus.cc:3055] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:08.650051 28563 raft_consensus.cc:740] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23cc304460b3447092ff00d64430af73, State: Running, Role: LEADER
I20260709 13:22:08.651083 28563 consensus_queue.cc:260] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.652637 28563 raft_consensus.cc:3060] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.658315 28770 raft_consensus.cc:2468] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 2.
I20260709 13:22:08.659757 28452 leader_election.cc:304] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af; no voters: 
I20260709 13:22:08.660763 28740 raft_consensus.cc:2804] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:08.661270 28740 raft_consensus.cc:697] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [term 2 LEADER]: Becoming Leader. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Running, Role: LEADER
I20260709 13:22:08.662329 28740 consensus_queue.cc:237] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.663328 28563 raft_consensus.cc:2468] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 2.
I20260709 13:22:08.671463 28309 catalog_manager.cc:5697] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af reported cstate change: term changed from 1 to 2, leader changed from 23cc304460b3447092ff00d64430af73 (127.16.188.131) to 03ba0ee779824f1887cc4012724105af (127.16.188.130). New cstate: current_term: 2 leader_uuid: "03ba0ee779824f1887cc4012724105af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.685460 28716 raft_consensus.cc:993] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af: : Instructing follower 23cc304460b3447092ff00d64430af73 to start an election
I20260709 13:22:08.686053 28716 raft_consensus.cc:1081] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Signalling peer 23cc304460b3447092ff00d64430af73 to start an election
I20260709 13:22:08.687839 28563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83274898c08c4f33845ec447c714f61b"
dest_uuid: "23cc304460b3447092ff00d64430af73"
 from {username='slave'} at 127.0.0.1:54374
I20260709 13:22:08.688380 28563 raft_consensus.cc:493] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:08.688774 28563 raft_consensus.cc:3060] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.693907 28563 raft_consensus.cc:515] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.695749 28563 leader_election.cc:290] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:08.696636 28770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83274898c08c4f33845ec447c714f61b" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:08.696954 28489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83274898c08c4f33845ec447c714f61b" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03ba0ee779824f1887cc4012724105af"
I20260709 13:22:08.697341 28770 raft_consensus.cc:3060] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.697728 28489 raft_consensus.cc:3055] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:08.698050 28489 raft_consensus.cc:740] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Running, Role: LEADER
I20260709 13:22:08.698771 28489 consensus_queue.cc:260] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.699899 28489 raft_consensus.cc:3060] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.702533 28770 raft_consensus.cc:2468] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 2.
I20260709 13:22:08.703663 28526 leader_election.cc:304] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:08.704564 28679 raft_consensus.cc:2804] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:08.704973 28679 raft_consensus.cc:697] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Becoming Leader. State: Replica: 23cc304460b3447092ff00d64430af73, State: Running, Role: LEADER
I20260709 13:22:08.705912 28679 consensus_queue.cc:237] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:08.706218 28489 raft_consensus.cc:2468] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 2.
I20260709 13:22:08.713290 28309 catalog_manager.cc:5697] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 reported cstate change: term changed from 1 to 2, leader changed from 03ba0ee779824f1887cc4012724105af (127.16.188.130) to 23cc304460b3447092ff00d64430af73 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "23cc304460b3447092ff00d64430af73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: HEALTHY } } }
W20260709 13:22:08.915439 28360 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:09.147573 28769 raft_consensus.cc:1275] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Refusing update from remote peer 03ba0ee779824f1887cc4012724105af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.149199 28716 consensus_queue.cc:1048] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:09.161594 28563 raft_consensus.cc:1275] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Refusing update from remote peer 03ba0ee779824f1887cc4012724105af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.163812 28716 consensus_queue.cc:1048] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:09.192589 28489 raft_consensus.cc:1275] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Refusing update from remote peer 23cc304460b3447092ff00d64430af73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.193948 28717 consensus_queue.cc:1048] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:09.204918 28770 raft_consensus.cc:1275] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Refusing update from remote peer 23cc304460b3447092ff00d64430af73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:09.206440 28679 consensus_queue.cc:1048] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:09.391649 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:09.399628 28563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f"
dest_uuid: "23cc304460b3447092ff00d64430af73"
mode: GRACEFUL
new_leader_uuid: "03ba0ee779824f1887cc4012724105af"
 from {username='slave'} at 127.0.0.1:44514
I20260709 13:22:09.400416 28563 raft_consensus.cc:606] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 1 LEADER]: Received request to transfer leadership to TS 03ba0ee779824f1887cc4012724105af
I20260709 13:22:09.403554 28489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "926cdbc0c6bb47c4880a8511ca063e01"
dest_uuid: "03ba0ee779824f1887cc4012724105af"
mode: GRACEFUL
new_leader_uuid: "23cc304460b3447092ff00d64430af73"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:22:09.404165 28489 raft_consensus.cc:606] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Received request to transfer leadership to TS 23cc304460b3447092ff00d64430af73
I20260709 13:22:09.405386 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:09.405813 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:09.406426 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:09.898422 28835 raft_consensus.cc:993] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af: : Instructing follower 23cc304460b3447092ff00d64430af73 to start an election
I20260709 13:22:09.898962 28836 raft_consensus.cc:1081] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Signalling peer 23cc304460b3447092ff00d64430af73 to start an election
I20260709 13:22:09.900734 28563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "926cdbc0c6bb47c4880a8511ca063e01"
dest_uuid: "23cc304460b3447092ff00d64430af73"
 from {username='slave'} at 127.0.0.1:54374
I20260709 13:22:09.901427 28563 raft_consensus.cc:493] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:09.901773 28563 raft_consensus.cc:3060] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.909502 28563 raft_consensus.cc:515] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:09.911222 28563 leader_election.cc:290] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:09.911944 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926cdbc0c6bb47c4880a8511ca063e01" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:09.912370 28489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "926cdbc0c6bb47c4880a8511ca063e01" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03ba0ee779824f1887cc4012724105af"
I20260709 13:22:09.912683 28769 raft_consensus.cc:3060] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.913067 28489 raft_consensus.cc:3055] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:09.913429 28489 raft_consensus.cc:740] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Running, Role: LEADER
I20260709 13:22:09.914080 28489 consensus_queue.cc:260] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:09.915412 28489 raft_consensus.cc:3060] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:22:09.916445 28360 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:09.919078 28769 raft_consensus.cc:2468] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 2.
I20260709 13:22:09.920324 28526 leader_election.cc:304] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:09.921300 28489 raft_consensus.cc:2468] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 2.
I20260709 13:22:09.921319 28834 raft_consensus.cc:2804] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:09.922073 28834 raft_consensus.cc:697] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Becoming Leader. State: Replica: 23cc304460b3447092ff00d64430af73, State: Running, Role: LEADER
I20260709 13:22:09.923066 28834 consensus_queue.cc:237] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:09.928213 28833 raft_consensus.cc:993] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73: : Instructing follower 03ba0ee779824f1887cc4012724105af to start an election
I20260709 13:22:09.928802 28834 raft_consensus.cc:1081] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 1 LEADER]: Signalling peer 03ba0ee779824f1887cc4012724105af to start an election
I20260709 13:22:09.930572 28489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f"
dest_uuid: "03ba0ee779824f1887cc4012724105af"
 from {username='slave'} at 127.0.0.1:55292
I20260709 13:22:09.931185 28489 raft_consensus.cc:493] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:09.931568 28489 raft_consensus.cc:3060] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.932086 28309 catalog_manager.cc:5697] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 reported cstate change: term changed from 1 to 2, leader changed from 03ba0ee779824f1887cc4012724105af (127.16.188.130) to 23cc304460b3447092ff00d64430af73 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "23cc304460b3447092ff00d64430af73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:09.938167 28489 raft_consensus.cc:515] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:09.940505 28489 leader_election.cc:290] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 2 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:09.941304 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:09.941709 28563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23cc304460b3447092ff00d64430af73"
I20260709 13:22:09.942078 28769 raft_consensus.cc:3060] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.942310 28563 raft_consensus.cc:3055] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:09.942649 28563 raft_consensus.cc:740] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23cc304460b3447092ff00d64430af73, State: Running, Role: LEADER
I20260709 13:22:09.943591 28563 consensus_queue.cc:260] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:09.944749 28563 raft_consensus.cc:3060] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:09.950477 28769 raft_consensus.cc:2468] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 2.
I20260709 13:22:09.952154 28452 leader_election.cc:304] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af; no voters: 
I20260709 13:22:09.952638 28563 raft_consensus.cc:2468] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 2.
I20260709 13:22:09.953085 28836 raft_consensus.cc:2804] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:09.953610 28836 raft_consensus.cc:697] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 2 LEADER]: Becoming Leader. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Running, Role: LEADER
I20260709 13:22:09.954644 28836 consensus_queue.cc:237] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:09.962452 28309 catalog_manager.cc:5697] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af reported cstate change: term changed from 1 to 2, leader changed from 23cc304460b3447092ff00d64430af73 (127.16.188.131) to 03ba0ee779824f1887cc4012724105af (127.16.188.130). New cstate: current_term: 2 leader_uuid: "03ba0ee779824f1887cc4012724105af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:10.320621 28769 raft_consensus.cc:1275] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Refusing update from remote peer 23cc304460b3447092ff00d64430af73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.322309 28834 consensus_queue.cc:1048] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.335532 28489 raft_consensus.cc:1275] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Refusing update from remote peer 23cc304460b3447092ff00d64430af73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.337222 28846 consensus_queue.cc:1048] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.414978 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:10.423414 28489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1737010745e144fab6b8fc54f74434d0"
dest_uuid: "03ba0ee779824f1887cc4012724105af"
mode: GRACEFUL
new_leader_uuid: "23cc304460b3447092ff00d64430af73"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:22:10.423933 28489 raft_consensus.cc:606] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Received request to transfer leadership to TS 23cc304460b3447092ff00d64430af73
I20260709 13:22:10.426867 28563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8152c1181a174c798146de84c401aa35"
dest_uuid: "23cc304460b3447092ff00d64430af73"
mode: GRACEFUL
new_leader_uuid: "03ba0ee779824f1887cc4012724105af"
 from {username='slave'} at 127.0.0.1:44514
I20260709 13:22:10.427491 28563 raft_consensus.cc:606] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Received request to transfer leadership to TS 03ba0ee779824f1887cc4012724105af
I20260709 13:22:10.429118 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:10.429203 28833 raft_consensus.cc:993] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73: : Instructing follower 03ba0ee779824f1887cc4012724105af to start an election
I20260709 13:22:10.429790 28846 raft_consensus.cc:1081] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Signalling peer 03ba0ee779824f1887cc4012724105af to start an election
I20260709 13:22:10.429906 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:10.430780 28835 raft_consensus.cc:993] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af: : Instructing follower 23cc304460b3447092ff00d64430af73 to start an election
I20260709 13:22:10.430800 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:10.431562 28836 raft_consensus.cc:1081] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Signalling peer 23cc304460b3447092ff00d64430af73 to start an election
I20260709 13:22:10.432276 28489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8152c1181a174c798146de84c401aa35"
dest_uuid: "03ba0ee779824f1887cc4012724105af"
 from {username='slave'} at 127.0.0.1:55292
I20260709 13:22:10.432946 28489 raft_consensus.cc:493] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:10.433318 28489 raft_consensus.cc:3060] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:10.433466 28562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1737010745e144fab6b8fc54f74434d0"
dest_uuid: "23cc304460b3447092ff00d64430af73"
 from {username='slave'} at 127.0.0.1:54374
I20260709 13:22:10.434165 28562 raft_consensus.cc:493] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:10.434508 28562 raft_consensus.cc:3060] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:10.441171 28562 raft_consensus.cc:515] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:10.441365 28489 raft_consensus.cc:515] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:10.443073 28562 leader_election.cc:290] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:10.444339 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1737010745e144fab6b8fc54f74434d0" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:10.444702 28770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8152c1181a174c798146de84c401aa35" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:10.444404 28488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1737010745e144fab6b8fc54f74434d0" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03ba0ee779824f1887cc4012724105af"
I20260709 13:22:10.445235 28769 raft_consensus.cc:3060] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:10.445498 28770 raft_consensus.cc:3060] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:10.445536 28562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8152c1181a174c798146de84c401aa35" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "23cc304460b3447092ff00d64430af73"
I20260709 13:22:10.445582 28488 raft_consensus.cc:3055] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:10.444939 28489 leader_election.cc:290] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 3 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:10.446672 28488 raft_consensus.cc:740] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Running, Role: LEADER
I20260709 13:22:10.447824 28488 consensus_queue.cc:260] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:10.449286 28488 raft_consensus.cc:3060] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:10.451856 28769 raft_consensus.cc:2468] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 2.
I20260709 13:22:10.446658 28562 raft_consensus.cc:3055] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:10.452948 28526 leader_election.cc:304] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:10.453424 28562 raft_consensus.cc:740] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23cc304460b3447092ff00d64430af73, State: Running, Role: LEADER
I20260709 13:22:10.453963 28846 raft_consensus.cc:2804] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:10.454337 28770 raft_consensus.cc:2468] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 3.
I20260709 13:22:10.454391 28562 consensus_queue.cc:260] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:10.454537 28846 raft_consensus.cc:697] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Becoming Leader. State: Replica: 23cc304460b3447092ff00d64430af73, State: Running, Role: LEADER
I20260709 13:22:10.455955 28452 leader_election.cc:304] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af; no voters: 
I20260709 13:22:10.456251 28562 raft_consensus.cc:3060] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:10.456944 28836 raft_consensus.cc:2804] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:10.456593 28846 consensus_queue.cc:237] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:10.457595 28836 raft_consensus.cc:697] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 3 LEADER]: Becoming Leader. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Running, Role: LEADER
I20260709 13:22:10.459275 28488 raft_consensus.cc:2468] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 2.
I20260709 13:22:10.459165 28836 consensus_queue.cc:237] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:10.466925 28562 raft_consensus.cc:2468] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 3.
I20260709 13:22:10.467204 28309 catalog_manager.cc:5697] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 reported cstate change: term changed from 1 to 2, leader changed from 03ba0ee779824f1887cc4012724105af (127.16.188.130) to 23cc304460b3447092ff00d64430af73 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "23cc304460b3447092ff00d64430af73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:10.471459 28310 catalog_manager.cc:5697] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af reported cstate change: term changed from 2 to 3, leader changed from 23cc304460b3447092ff00d64430af73 (127.16.188.131) to 03ba0ee779824f1887cc4012724105af (127.16.188.130). New cstate: current_term: 3 leader_uuid: "03ba0ee779824f1887cc4012724105af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:10.491271 28562 raft_consensus.cc:1275] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Refusing update from remote peer 03ba0ee779824f1887cc4012724105af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.492847 28836 consensus_queue.cc:1048] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.504886 28770 raft_consensus.cc:1275] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Refusing update from remote peer 03ba0ee779824f1887cc4012724105af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.506839 28836 consensus_queue.cc:1048] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:10.845237 28488 raft_consensus.cc:1275] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Refusing update from remote peer 23cc304460b3447092ff00d64430af73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.846573 28846 consensus_queue.cc:1048] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.854919 28770 raft_consensus.cc:1275] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 3 FOLLOWER]: Refusing update from remote peer 03ba0ee779824f1887cc4012724105af: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:22:10.857105 28835 consensus_queue.cc:1048] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:10.861023 28768 raft_consensus.cc:1275] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Refusing update from remote peer 23cc304460b3447092ff00d64430af73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:10.865828 28859 consensus_queue.cc:1048] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:10.871336 28562 raft_consensus.cc:1275] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Refusing update from remote peer 03ba0ee779824f1887cc4012724105af: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:22:10.873152 28835 consensus_queue.cc:1048] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:10.917523 28360 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:11.547477 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:11.555500 28488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f"
dest_uuid: "03ba0ee779824f1887cc4012724105af"
mode: GRACEFUL
new_leader_uuid: "23cc304460b3447092ff00d64430af73"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:22:11.556077 28488 raft_consensus.cc:606] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 2 LEADER]: Received request to transfer leadership to TS 23cc304460b3447092ff00d64430af73
I20260709 13:22:11.558770 28562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1737010745e144fab6b8fc54f74434d0"
dest_uuid: "23cc304460b3447092ff00d64430af73"
mode: GRACEFUL
new_leader_uuid: "03ba0ee779824f1887cc4012724105af"
 from {username='slave'} at 127.0.0.1:44514
I20260709 13:22:11.559311 28562 raft_consensus.cc:606] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Received request to transfer leadership to TS 03ba0ee779824f1887cc4012724105af
I20260709 13:22:11.560566 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:11.561262 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:11.562002 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:11.565229 28864 raft_consensus.cc:993] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af: : Instructing follower 23cc304460b3447092ff00d64430af73 to start an election
I20260709 13:22:11.565936 28856 raft_consensus.cc:1081] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 2 LEADER]: Signalling peer 23cc304460b3447092ff00d64430af73 to start an election
I20260709 13:22:11.567659 28562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f"
dest_uuid: "23cc304460b3447092ff00d64430af73"
 from {username='slave'} at 127.0.0.1:54374
I20260709 13:22:11.568269 28562 raft_consensus.cc:493] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:11.568691 28562 raft_consensus.cc:3060] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:11.575217 28562 raft_consensus.cc:515] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:11.576941 28562 leader_election.cc:290] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 3 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:11.577786 28768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:11.578316 28488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03ba0ee779824f1887cc4012724105af"
I20260709 13:22:11.578539 28768 raft_consensus.cc:3060] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:11.578933 28488 raft_consensus.cc:3055] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:11.579290 28488 raft_consensus.cc:740] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Running, Role: LEADER
I20260709 13:22:11.580257 28488 consensus_queue.cc:260] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:11.581727 28488 raft_consensus.cc:3060] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:11.587116 28768 raft_consensus.cc:2468] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 3.
I20260709 13:22:11.588667 28526 leader_election.cc:304] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:11.589421 28859 raft_consensus.cc:2804] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:11.589569 28488 raft_consensus.cc:2468] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 3.
I20260709 13:22:11.589854 28859 raft_consensus.cc:697] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 3 LEADER]: Becoming Leader. State: Replica: 23cc304460b3447092ff00d64430af73, State: Running, Role: LEADER
I20260709 13:22:11.590893 28859 consensus_queue.cc:237] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:11.598448 28310 catalog_manager.cc:5697] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 reported cstate change: term changed from 2 to 3, leader changed from 03ba0ee779824f1887cc4012724105af (127.16.188.130) to 23cc304460b3447092ff00d64430af73 (127.16.188.131). New cstate: current_term: 3 leader_uuid: "23cc304460b3447092ff00d64430af73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:11.915441 28866 raft_consensus.cc:993] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73: : Instructing follower 03ba0ee779824f1887cc4012724105af to start an election
I20260709 13:22:11.915968 28859 raft_consensus.cc:1081] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Signalling peer 03ba0ee779824f1887cc4012724105af to start an election
I20260709 13:22:11.917685 28488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1737010745e144fab6b8fc54f74434d0"
dest_uuid: "03ba0ee779824f1887cc4012724105af"
 from {username='slave'} at 127.0.0.1:55292
I20260709 13:22:11.918248 28488 raft_consensus.cc:493] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:22:11.918524 28360 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:11.918608 28488 raft_consensus.cc:3060] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:11.925194 28488 raft_consensus.cc:515] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:11.927209 28488 leader_election.cc:290] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 3 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:11.928016 28768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1737010745e144fab6b8fc54f74434d0" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:11.928452 28562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1737010745e144fab6b8fc54f74434d0" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23cc304460b3447092ff00d64430af73"
I20260709 13:22:11.928740 28768 raft_consensus.cc:3060] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:11.929183 28562 raft_consensus.cc:3055] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:11.929510 28562 raft_consensus.cc:740] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23cc304460b3447092ff00d64430af73, State: Running, Role: LEADER
I20260709 13:22:11.930394 28562 consensus_queue.cc:260] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:11.931528 28562 raft_consensus.cc:3060] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:11.934981 28768 raft_consensus.cc:2468] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 3.
I20260709 13:22:11.936395 28452 leader_election.cc:304] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af; no voters: 
I20260709 13:22:11.937309 28856 raft_consensus.cc:2804] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:11.937846 28856 raft_consensus.cc:697] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 3 LEADER]: Becoming Leader. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Running, Role: LEADER
I20260709 13:22:11.938747 28856 consensus_queue.cc:237] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:11.939700 28562 raft_consensus.cc:2468] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 3.
I20260709 13:22:11.946143 28310 catalog_manager.cc:5697] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af reported cstate change: term changed from 2 to 3, leader changed from 23cc304460b3447092ff00d64430af73 (127.16.188.131) to 03ba0ee779824f1887cc4012724105af (127.16.188.130). New cstate: current_term: 3 leader_uuid: "03ba0ee779824f1887cc4012724105af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:12.043670 28768 raft_consensus.cc:1275] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 3 FOLLOWER]: Refusing update from remote peer 23cc304460b3447092ff00d64430af73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:12.045001 28866 consensus_queue.cc:1048] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:12.056499 28488 raft_consensus.cc:1275] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 3 FOLLOWER]: Refusing update from remote peer 23cc304460b3447092ff00d64430af73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:12.061367 28876 consensus_queue.cc:1048] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:22:12.316164 28510 debug-util.cc:398] Leaking SignalData structure 0x7b08000dfca0 after lost signal to thread 17141
W20260709 13:22:12.317656 28510 debug-util.cc:398] Leaking SignalData structure 0x7b08000c0300 after lost signal to thread 28346
W20260709 13:22:12.319095 28510 debug-util.cc:398] Leaking SignalData structure 0x7b0800051140 after lost signal to thread 28513
W20260709 13:22:12.320367 28510 debug-util.cc:398] Leaking SignalData structure 0x7b08003d4240 after lost signal to thread 28587
W20260709 13:22:12.321717 28510 debug-util.cc:398] Leaking SignalData structure 0x7b08000e3040 after lost signal to thread 28795
I20260709 13:22:12.551579 28769 raft_consensus.cc:1275] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 3 FOLLOWER]: Refusing update from remote peer 03ba0ee779824f1887cc4012724105af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:12.553413 28881 consensus_queue.cc:1048] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:12.554726 28562 raft_consensus.cc:1275] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Refusing update from remote peer 03ba0ee779824f1887cc4012724105af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:12.556769 28881 consensus_queue.cc:1048] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:12.571525 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:12.591334 28563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f"
dest_uuid: "23cc304460b3447092ff00d64430af73"
mode: GRACEFUL
new_leader_uuid: "03ba0ee779824f1887cc4012724105af"
 from {username='slave'} at 127.0.0.1:44514
I20260709 13:22:12.591951 28563 raft_consensus.cc:606] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 3 LEADER]: Received request to transfer leadership to TS 03ba0ee779824f1887cc4012724105af
I20260709 13:22:12.595512 28488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "281b7e55fe1e4bbda42f5d1bd309c807"
dest_uuid: "03ba0ee779824f1887cc4012724105af"
mode: GRACEFUL
new_leader_uuid: "23cc304460b3447092ff00d64430af73"
 from {username='slave'} at 127.0.0.1:33012
I20260709 13:22:12.596266 28488 raft_consensus.cc:606] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Received request to transfer leadership to TS 23cc304460b3447092ff00d64430af73
I20260709 13:22:12.600548 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:12.601281 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:12.602097 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:12.627415 28887 raft_consensus.cc:993] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73: : Instructing follower 03ba0ee779824f1887cc4012724105af to start an election
I20260709 13:22:12.628064 28876 raft_consensus.cc:1081] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 3 LEADER]: Signalling peer 03ba0ee779824f1887cc4012724105af to start an election
I20260709 13:22:12.630007 28488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f"
dest_uuid: "03ba0ee779824f1887cc4012724105af"
 from {username='slave'} at 127.0.0.1:55292
I20260709 13:22:12.630770 28488 raft_consensus.cc:493] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:12.631189 28488 raft_consensus.cc:3060] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:12.639508 28488 raft_consensus.cc:515] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:12.642284 28488 leader_election.cc:290] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 4 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 23cc304460b3447092ff00d64430af73 (127.16.188.131:40363)
I20260709 13:22:12.642871 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:12.643708 28769 raft_consensus.cc:3060] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:12.646936 28562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1057cc07cc2a4d4e8ede3957ef8b7a8f" candidate_uuid: "03ba0ee779824f1887cc4012724105af" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "23cc304460b3447092ff00d64430af73"
I20260709 13:22:12.647652 28562 raft_consensus.cc:3055] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:22:12.648002 28562 raft_consensus.cc:740] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 23cc304460b3447092ff00d64430af73, State: Running, Role: LEADER
I20260709 13:22:12.648913 28562 consensus_queue.cc:260] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:12.650396 28562 raft_consensus.cc:3060] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:12.652848 28769 raft_consensus.cc:2468] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 4.
I20260709 13:22:12.654438 28452 leader_election.cc:304] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af; no voters: 
I20260709 13:22:12.655211 28856 raft_consensus.cc:2804] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:22:12.655712 28856 raft_consensus.cc:697] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 4 LEADER]: Becoming Leader. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Running, Role: LEADER
I20260709 13:22:12.656641 28856 consensus_queue.cc:237] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:12.658746 28562 raft_consensus.cc:2468] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ba0ee779824f1887cc4012724105af in term 4.
I20260709 13:22:12.669485 28310 catalog_manager.cc:5697] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af reported cstate change: term changed from 3 to 4, leader changed from 23cc304460b3447092ff00d64430af73 (127.16.188.131) to 03ba0ee779824f1887cc4012724105af (127.16.188.130). New cstate: current_term: 4 leader_uuid: "03ba0ee779824f1887cc4012724105af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:12.802081 28856 raft_consensus.cc:993] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af: : Instructing follower 23cc304460b3447092ff00d64430af73 to start an election
I20260709 13:22:12.802659 28880 raft_consensus.cc:1081] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Signalling peer 23cc304460b3447092ff00d64430af73 to start an election
I20260709 13:22:12.804237 28563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "281b7e55fe1e4bbda42f5d1bd309c807"
dest_uuid: "23cc304460b3447092ff00d64430af73"
 from {username='slave'} at 127.0.0.1:54374
I20260709 13:22:12.804901 28563 raft_consensus.cc:493] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:12.805275 28563 raft_consensus.cc:3060] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:12.812636 28563 raft_consensus.cc:515] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:12.814721 28563 leader_election.cc:290] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 election: Requested vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
I20260709 13:22:12.815609 28769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281b7e55fe1e4bbda42f5d1bd309c807" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "004f456252b8484eb43b4ce94ac3ff5e"
I20260709 13:22:12.816020 28488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281b7e55fe1e4bbda42f5d1bd309c807" candidate_uuid: "23cc304460b3447092ff00d64430af73" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03ba0ee779824f1887cc4012724105af"
I20260709 13:22:12.816442 28769 raft_consensus.cc:3060] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:12.816864 28488 raft_consensus.cc:3055] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:12.817271 28488 raft_consensus.cc:740] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03ba0ee779824f1887cc4012724105af, State: Running, Role: LEADER
I20260709 13:22:12.818260 28488 consensus_queue.cc:260] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:12.819732 28488 raft_consensus.cc:3060] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:12.823122 28769 raft_consensus.cc:2468] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 2.
I20260709 13:22:12.824429 28526 leader_election.cc:304] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004f456252b8484eb43b4ce94ac3ff5e, 23cc304460b3447092ff00d64430af73; no voters: 
I20260709 13:22:12.825287 28876 raft_consensus.cc:2804] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:12.825771 28876 raft_consensus.cc:697] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Becoming Leader. State: Replica: 23cc304460b3447092ff00d64430af73, State: Running, Role: LEADER
I20260709 13:22:12.826764 28876 consensus_queue.cc:237] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:12.827992 28488 raft_consensus.cc:2468] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23cc304460b3447092ff00d64430af73 in term 2.
I20260709 13:22:12.837956 28310 catalog_manager.cc:5697] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 reported cstate change: term changed from 1 to 2, leader changed from 03ba0ee779824f1887cc4012724105af (127.16.188.130) to 23cc304460b3447092ff00d64430af73 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "23cc304460b3447092ff00d64430af73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } health_report { overall_health: HEALTHY } } }
W20260709 13:22:12.919682 28360 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:13.202584 28769 raft_consensus.cc:1275] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 4 FOLLOWER]: Refusing update from remote peer 03ba0ee779824f1887cc4012724105af: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:13.204246 28880 consensus_queue.cc:1048] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:13.219130 28488 raft_consensus.cc:1275] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Refusing update from remote peer 23cc304460b3447092ff00d64430af73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:13.220963 28876 consensus_queue.cc:1048] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:13.225310 28563 raft_consensus.cc:1275] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 4 FOLLOWER]: Refusing update from remote peer 03ba0ee779824f1887cc4012724105af: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:22:13.227583 28880 consensus_queue.cc:1048] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [LEADER]: Connected to new peer: Peer: permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:13.252784 28769 raft_consensus.cc:1275] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Refusing update from remote peer 23cc304460b3447092ff00d64430af73: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:13.255033 28876 consensus_queue.cc:1048] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:13.613718 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:13.668169 17138 tablet_server.cc:179] TabletServer@127.16.188.129:37681 shutting down...
W20260709 13:22:13.674428 28452 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 13:22:13.688526 28452 consensus_peers.cc:597] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:13.707791 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:13.708752 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:13.709400 17138 raft_consensus.cc:2243] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:13.709893 17138 raft_consensus.cc:2272] T 22f57744b40647d09ed70cc4ee340c7e P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.711865 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:13.712451 17138 raft_consensus.cc:2243] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:13.713071 17138 raft_consensus.cc:2272] T 8152c1181a174c798146de84c401aa35 P 004f456252b8484eb43b4ce94ac3ff5e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.715307 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:13.715998 17138 raft_consensus.cc:2243] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:13.716470 17138 raft_consensus.cc:2272] T 926cdbc0c6bb47c4880a8511ca063e01 P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.718283 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:13.718842 17138 raft_consensus.cc:2243] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:13.719285 17138 raft_consensus.cc:2272] T 1737010745e144fab6b8fc54f74434d0 P 004f456252b8484eb43b4ce94ac3ff5e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.721063 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:13.721587 17138 raft_consensus.cc:2243] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:13.722035 17138 raft_consensus.cc:2272] T 0d29d8ce48ef406888dad00e902e7be0 P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.726297 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:13.727295 17138 raft_consensus.cc:2243] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:13.727998 17138 raft_consensus.cc:2272] T 83274898c08c4f33845ec447c714f61b P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.730932 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:13.731756 17138 raft_consensus.cc:2243] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:13.732380 17138 raft_consensus.cc:2272] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 004f456252b8484eb43b4ce94ac3ff5e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.738948 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:13.740002 17138 raft_consensus.cc:2243] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:13.740674 17138 raft_consensus.cc:2272] T 16ffc2091e8940379a8d55961701e74f P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:13.741561 28526 consensus_peers.cc:597] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:13.743146 28452 consensus_peers.cc:597] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:13.743726 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:13.744626 17138 raft_consensus.cc:2243] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:13.745183 17138 raft_consensus.cc:2272] T 281b7e55fe1e4bbda42f5d1bd309c807 P 004f456252b8484eb43b4ce94ac3ff5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.748358 17138 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:13.749115 17138 raft_consensus.cc:2243] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:13.749609 17138 raft_consensus.cc:2272] T f3df851215834fc0aecdbf1378ee50f7 P 004f456252b8484eb43b4ce94ac3ff5e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:13.755765 28526 consensus_peers.cc:597] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:13.776010 17138 tablet_server.cc:196] TabletServer@127.16.188.129:37681 shutdown complete.
W20260709 13:22:13.786696 28452 consensus_peers.cc:597] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:13.803202 17138 tablet_server.cc:179] TabletServer@127.16.188.130:0 shutting down...
I20260709 13:22:13.846939 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:13.848196 17138 tablet_replica.cc:333] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af: stopping tablet replica
I20260709 13:22:13.850692 17138 raft_consensus.cc:2243] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:13.851516 17138 raft_consensus.cc:2272] T 8152c1181a174c798146de84c401aa35 P 03ba0ee779824f1887cc4012724105af [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.853976 17138 tablet_replica.cc:333] T f3df851215834fc0aecdbf1378ee50f7 P 03ba0ee779824f1887cc4012724105af: stopping tablet replica
I20260709 13:22:13.854809 17138 raft_consensus.cc:2243] T f3df851215834fc0aecdbf1378ee50f7 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:13.855290 17138 raft_consensus.cc:2272] T f3df851215834fc0aecdbf1378ee50f7 P 03ba0ee779824f1887cc4012724105af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.857702 17138 tablet_replica.cc:333] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af: stopping tablet replica
I20260709 13:22:13.858279 17138 raft_consensus.cc:2243] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:13.858692 17138 raft_consensus.cc:2272] T 281b7e55fe1e4bbda42f5d1bd309c807 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.861197 17138 tablet_replica.cc:333] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af: stopping tablet replica
I20260709 13:22:13.861775 17138 raft_consensus.cc:2243] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:13.862216 17138 raft_consensus.cc:2272] T 83274898c08c4f33845ec447c714f61b P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.864260 17138 tablet_replica.cc:333] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af: stopping tablet replica
I20260709 13:22:13.864895 17138 raft_consensus.cc:2243] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:22:13.865628 17138 raft_consensus.cc:2272] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 03ba0ee779824f1887cc4012724105af [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.868347 17138 tablet_replica.cc:333] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af: stopping tablet replica
I20260709 13:22:13.868908 17138 raft_consensus.cc:2243] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:13.869689 17138 raft_consensus.cc:2272] T 0d29d8ce48ef406888dad00e902e7be0 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.872000 17138 tablet_replica.cc:333] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af: stopping tablet replica
I20260709 13:22:13.872578 17138 raft_consensus.cc:2243] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:13.873296 17138 raft_consensus.cc:2272] T 16ffc2091e8940379a8d55961701e74f P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.875248 17138 tablet_replica.cc:333] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af: stopping tablet replica
I20260709 13:22:13.875789 17138 raft_consensus.cc:2243] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:13.876181 17138 raft_consensus.cc:2272] T 926cdbc0c6bb47c4880a8511ca063e01 P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.878159 17138 tablet_replica.cc:333] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af: stopping tablet replica
I20260709 13:22:13.878638 17138 raft_consensus.cc:2243] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:13.879156 17138 raft_consensus.cc:2272] T 22f57744b40647d09ed70cc4ee340c7e P 03ba0ee779824f1887cc4012724105af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:13.881228 17138 tablet_replica.cc:333] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af: stopping tablet replica
I20260709 13:22:13.881695 17138 raft_consensus.cc:2243] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:13.882411 17138 raft_consensus.cc:2272] T 1737010745e144fab6b8fc54f74434d0 P 03ba0ee779824f1887cc4012724105af [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:13.920848 28360 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:13.921190 28526 consensus_peers.cc:597] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:13.979328 28526 consensus_peers.cc:597] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 -> Peer 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033): Couldn't send request to peer 03ba0ee779824f1887cc4012724105af. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:39033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:13.984720 28526 consensus_peers.cc:597] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:13.990772 28526 consensus_peers.cc:597] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 -> Peer 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033): Couldn't send request to peer 03ba0ee779824f1887cc4012724105af. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:39033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:14.160849 28526 consensus_peers.cc:597] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 -> Peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Couldn't send request to peer 004f456252b8484eb43b4ce94ac3ff5e. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:14.265923 28526 consensus_peers.cc:597] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 -> Peer 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033): Couldn't send request to peer 03ba0ee779824f1887cc4012724105af. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:39033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:14.268556 28526 consensus_peers.cc:597] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 -> Peer 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033): Couldn't send request to peer 03ba0ee779824f1887cc4012724105af. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:39033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:14.339156 28526 consensus_peers.cc:597] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 -> Peer 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033): Couldn't send request to peer 03ba0ee779824f1887cc4012724105af. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:39033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:14.873418 28876 raft_consensus.cc:493] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 03ba0ee779824f1887cc4012724105af)
I20260709 13:22:14.874006 28876 raft_consensus.cc:515] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:14.875998 28876 leader_election.cc:290] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
W20260709 13:22:14.880175 28526 leader_election.cc:336] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111)
W20260709 13:22:14.881076 28526 leader_election.cc:336] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033): Network error: Client connection negotiation failed: client connection to 127.16.188.130:39033: connect: Connection refused (error 111)
I20260709 13:22:14.881433 28526 leader_election.cc:304] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23cc304460b3447092ff00d64430af73; no voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af
I20260709 13:22:14.882078 28876 raft_consensus.cc:2749] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:22:14.913729 17138 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 28510)
W20260709 13:22:14.922048 28360 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:14.965888 28876 raft_consensus.cc:493] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 03ba0ee779824f1887cc4012724105af)
I20260709 13:22:14.966614 28876 raft_consensus.cc:515] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:14.969084 28876 leader_election.cc:290] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
W20260709 13:22:14.973632 28526 leader_election.cc:336] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111)
W20260709 13:22:14.974352 28526 leader_election.cc:336] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033): Network error: Client connection negotiation failed: client connection to 127.16.188.130:39033: connect: Connection refused (error 111)
I20260709 13:22:14.974675 28526 leader_election.cc:304] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23cc304460b3447092ff00d64430af73; no voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af
I20260709 13:22:14.975328 28876 raft_consensus.cc:2749] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:22:15.079402 28876 raft_consensus.cc:493] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 03ba0ee779824f1887cc4012724105af)
I20260709 13:22:15.080017 28876 raft_consensus.cc:515] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:15.082403 28876 leader_election.cc:290] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
W20260709 13:22:15.086944 28526 leader_election.cc:336] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111)
W20260709 13:22:15.087637 28526 leader_election.cc:336] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033): Network error: Client connection negotiation failed: client connection to 127.16.188.130:39033: connect: Connection refused (error 111)
I20260709 13:22:15.087967 28526 leader_election.cc:304] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23cc304460b3447092ff00d64430af73; no voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af
I20260709 13:22:15.088604 28876 raft_consensus.cc:2749] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:22:15.130824 28876 raft_consensus.cc:493] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 03ba0ee779824f1887cc4012724105af)
I20260709 13:22:15.131460 28876 raft_consensus.cc:515] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:15.133955 28876 leader_election.cc:290] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
W20260709 13:22:15.138886 28526 leader_election.cc:336] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111)
W20260709 13:22:15.139639 28526 leader_election.cc:336] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033): Network error: Client connection negotiation failed: client connection to 127.16.188.130:39033: connect: Connection refused (error 111)
I20260709 13:22:15.140013 28526 leader_election.cc:304] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23cc304460b3447092ff00d64430af73; no voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af
I20260709 13:22:15.140683 28876 raft_consensus.cc:2749] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:22:15.169442 28876 raft_consensus.cc:493] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 03ba0ee779824f1887cc4012724105af)
I20260709 13:22:15.170145 28876 raft_consensus.cc:515] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "004f456252b8484eb43b4ce94ac3ff5e" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 37681 } } peers { permanent_uuid: "03ba0ee779824f1887cc4012724105af" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 39033 } } peers { permanent_uuid: "23cc304460b3447092ff00d64430af73" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 40363 } }
I20260709 13:22:15.172485 28876 leader_election.cc:290] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681), 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033)
W20260709 13:22:15.176898 28526 leader_election.cc:336] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 004f456252b8484eb43b4ce94ac3ff5e (127.16.188.129:37681): Network error: Client connection negotiation failed: client connection to 127.16.188.129:37681: connect: Connection refused (error 111)
W20260709 13:22:15.177614 28526 leader_election.cc:336] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 03ba0ee779824f1887cc4012724105af (127.16.188.130:39033): Network error: Client connection negotiation failed: client connection to 127.16.188.130:39033: connect: Connection refused (error 111)
I20260709 13:22:15.177943 28526 leader_election.cc:304] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23cc304460b3447092ff00d64430af73; no voters: 004f456252b8484eb43b4ce94ac3ff5e, 03ba0ee779824f1887cc4012724105af
I20260709 13:22:15.178575 28876 raft_consensus.cc:2749] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:22:15.598081 17138 tablet_server.cc:196] TabletServer@127.16.188.130:0 shutdown complete.
I20260709 13:22:15.629889 17138 tablet_server.cc:179] TabletServer@127.16.188.131:0 shutting down...
I20260709 13:22:15.665246 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:15.665982 17138 tablet_replica.cc:333] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73: stopping tablet replica
I20260709 13:22:15.666694 17138 raft_consensus.cc:2243] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.667161 17138 raft_consensus.cc:2272] T 8152c1181a174c798146de84c401aa35 P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.669411 17138 tablet_replica.cc:333] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73: stopping tablet replica
I20260709 13:22:15.669979 17138 raft_consensus.cc:2243] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.670384 17138 raft_consensus.cc:2272] T 1737010745e144fab6b8fc54f74434d0 P 23cc304460b3447092ff00d64430af73 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.672422 17138 tablet_replica.cc:333] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73: stopping tablet replica
I20260709 13:22:15.673053 17138 raft_consensus.cc:2243] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:15.673813 17138 raft_consensus.cc:2272] T 926cdbc0c6bb47c4880a8511ca063e01 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.675822 17138 tablet_replica.cc:333] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73: stopping tablet replica
I20260709 13:22:15.676385 17138 raft_consensus.cc:2243] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:15.677248 17138 raft_consensus.cc:2272] T 281b7e55fe1e4bbda42f5d1bd309c807 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.679382 17138 tablet_replica.cc:333] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73: stopping tablet replica
I20260709 13:22:15.679875 17138 raft_consensus.cc:2243] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:15.680698 17138 raft_consensus.cc:2272] T f3df851215834fc0aecdbf1378ee50f7 P 23cc304460b3447092ff00d64430af73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.682768 17138 tablet_replica.cc:333] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73: stopping tablet replica
I20260709 13:22:15.683272 17138 raft_consensus.cc:2243] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:15.683983 17138 raft_consensus.cc:2272] T 83274898c08c4f33845ec447c714f61b P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.685987 17138 tablet_replica.cc:333] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73: stopping tablet replica
I20260709 13:22:15.686512 17138 raft_consensus.cc:2243] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.686908 17138 raft_consensus.cc:2272] T 1057cc07cc2a4d4e8ede3957ef8b7a8f P 23cc304460b3447092ff00d64430af73 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.688804 17138 tablet_replica.cc:333] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73: stopping tablet replica
I20260709 13:22:15.689301 17138 raft_consensus.cc:2243] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.689694 17138 raft_consensus.cc:2272] T 16ffc2091e8940379a8d55961701e74f P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.691536 17138 tablet_replica.cc:333] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73: stopping tablet replica
I20260709 13:22:15.692023 17138 raft_consensus.cc:2243] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:15.692495 17138 raft_consensus.cc:2272] T 0d29d8ce48ef406888dad00e902e7be0 P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.694741 17138 tablet_replica.cc:333] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73: stopping tablet replica
I20260709 13:22:15.695179 17138 raft_consensus.cc:2243] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:15.695923 17138 raft_consensus.cc:2272] T 22f57744b40647d09ed70cc4ee340c7e P 23cc304460b3447092ff00d64430af73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.729076 17138 tablet_server.cc:196] TabletServer@127.16.188.131:0 shutdown complete.
I20260709 13:22:15.753890 17138 master.cc:562] Master@127.16.188.190:39015 shutting down...
I20260709 13:22:15.780120 17138 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:15.780776 17138 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:15.781194 17138 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7769f809450840e8b77e67c1108fe969: stopping tablet replica
I20260709 13:22:15.803303 17138 master.cc:584] Master@127.16.188.190:39015 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (15091 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:22:15.857936 17138 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.188.190:34829
I20260709 13:22:15.859208 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:15.865345 28909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:15.865463 28910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:15.866405 28912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:15.868471 17138 server_base.cc:1061] running on GCE node
I20260709 13:22:15.869572 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:15.869751 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:15.869870 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603335869859 us; error 0 us; skew 500 ppm
I20260709 13:22:15.870396 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:15.873142 17138 webserver.cc:533] Webserver started at http://127.16.188.190:35515/ using document root <none> and password file <none>
I20260709 13:22:15.873639 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:15.873795 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:15.874027 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:15.875174 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/master-0-root/instance:
uuid: "2c8a072abc664c0f81fe3260f55e2a8d"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-2hqk"
I20260709 13:22:15.879860 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:15.883373 28917 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:15.884196 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:15.884477 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/master-0-root
uuid: "2c8a072abc664c0f81fe3260f55e2a8d"
format_stamp: "Formatted at 2026-07-09 13:22:15 on dist-test-slave-2hqk"
I20260709 13:22:15.884799 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:15.902808 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:15.904109 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:15.949801 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.190:34829
I20260709 13:22:15.949935 28968 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.190:34829 every 8 connection(s)
I20260709 13:22:15.953923 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:15.964675 28969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d: Bootstrap starting.
I20260709 13:22:15.969411 28969 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:15.973997 28969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d: No bootstrap required, opened a new log
I20260709 13:22:15.976316 28969 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c8a072abc664c0f81fe3260f55e2a8d" member_type: VOTER }
I20260709 13:22:15.976816 28969 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:15.977083 28969 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c8a072abc664c0f81fe3260f55e2a8d, State: Initialized, Role: FOLLOWER
I20260709 13:22:15.977725 28969 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c8a072abc664c0f81fe3260f55e2a8d" member_type: VOTER }
I20260709 13:22:15.978226 28969 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:15.978453 28969 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:15.978785 28969 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:15.983944 28969 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c8a072abc664c0f81fe3260f55e2a8d" member_type: VOTER }
I20260709 13:22:15.984505 28969 leader_election.cc:304] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c8a072abc664c0f81fe3260f55e2a8d; no voters: 
I20260709 13:22:15.986147 28969 leader_election.cc:290] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:15.986493 28972 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:15.988443 28972 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [term 1 LEADER]: Becoming Leader. State: Replica: 2c8a072abc664c0f81fe3260f55e2a8d, State: Running, Role: LEADER
I20260709 13:22:15.989319 28972 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c8a072abc664c0f81fe3260f55e2a8d" member_type: VOTER }
I20260709 13:22:15.990109 28969 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:15.995635 28974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c8a072abc664c0f81fe3260f55e2a8d. Latest consensus state: current_term: 1 leader_uuid: "2c8a072abc664c0f81fe3260f55e2a8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c8a072abc664c0f81fe3260f55e2a8d" member_type: VOTER } }
I20260709 13:22:15.995635 28973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c8a072abc664c0f81fe3260f55e2a8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c8a072abc664c0f81fe3260f55e2a8d" member_type: VOTER } }
I20260709 13:22:15.996488 28974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:15.996553 28973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:16.004345 28979 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:16.012197 28979 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:16.013329 17138 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:16.021806 28979 catalog_manager.cc:1383] Generated new cluster ID: 4fe5ee57bc4b4add8a28e8dfc1cafc04
I20260709 13:22:16.022089 28979 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:16.059828 28979 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:16.061314 28979 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:16.076650 28979 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d: Generated new TSK 0
I20260709 13:22:16.077284 28979 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:16.144786 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:16.151846 28990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:16.153209 28991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:16.155308 17138 server_base.cc:1061] running on GCE node
W20260709 13:22:16.155419 28993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:16.156665 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:16.156930 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:16.157124 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603336157096 us; error 0 us; skew 500 ppm
I20260709 13:22:16.157800 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:16.160482 17138 webserver.cc:533] Webserver started at http://127.16.188.129:41767/ using document root <none> and password file <none>
I20260709 13:22:16.161111 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:16.161381 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:16.161697 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:16.162958 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/ts-0-root/instance:
uuid: "0de60efee4d74c9489e18666aca8e144"
format_stamp: "Formatted at 2026-07-09 13:22:16 on dist-test-slave-2hqk"
I20260709 13:22:16.168010 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:22:16.171900 28998 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:16.172891 17138 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:22:16.173236 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/ts-0-root
uuid: "0de60efee4d74c9489e18666aca8e144"
format_stamp: "Formatted at 2026-07-09 13:22:16 on dist-test-slave-2hqk"
I20260709 13:22:16.173579 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:16.186753 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:16.188069 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:16.189723 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:16.192255 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:16.192492 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:16.192839 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:16.193045 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:16.291936 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.129:40035
I20260709 13:22:16.292070 29060 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.129:40035 every 8 connection(s)
I20260709 13:22:16.310153 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:16.358026 29063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:16.362715 29064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:16.368278 29066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:16.369561 17138 server_base.cc:1061] running on GCE node
I20260709 13:22:16.371403 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:16.371707 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:16.371903 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603336371884 us; error 0 us; skew 500 ppm
I20260709 13:22:16.372696 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:16.387109 17138 webserver.cc:533] Webserver started at http://127.16.188.130:42937/ using document root <none> and password file <none>
I20260709 13:22:16.387881 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:16.388134 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:16.388494 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:16.390157 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/ts-1-root/instance:
uuid: "404f6bc08f2e4b34b1a3321c3e517141"
format_stamp: "Formatted at 2026-07-09 13:22:16 on dist-test-slave-2hqk"
I20260709 13:22:16.398355 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:22:16.402721 29073 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:16.403797 17138 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:22:16.404127 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/ts-1-root
uuid: "404f6bc08f2e4b34b1a3321c3e517141"
format_stamp: "Formatted at 2026-07-09 13:22:16 on dist-test-slave-2hqk"
I20260709 13:22:16.404438 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:16.406394 29061 heartbeater.cc:344] Connected to a master server at 127.16.188.190:34829
I20260709 13:22:16.406924 29061 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:16.407917 29061 heartbeater.cc:507] Master 127.16.188.190:34829 requested a full tablet report, sending...
I20260709 13:22:16.411209 28934 ts_manager.cc:194] Registered new tserver with Master: 0de60efee4d74c9489e18666aca8e144 (127.16.188.129:40035)
I20260709 13:22:16.413663 28934 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54922
I20260709 13:22:16.424391 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:16.425856 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:16.427423 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:16.429888 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:16.430061 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:16.430373 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:16.430516 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:16.481320 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.130:35943
I20260709 13:22:16.481581 29135 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.130:35943 every 8 connection(s)
I20260709 13:22:16.486904 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:16.495400 29139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:16.497982 29140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:16.502779 29136 heartbeater.cc:344] Connected to a master server at 127.16.188.190:34829
I20260709 13:22:16.503742 29136 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:16.504042 17138 server_base.cc:1061] running on GCE node
I20260709 13:22:16.505264 29136 heartbeater.cc:507] Master 127.16.188.190:34829 requested a full tablet report, sending...
W20260709 13:22:16.505861 29142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:16.507320 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:16.507541 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:16.507809 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603336507765 us; error 0 us; skew 500 ppm
I20260709 13:22:16.507898 28934 ts_manager.cc:194] Registered new tserver with Master: 404f6bc08f2e4b34b1a3321c3e517141 (127.16.188.130:35943)
I20260709 13:22:16.508595 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:16.509824 28934 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54930
I20260709 13:22:16.512045 17138 webserver.cc:533] Webserver started at http://127.16.188.131:38877/ using document root <none> and password file <none>
I20260709 13:22:16.512804 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:16.513048 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:16.513337 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:16.514909 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/ts-2-root/instance:
uuid: "bbf3f102176c4b9e952aa5e1a8717ec2"
format_stamp: "Formatted at 2026-07-09 13:22:16 on dist-test-slave-2hqk"
I20260709 13:22:16.519634 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:16.523320 29147 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:16.524101 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:16.524435 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/ts-2-root
uuid: "bbf3f102176c4b9e952aa5e1a8717ec2"
format_stamp: "Formatted at 2026-07-09 13:22:16 on dist-test-slave-2hqk"
I20260709 13:22:16.524845 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602984839783-17138-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:16.539686 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:16.541100 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:16.542766 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:16.545301 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:16.545537 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:16.545792 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:16.545979 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:16.593461 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.131:44257
I20260709 13:22:16.593607 29210 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.131:44257 every 8 connection(s)
I20260709 13:22:16.608340 29211 heartbeater.cc:344] Connected to a master server at 127.16.188.190:34829
I20260709 13:22:16.608850 29211 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:16.609551 29211 heartbeater.cc:507] Master 127.16.188.190:34829 requested a full tablet report, sending...
I20260709 13:22:16.611580 28934 ts_manager.cc:194] Registered new tserver with Master: bbf3f102176c4b9e952aa5e1a8717ec2 (127.16.188.131:44257)
I20260709 13:22:16.612104 17138 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015100785s
I20260709 13:22:16.613386 28934 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54940
I20260709 13:22:16.639991 28934 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54942:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:16.642103 28934 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:16.746024 29026 tablet_service.cc:1511] Processing CreateTablet for tablet 0c1e38ad283e4f04827b138cee16484a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fa84c959787b44c9be67b77587944118]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:16.747169 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 0c1e38ad283e4f04827b138cee16484a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fa84c959787b44c9be67b77587944118]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:16.747946 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 4c8608a489c141e8a94c9297b51a2c6c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fa84c959787b44c9be67b77587944118]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:16.749266 29026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c1e38ad283e4f04827b138cee16484a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.750357 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c8608a489c141e8a94c9297b51a2c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.752503 29175 tablet_service.cc:1511] Processing CreateTablet for tablet 0c1e38ad283e4f04827b138cee16484a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fa84c959787b44c9be67b77587944118]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:16.752915 29025 tablet_service.cc:1511] Processing CreateTablet for tablet 4c8608a489c141e8a94c9297b51a2c6c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fa84c959787b44c9be67b77587944118]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:16.754393 29175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c1e38ad283e4f04827b138cee16484a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.757620 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c1e38ad283e4f04827b138cee16484a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.758641 29174 tablet_service.cc:1511] Processing CreateTablet for tablet 4c8608a489c141e8a94c9297b51a2c6c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fa84c959787b44c9be67b77587944118]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:16.760196 29174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c8608a489c141e8a94c9297b51a2c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.754558 29025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c8608a489c141e8a94c9297b51a2c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:16.803223 29230 tablet_bootstrap.cc:492] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144: Bootstrap starting.
I20260709 13:22:16.803963 29231 tablet_bootstrap.cc:492] T 0c1e38ad283e4f04827b138cee16484a P 404f6bc08f2e4b34b1a3321c3e517141: Bootstrap starting.
I20260709 13:22:16.809837 29230 tablet_bootstrap.cc:654] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.811671 29232 tablet_bootstrap.cc:492] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2: Bootstrap starting.
I20260709 13:22:16.812915 29231 tablet_bootstrap.cc:654] T 0c1e38ad283e4f04827b138cee16484a P 404f6bc08f2e4b34b1a3321c3e517141: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.816076 29230 tablet_bootstrap.cc:492] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144: No bootstrap required, opened a new log
I20260709 13:22:16.816841 29230 ts_tablet_manager.cc:1403] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:22:16.821020 29231 tablet_bootstrap.cc:492] T 0c1e38ad283e4f04827b138cee16484a P 404f6bc08f2e4b34b1a3321c3e517141: No bootstrap required, opened a new log
I20260709 13:22:16.820968 29230 raft_consensus.cc:359] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:16.821743 29231 ts_tablet_manager.cc:1403] T 0c1e38ad283e4f04827b138cee16484a P 404f6bc08f2e4b34b1a3321c3e517141: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.009s
I20260709 13:22:16.821854 29232 tablet_bootstrap.cc:654] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.822139 29230 raft_consensus.cc:385] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.822564 29230 raft_consensus.cc:740] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0de60efee4d74c9489e18666aca8e144, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.823387 29230 consensus_queue.cc:260] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:16.825801 29231 raft_consensus.cc:359] T 0c1e38ad283e4f04827b138cee16484a P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:16.826344 29061 heartbeater.cc:499] Master 127.16.188.190:34829 was elected leader, sending a full tablet report...
I20260709 13:22:16.826573 29230 ts_tablet_manager.cc:1434] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:22:16.826783 29231 raft_consensus.cc:385] T 0c1e38ad283e4f04827b138cee16484a P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.827322 29231 raft_consensus.cc:740] T 0c1e38ad283e4f04827b138cee16484a P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 404f6bc08f2e4b34b1a3321c3e517141, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.827651 29230 tablet_bootstrap.cc:492] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144: Bootstrap starting.
I20260709 13:22:16.828194 29231 consensus_queue.cc:260] T 0c1e38ad283e4f04827b138cee16484a P 404f6bc08f2e4b34b1a3321c3e517141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:16.831393 29232 tablet_bootstrap.cc:492] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2: No bootstrap required, opened a new log
I20260709 13:22:16.832064 29232 ts_tablet_manager.cc:1403] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:22:16.835163 29230 tablet_bootstrap.cc:654] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.835762 29232 raft_consensus.cc:359] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:16.836786 29232 raft_consensus.cc:385] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.837131 29232 raft_consensus.cc:740] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbf3f102176c4b9e952aa5e1a8717ec2, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.838972 29232 consensus_queue.cc:260] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:16.846315 29136 heartbeater.cc:499] Master 127.16.188.190:34829 was elected leader, sending a full tablet report...
I20260709 13:22:16.855966 29231 ts_tablet_manager.cc:1434] T 0c1e38ad283e4f04827b138cee16484a P 404f6bc08f2e4b34b1a3321c3e517141: Time spent starting tablet: real 0.034s	user 0.015s	sys 0.008s
I20260709 13:22:16.857404 29231 tablet_bootstrap.cc:492] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141: Bootstrap starting.
I20260709 13:22:16.862344 29232 ts_tablet_manager.cc:1434] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2: Time spent starting tablet: real 0.030s	user 0.015s	sys 0.012s
I20260709 13:22:16.863703 29232 tablet_bootstrap.cc:492] T 0c1e38ad283e4f04827b138cee16484a P bbf3f102176c4b9e952aa5e1a8717ec2: Bootstrap starting.
I20260709 13:22:16.864074 29211 heartbeater.cc:499] Master 127.16.188.190:34829 was elected leader, sending a full tablet report...
I20260709 13:22:16.864086 29230 tablet_bootstrap.cc:492] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144: No bootstrap required, opened a new log
I20260709 13:22:16.867053 29230 ts_tablet_manager.cc:1403] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.015s
I20260709 13:22:16.868362 29231 tablet_bootstrap.cc:654] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.870607 29230 raft_consensus.cc:359] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:16.871179 29232 tablet_bootstrap.cc:654] T 0c1e38ad283e4f04827b138cee16484a P bbf3f102176c4b9e952aa5e1a8717ec2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:16.871524 29230 raft_consensus.cc:385] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.871948 29230 raft_consensus.cc:740] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0de60efee4d74c9489e18666aca8e144, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.873406 29230 consensus_queue.cc:260] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:16.876101 29230 ts_tablet_manager.cc:1434] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:22:16.885289 29231 tablet_bootstrap.cc:492] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141: No bootstrap required, opened a new log
I20260709 13:22:16.885773 29231 ts_tablet_manager.cc:1403] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.005s
I20260709 13:22:16.888072 29232 tablet_bootstrap.cc:492] T 0c1e38ad283e4f04827b138cee16484a P bbf3f102176c4b9e952aa5e1a8717ec2: No bootstrap required, opened a new log
I20260709 13:22:16.888659 29232 ts_tablet_manager.cc:1403] T 0c1e38ad283e4f04827b138cee16484a P bbf3f102176c4b9e952aa5e1a8717ec2: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 13:22:16.888545 29231 raft_consensus.cc:359] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:16.889582 29231 raft_consensus.cc:385] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.889925 29231 raft_consensus.cc:740] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 404f6bc08f2e4b34b1a3321c3e517141, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.890806 29231 consensus_queue.cc:260] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:16.891919 29232 raft_consensus.cc:359] T 0c1e38ad283e4f04827b138cee16484a P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:16.892665 29231 ts_tablet_manager.cc:1434] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:16.892787 29232 raft_consensus.cc:385] T 0c1e38ad283e4f04827b138cee16484a P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:16.893298 29232 raft_consensus.cc:740] T 0c1e38ad283e4f04827b138cee16484a P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbf3f102176c4b9e952aa5e1a8717ec2, State: Initialized, Role: FOLLOWER
I20260709 13:22:16.894100 29232 consensus_queue.cc:260] T 0c1e38ad283e4f04827b138cee16484a P bbf3f102176c4b9e952aa5e1a8717ec2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:16.895978 29232 ts_tablet_manager.cc:1434] T 0c1e38ad283e4f04827b138cee16484a P bbf3f102176c4b9e952aa5e1a8717ec2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:16.975937 29239 raft_consensus.cc:493] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:16.976599 29239 raft_consensus.cc:515] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:16.979251 29239 leader_election.cc:290] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0de60efee4d74c9489e18666aca8e144 (127.16.188.129:40035), 404f6bc08f2e4b34b1a3321c3e517141 (127.16.188.130:35943)
I20260709 13:22:16.992982 29036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8608a489c141e8a94c9297b51a2c6c" candidate_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0de60efee4d74c9489e18666aca8e144" is_pre_election: true
I20260709 13:22:16.993965 29036 raft_consensus.cc:2468] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbf3f102176c4b9e952aa5e1a8717ec2 in term 0.
I20260709 13:22:16.994181 29111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8608a489c141e8a94c9297b51a2c6c" candidate_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "404f6bc08f2e4b34b1a3321c3e517141" is_pre_election: true
I20260709 13:22:16.995056 29111 raft_consensus.cc:2468] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbf3f102176c4b9e952aa5e1a8717ec2 in term 0.
I20260709 13:22:16.995258 29148 leader_election.cc:304] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0de60efee4d74c9489e18666aca8e144, bbf3f102176c4b9e952aa5e1a8717ec2; no voters: 
I20260709 13:22:16.996258 29239 raft_consensus.cc:2804] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:16.996701 29239 raft_consensus.cc:493] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:16.997030 29239 raft_consensus.cc:3060] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:17.001646 28981 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:17.004339 29239 raft_consensus.cc:515] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.006279 29239 leader_election.cc:290] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [CANDIDATE]: Term 1 election: Requested vote from peers 0de60efee4d74c9489e18666aca8e144 (127.16.188.129:40035), 404f6bc08f2e4b34b1a3321c3e517141 (127.16.188.130:35943)
I20260709 13:22:17.007217 29036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8608a489c141e8a94c9297b51a2c6c" candidate_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0de60efee4d74c9489e18666aca8e144"
I20260709 13:22:17.007593 29111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8608a489c141e8a94c9297b51a2c6c" candidate_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "404f6bc08f2e4b34b1a3321c3e517141"
I20260709 13:22:17.007773 29036 raft_consensus.cc:3060] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.008247 29111 raft_consensus.cc:3060] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.014372 29036 raft_consensus.cc:2468] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbf3f102176c4b9e952aa5e1a8717ec2 in term 1.
I20260709 13:22:17.015647 29111 raft_consensus.cc:2468] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbf3f102176c4b9e952aa5e1a8717ec2 in term 1.
I20260709 13:22:17.015621 29148 leader_election.cc:304] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0de60efee4d74c9489e18666aca8e144, bbf3f102176c4b9e952aa5e1a8717ec2; no voters: 
I20260709 13:22:17.017009 29239 raft_consensus.cc:2804] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:17.018019 29239 raft_consensus.cc:697] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 LEADER]: Becoming Leader. State: Replica: bbf3f102176c4b9e952aa5e1a8717ec2, State: Running, Role: LEADER
I20260709 13:22:17.018895 29239 consensus_queue.cc:237] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.028774 28934 catalog_manager.cc:5697] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bbf3f102176c4b9e952aa5e1a8717ec2 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:17.223289 29235 raft_consensus.cc:493] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:17.223963 29235 raft_consensus.cc:515] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.226455 29235 leader_election.cc:290] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 404f6bc08f2e4b34b1a3321c3e517141 (127.16.188.130:35943), bbf3f102176c4b9e952aa5e1a8717ec2 (127.16.188.131:44257)
I20260709 13:22:17.238704 29111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1e38ad283e4f04827b138cee16484a" candidate_uuid: "0de60efee4d74c9489e18666aca8e144" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "404f6bc08f2e4b34b1a3321c3e517141" is_pre_election: true
I20260709 13:22:17.239606 29111 raft_consensus.cc:2468] T 0c1e38ad283e4f04827b138cee16484a P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0de60efee4d74c9489e18666aca8e144 in term 0.
I20260709 13:22:17.240538 29186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1e38ad283e4f04827b138cee16484a" candidate_uuid: "0de60efee4d74c9489e18666aca8e144" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" is_pre_election: true
I20260709 13:22:17.240854 29000 leader_election.cc:304] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0de60efee4d74c9489e18666aca8e144, 404f6bc08f2e4b34b1a3321c3e517141; no voters: 
I20260709 13:22:17.241348 29186 raft_consensus.cc:2468] T 0c1e38ad283e4f04827b138cee16484a P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0de60efee4d74c9489e18666aca8e144 in term 0.
I20260709 13:22:17.241773 29235 raft_consensus.cc:2804] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:17.242168 29235 raft_consensus.cc:493] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:17.242547 29235 raft_consensus.cc:3060] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.250090 29235 raft_consensus.cc:515] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.251819 29235 leader_election.cc:290] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [CANDIDATE]: Term 1 election: Requested vote from peers 404f6bc08f2e4b34b1a3321c3e517141 (127.16.188.130:35943), bbf3f102176c4b9e952aa5e1a8717ec2 (127.16.188.131:44257)
I20260709 13:22:17.252990 29111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1e38ad283e4f04827b138cee16484a" candidate_uuid: "0de60efee4d74c9489e18666aca8e144" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "404f6bc08f2e4b34b1a3321c3e517141"
I20260709 13:22:17.253413 29186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c1e38ad283e4f04827b138cee16484a" candidate_uuid: "0de60efee4d74c9489e18666aca8e144" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2"
I20260709 13:22:17.253660 29111 raft_consensus.cc:3060] T 0c1e38ad283e4f04827b138cee16484a P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.254175 29186 raft_consensus.cc:3060] T 0c1e38ad283e4f04827b138cee16484a P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.259724 29111 raft_consensus.cc:2468] T 0c1e38ad283e4f04827b138cee16484a P 404f6bc08f2e4b34b1a3321c3e517141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0de60efee4d74c9489e18666aca8e144 in term 1.
I20260709 13:22:17.260480 29186 raft_consensus.cc:2468] T 0c1e38ad283e4f04827b138cee16484a P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0de60efee4d74c9489e18666aca8e144 in term 1.
I20260709 13:22:17.261003 29000 leader_election.cc:304] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0de60efee4d74c9489e18666aca8e144, 404f6bc08f2e4b34b1a3321c3e517141; no voters: 
I20260709 13:22:17.261880 29235 raft_consensus.cc:2804] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:17.262871 29235 raft_consensus.cc:697] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [term 1 LEADER]: Becoming Leader. State: Replica: 0de60efee4d74c9489e18666aca8e144, State: Running, Role: LEADER
I20260709 13:22:17.263762 29235 consensus_queue.cc:237] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.271147 28934 catalog_manager.cc:5697] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0de60efee4d74c9489e18666aca8e144 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "0de60efee4d74c9489e18666aca8e144" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:17.353405 28934 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54950:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:17.355274 28965 debug-util.cc:398] Leaking SignalData structure 0x7b08001b75c0 after lost signal to thread 17141
W20260709 13:22:17.355707 28934 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:17.384116 29025 tablet_service.cc:1511] Processing CreateTablet for tablet c6ae078804fd4c16889e64f50b32c0bc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=200775f5d5384171932f0a1796df9524]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:17.385803 29025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ae078804fd4c16889e64f50b32c0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.385885 29100 tablet_service.cc:1511] Processing CreateTablet for tablet c6ae078804fd4c16889e64f50b32c0bc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=200775f5d5384171932f0a1796df9524]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:17.387363 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ae078804fd4c16889e64f50b32c0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.391050 29026 tablet_service.cc:1511] Processing CreateTablet for tablet 5b3a106683a14c1590fffb3aea0c0ff2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=200775f5d5384171932f0a1796df9524]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:17.392498 29026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3a106683a14c1590fffb3aea0c0ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.399571 29174 tablet_service.cc:1511] Processing CreateTablet for tablet c6ae078804fd4c16889e64f50b32c0bc (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=200775f5d5384171932f0a1796df9524]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:17.400398 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 5b3a106683a14c1590fffb3aea0c0ff2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=200775f5d5384171932f0a1796df9524]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:17.401048 29174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ae078804fd4c16889e64f50b32c0bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.401870 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3a106683a14c1590fffb3aea0c0ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.405694 29175 tablet_service.cc:1511] Processing CreateTablet for tablet 5b3a106683a14c1590fffb3aea0c0ff2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=200775f5d5384171932f0a1796df9524]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:17.407055 29175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3a106683a14c1590fffb3aea0c0ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:17.449813 29256 tablet_bootstrap.cc:492] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141: Bootstrap starting.
I20260709 13:22:17.451175 29257 tablet_bootstrap.cc:492] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144: Bootstrap starting.
I20260709 13:22:17.456871 29256 tablet_bootstrap.cc:654] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.461930 29258 tablet_bootstrap.cc:492] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2: Bootstrap starting.
I20260709 13:22:17.458693 29257 tablet_bootstrap.cc:654] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.470249 29258 tablet_bootstrap.cc:654] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.471891 29256 tablet_bootstrap.cc:492] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141: No bootstrap required, opened a new log
I20260709 13:22:17.472606 29256 ts_tablet_manager.cc:1403] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.004s
I20260709 13:22:17.473353 29257 tablet_bootstrap.cc:492] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144: No bootstrap required, opened a new log
I20260709 13:22:17.474123 29257 ts_tablet_manager.cc:1403] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.009s
I20260709 13:22:17.476248 29256 raft_consensus.cc:359] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.477226 29256 raft_consensus.cc:385] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.477579 29256 raft_consensus.cc:740] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 404f6bc08f2e4b34b1a3321c3e517141, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.478595 29256 consensus_queue.cc:260] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.483302 29257 raft_consensus.cc:359] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.483456 29239 consensus_queue.cc:1048] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:17.484386 29257 raft_consensus.cc:385] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.484817 29257 raft_consensus.cc:740] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0de60efee4d74c9489e18666aca8e144, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.485929 29258 tablet_bootstrap.cc:492] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2: No bootstrap required, opened a new log
I20260709 13:22:17.485734 29257 consensus_queue.cc:260] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.486717 29258 ts_tablet_manager.cc:1403] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 13:22:17.483530 29256 ts_tablet_manager.cc:1434] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 13:22:17.489575 29256 tablet_bootstrap.cc:492] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141: Bootstrap starting.
I20260709 13:22:17.491366 29257 ts_tablet_manager.cc:1434] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 13:22:17.494421 29257 tablet_bootstrap.cc:492] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144: Bootstrap starting.
I20260709 13:22:17.500494 29258 raft_consensus.cc:359] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.502565 29258 raft_consensus.cc:385] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.503325 29258 raft_consensus.cc:740] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbf3f102176c4b9e952aa5e1a8717ec2, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.508211 29257 tablet_bootstrap.cc:654] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.516686 29256 tablet_bootstrap.cc:654] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.505923 29258 consensus_queue.cc:260] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.525691 29258 ts_tablet_manager.cc:1434] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:22:17.526330 29257 tablet_bootstrap.cc:492] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144: No bootstrap required, opened a new log
I20260709 13:22:17.527204 29257 ts_tablet_manager.cc:1403] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.016s
I20260709 13:22:17.527711 29258 tablet_bootstrap.cc:492] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2: Bootstrap starting.
I20260709 13:22:17.530558 29257 raft_consensus.cc:359] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.531386 29257 raft_consensus.cc:385] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.531762 29257 raft_consensus.cc:740] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0de60efee4d74c9489e18666aca8e144, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.532809 29257 consensus_queue.cc:260] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.539460 29258 tablet_bootstrap.cc:654] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:17.549399 29239 consensus_queue.cc:1048] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:17.550714 29257 ts_tablet_manager.cc:1434] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 13:22:17.563766 29256 tablet_bootstrap.cc:492] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141: No bootstrap required, opened a new log
I20260709 13:22:17.565907 29256 ts_tablet_manager.cc:1403] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141: Time spent bootstrapping tablet: real 0.077s	user 0.011s	sys 0.021s
I20260709 13:22:17.569684 29256 raft_consensus.cc:359] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.580663 29256 raft_consensus.cc:385] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.587039 29256 raft_consensus.cc:740] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 404f6bc08f2e4b34b1a3321c3e517141, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.588339 29256 consensus_queue.cc:260] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.591037 29256 ts_tablet_manager.cc:1434] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 13:22:17.591265 29258 tablet_bootstrap.cc:492] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2: No bootstrap required, opened a new log
I20260709 13:22:17.592149 29258 ts_tablet_manager.cc:1403] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2: Time spent bootstrapping tablet: real 0.065s	user 0.022s	sys 0.009s
I20260709 13:22:17.595639 29258 raft_consensus.cc:359] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.596422 29258 raft_consensus.cc:385] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:17.596855 29258 raft_consensus.cc:740] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbf3f102176c4b9e952aa5e1a8717ec2, State: Initialized, Role: FOLLOWER
I20260709 13:22:17.597879 29258 consensus_queue.cc:260] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.600495 29258 ts_tablet_manager.cc:1434] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:17.603339 29243 raft_consensus.cc:493] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:17.603974 29243 raft_consensus.cc:515] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.607548 29243 leader_election.cc:290] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0de60efee4d74c9489e18666aca8e144 (127.16.188.129:40035), 404f6bc08f2e4b34b1a3321c3e517141 (127.16.188.130:35943)
I20260709 13:22:17.607543 29036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ae078804fd4c16889e64f50b32c0bc" candidate_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0de60efee4d74c9489e18666aca8e144" is_pre_election: true
I20260709 13:22:17.608451 29036 raft_consensus.cc:2468] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbf3f102176c4b9e952aa5e1a8717ec2 in term 0.
I20260709 13:22:17.609609 29148 leader_election.cc:304] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0de60efee4d74c9489e18666aca8e144, bbf3f102176c4b9e952aa5e1a8717ec2; no voters: 
I20260709 13:22:17.609680 29111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ae078804fd4c16889e64f50b32c0bc" candidate_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "404f6bc08f2e4b34b1a3321c3e517141" is_pre_election: true
I20260709 13:22:17.610493 29243 raft_consensus.cc:2804] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:17.610617 29111 raft_consensus.cc:2468] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbf3f102176c4b9e952aa5e1a8717ec2 in term 0.
I20260709 13:22:17.610922 29243 raft_consensus.cc:493] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:17.611429 29243 raft_consensus.cc:3060] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.620281 29243 raft_consensus.cc:515] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.622622 29243 leader_election.cc:290] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [CANDIDATE]: Term 1 election: Requested vote from peers 0de60efee4d74c9489e18666aca8e144 (127.16.188.129:40035), 404f6bc08f2e4b34b1a3321c3e517141 (127.16.188.130:35943)
I20260709 13:22:17.623056 29036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ae078804fd4c16889e64f50b32c0bc" candidate_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0de60efee4d74c9489e18666aca8e144"
I20260709 13:22:17.623333 29111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ae078804fd4c16889e64f50b32c0bc" candidate_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "404f6bc08f2e4b34b1a3321c3e517141"
I20260709 13:22:17.623832 29036 raft_consensus.cc:3060] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.624009 29111 raft_consensus.cc:3060] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.630707 29111 raft_consensus.cc:2468] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbf3f102176c4b9e952aa5e1a8717ec2 in term 1.
I20260709 13:22:17.632015 29149 leader_election.cc:304] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 404f6bc08f2e4b34b1a3321c3e517141, bbf3f102176c4b9e952aa5e1a8717ec2; no voters: 
I20260709 13:22:17.632349 29036 raft_consensus.cc:2468] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbf3f102176c4b9e952aa5e1a8717ec2 in term 1.
I20260709 13:22:17.632938 29243 raft_consensus.cc:2804] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:17.633567 29243 raft_consensus.cc:697] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 LEADER]: Becoming Leader. State: Replica: bbf3f102176c4b9e952aa5e1a8717ec2, State: Running, Role: LEADER
I20260709 13:22:17.634536 29243 consensus_queue.cc:237] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.643350 28931 catalog_manager.cc:5697] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bbf3f102176c4b9e952aa5e1a8717ec2 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:17.750916 29235 consensus_queue.cc:1048] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:17.764858 29235 consensus_queue.cc:1048] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [LEADER]: Connected to new peer: Peer: permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:17.886557 29262 raft_consensus.cc:493] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:17.887153 29262 raft_consensus.cc:515] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.890971 29262 leader_election.cc:290] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0de60efee4d74c9489e18666aca8e144 (127.16.188.129:40035), bbf3f102176c4b9e952aa5e1a8717ec2 (127.16.188.131:44257)
I20260709 13:22:17.903103 29243 raft_consensus.cc:493] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:17.903790 29243 raft_consensus.cc:515] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.907387 29111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2" candidate_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "404f6bc08f2e4b34b1a3321c3e517141" is_pre_election: true
I20260709 13:22:17.908259 29243 leader_election.cc:290] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0de60efee4d74c9489e18666aca8e144 (127.16.188.129:40035), 404f6bc08f2e4b34b1a3321c3e517141 (127.16.188.130:35943)
I20260709 13:22:17.908028 29036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2" candidate_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0de60efee4d74c9489e18666aca8e144" is_pre_election: true
I20260709 13:22:17.909539 29036 raft_consensus.cc:2468] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbf3f102176c4b9e952aa5e1a8717ec2 in term 0.
I20260709 13:22:17.910934 29148 leader_election.cc:304] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0de60efee4d74c9489e18666aca8e144, bbf3f102176c4b9e952aa5e1a8717ec2; no voters: 
I20260709 13:22:17.911796 29239 raft_consensus.cc:2804] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:17.912149 29239 raft_consensus.cc:493] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:17.912485 29239 raft_consensus.cc:3060] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.908068 29111 raft_consensus.cc:2468] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbf3f102176c4b9e952aa5e1a8717ec2 in term 0.
I20260709 13:22:17.918391 29036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2" candidate_uuid: "404f6bc08f2e4b34b1a3321c3e517141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0de60efee4d74c9489e18666aca8e144" is_pre_election: true
I20260709 13:22:17.918921 29036 raft_consensus.cc:2468] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 404f6bc08f2e4b34b1a3321c3e517141 in term 0.
I20260709 13:22:17.920348 29074 leader_election.cc:304] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0de60efee4d74c9489e18666aca8e144, 404f6bc08f2e4b34b1a3321c3e517141; no voters: 
I20260709 13:22:17.921233 29262 raft_consensus.cc:2804] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:17.921581 29262 raft_consensus.cc:493] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:17.921927 29262 raft_consensus.cc:3060] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.922024 29239 raft_consensus.cc:515] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.924714 29239 leader_election.cc:290] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [CANDIDATE]: Term 1 election: Requested vote from peers 0de60efee4d74c9489e18666aca8e144 (127.16.188.129:40035), 404f6bc08f2e4b34b1a3321c3e517141 (127.16.188.130:35943)
I20260709 13:22:17.925922 29111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2" candidate_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "404f6bc08f2e4b34b1a3321c3e517141"
I20260709 13:22:17.926440 29186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2" candidate_uuid: "404f6bc08f2e4b34b1a3321c3e517141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" is_pre_election: true
I20260709 13:22:17.927238 29186 raft_consensus.cc:2393] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 404f6bc08f2e4b34b1a3321c3e517141 in current term 1: Already voted for candidate bbf3f102176c4b9e952aa5e1a8717ec2 in this term.
I20260709 13:22:17.929433 29036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2" candidate_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0de60efee4d74c9489e18666aca8e144"
I20260709 13:22:17.930241 29036 raft_consensus.cc:3060] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:17.936105 29262 raft_consensus.cc:515] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.937525 29111 raft_consensus.cc:2393] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bbf3f102176c4b9e952aa5e1a8717ec2 in current term 1: Already voted for candidate 404f6bc08f2e4b34b1a3321c3e517141 in this term.
I20260709 13:22:17.938274 29036 raft_consensus.cc:2468] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbf3f102176c4b9e952aa5e1a8717ec2 in term 1.
I20260709 13:22:17.939205 29035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2" candidate_uuid: "404f6bc08f2e4b34b1a3321c3e517141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0de60efee4d74c9489e18666aca8e144"
I20260709 13:22:17.939610 29148 leader_election.cc:304] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0de60efee4d74c9489e18666aca8e144, bbf3f102176c4b9e952aa5e1a8717ec2; no voters: 
I20260709 13:22:17.940104 29035 raft_consensus.cc:2393] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 404f6bc08f2e4b34b1a3321c3e517141 in current term 1: Already voted for candidate bbf3f102176c4b9e952aa5e1a8717ec2 in this term.
I20260709 13:22:17.940685 29239 raft_consensus.cc:2804] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:17.941411 29239 raft_consensus.cc:697] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 LEADER]: Becoming Leader. State: Replica: bbf3f102176c4b9e952aa5e1a8717ec2, State: Running, Role: LEADER
I20260709 13:22:17.942292 29239 consensus_queue.cc:237] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:17.942870 29262 leader_election.cc:290] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [CANDIDATE]: Term 1 election: Requested vote from peers 0de60efee4d74c9489e18666aca8e144 (127.16.188.129:40035), bbf3f102176c4b9e952aa5e1a8717ec2 (127.16.188.131:44257)
I20260709 13:22:17.943665 29186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2" candidate_uuid: "404f6bc08f2e4b34b1a3321c3e517141" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2"
I20260709 13:22:17.945648 29075 leader_election.cc:304] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 404f6bc08f2e4b34b1a3321c3e517141; no voters: 0de60efee4d74c9489e18666aca8e144, bbf3f102176c4b9e952aa5e1a8717ec2
I20260709 13:22:17.947182 29262 raft_consensus.cc:2749] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:22:17.951267 28931 catalog_manager.cc:5697] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bbf3f102176c4b9e952aa5e1a8717ec2 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:18.064173 29186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c8608a489c141e8a94c9297b51a2c6c"
dest_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2"
mode: GRACEFUL
new_leader_uuid: "404f6bc08f2e4b34b1a3321c3e517141"
 from {username='slave'} at 127.0.0.1:35570
I20260709 13:22:18.065176 29186 raft_consensus.cc:606] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 LEADER]: Received request to transfer leadership to TS 404f6bc08f2e4b34b1a3321c3e517141
I20260709 13:22:18.072605 29186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6ae078804fd4c16889e64f50b32c0bc"
dest_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2"
mode: GRACEFUL
new_leader_uuid: "0de60efee4d74c9489e18666aca8e144"
 from {username='slave'} at 127.0.0.1:35570
I20260709 13:22:18.073431 29186 raft_consensus.cc:606] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 LEADER]: Received request to transfer leadership to TS 0de60efee4d74c9489e18666aca8e144
I20260709 13:22:18.080457 29186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2"
dest_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2"
mode: GRACEFUL
new_leader_uuid: "0de60efee4d74c9489e18666aca8e144"
 from {username='slave'} at 127.0.0.1:35570
I20260709 13:22:18.081281 29186 raft_consensus.cc:606] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 LEADER]: Received request to transfer leadership to TS 0de60efee4d74c9489e18666aca8e144
I20260709 13:22:18.111943 29239 consensus_queue.cc:1048] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:18.135630 29239 consensus_queue.cc:1048] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:18.148557 29280 raft_consensus.cc:993] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2: : Instructing follower 0de60efee4d74c9489e18666aca8e144 to start an election
I20260709 13:22:18.149129 29280 raft_consensus.cc:1081] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 LEADER]: Signalling peer 0de60efee4d74c9489e18666aca8e144 to start an election
I20260709 13:22:18.151453 29036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6ae078804fd4c16889e64f50b32c0bc"
dest_uuid: "0de60efee4d74c9489e18666aca8e144"
 from {username='slave'} at 127.0.0.1:42830
I20260709 13:22:18.152189 29036 raft_consensus.cc:493] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:18.152659 29036 raft_consensus.cc:3060] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.161863 29036 raft_consensus.cc:515] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:18.164328 29036 leader_election.cc:290] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [CANDIDATE]: Term 2 election: Requested vote from peers 404f6bc08f2e4b34b1a3321c3e517141 (127.16.188.130:35943), bbf3f102176c4b9e952aa5e1a8717ec2 (127.16.188.131:44257)
I20260709 13:22:18.166009 29111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ae078804fd4c16889e64f50b32c0bc" candidate_uuid: "0de60efee4d74c9489e18666aca8e144" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "404f6bc08f2e4b34b1a3321c3e517141"
I20260709 13:22:18.166321 29186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6ae078804fd4c16889e64f50b32c0bc" candidate_uuid: "0de60efee4d74c9489e18666aca8e144" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2"
I20260709 13:22:18.166779 29111 raft_consensus.cc:3060] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.167148 29186 raft_consensus.cc:3055] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:18.167557 29186 raft_consensus.cc:740] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbf3f102176c4b9e952aa5e1a8717ec2, State: Running, Role: LEADER
I20260709 13:22:18.168444 29186 consensus_queue.cc:260] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:18.170019 29186 raft_consensus.cc:3060] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.181480 29186 raft_consensus.cc:2468] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0de60efee4d74c9489e18666aca8e144 in term 2.
I20260709 13:22:18.181480 29111 raft_consensus.cc:2468] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0de60efee4d74c9489e18666aca8e144 in term 2.
I20260709 13:22:18.183282 29000 leader_election.cc:304] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0de60efee4d74c9489e18666aca8e144, bbf3f102176c4b9e952aa5e1a8717ec2; no voters: 
I20260709 13:22:18.184818 29235 raft_consensus.cc:2804] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:18.185443 29235 raft_consensus.cc:697] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [term 2 LEADER]: Becoming Leader. State: Replica: 0de60efee4d74c9489e18666aca8e144, State: Running, Role: LEADER
I20260709 13:22:18.186338 29235 consensus_queue.cc:237] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:18.195389 28934 catalog_manager.cc:5697] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 reported cstate change: term changed from 1 to 2, leader changed from bbf3f102176c4b9e952aa5e1a8717ec2 (127.16.188.131) to 0de60efee4d74c9489e18666aca8e144 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "0de60efee4d74c9489e18666aca8e144" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:18.330514 29243 raft_consensus.cc:993] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2: : Instructing follower 404f6bc08f2e4b34b1a3321c3e517141 to start an election
I20260709 13:22:18.331068 29239 raft_consensus.cc:1081] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 LEADER]: Signalling peer 404f6bc08f2e4b34b1a3321c3e517141 to start an election
I20260709 13:22:18.332875 29111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c8608a489c141e8a94c9297b51a2c6c"
dest_uuid: "404f6bc08f2e4b34b1a3321c3e517141"
 from {username='slave'} at 127.0.0.1:60712
I20260709 13:22:18.333523 29111 raft_consensus.cc:493] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:18.333926 29111 raft_consensus.cc:3060] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.340581 29111 raft_consensus.cc:515] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:18.343523 29111 leader_election.cc:290] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [CANDIDATE]: Term 2 election: Requested vote from peers 0de60efee4d74c9489e18666aca8e144 (127.16.188.129:40035), bbf3f102176c4b9e952aa5e1a8717ec2 (127.16.188.131:44257)
I20260709 13:22:18.343721 29036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8608a489c141e8a94c9297b51a2c6c" candidate_uuid: "404f6bc08f2e4b34b1a3321c3e517141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0de60efee4d74c9489e18666aca8e144"
I20260709 13:22:18.344584 29036 raft_consensus.cc:3060] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.345867 29186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8608a489c141e8a94c9297b51a2c6c" candidate_uuid: "404f6bc08f2e4b34b1a3321c3e517141" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2"
I20260709 13:22:18.346580 29186 raft_consensus.cc:3055] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:18.346913 29186 raft_consensus.cc:740] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbf3f102176c4b9e952aa5e1a8717ec2, State: Running, Role: LEADER
I20260709 13:22:18.347779 29186 consensus_queue.cc:260] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:18.349200 29186 raft_consensus.cc:3060] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.354629 29036 raft_consensus.cc:2468] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 404f6bc08f2e4b34b1a3321c3e517141 in term 2.
I20260709 13:22:18.356127 29074 leader_election.cc:304] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0de60efee4d74c9489e18666aca8e144, 404f6bc08f2e4b34b1a3321c3e517141; no voters: 
I20260709 13:22:18.356699 29186 raft_consensus.cc:2468] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 404f6bc08f2e4b34b1a3321c3e517141 in term 2.
I20260709 13:22:18.357178 29262 raft_consensus.cc:2804] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:18.359148 29262 raft_consensus.cc:697] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [term 2 LEADER]: Becoming Leader. State: Replica: 404f6bc08f2e4b34b1a3321c3e517141, State: Running, Role: LEADER
I20260709 13:22:18.360118 29262 consensus_queue.cc:237] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:18.368038 28931 catalog_manager.cc:5697] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 reported cstate change: term changed from 1 to 2, leader changed from bbf3f102176c4b9e952aa5e1a8717ec2 (127.16.188.131) to 404f6bc08f2e4b34b1a3321c3e517141 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "404f6bc08f2e4b34b1a3321c3e517141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:18.383496 29239 consensus_queue.cc:1048] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:18.395763 29243 consensus_queue.cc:1048] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:18.406268 29243 raft_consensus.cc:993] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2: : Instructing follower 0de60efee4d74c9489e18666aca8e144 to start an election
I20260709 13:22:18.406801 29243 raft_consensus.cc:1081] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 LEADER]: Signalling peer 0de60efee4d74c9489e18666aca8e144 to start an election
I20260709 13:22:18.408807 29036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2"
dest_uuid: "0de60efee4d74c9489e18666aca8e144"
 from {username='slave'} at 127.0.0.1:42830
I20260709 13:22:18.409528 29036 raft_consensus.cc:493] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:18.409986 29036 raft_consensus.cc:3060] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.416953 29036 raft_consensus.cc:515] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:18.420573 29111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2" candidate_uuid: "0de60efee4d74c9489e18666aca8e144" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "404f6bc08f2e4b34b1a3321c3e517141"
I20260709 13:22:18.427842 29111 raft_consensus.cc:3060] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.426764 29036 leader_election.cc:290] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [CANDIDATE]: Term 2 election: Requested vote from peers 404f6bc08f2e4b34b1a3321c3e517141 (127.16.188.130:35943), bbf3f102176c4b9e952aa5e1a8717ec2 (127.16.188.131:44257)
I20260709 13:22:18.428202 29186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2" candidate_uuid: "0de60efee4d74c9489e18666aca8e144" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2"
I20260709 13:22:18.428988 29186 raft_consensus.cc:3055] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:18.429754 29186 raft_consensus.cc:740] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbf3f102176c4b9e952aa5e1a8717ec2, State: Running, Role: LEADER
I20260709 13:22:18.430891 29186 consensus_queue.cc:260] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:18.432389 29186 raft_consensus.cc:3060] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.440591 29186 raft_consensus.cc:2468] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0de60efee4d74c9489e18666aca8e144 in term 2.
I20260709 13:22:18.441447 29111 raft_consensus.cc:2468] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0de60efee4d74c9489e18666aca8e144 in term 2.
I20260709 13:22:18.442109 29000 leader_election.cc:304] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0de60efee4d74c9489e18666aca8e144, bbf3f102176c4b9e952aa5e1a8717ec2; no voters: 
I20260709 13:22:18.443105 29248 raft_consensus.cc:2804] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:18.443583 29248 raft_consensus.cc:697] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 2 LEADER]: Becoming Leader. State: Replica: 0de60efee4d74c9489e18666aca8e144, State: Running, Role: LEADER
I20260709 13:22:18.444499 29248 consensus_queue.cc:237] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:18.452502 28931 catalog_manager.cc:5697] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 reported cstate change: term changed from 1 to 2, leader changed from bbf3f102176c4b9e952aa5e1a8717ec2 (127.16.188.131) to 0de60efee4d74c9489e18666aca8e144 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "0de60efee4d74c9489e18666aca8e144" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:18.607191 17138 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:22:18.609289 17138 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:22:18.609871 17138 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:22:18.625572 29036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2"
dest_uuid: "0de60efee4d74c9489e18666aca8e144"
mode: GRACEFUL
new_leader_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2"
 from {username='slave'} at 127.0.0.1:42854
I20260709 13:22:18.626366 29036 raft_consensus.cc:606] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 2 LEADER]: Received request to transfer leadership to TS bbf3f102176c4b9e952aa5e1a8717ec2
I20260709 13:22:18.628228 17138 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:22:18.724486 29186 raft_consensus.cc:1275] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 2 FOLLOWER]: Refusing update from remote peer 0de60efee4d74c9489e18666aca8e144: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.726070 29248 consensus_queue.cc:1048] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:18.738186 29111 raft_consensus.cc:1275] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141 [term 2 FOLLOWER]: Refusing update from remote peer 0de60efee4d74c9489e18666aca8e144: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.739940 29235 consensus_queue.cc:1048] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [LEADER]: Connected to new peer: Peer: permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:18.789795 29036 raft_consensus.cc:1275] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144 [term 2 FOLLOWER]: Refusing update from remote peer 404f6bc08f2e4b34b1a3321c3e517141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.791422 29262 consensus_queue.cc:1048] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.803222 29186 raft_consensus.cc:1275] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 2 FOLLOWER]: Refusing update from remote peer 404f6bc08f2e4b34b1a3321c3e517141: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.808832 29284 consensus_queue.cc:1048] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.856865 29111 raft_consensus.cc:1275] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 2 FOLLOWER]: Refusing update from remote peer 0de60efee4d74c9489e18666aca8e144: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.858448 29235 consensus_queue.cc:1048] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [LEADER]: Connected to new peer: Peer: permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.872982 29186 raft_consensus.cc:1275] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 2 FOLLOWER]: Refusing update from remote peer 0de60efee4d74c9489e18666aca8e144: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:18.874853 29248 consensus_queue.cc:1048] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.882550 29248 raft_consensus.cc:993] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144: : Instructing follower bbf3f102176c4b9e952aa5e1a8717ec2 to start an election
I20260709 13:22:18.883028 29248 raft_consensus.cc:1081] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 2 LEADER]: Signalling peer bbf3f102176c4b9e952aa5e1a8717ec2 to start an election
I20260709 13:22:18.885046 29186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2"
dest_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2"
 from {username='slave'} at 127.0.0.1:35550
I20260709 13:22:18.885870 29186 raft_consensus.cc:493] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:18.886385 29186 raft_consensus.cc:3060] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:18.893214 29186 raft_consensus.cc:515] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:18.896423 29036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2" candidate_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0de60efee4d74c9489e18666aca8e144"
I20260709 13:22:18.896678 29111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3a106683a14c1590fffb3aea0c0ff2" candidate_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "404f6bc08f2e4b34b1a3321c3e517141"
I20260709 13:22:18.897236 29036 raft_consensus.cc:3055] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:18.897382 29111 raft_consensus.cc:3060] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:18.897689 29036 raft_consensus.cc:740] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0de60efee4d74c9489e18666aca8e144, State: Running, Role: LEADER
I20260709 13:22:18.898816 29036 consensus_queue.cc:260] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:18.900115 29036 raft_consensus.cc:3060] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:18.901407 29186 leader_election.cc:290] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [CANDIDATE]: Term 3 election: Requested vote from peers 0de60efee4d74c9489e18666aca8e144 (127.16.188.129:40035), 404f6bc08f2e4b34b1a3321c3e517141 (127.16.188.130:35943)
I20260709 13:22:18.907087 29111 raft_consensus.cc:2468] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbf3f102176c4b9e952aa5e1a8717ec2 in term 3.
I20260709 13:22:18.910286 29149 leader_election.cc:304] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 404f6bc08f2e4b34b1a3321c3e517141, bbf3f102176c4b9e952aa5e1a8717ec2; no voters: 
I20260709 13:22:18.911391 29280 raft_consensus.cc:2804] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:18.911247 29036 raft_consensus.cc:2468] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbf3f102176c4b9e952aa5e1a8717ec2 in term 3.
I20260709 13:22:18.913884 29280 raft_consensus.cc:697] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 3 LEADER]: Becoming Leader. State: Replica: bbf3f102176c4b9e952aa5e1a8717ec2, State: Running, Role: LEADER
I20260709 13:22:18.915182 29280 consensus_queue.cc:237] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } }
I20260709 13:22:18.923231 28933 catalog_manager.cc:5697] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 reported cstate change: term changed from 2 to 3, leader changed from 0de60efee4d74c9489e18666aca8e144 (127.16.188.129) to bbf3f102176c4b9e952aa5e1a8717ec2 (127.16.188.131). New cstate: current_term: 3 leader_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0de60efee4d74c9489e18666aca8e144" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "404f6bc08f2e4b34b1a3321c3e517141" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 35943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbf3f102176c4b9e952aa5e1a8717ec2" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44257 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:19.004787 17138 tablet_server.cc:179] TabletServer@127.16.188.129:0 shutting down...
I20260709 13:22:19.056536 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:19.057597 17138 tablet_replica.cc:333] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144: stopping tablet replica
I20260709 13:22:19.058516 17138 raft_consensus.cc:2243] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.059195 17138 raft_consensus.cc:2272] T 5b3a106683a14c1590fffb3aea0c0ff2 P 0de60efee4d74c9489e18666aca8e144 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.062704 17138 tablet_replica.cc:333] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144: stopping tablet replica
I20260709 13:22:19.063519 17138 raft_consensus.cc:2243] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.064751 17138 raft_consensus.cc:2272] T c6ae078804fd4c16889e64f50b32c0bc P 0de60efee4d74c9489e18666aca8e144 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.068029 17138 tablet_replica.cc:333] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144: stopping tablet replica
I20260709 13:22:19.068907 17138 raft_consensus.cc:2243] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.069499 17138 raft_consensus.cc:2272] T 4c8608a489c141e8a94c9297b51a2c6c P 0de60efee4d74c9489e18666aca8e144 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.072810 17138 tablet_replica.cc:333] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144: stopping tablet replica
I20260709 13:22:19.073585 17138 raft_consensus.cc:2243] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.074838 17138 raft_consensus.cc:2272] T 0c1e38ad283e4f04827b138cee16484a P 0de60efee4d74c9489e18666aca8e144 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.107278 17138 tablet_server.cc:196] TabletServer@127.16.188.129:0 shutdown complete.
I20260709 13:22:19.124711 17138 tablet_server.cc:179] TabletServer@127.16.188.130:0 shutting down...
I20260709 13:22:19.166602 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:19.167524 17138 tablet_replica.cc:333] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141: stopping tablet replica
I20260709 13:22:19.168226 17138 raft_consensus.cc:2243] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.168807 17138 raft_consensus.cc:2272] T 5b3a106683a14c1590fffb3aea0c0ff2 P 404f6bc08f2e4b34b1a3321c3e517141 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.171571 17138 tablet_replica.cc:333] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141: stopping tablet replica
I20260709 13:22:19.172147 17138 raft_consensus.cc:2243] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.172683 17138 raft_consensus.cc:2272] T c6ae078804fd4c16889e64f50b32c0bc P 404f6bc08f2e4b34b1a3321c3e517141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.175721 17138 tablet_replica.cc:333] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141: stopping tablet replica
I20260709 13:22:19.176277 17138 raft_consensus.cc:2243] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.177309 17138 raft_consensus.cc:2272] T 4c8608a489c141e8a94c9297b51a2c6c P 404f6bc08f2e4b34b1a3321c3e517141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.179770 17138 tablet_replica.cc:333] T 0c1e38ad283e4f04827b138cee16484a P 404f6bc08f2e4b34b1a3321c3e517141: stopping tablet replica
I20260709 13:22:19.180282 17138 raft_consensus.cc:2243] T 0c1e38ad283e4f04827b138cee16484a P 404f6bc08f2e4b34b1a3321c3e517141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.180749 17138 raft_consensus.cc:2272] T 0c1e38ad283e4f04827b138cee16484a P 404f6bc08f2e4b34b1a3321c3e517141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.206784 17138 tablet_server.cc:196] TabletServer@127.16.188.130:0 shutdown complete.
I20260709 13:22:19.225481 17138 tablet_server.cc:179] TabletServer@127.16.188.131:0 shutting down...
I20260709 13:22:19.271009 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:19.271879 17138 tablet_replica.cc:333] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2: stopping tablet replica
I20260709 13:22:19.272583 17138 raft_consensus.cc:2243] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.273283 17138 pending_rounds.cc:70] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2: Trying to abort 1 pending ops.
I20260709 13:22:19.273483 17138 pending_rounds.cc:77] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305639276207087616 op_type: NO_OP noop_request { }
I20260709 13:22:19.273802 17138 raft_consensus.cc:2889] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:22:19.274099 17138 raft_consensus.cc:2272] T 5b3a106683a14c1590fffb3aea0c0ff2 P bbf3f102176c4b9e952aa5e1a8717ec2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.276350 17138 tablet_replica.cc:333] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2: stopping tablet replica
I20260709 13:22:19.276933 17138 raft_consensus.cc:2243] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.277369 17138 raft_consensus.cc:2272] T c6ae078804fd4c16889e64f50b32c0bc P bbf3f102176c4b9e952aa5e1a8717ec2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.279419 17138 tablet_replica.cc:333] T 0c1e38ad283e4f04827b138cee16484a P bbf3f102176c4b9e952aa5e1a8717ec2: stopping tablet replica
I20260709 13:22:19.279958 17138 raft_consensus.cc:2243] T 0c1e38ad283e4f04827b138cee16484a P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.280360 17138 raft_consensus.cc:2272] T 0c1e38ad283e4f04827b138cee16484a P bbf3f102176c4b9e952aa5e1a8717ec2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.282083 17138 tablet_replica.cc:333] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2: stopping tablet replica
I20260709 13:22:19.282537 17138 raft_consensus.cc:2243] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:19.282927 17138 raft_consensus.cc:2272] T 4c8608a489c141e8a94c9297b51a2c6c P bbf3f102176c4b9e952aa5e1a8717ec2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.298326 17138 tablet_server.cc:196] TabletServer@127.16.188.131:0 shutdown complete.
I20260709 13:22:19.318990 17138 master.cc:562] Master@127.16.188.190:34829 shutting down...
I20260709 13:22:19.359158 17138 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:19.360134 17138 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:19.360710 17138 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2c8a072abc664c0f81fe3260f55e2a8d: stopping tablet replica
W20260709 13:22:20.371810 17138 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 28965)
I20260709 13:22:20.997572 17138 master.cc:584] Master@127.16.188.190:34829 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (5183 ms)
[----------] 6 tests from LeaderRebalancerTest (356037 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:22:21.040890 17138 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.188.190:46177
I20260709 13:22:21.041965 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:21.047607 29293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:21.047844 29294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:21.050007 29296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:21.050410 17138 server_base.cc:1061] running on GCE node
I20260709 13:22:21.051462 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:21.051704 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:21.051867 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603341051849 us; error 0 us; skew 500 ppm
I20260709 13:22:21.052402 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:21.055073 17138 webserver.cc:533] Webserver started at http://127.16.188.190:38641/ using document root <none> and password file <none>
I20260709 13:22:21.055583 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:21.055780 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:21.056061 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:21.057322 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/master-0-root/instance:
uuid: "d4f65238d610429b851aa9f74040dc9b"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-2hqk"
I20260709 13:22:21.061975 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:22:21.065428 29301 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.066254 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:22:21.066586 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/master-0-root
uuid: "d4f65238d610429b851aa9f74040dc9b"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-2hqk"
I20260709 13:22:21.066876 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:21.088022 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:21.089224 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:21.130872 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.190:46177
I20260709 13:22:21.131036 29352 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.190:46177 every 8 connection(s)
I20260709 13:22:21.134997 29353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.146943 29353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b: Bootstrap starting.
I20260709 13:22:21.152590 29353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.157519 29353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b: No bootstrap required, opened a new log
I20260709 13:22:21.159935 29353 raft_consensus.cc:359] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f65238d610429b851aa9f74040dc9b" member_type: VOTER }
I20260709 13:22:21.160346 29353 raft_consensus.cc:385] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.160620 29353 raft_consensus.cc:740] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4f65238d610429b851aa9f74040dc9b, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.161238 29353 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f65238d610429b851aa9f74040dc9b" member_type: VOTER }
I20260709 13:22:21.161705 29353 raft_consensus.cc:399] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:21.161947 29353 raft_consensus.cc:493] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:21.162221 29353 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.167850 29353 raft_consensus.cc:515] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f65238d610429b851aa9f74040dc9b" member_type: VOTER }
I20260709 13:22:21.168411 29353 leader_election.cc:304] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4f65238d610429b851aa9f74040dc9b; no voters: 
I20260709 13:22:21.169729 29353 leader_election.cc:290] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:21.170145 29356 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:21.171669 29356 raft_consensus.cc:697] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [term 1 LEADER]: Becoming Leader. State: Replica: d4f65238d610429b851aa9f74040dc9b, State: Running, Role: LEADER
I20260709 13:22:21.172384 29356 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f65238d610429b851aa9f74040dc9b" member_type: VOTER }
I20260709 13:22:21.172936 29353 sys_catalog.cc:565] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:21.177105 29358 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4f65238d610429b851aa9f74040dc9b. Latest consensus state: current_term: 1 leader_uuid: "d4f65238d610429b851aa9f74040dc9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f65238d610429b851aa9f74040dc9b" member_type: VOTER } }
I20260709 13:22:21.177757 29358 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:21.177815 29357 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4f65238d610429b851aa9f74040dc9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f65238d610429b851aa9f74040dc9b" member_type: VOTER } }
I20260709 13:22:21.178371 29357 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:21.186203 29362 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:21.191023 29362 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:21.198643 17138 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:21.201339 29362 catalog_manager.cc:1383] Generated new cluster ID: 062a67b9b4fb4c6e94e519ee469cbe2a
I20260709 13:22:21.201630 29362 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:21.217653 29362 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:21.218904 29362 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:21.237126 29362 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b: Generated new TSK 0
I20260709 13:22:21.237718 29362 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:21.266623 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:21.273209 29374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:21.274309 29375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:21.275810 29377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:21.276609 17138 server_base.cc:1061] running on GCE node
I20260709 13:22:21.277477 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:21.277662 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:21.277786 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603341277775 us; error 0 us; skew 500 ppm
I20260709 13:22:21.278268 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:21.280612 17138 webserver.cc:533] Webserver started at http://127.16.188.129:42433/ using document root <none> and password file <none>
I20260709 13:22:21.281054 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:21.281210 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:21.281419 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:21.282464 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/ts-0-root/instance:
uuid: "d2959aed377e426c8b0c8813f9325882"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-2hqk"
I20260709 13:22:21.286872 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:21.290534 29382 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.291411 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:21.291677 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/ts-0-root
uuid: "d2959aed377e426c8b0c8813f9325882"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-2hqk"
I20260709 13:22:21.292076 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:21.305696 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:21.306821 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:21.308310 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:21.310599 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:21.310817 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.311065 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:21.311255 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.354657 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.129:40337
I20260709 13:22:21.354826 29444 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.129:40337 every 8 connection(s)
I20260709 13:22:21.359923 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:21.367283 29449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:21.368553 29450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:21.371671 17138 server_base.cc:1061] running on GCE node
W20260709 13:22:21.372509 29453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:21.373502 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:21.373735 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:21.373924 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603341373906 us; error 0 us; skew 500 ppm
I20260709 13:22:21.374501 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:21.377032 17138 webserver.cc:533] Webserver started at http://127.16.188.130:33191/ using document root <none> and password file <none>
I20260709 13:22:21.377674 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:21.377970 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:21.378330 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:21.379791 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/ts-1-root/instance:
uuid: "054e8d248d304857abe43ff0932e80a9"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-2hqk"
I20260709 13:22:21.380502 29445 heartbeater.cc:344] Connected to a master server at 127.16.188.190:46177
I20260709 13:22:21.381011 29445 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:21.381801 29445 heartbeater.cc:507] Master 127.16.188.190:46177 requested a full tablet report, sending...
I20260709 13:22:21.384001 29318 ts_manager.cc:194] Registered new tserver with Master: d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337)
I20260709 13:22:21.384954 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:22:21.386051 29318 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40654
I20260709 13:22:21.389057 29457 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.389889 17138 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:22:21.390237 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/ts-1-root
uuid: "054e8d248d304857abe43ff0932e80a9"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-2hqk"
I20260709 13:22:21.390519 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:21.404739 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:21.405762 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:21.407230 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:21.409511 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:21.409729 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.409976 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:21.410159 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.451205 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.130:43759
I20260709 13:22:21.451349 29519 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.130:43759 every 8 connection(s)
I20260709 13:22:21.456249 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:21.464275 29523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:21.465934 29524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:21.469949 17138 server_base.cc:1061] running on GCE node
I20260709 13:22:21.471086 29520 heartbeater.cc:344] Connected to a master server at 127.16.188.190:46177
I20260709 13:22:21.471511 29520 heartbeater.cc:461] Registering TS with master...
W20260709 13:22:21.471858 29526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:21.472555 29520 heartbeater.cc:507] Master 127.16.188.190:46177 requested a full tablet report, sending...
I20260709 13:22:21.473117 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:21.473481 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:21.473690 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603341473660 us; error 0 us; skew 500 ppm
I20260709 13:22:21.474537 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:21.474877 29318 ts_manager.cc:194] Registered new tserver with Master: 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:21.476588 29318 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40670
I20260709 13:22:21.477537 17138 webserver.cc:533] Webserver started at http://127.16.188.131:33479/ using document root <none> and password file <none>
I20260709 13:22:21.478225 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:21.478438 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:21.478739 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:21.480477 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/ts-2-root/instance:
uuid: "da72947b063c44aab667947ea511f20e"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-2hqk"
I20260709 13:22:21.485308 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:22:21.488850 29531 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.489831 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:22:21.490111 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/ts-2-root
uuid: "da72947b063c44aab667947ea511f20e"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-2hqk"
I20260709 13:22:21.490378 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602984839783-17138-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:21.531316 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:21.532359 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:21.533963 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:21.536300 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:21.536480 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.536804 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:21.536949 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.588456 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.131:39371
I20260709 13:22:21.588557 29593 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.131:39371 every 8 connection(s)
I20260709 13:22:21.606231 29594 heartbeater.cc:344] Connected to a master server at 127.16.188.190:46177
I20260709 13:22:21.606828 29594 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:21.607755 29594 heartbeater.cc:507] Master 127.16.188.190:46177 requested a full tablet report, sending...
I20260709 13:22:21.609985 29318 ts_manager.cc:194] Registered new tserver with Master: da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:21.610189 17138 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017585043s
I20260709 13:22:21.611621 29318 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40678
I20260709 13:22:21.639810 29318 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40692:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:21.642766 29318 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:21.724390 29485 tablet_service.cc:1511] Processing CreateTablet for tablet c0c7581b429a4f698bf7f8f81c3f79cf (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:21.727025 29485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c7581b429a4f698bf7f8f81c3f79cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.728499 29484 tablet_service.cc:1511] Processing CreateTablet for tablet 8098e9a2d109459cab32b498ae7a8b8d (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:21.730079 29484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8098e9a2d109459cab32b498ae7a8b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.736032 29483 tablet_service.cc:1511] Processing CreateTablet for tablet 0d13221006ac4ca1b5b47dc6f8a13276 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:21.761351 29483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d13221006ac4ca1b5b47dc6f8a13276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.741393 29410 tablet_service.cc:1511] Processing CreateTablet for tablet c0c7581b429a4f698bf7f8f81c3f79cf (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:21.765264 29410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c7581b429a4f698bf7f8f81c3f79cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.746038 29407 tablet_service.cc:1511] Processing CreateTablet for tablet c09cf65638344fc89ed3c6a445886ab4 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:21.769539 29407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c09cf65638344fc89ed3c6a445886ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.769586 29402 tablet_service.cc:1511] Processing CreateTablet for tablet 3b64947627d54c43ba226d91efb0ca75 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:21.771667 29402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b64947627d54c43ba226d91efb0ca75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.748374 29406 tablet_service.cc:1511] Processing CreateTablet for tablet daf394c61ea549acbb187857f205babd (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:21.773471 29406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf394c61ea549acbb187857f205babd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.752097 29482 tablet_service.cc:1511] Processing CreateTablet for tablet c09cf65638344fc89ed3c6a445886ab4 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:21.776877 29482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c09cf65638344fc89ed3c6a445886ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.753739 29481 tablet_service.cc:1511] Processing CreateTablet for tablet daf394c61ea549acbb187857f205babd (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:21.755126 29480 tablet_service.cc:1511] Processing CreateTablet for tablet 3026876f8e49428883ab8e897efdd2b1 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:21.781483 29481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf394c61ea549acbb187857f205babd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.782956 29480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3026876f8e49428883ab8e897efdd2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.783447 29479 tablet_service.cc:1511] Processing CreateTablet for tablet 9feb6b9b5ae14bb492a4df2c788cdbb7 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:21.785991 29478 tablet_service.cc:1511] Processing CreateTablet for tablet 49f1115f7b8a4576b43f65ff2b245ac7 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:21.756772 29405 tablet_service.cc:1511] Processing CreateTablet for tablet 3026876f8e49428883ab8e897efdd2b1 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:21.757910 29403 tablet_service.cc:1511] Processing CreateTablet for tablet 49f1115f7b8a4576b43f65ff2b245ac7 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:21.759625 29404 tablet_service.cc:1511] Processing CreateTablet for tablet 9feb6b9b5ae14bb492a4df2c788cdbb7 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:21.743767 29408 tablet_service.cc:1511] Processing CreateTablet for tablet 0d13221006ac4ca1b5b47dc6f8a13276 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:21.738898 29409 tablet_service.cc:1511] Processing CreateTablet for tablet 8098e9a2d109459cab32b498ae7a8b8d (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:21.792982 29477 tablet_service.cc:1511] Processing CreateTablet for tablet 3b64947627d54c43ba226d91efb0ca75 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:21.795071 29403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f1115f7b8a4576b43f65ff2b245ac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.799644 29408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d13221006ac4ca1b5b47dc6f8a13276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.805161 29404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9feb6b9b5ae14bb492a4df2c788cdbb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.810866 29559 tablet_service.cc:1511] Processing CreateTablet for tablet c0c7581b429a4f698bf7f8f81c3f79cf (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:21.812942 29559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c7581b429a4f698bf7f8f81c3f79cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.817018 29405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3026876f8e49428883ab8e897efdd2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.818317 29558 tablet_service.cc:1511] Processing CreateTablet for tablet 8098e9a2d109459cab32b498ae7a8b8d (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:21.819891 29558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8098e9a2d109459cab32b498ae7a8b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.825244 29551 tablet_service.cc:1511] Processing CreateTablet for tablet 3b64947627d54c43ba226d91efb0ca75 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:21.825949 29557 tablet_service.cc:1511] Processing CreateTablet for tablet 0d13221006ac4ca1b5b47dc6f8a13276 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:21.826052 29556 tablet_service.cc:1511] Processing CreateTablet for tablet c09cf65638344fc89ed3c6a445886ab4 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:21.826748 29551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b64947627d54c43ba226d91efb0ca75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.827603 29557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d13221006ac4ca1b5b47dc6f8a13276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.828167 29409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8098e9a2d109459cab32b498ae7a8b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.829319 29553 tablet_service.cc:1511] Processing CreateTablet for tablet 9feb6b9b5ae14bb492a4df2c788cdbb7 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:21.828161 29552 tablet_service.cc:1511] Processing CreateTablet for tablet 49f1115f7b8a4576b43f65ff2b245ac7 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:21.830468 29556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c09cf65638344fc89ed3c6a445886ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.831401 29552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f1115f7b8a4576b43f65ff2b245ac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.831645 29554 tablet_service.cc:1511] Processing CreateTablet for tablet 3026876f8e49428883ab8e897efdd2b1 (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:21.832986 29554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3026876f8e49428883ab8e897efdd2b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.835629 29479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9feb6b9b5ae14bb492a4df2c788cdbb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.835871 29555 tablet_service.cc:1511] Processing CreateTablet for tablet daf394c61ea549acbb187857f205babd (DEFAULT_TABLE table=test-workload [id=10fbf01b522b46949865769b8525178e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:21.837216 29555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf394c61ea549acbb187857f205babd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.840049 29553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9feb6b9b5ae14bb492a4df2c788cdbb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.848730 29478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49f1115f7b8a4576b43f65ff2b245ac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.856731 29477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b64947627d54c43ba226d91efb0ca75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.885988 29610 tablet_bootstrap.cc:492] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:21.894807 29609 tablet_bootstrap.cc:492] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:21.932850 29611 tablet_bootstrap.cc:492] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:21.941936 29610 tablet_bootstrap.cc:654] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.962771 29609 tablet_bootstrap.cc:654] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.964360 29611 tablet_bootstrap.cc:654] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.992929 29609 tablet_bootstrap.cc:492] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:21.993649 29609 ts_tablet_manager.cc:1403] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.004s
I20260709 13:22:21.993990 29610 tablet_bootstrap.cc:492] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:21.994828 29610 ts_tablet_manager.cc:1403] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.113s	user 0.011s	sys 0.018s
I20260709 13:22:21.995332 29611 tablet_bootstrap.cc:492] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:21.995967 29611 ts_tablet_manager.cc:1403] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.064s	user 0.026s	sys 0.004s
I20260709 13:22:21.996618 29609 raft_consensus.cc:359] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } } peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } }
I20260709 13:22:21.997399 29609 raft_consensus.cc:385] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.997699 29609 raft_consensus.cc:740] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.998456 29609 consensus_queue.cc:260] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } } peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } }
I20260709 13:22:21.998548 29610 raft_consensus.cc:359] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:21.999351 29610 raft_consensus.cc:385] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.999130 29611 raft_consensus.cc:359] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:21.999771 29610 raft_consensus.cc:740] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.000268 29611 raft_consensus.cc:385] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.000738 29611 raft_consensus.cc:740] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.001121 29520 heartbeater.cc:499] Master 127.16.188.190:46177 was elected leader, sending a full tablet report...
I20260709 13:22:22.001700 29609 ts_tablet_manager.cc:1434] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:22:22.001077 29610 consensus_queue.cc:260] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.001940 29611 consensus_queue.cc:260] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.003005 29609 tablet_bootstrap.cc:492] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:22.010726 29609 tablet_bootstrap.cc:654] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.012161 29611 ts_tablet_manager.cc:1434] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:22:22.013022 29594 heartbeater.cc:499] Master 127.16.188.190:46177 was elected leader, sending a full tablet report...
I20260709 13:22:22.014609 29445 heartbeater.cc:499] Master 127.16.188.190:46177 was elected leader, sending a full tablet report...
I20260709 13:22:22.014762 29610 ts_tablet_manager.cc:1434] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.011s
I20260709 13:22:22.016278 29610 tablet_bootstrap.cc:492] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:22.022820 29611 tablet_bootstrap.cc:492] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:22.025040 29610 tablet_bootstrap.cc:654] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.029103 29609 tablet_bootstrap.cc:492] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:22.029866 29609 ts_tablet_manager.cc:1403] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.000s
I20260709 13:22:22.033900 29609 raft_consensus.cc:359] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.034982 29609 raft_consensus.cc:385] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.035427 29609 raft_consensus.cc:740] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.036635 29609 consensus_queue.cc:260] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.037485 29611 tablet_bootstrap.cc:654] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.040005 29609 ts_tablet_manager.cc:1434] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:22:22.043213 29609 tablet_bootstrap.cc:492] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:22.047643 29610 tablet_bootstrap.cc:492] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:22.048364 29610 ts_tablet_manager.cc:1403] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.013s
I20260709 13:22:22.051685 29611 tablet_bootstrap.cc:492] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:22.051455 29610 raft_consensus.cc:359] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.052453 29610 raft_consensus.cc:385] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.052654 29611 ts_tablet_manager.cc:1403] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.003s
I20260709 13:22:22.052924 29609 tablet_bootstrap.cc:654] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.052901 29610 raft_consensus.cc:740] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.054522 29610 consensus_queue.cc:260] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.057035 29610 ts_tablet_manager.cc:1434] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:22.058022 29610 tablet_bootstrap.cc:492] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:22.057296 29611 raft_consensus.cc:359] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.058696 29611 raft_consensus.cc:385] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.059295 29611 raft_consensus.cc:740] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.060878 29611 consensus_queue.cc:260] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.064862 29610 tablet_bootstrap.cc:654] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.065217 29611 ts_tablet_manager.cc:1434] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:22:22.066932 29611 tablet_bootstrap.cc:492] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:22.072237 29609 tablet_bootstrap.cc:492] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:22.073112 29609 ts_tablet_manager.cc:1403] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.030s	user 0.024s	sys 0.004s
I20260709 13:22:22.076702 29611 tablet_bootstrap.cc:654] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.079101 29609 raft_consensus.cc:359] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.080199 29609 raft_consensus.cc:385] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.080734 29609 raft_consensus.cc:740] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.082165 29609 consensus_queue.cc:260] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.087914 29616 raft_consensus.cc:493] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.088500 29616 raft_consensus.cc:515] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.090164 29611 tablet_bootstrap.cc:492] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:22.090888 29611 ts_tablet_manager.cc:1403] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 13:22:22.092682 29615 raft_consensus.cc:493] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.093252 29616 leader_election.cc:290] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:22.093380 29615 raft_consensus.cc:515] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.096377 29609 ts_tablet_manager.cc:1434] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 13:22:22.101085 29609 tablet_bootstrap.cc:492] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:22.103554 29615 leader_election.cc:290] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:22.110522 29609 tablet_bootstrap.cc:654] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.110363 29611 raft_consensus.cc:359] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.119778 29611 raft_consensus.cc:385] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.120500 29611 raft_consensus.cc:740] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.123804 29611 consensus_queue.cc:260] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.125427 29609 tablet_bootstrap.cc:492] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:22.110471 29610 tablet_bootstrap.cc:492] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:22.126600 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b64947627d54c43ba226d91efb0ca75" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:22.127085 29609 ts_tablet_manager.cc:1403] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.011s
I20260709 13:22:22.127125 29610 ts_tablet_manager.cc:1403] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.014s
W20260709 13:22:22.129139 29458 leader_election.cc:343] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.131881 29609 raft_consensus.cc:359] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.132866 29609 raft_consensus.cc:385] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.133359 29617 raft_consensus.cc:493] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.133252 29609 raft_consensus.cc:740] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.133890 29617 raft_consensus.cc:515] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.137907 29617 leader_election.cc:290] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:22.138895 29609 consensus_queue.cc:260] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.141278 29609 ts_tablet_manager.cc:1434] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 13:22:22.142427 29609 tablet_bootstrap.cc:492] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:22.148002 29495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09cf65638344fc89ed3c6a445886ab4" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
W20260709 13:22:22.149849 29385 leader_election.cc:343] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.149607 29610 raft_consensus.cc:359] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } } peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } }
I20260709 13:22:22.150267 29609 tablet_bootstrap.cc:654] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.150445 29610 raft_consensus.cc:385] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.150765 29610 raft_consensus.cc:740] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.151525 29610 consensus_queue.cc:260] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } } peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } }
I20260709 13:22:22.153976 29610 ts_tablet_manager.cc:1434] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:22:22.167624 29611 ts_tablet_manager.cc:1434] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.076s	user 0.011s	sys 0.000s
I20260709 13:22:22.169693 29610 tablet_bootstrap.cc:492] T 3b64947627d54c43ba226d91efb0ca75 P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:22.177621 29569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09cf65638344fc89ed3c6a445886ab4" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:22.178566 29569 raft_consensus.cc:2468] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 0.
I20260709 13:22:22.178776 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b64947627d54c43ba226d91efb0ca75" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:22.179864 29615 raft_consensus.cc:493] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.180505 29385 leader_election.cc:304] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e; no voters: 054e8d248d304857abe43ff0932e80a9
W20260709 13:22:22.181146 29460 leader_election.cc:343] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da72947b063c44aab667947ea511f20e (127.16.188.131:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.180682 29615 raft_consensus.cc:515] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.181753 29460 leader_election.cc:304] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9; no voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e
I20260709 13:22:22.183871 29616 raft_consensus.cc:2804] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.184427 29616 raft_consensus.cc:493] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.184857 29616 raft_consensus.cc:3060] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.184996 29611 tablet_bootstrap.cc:492] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:22.189569 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3026876f8e49428883ab8e897efdd2b1" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:22.190200 29634 raft_consensus.cc:2749] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:22:22.191131 29458 leader_election.cc:343] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.192261 29615 leader_election.cc:290] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
W20260709 13:22:22.193524 29366 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:22.195828 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3026876f8e49428883ab8e897efdd2b1" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
W20260709 13:22:22.197988 29460 leader_election.cc:343] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da72947b063c44aab667947ea511f20e (127.16.188.131:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.198642 29460 leader_election.cc:304] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9; no voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e
I20260709 13:22:22.199645 29634 raft_consensus.cc:2749] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:22.206094 29616 raft_consensus.cc:515] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.207105 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf394c61ea549acbb187857f205babd" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:22.211896 29420 raft_consensus.cc:2468] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 0.
I20260709 13:22:22.213443 29495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf394c61ea549acbb187857f205babd" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
I20260709 13:22:22.213802 29532 leader_election.cc:304] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:22.214294 29611 tablet_bootstrap.cc:654] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.215303 29617 raft_consensus.cc:2804] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:22:22.215660 29534 leader_election.cc:343] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.215821 29617 raft_consensus.cc:493] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.216691 29617 raft_consensus.cc:3060] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.209416 29610 tablet_bootstrap.cc:654] T 3b64947627d54c43ba226d91efb0ca75 P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.220253 29609 tablet_bootstrap.cc:492] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:22.220839 29609 ts_tablet_manager.cc:1403] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.079s	user 0.036s	sys 0.033s
I20260709 13:22:22.221555 29495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09cf65638344fc89ed3c6a445886ab4" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9"
W20260709 13:22:22.223369 29385 leader_election.cc:343] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.224771 29609 raft_consensus.cc:359] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.225874 29609 raft_consensus.cc:385] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.226018 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09cf65638344fc89ed3c6a445886ab4" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:22.226364 29609 raft_consensus.cc:740] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.226900 29568 raft_consensus.cc:3060] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.226429 29617 raft_consensus.cc:515] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.228094 29609 consensus_queue.cc:260] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.229496 29616 leader_election.cc:290] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 election: Requested vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:22.230247 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf394c61ea549acbb187857f205babd" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:22.230868 29420 raft_consensus.cc:3060] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.231105 29609 ts_tablet_manager.cc:1434] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:22:22.232296 29609 tablet_bootstrap.cc:492] T 8098e9a2d109459cab32b498ae7a8b8d P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:22.237964 29495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf394c61ea549acbb187857f205babd" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:22.238778 29495 raft_consensus.cc:3060] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.243345 29611 tablet_bootstrap.cc:492] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:22.244153 29611 ts_tablet_manager.cc:1403] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.003s
I20260709 13:22:22.249029 29495 raft_consensus.cc:2468] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 1.
I20260709 13:22:22.248850 29420 raft_consensus.cc:2468] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 1.
I20260709 13:22:22.251194 29609 tablet_bootstrap.cc:654] T 8098e9a2d109459cab32b498ae7a8b8d P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.251273 29532 leader_election.cc:304] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:22.254158 29568 raft_consensus.cc:2468] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 1.
I20260709 13:22:22.248651 29617 leader_election.cc:290] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:22.255841 29617 raft_consensus.cc:2804] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.256421 29617 raft_consensus.cc:697] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Leader. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:22.257560 29617 consensus_queue.cc:237] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.261018 29385 leader_election.cc:304] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e; no voters: 054e8d248d304857abe43ff0932e80a9
I20260709 13:22:22.262439 29610 tablet_bootstrap.cc:492] T 3b64947627d54c43ba226d91efb0ca75 P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:22.248154 29611 raft_consensus.cc:359] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.264003 29611 raft_consensus.cc:385] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.264411 29611 raft_consensus.cc:740] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.264873 29616 raft_consensus.cc:2804] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.265797 29611 consensus_queue.cc:260] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.266215 29616 raft_consensus.cc:697] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Becoming Leader. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Running, Role: LEADER
I20260709 13:22:22.263219 29610 ts_tablet_manager.cc:1403] T 3b64947627d54c43ba226d91efb0ca75 P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.094s	user 0.022s	sys 0.016s
I20260709 13:22:22.267305 29616 consensus_queue.cc:237] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.270300 29610 raft_consensus.cc:359] T 3b64947627d54c43ba226d91efb0ca75 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.271364 29610 raft_consensus.cc:385] T 3b64947627d54c43ba226d91efb0ca75 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.271807 29610 raft_consensus.cc:740] T 3b64947627d54c43ba226d91efb0ca75 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.275305 29610 consensus_queue.cc:260] T 3b64947627d54c43ba226d91efb0ca75 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.276038 29609 tablet_bootstrap.cc:492] T 8098e9a2d109459cab32b498ae7a8b8d P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:22.276693 29609 ts_tablet_manager.cc:1403] T 8098e9a2d109459cab32b498ae7a8b8d P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.007s
I20260709 13:22:22.278847 29610 ts_tablet_manager.cc:1434] T 3b64947627d54c43ba226d91efb0ca75 P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:22:22.278431 29314 catalog_manager.cc:5697] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e reported cstate change: term changed from 0 to 1, leader changed from <none> to da72947b063c44aab667947ea511f20e (127.16.188.131). New cstate: current_term: 1 leader_uuid: "da72947b063c44aab667947ea511f20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:22.279417 29609 raft_consensus.cc:359] T 8098e9a2d109459cab32b498ae7a8b8d P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.280210 29609 raft_consensus.cc:385] T 8098e9a2d109459cab32b498ae7a8b8d P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.280257 29610 tablet_bootstrap.cc:492] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:22.280514 29609 raft_consensus.cc:740] T 8098e9a2d109459cab32b498ae7a8b8d P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.281594 29609 consensus_queue.cc:260] T 8098e9a2d109459cab32b498ae7a8b8d P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.284823 29611 ts_tablet_manager.cc:1434] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:22:22.285854 29611 tablet_bootstrap.cc:492] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:22.287472 29318 catalog_manager.cc:5697] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2959aed377e426c8b0c8813f9325882 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "d2959aed377e426c8b0c8813f9325882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.292114 29609 ts_tablet_manager.cc:1434] T 8098e9a2d109459cab32b498ae7a8b8d P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:22:22.292528 29611 tablet_bootstrap.cc:654] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.296278 29610 tablet_bootstrap.cc:654] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.297784 29609 tablet_bootstrap.cc:492] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:22.307729 29609 tablet_bootstrap.cc:654] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.310458 29610 tablet_bootstrap.cc:492] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:22.311254 29610 ts_tablet_manager.cc:1403] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.010s
I20260709 13:22:22.316275 29610 raft_consensus.cc:359] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.317602 29610 raft_consensus.cc:385] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.318074 29610 raft_consensus.cc:740] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.320077 29610 consensus_queue.cc:260] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.322607 29609 tablet_bootstrap.cc:492] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:22.323103 29609 ts_tablet_manager.cc:1403] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.012s
I20260709 13:22:22.323208 29610 ts_tablet_manager.cc:1434] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:22:22.323778 29611 tablet_bootstrap.cc:492] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:22.324435 29611 ts_tablet_manager.cc:1403] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.018s
I20260709 13:22:22.325610 29609 raft_consensus.cc:359] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.326221 29609 raft_consensus.cc:385] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.326459 29609 raft_consensus.cc:740] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.324615 29610 tablet_bootstrap.cc:492] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:22.327284 29609 consensus_queue.cc:260] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.328354 29611 raft_consensus.cc:359] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.329365 29611 raft_consensus.cc:385] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.329741 29611 raft_consensus.cc:740] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.329949 29609 ts_tablet_manager.cc:1434] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:22:22.331094 29609 tablet_bootstrap.cc:492] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:22.330709 29611 consensus_queue.cc:260] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.333877 29611 ts_tablet_manager.cc:1434] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:22:22.335239 29611 tablet_bootstrap.cc:492] T 8098e9a2d109459cab32b498ae7a8b8d P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:22.337163 29610 tablet_bootstrap.cc:654] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.343904 29609 tablet_bootstrap.cc:654] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.344707 29611 tablet_bootstrap.cc:654] T 8098e9a2d109459cab32b498ae7a8b8d P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.351534 29610 tablet_bootstrap.cc:492] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:22.352559 29610 ts_tablet_manager.cc:1403] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.012s
I20260709 13:22:22.357385 29610 raft_consensus.cc:359] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.358459 29610 raft_consensus.cc:385] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.358880 29611 tablet_bootstrap.cc:492] T 8098e9a2d109459cab32b498ae7a8b8d P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:22.358898 29610 raft_consensus.cc:740] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.359723 29611 ts_tablet_manager.cc:1403] T 8098e9a2d109459cab32b498ae7a8b8d P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:22:22.363665 29611 raft_consensus.cc:359] T 8098e9a2d109459cab32b498ae7a8b8d P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.364760 29611 raft_consensus.cc:385] T 8098e9a2d109459cab32b498ae7a8b8d P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.360500 29610 consensus_queue.cc:260] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.365156 29611 raft_consensus.cc:740] T 8098e9a2d109459cab32b498ae7a8b8d P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.366462 29611 consensus_queue.cc:260] T 8098e9a2d109459cab32b498ae7a8b8d P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.368813 29610 ts_tablet_manager.cc:1434] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:22:22.370086 29611 ts_tablet_manager.cc:1434] T 8098e9a2d109459cab32b498ae7a8b8d P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:22:22.371398 29611 tablet_bootstrap.cc:492] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:22.370208 29610 tablet_bootstrap.cc:492] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:22.380676 29610 tablet_bootstrap.cc:654] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.380676 29611 tablet_bootstrap.cc:654] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.391323 29610 tablet_bootstrap.cc:492] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:22.391386 29609 tablet_bootstrap.cc:492] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:22.392206 29610 ts_tablet_manager.cc:1403] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:22:22.392347 29609 ts_tablet_manager.cc:1403] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.061s	user 0.027s	sys 0.013s
I20260709 13:22:22.392865 29611 tablet_bootstrap.cc:492] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:22.393523 29611 ts_tablet_manager.cc:1403] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 13:22:22.395161 29610 raft_consensus.cc:359] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.395807 29610 raft_consensus.cc:385] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.396059 29610 raft_consensus.cc:740] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.396235 29609 raft_consensus.cc:359] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.396750 29610 consensus_queue.cc:260] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.397135 29609 raft_consensus.cc:385] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.396944 29611 raft_consensus.cc:359] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.397571 29609 raft_consensus.cc:740] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.398034 29611 raft_consensus.cc:385] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.398460 29611 raft_consensus.cc:740] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.398627 29609 consensus_queue.cc:260] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.399175 29610 ts_tablet_manager.cc:1434] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:22:22.399477 29611 consensus_queue.cc:260] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.400463 29610 tablet_bootstrap.cc:492] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:22.404949 29611 ts_tablet_manager.cc:1434] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:22:22.405205 29609 ts_tablet_manager.cc:1434] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:22:22.406304 29609 tablet_bootstrap.cc:492] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:22.406312 29611 tablet_bootstrap.cc:492] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:22.407927 29610 tablet_bootstrap.cc:654] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.412179 29617 raft_consensus.cc:493] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.412909 29617 raft_consensus.cc:515] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.415429 29609 tablet_bootstrap.cc:654] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.415500 29611 tablet_bootstrap.cc:654] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.417279 29634 raft_consensus.cc:493] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.417470 29495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d13221006ac4ca1b5b47dc6f8a13276" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
I20260709 13:22:22.418424 29495 raft_consensus.cc:2468] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 0.
I20260709 13:22:22.418048 29634 raft_consensus.cc:515] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.420488 29534 leader_election.cc:304] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:22.422216 29637 raft_consensus.cc:2804] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.422605 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feb6b9b5ae14bb492a4df2c788cdbb7" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:22.423465 29420 raft_consensus.cc:2468] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 0.
I20260709 13:22:22.422652 29637 raft_consensus.cc:493] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.425420 29637 raft_consensus.cc:3060] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.429512 29458 leader_election.cc:304] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:22.431598 29615 raft_consensus.cc:2804] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.432075 29615 raft_consensus.cc:493] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.432463 29615 raft_consensus.cc:3060] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.433269 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d13221006ac4ca1b5b47dc6f8a13276" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:22.434598 29611 tablet_bootstrap.cc:492] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:22.435253 29611 ts_tablet_manager.cc:1403] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.014s
I20260709 13:22:22.438549 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feb6b9b5ae14bb492a4df2c788cdbb7" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:22.438902 29611 raft_consensus.cc:359] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } } peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } }
I20260709 13:22:22.439558 29568 raft_consensus.cc:2468] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 0.
I20260709 13:22:22.439824 29611 raft_consensus.cc:385] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.440392 29611 raft_consensus.cc:740] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.441414 29611 consensus_queue.cc:260] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } } peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } }
I20260709 13:22:22.441825 29617 leader_election.cc:290] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:22.442510 29634 leader_election.cc:290] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:22.453558 29637 raft_consensus.cc:515] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.462110 29634 raft_consensus.cc:493] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.463092 29634 raft_consensus.cc:515] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } } peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } }
I20260709 13:22:22.465993 29634 leader_election.cc:290] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da72947b063c44aab667947ea511f20e (127.16.188.131:39371), d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337)
I20260709 13:22:22.466753 29495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d13221006ac4ca1b5b47dc6f8a13276" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:22.462677 29419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d13221006ac4ca1b5b47dc6f8a13276" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:22.474012 29495 raft_consensus.cc:3060] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.434289 29420 raft_consensus.cc:2468] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 0.
I20260709 13:22:22.469107 29418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c7581b429a4f698bf7f8f81c3f79cf" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:22.475854 29418 raft_consensus.cc:2468] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 0.
I20260709 13:22:22.476289 29609 tablet_bootstrap.cc:492] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:22.476979 29609 ts_tablet_manager.cc:1403] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.008s
I20260709 13:22:22.477130 29616 raft_consensus.cc:493] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.469417 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c7581b429a4f698bf7f8f81c3f79cf" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:22.478107 29568 raft_consensus.cc:2468] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 0.
I20260709 13:22:22.477888 29616 raft_consensus.cc:515] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.477537 29458 leader_election.cc:304] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:22.482277 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8098e9a2d109459cab32b498ae7a8b8d" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
I20260709 13:22:22.483412 29494 raft_consensus.cc:2468] T 8098e9a2d109459cab32b498ae7a8b8d P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 0.
I20260709 13:22:22.485412 29385 leader_election.cc:304] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:22.470810 29637 leader_election.cc:290] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:22.486773 29640 raft_consensus.cc:2804] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.487308 29640 raft_consensus.cc:493] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.456359 29615 raft_consensus.cc:515] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.487712 29640 raft_consensus.cc:3060] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.489282 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8098e9a2d109459cab32b498ae7a8b8d" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:22.490088 29634 raft_consensus.cc:2804] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.487722 29609 raft_consensus.cc:359] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.491267 29616 leader_election.cc:290] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:22.494902 29609 raft_consensus.cc:385] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.496088 29609 raft_consensus.cc:740] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.494594 29634 raft_consensus.cc:493] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.497165 29568 raft_consensus.cc:2468] T 8098e9a2d109459cab32b498ae7a8b8d P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 0.
I20260709 13:22:22.500221 29637 raft_consensus.cc:493] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.500849 29637 raft_consensus.cc:515] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.501075 29609 consensus_queue.cc:260] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.500849 29634 raft_consensus.cc:3060] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.503106 29495 raft_consensus.cc:2468] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 1.
I20260709 13:22:22.504384 29534 leader_election.cc:304] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e; no voters: d2959aed377e426c8b0c8813f9325882
I20260709 13:22:22.505079 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b64947627d54c43ba226d91efb0ca75" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:22.505952 29420 raft_consensus.cc:2468] T 3b64947627d54c43ba226d91efb0ca75 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 0.
I20260709 13:22:22.506428 29615 leader_election.cc:290] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:22.505287 29617 raft_consensus.cc:2804] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.507258 29617 raft_consensus.cc:697] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Leader. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:22.507684 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feb6b9b5ae14bb492a4df2c788cdbb7" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:22.508401 29568 raft_consensus.cc:3060] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.508358 29617 consensus_queue.cc:237] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.509580 29640 raft_consensus.cc:515] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.512602 29495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8098e9a2d109459cab32b498ae7a8b8d" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:22.513233 29495 raft_consensus.cc:3060] T 8098e9a2d109459cab32b498ae7a8b8d P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.514325 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feb6b9b5ae14bb492a4df2c788cdbb7" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:22.515182 29420 raft_consensus.cc:3060] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.516004 29568 raft_consensus.cc:2468] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 1.
I20260709 13:22:22.517318 29460 leader_election.cc:304] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:22.518325 29615 raft_consensus.cc:2804] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.518925 29615 raft_consensus.cc:697] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Becoming Leader. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:22.519639 29495 raft_consensus.cc:2468] T 8098e9a2d109459cab32b498ae7a8b8d P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 1.
I20260709 13:22:22.519968 29615 consensus_queue.cc:237] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.520839 29385 leader_election.cc:304] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:22.521184 29532 leader_election.cc:304] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:22.521862 29616 raft_consensus.cc:2804] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.523983 29637 leader_election.cc:290] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:22.524919 29637 raft_consensus.cc:2804] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.525455 29637 raft_consensus.cc:493] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.525938 29637 raft_consensus.cc:3060] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.526808 29610 tablet_bootstrap.cc:492] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:22.527357 29610 ts_tablet_manager.cc:1403] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.127s	user 0.051s	sys 0.047s
I20260709 13:22:22.528383 29609 ts_tablet_manager.cc:1434] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 13:22:22.528802 29640 leader_election.cc:290] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 election: Requested vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:22.530882 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8098e9a2d109459cab32b498ae7a8b8d" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:22.513834 29634 raft_consensus.cc:515] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } } peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } }
I20260709 13:22:22.532688 29568 raft_consensus.cc:3060] T 8098e9a2d109459cab32b498ae7a8b8d P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.531147 29495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b64947627d54c43ba226d91efb0ca75" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
I20260709 13:22:22.535272 29634 leader_election.cc:290] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 election: Requested vote from peers da72947b063c44aab667947ea511f20e (127.16.188.131:39371), d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337)
I20260709 13:22:22.536267 29418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c7581b429a4f698bf7f8f81c3f79cf" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:22.537076 29418 raft_consensus.cc:3060] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.539111 29317 catalog_manager.cc:5697] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e reported cstate change: term changed from 0 to 1, leader changed from <none> to da72947b063c44aab667947ea511f20e (127.16.188.131). New cstate: current_term: 1 leader_uuid: "da72947b063c44aab667947ea511f20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:22.535181 29610 raft_consensus.cc:359] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.535486 29569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c7581b429a4f698bf7f8f81c3f79cf" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:22.543346 29569 raft_consensus.cc:3060] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.536325 29495 raft_consensus.cc:2468] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 0.
I20260709 13:22:22.543843 29318 catalog_manager.cc:5697] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 054e8d248d304857abe43ff0932e80a9 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "054e8d248d304857abe43ff0932e80a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.549965 29418 raft_consensus.cc:2468] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 1.
I20260709 13:22:22.551157 29569 raft_consensus.cc:2468] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 1.
I20260709 13:22:22.551803 29458 leader_election.cc:304] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:22.552812 29610 raft_consensus.cc:385] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.552887 29615 raft_consensus.cc:2804] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.553164 29610 raft_consensus.cc:740] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.528999 29611 ts_tablet_manager.cc:1434] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.093s	user 0.019s	sys 0.021s
I20260709 13:22:22.554009 29615 raft_consensus.cc:697] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Becoming Leader. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:22.554796 29611 tablet_bootstrap.cc:492] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:22.555123 29615 consensus_queue.cc:237] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } } peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } }
I20260709 13:22:22.559430 29568 raft_consensus.cc:2468] T 8098e9a2d109459cab32b498ae7a8b8d P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 1.
I20260709 13:22:22.561386 29616 raft_consensus.cc:697] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Becoming Leader. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Running, Role: LEADER
I20260709 13:22:22.564868 29616 consensus_queue.cc:237] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.554023 29610 consensus_queue.cc:260] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.567607 29610 ts_tablet_manager.cc:1434] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.002s
I20260709 13:22:22.569089 29610 tablet_bootstrap.cc:492] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:22.562165 29420 raft_consensus.cc:2468] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 1.
I20260709 13:22:22.573645 29317 catalog_manager.cc:5697] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 054e8d248d304857abe43ff0932e80a9 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "054e8d248d304857abe43ff0932e80a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.577561 29610 tablet_bootstrap.cc:654] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.578043 29637 raft_consensus.cc:515] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.581578 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b64947627d54c43ba226d91efb0ca75" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:22.582738 29420 raft_consensus.cc:3060] T 3b64947627d54c43ba226d91efb0ca75 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.586941 29611 tablet_bootstrap.cc:654] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.591269 29317 catalog_manager.cc:5697] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2959aed377e426c8b0c8813f9325882 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "d2959aed377e426c8b0c8813f9325882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.593339 29637 leader_election.cc:290] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:22.592234 29420 raft_consensus.cc:2468] T 3b64947627d54c43ba226d91efb0ca75 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 1.
I20260709 13:22:22.594554 29495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b64947627d54c43ba226d91efb0ca75" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:22.595218 29495 raft_consensus.cc:3060] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.595892 29611 tablet_bootstrap.cc:492] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:22.596294 29611 ts_tablet_manager.cc:1403] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.001s
I20260709 13:22:22.598536 29610 tablet_bootstrap.cc:492] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:22.599051 29610 ts_tablet_manager.cc:1403] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.009s
I20260709 13:22:22.599502 29611 raft_consensus.cc:359] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.600241 29611 raft_consensus.cc:385] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.600493 29611 raft_consensus.cc:740] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.600912 29532 leader_election.cc:304] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:22.601352 29495 raft_consensus.cc:2468] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 1.
I20260709 13:22:22.601334 29611 consensus_queue.cc:260] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.601873 29637 raft_consensus.cc:2804] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.602680 29610 raft_consensus.cc:359] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.603415 29610 raft_consensus.cc:385] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.603470 29637 raft_consensus.cc:697] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Leader. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:22.603778 29610 raft_consensus.cc:740] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.604589 29610 consensus_queue.cc:260] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.604588 29637 consensus_queue.cc:237] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.607095 29610 ts_tablet_manager.cc:1434] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:22.611224 29611 ts_tablet_manager.cc:1434] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 13:22:22.614786 29317 catalog_manager.cc:5697] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e reported cstate change: term changed from 0 to 1, leader changed from <none> to da72947b063c44aab667947ea511f20e (127.16.188.131). New cstate: current_term: 1 leader_uuid: "da72947b063c44aab667947ea511f20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:22.637980 29616 raft_consensus.cc:493] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.638803 29616 raft_consensus.cc:515] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.641294 29616 leader_election.cc:290] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:22.641995 29495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3026876f8e49428883ab8e897efdd2b1" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
I20260709 13:22:22.642369 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3026876f8e49428883ab8e897efdd2b1" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:22.642692 29495 raft_consensus.cc:2468] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 0.
I20260709 13:22:22.643139 29568 raft_consensus.cc:2468] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 0.
I20260709 13:22:22.643860 29385 leader_election.cc:304] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:22.644657 29616 raft_consensus.cc:2804] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.645073 29616 raft_consensus.cc:493] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.645417 29616 raft_consensus.cc:3060] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.650830 29616 raft_consensus.cc:515] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.652626 29616 leader_election.cc:290] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 election: Requested vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:22.653571 29495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3026876f8e49428883ab8e897efdd2b1" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:22.653694 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3026876f8e49428883ab8e897efdd2b1" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:22.654382 29495 raft_consensus.cc:3060] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.654446 29568 raft_consensus.cc:3060] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.662111 29495 raft_consensus.cc:2468] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 1.
I20260709 13:22:22.662111 29568 raft_consensus.cc:2468] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 1.
I20260709 13:22:22.663616 29385 leader_election.cc:304] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:22.664301 29616 raft_consensus.cc:2804] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.664815 29616 raft_consensus.cc:697] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Becoming Leader. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Running, Role: LEADER
I20260709 13:22:22.665490 29616 consensus_queue.cc:237] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.673940 29317 catalog_manager.cc:5697] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2959aed377e426c8b0c8813f9325882 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "d2959aed377e426c8b0c8813f9325882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.688889 29616 raft_consensus.cc:493] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.689412 29616 raft_consensus.cc:515] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.691181 29616 leader_election.cc:290] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:22.692117 29495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f1115f7b8a4576b43f65ff2b245ac7" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
I20260709 13:22:22.692355 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f1115f7b8a4576b43f65ff2b245ac7" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:22.692898 29495 raft_consensus.cc:2468] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 0.
I20260709 13:22:22.692965 29568 raft_consensus.cc:2468] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 0.
I20260709 13:22:22.694141 29385 leader_election.cc:304] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:22.694796 29616 raft_consensus.cc:2804] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.695164 29616 raft_consensus.cc:493] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.695437 29616 raft_consensus.cc:3060] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.699544 29637 consensus_queue.cc:1048] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:22.700626 29616 raft_consensus.cc:515] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.702392 29616 leader_election.cc:290] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 election: Requested vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:22.703619 29495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f1115f7b8a4576b43f65ff2b245ac7" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:22.703667 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f1115f7b8a4576b43f65ff2b245ac7" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:22.704361 29495 raft_consensus.cc:3060] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.704556 29568 raft_consensus.cc:3060] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.710666 29495 raft_consensus.cc:2468] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 1.
I20260709 13:22:22.712373 29385 leader_election.cc:304] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:22.714286 29568 raft_consensus.cc:2468] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 1.
I20260709 13:22:22.717375 29659 raft_consensus.cc:2804] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.717983 29659 raft_consensus.cc:697] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Becoming Leader. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Running, Role: LEADER
I20260709 13:22:22.718863 29659 consensus_queue.cc:237] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.724988 29637 consensus_queue.cc:1048] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:22.729620 29318 catalog_manager.cc:5697] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2959aed377e426c8b0c8813f9325882 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "d2959aed377e426c8b0c8813f9325882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.760038 29615 raft_consensus.cc:493] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.760795 29615 raft_consensus.cc:515] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.761656 29495 raft_consensus.cc:3060] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.762682 29615 leader_election.cc:290] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:22.763720 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09cf65638344fc89ed3c6a445886ab4" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:22.763943 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09cf65638344fc89ed3c6a445886ab4" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:22.764900 29568 raft_consensus.cc:2393] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 054e8d248d304857abe43ff0932e80a9 in current term 1: Already voted for candidate d2959aed377e426c8b0c8813f9325882 in this term.
I20260709 13:22:22.766014 29460 leader_election.cc:304] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9; no voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e
I20260709 13:22:22.768963 29615 raft_consensus.cc:2749] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:22.771715 29659 consensus_queue.cc:1048] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:22.783695 29616 consensus_queue.cc:1048] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:22.811522 29495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0c7581b429a4f698bf7f8f81c3f79cf"
dest_uuid: "054e8d248d304857abe43ff0932e80a9"
mode: GRACEFUL
new_leader_uuid: "d2959aed377e426c8b0c8813f9325882"
 from {username='slave'} at 127.0.0.1:54024
I20260709 13:22:22.812129 29495 raft_consensus.cc:606] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Received request to transfer leadership to TS d2959aed377e426c8b0c8813f9325882
I20260709 13:22:22.828693 29568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d13221006ac4ca1b5b47dc6f8a13276"
dest_uuid: "da72947b063c44aab667947ea511f20e"
mode: GRACEFUL
new_leader_uuid: "d2959aed377e426c8b0c8813f9325882"
 from {username='slave'} at 127.0.0.1:35052
I20260709 13:22:22.829185 29568 raft_consensus.cc:606] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Received request to transfer leadership to TS d2959aed377e426c8b0c8813f9325882
I20260709 13:22:22.837435 29568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daf394c61ea549acbb187857f205babd"
dest_uuid: "da72947b063c44aab667947ea511f20e"
mode: GRACEFUL
new_leader_uuid: "054e8d248d304857abe43ff0932e80a9"
 from {username='slave'} at 127.0.0.1:35052
I20260709 13:22:22.837891 29568 raft_consensus.cc:606] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Received request to transfer leadership to TS 054e8d248d304857abe43ff0932e80a9
I20260709 13:22:22.851598 29420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3026876f8e49428883ab8e897efdd2b1"
dest_uuid: "d2959aed377e426c8b0c8813f9325882"
mode: GRACEFUL
new_leader_uuid: "054e8d248d304857abe43ff0932e80a9"
 from {username='slave'} at 127.0.0.1:33796
I20260709 13:22:22.852231 29420 raft_consensus.cc:606] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Received request to transfer leadership to TS 054e8d248d304857abe43ff0932e80a9
I20260709 13:22:22.860917 29420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49f1115f7b8a4576b43f65ff2b245ac7"
dest_uuid: "d2959aed377e426c8b0c8813f9325882"
mode: GRACEFUL
new_leader_uuid: "054e8d248d304857abe43ff0932e80a9"
 from {username='slave'} at 127.0.0.1:33796
I20260709 13:22:22.861552 29420 raft_consensus.cc:606] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Received request to transfer leadership to TS 054e8d248d304857abe43ff0932e80a9
I20260709 13:22:22.905927 29637 consensus_queue.cc:1048] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:22.915328 29420 raft_consensus.cc:3060] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.923617 29657 consensus_queue.cc:1048] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:22.930807 29671 raft_consensus.cc:993] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e: : Instructing follower d2959aed377e426c8b0c8813f9325882 to start an election
I20260709 13:22:22.931423 29657 raft_consensus.cc:1081] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Signalling peer d2959aed377e426c8b0c8813f9325882 to start an election
I20260709 13:22:22.933413 29420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d13221006ac4ca1b5b47dc6f8a13276"
dest_uuid: "d2959aed377e426c8b0c8813f9325882"
 from {username='slave'} at 127.0.0.1:58274
I20260709 13:22:22.933930 29420 raft_consensus.cc:493] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:22.934250 29420 raft_consensus.cc:3060] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:22.939941 29420 raft_consensus.cc:515] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.941780 29420 leader_election.cc:290] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 2 election: Requested vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:22.942766 29495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d13221006ac4ca1b5b47dc6f8a13276" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:22.943482 29495 raft_consensus.cc:3060] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:22.943161 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d13221006ac4ca1b5b47dc6f8a13276" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:22.944267 29568 raft_consensus.cc:3055] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:22.944636 29568 raft_consensus.cc:740] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:22.945446 29568 consensus_queue.cc:260] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.946534 29568 raft_consensus.cc:3060] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:22.950585 29495 raft_consensus.cc:2468] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 2.
I20260709 13:22:22.951797 29385 leader_election.cc:304] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:22.952627 29616 raft_consensus.cc:2804] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:22.952837 29568 raft_consensus.cc:2468] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 2.
I20260709 13:22:22.953259 29616 raft_consensus.cc:697] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 2 LEADER]: Becoming Leader. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Running, Role: LEADER
I20260709 13:22:22.954276 29616 consensus_queue.cc:237] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:22.958554 29615 consensus_queue.cc:1048] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:22.962576 29314 catalog_manager.cc:5697] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 reported cstate change: term changed from 1 to 2, leader changed from da72947b063c44aab667947ea511f20e (127.16.188.131) to d2959aed377e426c8b0c8813f9325882 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "d2959aed377e426c8b0c8813f9325882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.969870 29658 consensus_queue.cc:1048] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:23.056341 29657 consensus_queue.cc:1048] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.061154 29616 consensus_queue.cc:1048] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:23.070165 29671 consensus_queue.cc:1048] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.085537 29616 consensus_queue.cc:1048] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.089183 29658 consensus_queue.cc:1048] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.104187 29615 raft_consensus.cc:993] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9: : Instructing follower d2959aed377e426c8b0c8813f9325882 to start an election
I20260709 13:22:23.104779 29615 raft_consensus.cc:1081] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Signalling peer d2959aed377e426c8b0c8813f9325882 to start an election
I20260709 13:22:23.106674 29657 raft_consensus.cc:993] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e: : Instructing follower 054e8d248d304857abe43ff0932e80a9 to start an election
I20260709 13:22:23.107285 29671 raft_consensus.cc:1081] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Signalling peer 054e8d248d304857abe43ff0932e80a9 to start an election
I20260709 13:22:23.110754 29418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0c7581b429a4f698bf7f8f81c3f79cf"
dest_uuid: "d2959aed377e426c8b0c8813f9325882"
 from {username='slave'} at 127.0.0.1:58260
I20260709 13:22:23.112457 29495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daf394c61ea549acbb187857f205babd"
dest_uuid: "054e8d248d304857abe43ff0932e80a9"
 from {username='slave'} at 127.0.0.1:37958
I20260709 13:22:23.113474 29495 raft_consensus.cc:493] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:23.113858 29495 raft_consensus.cc:3060] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.116186 29418 raft_consensus.cc:493] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:23.116621 29418 raft_consensus.cc:3060] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.112502 29634 consensus_queue.cc:1048] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:22:23.122007 29418 raft_consensus.cc:515] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } } peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } }
I20260709 13:22:23.120184 29495 raft_consensus.cc:515] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:23.128203 29569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf394c61ea549acbb187857f205babd" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:23.129103 29569 raft_consensus.cc:3055] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:23.129565 29569 raft_consensus.cc:740] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:23.130707 29569 consensus_queue.cc:260] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:23.132256 29569 raft_consensus.cc:3060] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.132889 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c7581b429a4f698bf7f8f81c3f79cf" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:23.133109 29418 leader_election.cc:290] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 2 election: Requested vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:23.133633 29494 raft_consensus.cc:3055] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:23.134006 29494 raft_consensus.cc:740] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:23.134832 29494 consensus_queue.cc:260] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } } peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } }
I20260709 13:22:23.136055 29494 raft_consensus.cc:3060] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.136189 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf394c61ea549acbb187857f205babd" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:23.136967 29420 raft_consensus.cc:3060] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.140053 29495 leader_election.cc:290] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:23.141475 29567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c7581b429a4f698bf7f8f81c3f79cf" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:23.141829 29569 raft_consensus.cc:2468] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 2.
I20260709 13:22:23.143126 29460 leader_election.cc:304] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:23.143392 29420 raft_consensus.cc:2468] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 2.
I20260709 13:22:23.143966 29615 raft_consensus.cc:2804] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:23.144537 29615 raft_consensus.cc:697] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Becoming Leader. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:23.145514 29615 consensus_queue.cc:237] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:23.146703 29494 raft_consensus.cc:2468] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 2.
I20260709 13:22:23.148396 29385 leader_election.cc:304] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: da72947b063c44aab667947ea511f20e
I20260709 13:22:23.149290 29616 raft_consensus.cc:2804] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:23.149828 29616 raft_consensus.cc:697] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [term 2 LEADER]: Becoming Leader. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Running, Role: LEADER
I20260709 13:22:23.150687 29616 consensus_queue.cc:237] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } } peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } }
I20260709 13:22:23.156276 29317 catalog_manager.cc:5697] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 reported cstate change: term changed from 1 to 2, leader changed from da72947b063c44aab667947ea511f20e (127.16.188.131) to 054e8d248d304857abe43ff0932e80a9 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "054e8d248d304857abe43ff0932e80a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:23.160225 29314 catalog_manager.cc:5697] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 reported cstate change: term changed from 1 to 2, leader changed from 054e8d248d304857abe43ff0932e80a9 (127.16.188.130) to d2959aed377e426c8b0c8813f9325882 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "d2959aed377e426c8b0c8813f9325882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:23.187999 29616 consensus_queue.cc:1048] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.195621 29640 raft_consensus.cc:993] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882: : Instructing follower 054e8d248d304857abe43ff0932e80a9 to start an election
I20260709 13:22:23.196240 29640 raft_consensus.cc:1081] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Signalling peer 054e8d248d304857abe43ff0932e80a9 to start an election
I20260709 13:22:23.199118 29495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49f1115f7b8a4576b43f65ff2b245ac7"
dest_uuid: "054e8d248d304857abe43ff0932e80a9"
 from {username='slave'} at 127.0.0.1:37956
I20260709 13:22:23.199723 29495 raft_consensus.cc:493] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:23.200125 29495 raft_consensus.cc:3060] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.204005 29616 consensus_queue.cc:1048] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:23.207818 29495 raft_consensus.cc:515] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:23.209300 29494 raft_consensus.cc:1240] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Rejecting Update request from peer d2959aed377e426c8b0c8813f9325882 for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:23.211005 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f1115f7b8a4576b43f65ff2b245ac7" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:23.211678 29420 raft_consensus.cc:3055] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:23.211999 29420 raft_consensus.cc:740] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Running, Role: LEADER
I20260709 13:22:23.212741 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f1115f7b8a4576b43f65ff2b245ac7" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:23.212877 29420 consensus_queue.cc:260] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:23.213977 29420 raft_consensus.cc:3060] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.215013 29495 leader_election.cc:290] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:23.221783 29420 raft_consensus.cc:2468] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 2.
I20260709 13:22:23.223242 29458 leader_election.cc:304] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: da72947b063c44aab667947ea511f20e
I20260709 13:22:23.226166 29615 raft_consensus.cc:2804] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:23.226437 29616 consensus_queue.cc:1048] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.226703 29615 raft_consensus.cc:697] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Becoming Leader. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:23.227911 29615 consensus_queue.cc:237] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:23.233646 29659 raft_consensus.cc:993] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882: : Instructing follower 054e8d248d304857abe43ff0932e80a9 to start an election
I20260709 13:22:23.234086 29659 raft_consensus.cc:1081] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Signalling peer 054e8d248d304857abe43ff0932e80a9 to start an election
I20260709 13:22:23.235011 29314 catalog_manager.cc:5697] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 reported cstate change: term changed from 1 to 2, leader changed from d2959aed377e426c8b0c8813f9325882 (127.16.188.129) to 054e8d248d304857abe43ff0932e80a9 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "054e8d248d304857abe43ff0932e80a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:23.235796 29494 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3026876f8e49428883ab8e897efdd2b1"
dest_uuid: "054e8d248d304857abe43ff0932e80a9"
 from {username='slave'} at 127.0.0.1:37956
I20260709 13:22:23.237311 29494 raft_consensus.cc:493] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:23.237736 29494 raft_consensus.cc:3060] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.240907 29659 consensus_queue.cc:1048] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.245886 29494 raft_consensus.cc:515] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:23.248744 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3026876f8e49428883ab8e897efdd2b1" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:23.249307 29420 raft_consensus.cc:3055] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:23.249598 29420 raft_consensus.cc:740] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Running, Role: LEADER
I20260709 13:22:23.250367 29420 consensus_queue.cc:260] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:23.251190 29420 raft_consensus.cc:3060] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.253831 29494 leader_election.cc:290] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:23.255226 29569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3026876f8e49428883ab8e897efdd2b1" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:23.255854 29569 raft_consensus.cc:3060] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.259054 29420 raft_consensus.cc:2468] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 2.
I20260709 13:22:23.260476 29458 leader_election.cc:304] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:23.261405 29615 raft_consensus.cc:2804] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:23.261926 29615 raft_consensus.cc:697] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Becoming Leader. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:23.262751 29615 consensus_queue.cc:237] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:23.263273 29569 raft_consensus.cc:2468] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 2.
I20260709 13:22:23.270375 29314 catalog_manager.cc:5697] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 reported cstate change: term changed from 1 to 2, leader changed from d2959aed377e426c8b0c8813f9325882 (127.16.188.129) to 054e8d248d304857abe43ff0932e80a9 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "054e8d248d304857abe43ff0932e80a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:23.523975 29569 raft_consensus.cc:1275] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Refusing update from remote peer d2959aed377e426c8b0c8813f9325882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.525317 29659 consensus_queue.cc:1048] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.534819 29494 raft_consensus.cc:1275] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Refusing update from remote peer d2959aed377e426c8b0c8813f9325882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.536283 29640 consensus_queue.cc:1048] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.537106 29494 raft_consensus.cc:1275] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Refusing update from remote peer d2959aed377e426c8b0c8813f9325882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.539225 29640 consensus_queue.cc:1048] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.551859 29569 raft_consensus.cc:3060] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.559706 29569 raft_consensus.cc:1275] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Refusing update from remote peer d2959aed377e426c8b0c8813f9325882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.560266 29420 raft_consensus.cc:1275] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Refusing update from remote peer 054e8d248d304857abe43ff0932e80a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.561545 29616 consensus_queue.cc:1048] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.562141 29615 consensus_queue.cc:1048] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.571233 29568 raft_consensus.cc:1275] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Refusing update from remote peer 054e8d248d304857abe43ff0932e80a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.572939 29658 consensus_queue.cc:1048] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.698715 29420 raft_consensus.cc:1275] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Refusing update from remote peer 054e8d248d304857abe43ff0932e80a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.700115 29569 raft_consensus.cc:3060] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.700371 29658 consensus_queue.cc:1048] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:23.708986 29569 raft_consensus.cc:1275] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Refusing update from remote peer 054e8d248d304857abe43ff0932e80a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.710534 29634 consensus_queue.cc:1048] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.770443 29420 raft_consensus.cc:1275] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Refusing update from remote peer 054e8d248d304857abe43ff0932e80a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.771951 29634 consensus_queue.cc:1048] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.781448 29569 raft_consensus.cc:1275] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Refusing update from remote peer 054e8d248d304857abe43ff0932e80a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.783090 29658 consensus_queue.cc:1048] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:25.895604 29314 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33288:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:25.898205 29314 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:25.949923 29403 tablet_service.cc:1511] Processing CreateTablet for tablet 353d27470b534d2ea0a1f09745a64fd7 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:25.951196 29403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353d27470b534d2ea0a1f09745a64fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:25.951164 29482 tablet_service.cc:1511] Processing CreateTablet for tablet 353d27470b534d2ea0a1f09745a64fd7 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:25.952189 29552 tablet_service.cc:1511] Processing CreateTablet for tablet 353d27470b534d2ea0a1f09745a64fd7 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:25.952847 29482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353d27470b534d2ea0a1f09745a64fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:25.953554 29552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353d27470b534d2ea0a1f09745a64fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:25.953348 29405 tablet_service.cc:1511] Processing CreateTablet for tablet fc2cd5e2643243eaa72ce365f08babb3 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:25.954638 29405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2cd5e2643243eaa72ce365f08babb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:25.969681 29478 tablet_service.cc:1511] Processing CreateTablet for tablet fc2cd5e2643243eaa72ce365f08babb3 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:25.971411 29478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2cd5e2643243eaa72ce365f08babb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:25.972808 29409 tablet_service.cc:1511] Processing CreateTablet for tablet 9caf458a253c43bfb793a09b7e3d1460 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:25.974582 29409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9caf458a253c43bfb793a09b7e3d1460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:25.977633 29708 tablet_bootstrap.cc:492] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:25.977381 29559 tablet_service.cc:1511] Processing CreateTablet for tablet fc2cd5e2643243eaa72ce365f08babb3 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:25.978891 29559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2cd5e2643243eaa72ce365f08babb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:25.989500 29479 tablet_service.cc:1511] Processing CreateTablet for tablet 9caf458a253c43bfb793a09b7e3d1460 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:25.990398 29551 tablet_service.cc:1511] Processing CreateTablet for tablet 9caf458a253c43bfb793a09b7e3d1460 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:25.991046 29479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9caf458a253c43bfb793a09b7e3d1460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:25.991917 29551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9caf458a253c43bfb793a09b7e3d1460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.003715 29409 tablet_service.cc:1511] Processing CreateTablet for tablet 9a273d1f2c1e4e498b66768eec24cbb9 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:26.015892 29480 tablet_service.cc:1511] Processing CreateTablet for tablet 9a273d1f2c1e4e498b66768eec24cbb9 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:26.013527 29405 tablet_service.cc:1511] Processing CreateTablet for tablet 267f51cd1b6e442288ecacb0f03a34cc (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:26.016638 29403 tablet_service.cc:1511] Processing CreateTablet for tablet 9a46837a9b2f40dab5d88a3867ec15b7 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:26.018889 29554 tablet_service.cc:1511] Processing CreateTablet for tablet 267f51cd1b6e442288ecacb0f03a34cc (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:26.019438 29557 tablet_service.cc:1511] Processing CreateTablet for tablet 9a46837a9b2f40dab5d88a3867ec15b7 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:26.021040 29480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a273d1f2c1e4e498b66768eec24cbb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.022348 29404 tablet_service.cc:1511] Processing CreateTablet for tablet 905a34cce1bc4198ac6625668f700e68 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:26.024631 29558 tablet_service.cc:1511] Processing CreateTablet for tablet 9a273d1f2c1e4e498b66768eec24cbb9 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:26.025334 29484 tablet_service.cc:1511] Processing CreateTablet for tablet 267f51cd1b6e442288ecacb0f03a34cc (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:26.026635 29484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267f51cd1b6e442288ecacb0f03a34cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.029565 29408 tablet_service.cc:1511] Processing CreateTablet for tablet 568ec73b39774d83939ce165a44ae8dd (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:26.029896 29553 tablet_service.cc:1511] Processing CreateTablet for tablet 905a34cce1bc4198ac6625668f700e68 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:26.030874 29556 tablet_service.cc:1511] Processing CreateTablet for tablet 568ec73b39774d83939ce165a44ae8dd (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:26.032578 29555 tablet_service.cc:1511] Processing CreateTablet for tablet d358e9d6a5884b0c89a8f9cdbceea9ba (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:26.034690 29483 tablet_service.cc:1511] Processing CreateTablet for tablet d358e9d6a5884b0c89a8f9cdbceea9ba (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:26.035926 29477 tablet_service.cc:1511] Processing CreateTablet for tablet 905a34cce1bc4198ac6625668f700e68 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:26.010083 29708 tablet_bootstrap.cc:654] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.037302 29481 tablet_service.cc:1511] Processing CreateTablet for tablet 9a46837a9b2f40dab5d88a3867ec15b7 (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:26.020394 29554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267f51cd1b6e442288ecacb0f03a34cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.039564 29485 tablet_service.cc:1511] Processing CreateTablet for tablet 568ec73b39774d83939ce165a44ae8dd (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:26.040026 29407 tablet_service.cc:1511] Processing CreateTablet for tablet d358e9d6a5884b0c89a8f9cdbceea9ba (DEFAULT_TABLE table=soft_deleted_table [id=b35afc364480408394d343e0d12aa296]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:26.041456 29553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 905a34cce1bc4198ac6625668f700e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.051982 29556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 568ec73b39774d83939ce165a44ae8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.017827 29409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a273d1f2c1e4e498b66768eec24cbb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.036190 29483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d358e9d6a5884b0c89a8f9cdbceea9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.061124 29408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 568ec73b39774d83939ce165a44ae8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.061800 29407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d358e9d6a5884b0c89a8f9cdbceea9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.061947 29558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a273d1f2c1e4e498b66768eec24cbb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.063117 29555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d358e9d6a5884b0c89a8f9cdbceea9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.063652 29403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a46837a9b2f40dab5d88a3867ec15b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.065819 29481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a46837a9b2f40dab5d88a3867ec15b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.067342 29485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 568ec73b39774d83939ce165a44ae8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.067538 29404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 905a34cce1bc4198ac6625668f700e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.070367 29557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a46837a9b2f40dab5d88a3867ec15b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.073149 29405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267f51cd1b6e442288ecacb0f03a34cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.072196 29477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 905a34cce1bc4198ac6625668f700e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.163558 29709 tablet_bootstrap.cc:492] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:26.164595 29708 tablet_bootstrap.cc:492] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:26.165179 29708 ts_tablet_manager.cc:1403] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.188s	user 0.002s	sys 0.011s
I20260709 13:22:26.171849 29709 tablet_bootstrap.cc:654] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.172458 29708 raft_consensus.cc:359] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.184731 29708 raft_consensus.cc:385] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.185089 29708 raft_consensus.cc:740] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.179019 29712 tablet_bootstrap.cc:492] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:26.185830 29708 consensus_queue.cc:260] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.199436 29712 tablet_bootstrap.cc:654] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.205468 29708 ts_tablet_manager.cc:1434] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:22:26.210592 29708 tablet_bootstrap.cc:492] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:26.217909 29708 tablet_bootstrap.cc:654] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.218016 29712 tablet_bootstrap.cc:492] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:26.219632 29712 ts_tablet_manager.cc:1403] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.007s
I20260709 13:22:26.222719 29712 raft_consensus.cc:359] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.223517 29712 raft_consensus.cc:385] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.223860 29712 raft_consensus.cc:740] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.224581 29712 consensus_queue.cc:260] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.225636 29708 tablet_bootstrap.cc:492] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:26.226207 29708 ts_tablet_manager.cc:1403] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:22:26.227335 29712 ts_tablet_manager.cc:1434] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:26.228350 29712 tablet_bootstrap.cc:492] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:26.229367 29709 tablet_bootstrap.cc:492] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:26.229461 29708 raft_consensus.cc:359] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.230062 29709 ts_tablet_manager.cc:1403] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.006s
I20260709 13:22:26.230378 29708 raft_consensus.cc:385] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.230710 29708 raft_consensus.cc:740] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.231663 29708 consensus_queue.cc:260] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.235039 29712 tablet_bootstrap.cc:654] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.236606 29709 raft_consensus.cc:359] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.241593 29708 ts_tablet_manager.cc:1434] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:22:26.241847 29709 raft_consensus.cc:385] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.242209 29709 raft_consensus.cc:740] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.242918 29708 tablet_bootstrap.cc:492] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:26.242976 29712 tablet_bootstrap.cc:492] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:26.243964 29712 ts_tablet_manager.cc:1403] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.003s
I20260709 13:22:26.243063 29709 consensus_queue.cc:260] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.246399 29709 ts_tablet_manager.cc:1434] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
W20260709 13:22:26.248373 29366 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:26.249292 29709 tablet_bootstrap.cc:492] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:26.249951 29708 tablet_bootstrap.cc:654] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.251449 29712 raft_consensus.cc:359] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.252290 29712 raft_consensus.cc:385] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.252655 29712 raft_consensus.cc:740] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.253688 29712 consensus_queue.cc:260] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.257169 29709 tablet_bootstrap.cc:654] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.266829 29712 ts_tablet_manager.cc:1434] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:22:26.268373 29712 tablet_bootstrap.cc:492] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:26.277957 29712 tablet_bootstrap.cc:654] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.279382 29708 tablet_bootstrap.cc:492] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:26.279970 29708 ts_tablet_manager.cc:1403] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.037s	user 0.025s	sys 0.008s
I20260709 13:22:26.287353 29708 raft_consensus.cc:359] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.288090 29708 raft_consensus.cc:385] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.288375 29708 raft_consensus.cc:740] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.289238 29709 tablet_bootstrap.cc:492] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:26.289518 29712 tablet_bootstrap.cc:492] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:26.289165 29708 consensus_queue.cc:260] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.289784 29709 ts_tablet_manager.cc:1403] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.041s	user 0.024s	sys 0.015s
I20260709 13:22:26.290185 29712 ts_tablet_manager.cc:1403] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 13:22:26.291836 29708 ts_tablet_manager.cc:1434] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:22:26.293289 29708 tablet_bootstrap.cc:492] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:26.293320 29709 raft_consensus.cc:359] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.293870 29712 raft_consensus.cc:359] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.294293 29709 raft_consensus.cc:385] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.294674 29712 raft_consensus.cc:385] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.294802 29709 raft_consensus.cc:740] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.295200 29712 raft_consensus.cc:740] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.295809 29709 consensus_queue.cc:260] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.296142 29712 consensus_queue.cc:260] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.298482 29709 ts_tablet_manager.cc:1434] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:26.299437 29709 tablet_bootstrap.cc:492] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:26.301434 29708 tablet_bootstrap.cc:654] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.304148 29712 ts_tablet_manager.cc:1434] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:22:26.305487 29712 tablet_bootstrap.cc:492] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:26.306383 29709 tablet_bootstrap.cc:654] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.309589 29616 raft_consensus.cc:493] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.310240 29616 raft_consensus.cc:515] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.313731 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353d27470b534d2ea0a1f09745a64fd7" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
I20260709 13:22:26.314404 29494 raft_consensus.cc:2468] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 0.
I20260709 13:22:26.315786 29385 leader_election.cc:304] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:26.318707 29708 tablet_bootstrap.cc:492] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:26.319417 29708 ts_tablet_manager.cc:1403] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.008s
I20260709 13:22:26.332923 29708 raft_consensus.cc:359] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.333395 29711 raft_consensus.cc:493] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.333811 29708 raft_consensus.cc:385] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.334136 29708 raft_consensus.cc:740] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.334120 29711 raft_consensus.cc:515] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.322888 29709 tablet_bootstrap.cc:492] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:26.337257 29708 consensus_queue.cc:260] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.343827 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caf458a253c43bfb793a09b7e3d1460" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:26.344055 29711 leader_election.cc:290] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:26.344624 29420 raft_consensus.cc:2468] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 0.
I20260709 13:22:26.326097 29616 leader_election.cc:290] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:26.345700 29709 ts_tablet_manager.cc:1403] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.009s
I20260709 13:22:26.345428 29616 raft_consensus.cc:2804] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.346189 29532 leader_election.cc:304] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:26.351004 29616 raft_consensus.cc:493] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.351400 29616 raft_consensus.cc:3060] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.351650 29712 tablet_bootstrap.cc:654] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.352309 29711 raft_consensus.cc:2804] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.357774 29711 raft_consensus.cc:493] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.358250 29711 raft_consensus.cc:3060] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.361105 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caf458a253c43bfb793a09b7e3d1460" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
W20260709 13:22:26.362799 29534 leader_election.cc:343] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.366463 29616 raft_consensus.cc:515] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
W20260709 13:22:26.371547 29385 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:43759, user_credentials={real_user=slave}} blocked reactor thread for 55884.2us
I20260709 13:22:26.373703 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353d27470b534d2ea0a1f09745a64fd7" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:26.374898 29494 raft_consensus.cc:3060] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.373695 29569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353d27470b534d2ea0a1f09745a64fd7" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:26.378815 29569 raft_consensus.cc:2468] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 0.
I20260709 13:22:26.383069 29709 raft_consensus.cc:359] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.384114 29709 raft_consensus.cc:385] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.384480 29709 raft_consensus.cc:740] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.393285 29616 leader_election.cc:290] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 election: Requested vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:26.394430 29569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353d27470b534d2ea0a1f09745a64fd7" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:26.394218 29709 consensus_queue.cc:260] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.395025 29569 raft_consensus.cc:3060] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.395737 29494 raft_consensus.cc:2468] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 1.
I20260709 13:22:26.396963 29709 ts_tablet_manager.cc:1434] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.003s
I20260709 13:22:26.397758 29708 ts_tablet_manager.cc:1434] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.078s	user 0.012s	sys 0.013s
I20260709 13:22:26.398252 29709 tablet_bootstrap.cc:492] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:26.398803 29708 tablet_bootstrap.cc:492] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:26.411036 29569 raft_consensus.cc:2468] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 1.
I20260709 13:22:26.415899 29385 leader_election.cc:304] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:26.422592 29711 raft_consensus.cc:515] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.427055 29712 tablet_bootstrap.cc:492] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:26.427277 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caf458a253c43bfb793a09b7e3d1460" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:26.427665 29712 ts_tablet_manager.cc:1403] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.017s
I20260709 13:22:26.427994 29420 raft_consensus.cc:3060] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.426966 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caf458a253c43bfb793a09b7e3d1460" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9"
W20260709 13:22:26.433911 29534 leader_election.cc:343] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.439805 29420 raft_consensus.cc:2468] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 1.
I20260709 13:22:26.440946 29725 raft_consensus.cc:2804] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.442471 29532 leader_election.cc:304] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e; no voters: 054e8d248d304857abe43ff0932e80a9
I20260709 13:22:26.425336 29711 leader_election.cc:290] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:26.443934 29637 raft_consensus.cc:2804] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.445566 29725 raft_consensus.cc:697] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Becoming Leader. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Running, Role: LEADER
I20260709 13:22:26.451040 29708 tablet_bootstrap.cc:654] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.448184 29725 consensus_queue.cc:237] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.453745 29709 tablet_bootstrap.cc:654] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.453380 29712 raft_consensus.cc:359] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.456672 29637 raft_consensus.cc:697] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Leader. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:26.457147 29712 raft_consensus.cc:385] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.457700 29712 raft_consensus.cc:740] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.458063 29637 consensus_queue.cc:237] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.458695 29712 consensus_queue.cc:260] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.461714 29712 ts_tablet_manager.cc:1434] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.001s
I20260709 13:22:26.463135 29712 tablet_bootstrap.cc:492] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:26.466722 29317 catalog_manager.cc:5697] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2959aed377e426c8b0c8813f9325882 (127.16.188.129). New cstate: current_term: 1 leader_uuid: "d2959aed377e426c8b0c8813f9325882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:26.469794 29708 tablet_bootstrap.cc:492] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:26.470435 29708 ts_tablet_manager.cc:1403] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.009s
I20260709 13:22:26.473026 29712 tablet_bootstrap.cc:654] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.473803 29708 raft_consensus.cc:359] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.474684 29708 raft_consensus.cc:385] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.474987 29708 raft_consensus.cc:740] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.475435 29725 raft_consensus.cc:493] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.476284 29708 consensus_queue.cc:260] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.476148 29725 raft_consensus.cc:515] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.480381 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d358e9d6a5884b0c89a8f9cdbceea9ba" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
I20260709 13:22:26.481711 29569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d358e9d6a5884b0c89a8f9cdbceea9ba" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:26.478895 29316 catalog_manager.cc:5697] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e reported cstate change: term changed from 0 to 1, leader changed from <none> to da72947b063c44aab667947ea511f20e (127.16.188.131). New cstate: current_term: 1 leader_uuid: "da72947b063c44aab667947ea511f20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: HEALTHY } } }
W20260709 13:22:26.484944 29385 leader_election.cc:343] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da72947b063c44aab667947ea511f20e (127.16.188.131:39371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:26.485863 29385 leader_election.cc:343] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.486320 29385 leader_election.cc:304] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2959aed377e426c8b0c8813f9325882; no voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e
I20260709 13:22:26.487370 29722 raft_consensus.cc:2749] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:26.487989 29727 raft_consensus.cc:493] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.488739 29727 raft_consensus.cc:515] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.492549 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267f51cd1b6e442288ecacb0f03a34cc" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:26.493484 29709 tablet_bootstrap.cc:492] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
W20260709 13:22:26.493784 29532 leader_election.cc:343] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.494100 29709 ts_tablet_manager.cc:1403] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.096s	user 0.006s	sys 0.007s
I20260709 13:22:26.494967 29727 leader_election.cc:290] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:26.479007 29708 ts_tablet_manager.cc:1434] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:22:26.496145 29712 tablet_bootstrap.cc:492] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:26.496701 29712 ts_tablet_manager.cc:1403] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.015s
I20260709 13:22:26.497288 29708 tablet_bootstrap.cc:492] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:26.495159 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267f51cd1b6e442288ecacb0f03a34cc" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
I20260709 13:22:26.499861 29712 raft_consensus.cc:359] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.495400 29725 leader_election.cc:290] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:26.500648 29712 raft_consensus.cc:385] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.501083 29712 raft_consensus.cc:740] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.500658 29494 raft_consensus.cc:2468] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 0.
I20260709 13:22:26.502135 29712 consensus_queue.cc:260] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.502761 29534 leader_election.cc:304] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e; no voters: d2959aed377e426c8b0c8813f9325882
I20260709 13:22:26.503669 29727 raft_consensus.cc:2804] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.504050 29727 raft_consensus.cc:493] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.504390 29727 raft_consensus.cc:3060] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.504904 29712 ts_tablet_manager.cc:1434] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:26.506177 29712 tablet_bootstrap.cc:492] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:26.502198 29709 raft_consensus.cc:359] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.508718 29709 raft_consensus.cc:385] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.509099 29709 raft_consensus.cc:740] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.509894 29709 consensus_queue.cc:260] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.512329 29709 ts_tablet_manager.cc:1434] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.006s
I20260709 13:22:26.512686 29727 raft_consensus.cc:515] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.513415 29709 tablet_bootstrap.cc:492] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:26.515502 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267f51cd1b6e442288ecacb0f03a34cc" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882"
W20260709 13:22:26.516949 29532 leader_election.cc:343] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.517992 29708 tablet_bootstrap.cc:654] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.524657 29709 tablet_bootstrap.cc:654] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.525571 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267f51cd1b6e442288ecacb0f03a34cc" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:26.526072 29727 leader_election.cc:290] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:26.530448 29494 raft_consensus.cc:3060] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.529582 29712 tablet_bootstrap.cc:654] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.539414 29494 raft_consensus.cc:2468] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 1.
I20260709 13:22:26.540917 29534 leader_election.cc:304] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e; no voters: d2959aed377e426c8b0c8813f9325882
I20260709 13:22:26.541296 29712 tablet_bootstrap.cc:492] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:26.541878 29712 ts_tablet_manager.cc:1403] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 13:22:26.542198 29727 raft_consensus.cc:2804] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.542395 29708 tablet_bootstrap.cc:492] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:26.542799 29727 raft_consensus.cc:697] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Leader. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:26.543215 29708 ts_tablet_manager.cc:1403] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.009s
I20260709 13:22:26.543728 29727 consensus_queue.cc:237] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.545272 29712 raft_consensus.cc:359] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.546047 29712 raft_consensus.cc:385] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.546335 29712 raft_consensus.cc:740] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.547384 29712 consensus_queue.cc:260] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.548022 29708 raft_consensus.cc:359] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.549192 29708 raft_consensus.cc:385] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.549610 29708 raft_consensus.cc:740] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.550086 29712 ts_tablet_manager.cc:1434] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:26.551532 29712 tablet_bootstrap.cc:492] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:26.550812 29708 consensus_queue.cc:260] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.554718 29708 ts_tablet_manager.cc:1434] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.011s	user 0.012s	sys 0.000s
I20260709 13:22:26.556100 29708 tablet_bootstrap.cc:492] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:26.560858 29712 tablet_bootstrap.cc:654] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.562059 29725 raft_consensus.cc:493] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.562646 29725 raft_consensus.cc:515] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.564770 29725 leader_election.cc:290] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:26.566357 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2cd5e2643243eaa72ce365f08babb3" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
I20260709 13:22:26.566622 29569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2cd5e2643243eaa72ce365f08babb3" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
W20260709 13:22:26.568252 29385 leader_election.cc:343] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da72947b063c44aab667947ea511f20e (127.16.188.131:39371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:26.569358 29385 leader_election.cc:343] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.569900 29385 leader_election.cc:304] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2959aed377e426c8b0c8813f9325882; no voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e
I20260709 13:22:26.571552 29725 raft_consensus.cc:2749] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:26.572687 29708 tablet_bootstrap.cc:654] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.571935 29317 catalog_manager.cc:5697] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e reported cstate change: term changed from 0 to 1, leader changed from <none> to da72947b063c44aab667947ea511f20e (127.16.188.131). New cstate: current_term: 1 leader_uuid: "da72947b063c44aab667947ea511f20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:26.575421 29712 tablet_bootstrap.cc:492] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:26.576129 29712 ts_tablet_manager.cc:1403] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.011s
I20260709 13:22:26.579082 29709 tablet_bootstrap.cc:492] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:26.579222 29712 raft_consensus.cc:359] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.580488 29712 raft_consensus.cc:385] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.580077 29709 ts_tablet_manager.cc:1403] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.015s
I20260709 13:22:26.580915 29712 raft_consensus.cc:740] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.581837 29712 consensus_queue.cc:260] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.584430 29712 ts_tablet_manager.cc:1434] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:22:26.584060 29709 raft_consensus.cc:359] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.584934 29709 raft_consensus.cc:385] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.585254 29709 raft_consensus.cc:740] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.585930 29712 tablet_bootstrap.cc:492] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:26.585983 29709 consensus_queue.cc:260] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.588063 29727 raft_consensus.cc:493] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.588533 29709 ts_tablet_manager.cc:1434] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:26.588573 29727 raft_consensus.cc:515] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.589874 29709 tablet_bootstrap.cc:492] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:26.590806 29727 leader_election.cc:290] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:26.592680 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a273d1f2c1e4e498b66768eec24cbb9" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
I20260709 13:22:26.593003 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a273d1f2c1e4e498b66768eec24cbb9" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:26.593437 29494 raft_consensus.cc:2468] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 0.
I20260709 13:22:26.593587 29420 raft_consensus.cc:2468] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 0.
I20260709 13:22:26.594940 29534 leader_election.cc:304] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:26.597627 29708 tablet_bootstrap.cc:492] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:26.598260 29708 ts_tablet_manager.cc:1403] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.018s
I20260709 13:22:26.600127 29727 raft_consensus.cc:2804] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.600720 29727 raft_consensus.cc:493] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.601145 29727 raft_consensus.cc:3060] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.602056 29708 raft_consensus.cc:359] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.602886 29708 raft_consensus.cc:385] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.603204 29708 raft_consensus.cc:740] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.606683 29709 tablet_bootstrap.cc:654] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.604115 29708 consensus_queue.cc:260] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.610152 29727 raft_consensus.cc:515] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.612669 29708 ts_tablet_manager.cc:1434] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:22:26.617775 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a273d1f2c1e4e498b66768eec24cbb9" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:26.618667 29727 leader_election.cc:290] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:26.617843 29708 tablet_bootstrap.cc:492] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:26.620286 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a273d1f2c1e4e498b66768eec24cbb9" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:26.621001 29494 raft_consensus.cc:3060] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.623369 29709 tablet_bootstrap.cc:492] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:26.623893 29709 ts_tablet_manager.cc:1403] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.008s
I20260709 13:22:26.618685 29420 raft_consensus.cc:3060] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.626174 29708 tablet_bootstrap.cc:654] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.626953 29709 raft_consensus.cc:359] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.627683 29709 raft_consensus.cc:385] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.627957 29709 raft_consensus.cc:740] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.628696 29709 consensus_queue.cc:260] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.630929 29709 ts_tablet_manager.cc:1434] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:22:26.631978 29709 tablet_bootstrap.cc:492] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:26.634572 29494 raft_consensus.cc:2468] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 1.
I20260709 13:22:26.638511 29709 tablet_bootstrap.cc:654] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.636410 29420 raft_consensus.cc:2468] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 1.
I20260709 13:22:26.638382 29534 leader_election.cc:304] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:26.639424 29727 raft_consensus.cc:2804] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.639930 29727 raft_consensus.cc:697] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Leader. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:26.640820 29727 consensus_queue.cc:237] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.637223 29712 tablet_bootstrap.cc:654] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.653182 29709 tablet_bootstrap.cc:492] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:26.653662 29709 ts_tablet_manager.cc:1403] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:22:26.654018 29708 tablet_bootstrap.cc:492] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:26.654556 29708 ts_tablet_manager.cc:1403] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.037s	user 0.026s	sys 0.009s
I20260709 13:22:26.656451 29709 raft_consensus.cc:359] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.657195 29709 raft_consensus.cc:385] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.657528 29709 raft_consensus.cc:740] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.657330 29708 raft_consensus.cc:359] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.658236 29708 raft_consensus.cc:385] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.658573 29708 raft_consensus.cc:740] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.659349 29708 consensus_queue.cc:260] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.659659 29709 consensus_queue.cc:260] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.660596 29712 tablet_bootstrap.cc:492] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:26.661099 29712 ts_tablet_manager.cc:1403] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.011s
I20260709 13:22:26.662065 29708 ts_tablet_manager.cc:1434] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:22:26.662349 29709 ts_tablet_manager.cc:1434] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.006s
I20260709 13:22:26.663259 29708 tablet_bootstrap.cc:492] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882: Bootstrap starting.
I20260709 13:22:26.663540 29709 tablet_bootstrap.cc:492] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:26.663617 29712 raft_consensus.cc:359] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.664628 29712 raft_consensus.cc:385] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.664883 29712 raft_consensus.cc:740] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.665675 29723 raft_consensus.cc:493] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.665623 29712 consensus_queue.cc:260] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.666249 29723 raft_consensus.cc:515] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.668058 29712 ts_tablet_manager.cc:1434] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:26.669227 29712 tablet_bootstrap.cc:492] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e: Bootstrap starting.
I20260709 13:22:26.672230 29709 tablet_bootstrap.cc:654] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.674120 29708 tablet_bootstrap.cc:654] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.675684 29712 tablet_bootstrap.cc:654] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.678752 29658 raft_consensus.cc:493] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.679721 29658 raft_consensus.cc:515] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.682690 29658 leader_election.cc:290] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:26.685055 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caf458a253c43bfb793a09b7e3d1460" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:26.686018 29420 raft_consensus.cc:2393] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 054e8d248d304857abe43ff0932e80a9 in current term 1: Already voted for candidate da72947b063c44aab667947ea511f20e in this term.
I20260709 13:22:26.693166 29569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caf458a253c43bfb793a09b7e3d1460" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:26.697554 29460 leader_election.cc:304] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9; no voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e
I20260709 13:22:26.700675 29750 raft_consensus.cc:3060] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.706365 29723 leader_election.cc:290] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:26.708181 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2cd5e2643243eaa72ce365f08babb3" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:26.708912 29420 raft_consensus.cc:2468] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 0.
I20260709 13:22:26.710490 29458 leader_election.cc:304] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:26.713330 29727 raft_consensus.cc:493] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.713862 29727 raft_consensus.cc:515] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.716035 29727 leader_election.cc:290] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:26.721242 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905a34cce1bc4198ac6625668f700e68" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:26.722298 29420 raft_consensus.cc:2468] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 0.
I20260709 13:22:26.723726 29750 raft_consensus.cc:2749] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:26.723798 29532 leader_election.cc:304] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:26.724666 29750 raft_consensus.cc:2804] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.725060 29750 raft_consensus.cc:493] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.725438 29727 raft_consensus.cc:2804] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.725872 29727 raft_consensus.cc:493] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.726197 29727 raft_consensus.cc:3060] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.730887 29569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2cd5e2643243eaa72ce365f08babb3" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:26.731616 29569 raft_consensus.cc:2468] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 0.
I20260709 13:22:26.733144 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905a34cce1bc4198ac6625668f700e68" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
I20260709 13:22:26.733840 29494 raft_consensus.cc:2468] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 0.
I20260709 13:22:26.734126 29727 raft_consensus.cc:515] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.736236 29727 leader_election.cc:290] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:26.739063 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905a34cce1bc4198ac6625668f700e68" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:26.725419 29750 raft_consensus.cc:3060] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.739774 29494 raft_consensus.cc:3060] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.746313 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905a34cce1bc4198ac6625668f700e68" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:26.746990 29420 raft_consensus.cc:3060] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.748903 29750 raft_consensus.cc:515] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.751178 29750 leader_election.cc:290] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:26.752317 29418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2cd5e2643243eaa72ce365f08babb3" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:26.753298 29418 raft_consensus.cc:3060] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.757632 29727 raft_consensus.cc:493] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.758544 29727 raft_consensus.cc:515] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.761590 29727 leader_election.cc:290] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:26.763321 29419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "568ec73b39774d83939ce165a44ae8dd" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:26.764397 29419 raft_consensus.cc:2468] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 0.
I20260709 13:22:26.766542 29532 leader_election.cc:304] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:26.767948 29727 raft_consensus.cc:2804] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.768643 29727 raft_consensus.cc:493] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.769290 29727 raft_consensus.cc:3060] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.776921 29569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2cd5e2643243eaa72ce365f08babb3" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:26.777982 29569 raft_consensus.cc:3060] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.795464 29418 raft_consensus.cc:2468] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 1.
I20260709 13:22:26.797009 29458 leader_election.cc:304] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:26.797995 29750 raft_consensus.cc:2804] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.798513 29750 raft_consensus.cc:697] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Becoming Leader. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:26.799419 29750 consensus_queue.cc:237] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.802176 29494 raft_consensus.cc:2468] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 1.
I20260709 13:22:26.804329 29534 leader_election.cc:304] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:26.805289 29637 raft_consensus.cc:2804] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.805909 29637 raft_consensus.cc:697] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Leader. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:26.807032 29637 consensus_queue.cc:237] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.812306 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "568ec73b39774d83939ce165a44ae8dd" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
W20260709 13:22:26.814493 29534 leader_election.cc:343] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.822422 29569 raft_consensus.cc:2468] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 1.
I20260709 13:22:26.825614 29750 raft_consensus.cc:493] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.826471 29750 raft_consensus.cc:515] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.827688 29727 raft_consensus.cc:515] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.829974 29750 leader_election.cc:290] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:26.834487 29727 leader_election.cc:290] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:26.875622 29418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d358e9d6a5884b0c89a8f9cdbceea9ba" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:26.878027 29418 raft_consensus.cc:2468] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 0.
I20260709 13:22:26.877029 29318 catalog_manager.cc:5697] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e reported cstate change: term changed from 0 to 1, leader changed from <none> to da72947b063c44aab667947ea511f20e (127.16.188.131). New cstate: current_term: 1 leader_uuid: "da72947b063c44aab667947ea511f20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:26.883339 29458 leader_election.cc:304] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:26.886008 29712 tablet_bootstrap.cc:492] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e: No bootstrap required, opened a new log
I20260709 13:22:26.887588 29712 ts_tablet_manager.cc:1403] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e: Time spent bootstrapping tablet: real 0.219s	user 0.040s	sys 0.080s
I20260709 13:22:26.888147 29418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "568ec73b39774d83939ce165a44ae8dd" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:26.892743 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d358e9d6a5884b0c89a8f9cdbceea9ba" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:26.889467 29418 raft_consensus.cc:3060] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.835047 29709 tablet_bootstrap.cc:492] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:26.900977 29495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "568ec73b39774d83939ce165a44ae8dd" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9"
W20260709 13:22:26.905555 29460 leader_election.cc:343] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da72947b063c44aab667947ea511f20e (127.16.188.131:39371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.905820 29723 raft_consensus.cc:2804] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.906684 29723 raft_consensus.cc:493] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.907294 29723 raft_consensus.cc:3060] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.910562 29420 raft_consensus.cc:2468] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 1.
W20260709 13:22:26.913691 29534 leader_election.cc:343] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.898717 29316 catalog_manager.cc:5697] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 054e8d248d304857abe43ff0932e80a9 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "054e8d248d304857abe43ff0932e80a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:26.920655 29709 ts_tablet_manager.cc:1403] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.239s	user 0.024s	sys 0.080s
I20260709 13:22:26.925132 29709 raft_consensus.cc:359] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.926071 29709 raft_consensus.cc:385] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.926370 29709 raft_consensus.cc:740] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.927174 29709 consensus_queue.cc:260] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.929730 29712 raft_consensus.cc:359] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.930716 29712 raft_consensus.cc:385] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.931062 29712 raft_consensus.cc:740] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.931558 29723 raft_consensus.cc:515] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.932020 29712 consensus_queue.cc:260] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.936376 29419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d358e9d6a5884b0c89a8f9cdbceea9ba" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:26.936605 29723 leader_election.cc:290] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:26.937374 29419 raft_consensus.cc:3060] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.939231 29708 tablet_bootstrap.cc:492] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882: No bootstrap required, opened a new log
I20260709 13:22:26.940268 29708 ts_tablet_manager.cc:1403] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882: Time spent bootstrapping tablet: real 0.277s	user 0.053s	sys 0.085s
I20260709 13:22:26.940339 29569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d358e9d6a5884b0c89a8f9cdbceea9ba" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:26.940850 29725 raft_consensus.cc:493] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.941509 29569 raft_consensus.cc:3060] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.941877 29725 raft_consensus.cc:515] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.942956 29709 ts_tablet_manager.cc:1434] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.022s	user 0.000s	sys 0.009s
I20260709 13:22:26.944787 29709 tablet_bootstrap.cc:492] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9: Bootstrap starting.
I20260709 13:22:26.946009 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267f51cd1b6e442288ecacb0f03a34cc" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
I20260709 13:22:26.947077 29494 raft_consensus.cc:2393] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d2959aed377e426c8b0c8813f9325882 in current term 1: Already voted for candidate da72947b063c44aab667947ea511f20e in this term.
I20260709 13:22:26.956225 29316 catalog_manager.cc:5697] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e reported cstate change: term changed from 0 to 1, leader changed from <none> to da72947b063c44aab667947ea511f20e (127.16.188.131). New cstate: current_term: 1 leader_uuid: "da72947b063c44aab667947ea511f20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:26.958860 29727 consensus_queue.cc:1048] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:26.962623 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267f51cd1b6e442288ecacb0f03a34cc" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:26.965255 29385 leader_election.cc:304] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2959aed377e426c8b0c8813f9325882; no voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e
I20260709 13:22:26.960424 29709 tablet_bootstrap.cc:654] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.966580 29722 raft_consensus.cc:3060] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.968852 29725 leader_election.cc:290] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:26.968442 29708 raft_consensus.cc:359] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.976868 29727 consensus_queue.cc:1048] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:26.977406 29708 raft_consensus.cc:385] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.977707 29708 raft_consensus.cc:740] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.985740 29419 raft_consensus.cc:2468] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 1.
I20260709 13:22:26.962668 29569 raft_consensus.cc:2468] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 1.
I20260709 13:22:26.984230 29708 consensus_queue.cc:260] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.987978 29712 ts_tablet_manager.cc:1434] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e: Time spent starting tablet: real 0.100s	user 0.014s	sys 0.003s
I20260709 13:22:26.987910 29458 leader_election.cc:304] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:26.992405 29723 raft_consensus.cc:2804] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.993099 29723 raft_consensus.cc:697] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Becoming Leader. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:26.994787 29723 consensus_queue.cc:237] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:26.998405 29722 raft_consensus.cc:2749] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:26.998974 29418 raft_consensus.cc:2468] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 1.
I20260709 13:22:26.999689 29722 consensus_queue.cc:1048] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.002287 29532 leader_election.cc:304] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e; no voters: 054e8d248d304857abe43ff0932e80a9
I20260709 13:22:27.005091 29727 raft_consensus.cc:2804] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:27.005752 29727 raft_consensus.cc:697] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Leader. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:27.009822 29727 consensus_queue.cc:237] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.026810 29708 ts_tablet_manager.cc:1434] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.009s
I20260709 13:22:27.030736 29637 consensus_queue.cc:1048] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:22:27.058161 29722 consensus_queue.cc:1048] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:27.059062 29709 tablet_bootstrap.cc:492] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9: No bootstrap required, opened a new log
I20260709 13:22:27.059718 29709 ts_tablet_manager.cc:1403] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9: Time spent bootstrapping tablet: real 0.115s	user 0.003s	sys 0.015s
I20260709 13:22:27.062477 29637 raft_consensus.cc:493] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.063112 29637 raft_consensus.cc:515] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.066738 29420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a46837a9b2f40dab5d88a3867ec15b7" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:27.067379 29420 raft_consensus.cc:2468] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 0.
I20260709 13:22:27.068953 29532 leader_election.cc:304] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:27.070160 29727 raft_consensus.cc:2804] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:27.070676 29637 leader_election.cc:290] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:27.062022 29317 catalog_manager.cc:5697] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 054e8d248d304857abe43ff0932e80a9 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "054e8d248d304857abe43ff0932e80a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.073180 29493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a46837a9b2f40dab5d88a3867ec15b7" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9" is_pre_election: true
I20260709 13:22:27.070704 29727 raft_consensus.cc:493] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:27.081634 29727 raft_consensus.cc:3060] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:27.086498 29534 leader_election.cc:343] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:27.096570 29709 raft_consensus.cc:359] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.100917 29709 raft_consensus.cc:385] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:27.101194 29727 raft_consensus.cc:515] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.105225 29418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a46837a9b2f40dab5d88a3867ec15b7" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:27.105388 29727 leader_election.cc:290] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:27.106050 29418 raft_consensus.cc:3060] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.106928 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a46837a9b2f40dab5d88a3867ec15b7" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:27.101222 29709 raft_consensus.cc:740] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Initialized, Role: FOLLOWER
I20260709 13:22:27.110080 29709 consensus_queue.cc:260] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.110929 29494 raft_consensus.cc:3060] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.113305 29317 catalog_manager.cc:5697] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e reported cstate change: term changed from 0 to 1, leader changed from <none> to da72947b063c44aab667947ea511f20e (127.16.188.131). New cstate: current_term: 1 leader_uuid: "da72947b063c44aab667947ea511f20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:27.116078 29418 raft_consensus.cc:2468] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 1.
I20260709 13:22:27.117682 29532 leader_election.cc:304] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:27.118718 29727 raft_consensus.cc:2804] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:27.119271 29727 raft_consensus.cc:697] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Leader. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:27.120442 29727 consensus_queue.cc:237] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.120363 29494 raft_consensus.cc:2468] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 1.
I20260709 13:22:27.121888 29723 raft_consensus.cc:493] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.122488 29723 raft_consensus.cc:515] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.130203 29723 leader_election.cc:290] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:27.132414 29418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a46837a9b2f40dab5d88a3867ec15b7" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:27.133325 29418 raft_consensus.cc:2468] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 1.
I20260709 13:22:27.133682 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a46837a9b2f40dab5d88a3867ec15b7" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:27.135164 29458 leader_election.cc:304] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:27.138875 29723 raft_consensus.cc:2804] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:22:27.139318 29723 raft_consensus.cc:493] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:27.139643 29723 raft_consensus.cc:3060] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.154696 29318 catalog_manager.cc:5697] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e reported cstate change: term changed from 0 to 1, leader changed from <none> to da72947b063c44aab667947ea511f20e (127.16.188.131). New cstate: current_term: 1 leader_uuid: "da72947b063c44aab667947ea511f20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:27.168761 29637 consensus_queue.cc:1048] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:27.169909 29709 ts_tablet_manager.cc:1434] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9: Time spent starting tablet: real 0.110s	user 0.010s	sys 0.002s
I20260709 13:22:27.167496 29723 raft_consensus.cc:515] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.182013 29658 raft_consensus.cc:493] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.182699 29658 raft_consensus.cc:515] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.185178 29637 consensus_queue.cc:1048] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:27.186173 29418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "568ec73b39774d83939ce165a44ae8dd" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882" is_pre_election: true
I20260709 13:22:27.187021 29418 raft_consensus.cc:2393] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 054e8d248d304857abe43ff0932e80a9 in current term 1: Already voted for candidate da72947b063c44aab667947ea511f20e in this term.
I20260709 13:22:27.187142 29723 leader_election.cc:290] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:27.188035 29417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a46837a9b2f40dab5d88a3867ec15b7" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:27.188777 29417 raft_consensus.cc:3060] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.185539 29658 leader_election.cc:290] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:27.190999 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a46837a9b2f40dab5d88a3867ec15b7" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:27.198943 29417 raft_consensus.cc:2468] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 2.
I20260709 13:22:27.200876 29723 consensus_queue.cc:1048] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:27.201964 29458 leader_election.cc:304] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: da72947b063c44aab667947ea511f20e
I20260709 13:22:27.205510 29658 raft_consensus.cc:2804] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:27.206038 29658 raft_consensus.cc:697] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Becoming Leader. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:27.206822 29658 consensus_queue.cc:237] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.197249 29569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "568ec73b39774d83939ce165a44ae8dd" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da72947b063c44aab667947ea511f20e" is_pre_election: true
I20260709 13:22:27.211988 29460 leader_election.cc:304] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9; no voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e
I20260709 13:22:27.213179 29723 raft_consensus.cc:3060] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.220480 29727 consensus_queue.cc:1048] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:27.223476 29723 raft_consensus.cc:2749] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:27.243525 29317 catalog_manager.cc:5697] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 reported cstate change: term changed from 1 to 2, leader changed from da72947b063c44aab667947ea511f20e (127.16.188.131) to 054e8d248d304857abe43ff0932e80a9 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "054e8d248d304857abe43ff0932e80a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.245854 29774 consensus_queue.cc:1048] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:27.282145 29711 consensus_queue.cc:1048] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.295928 29727 consensus_queue.cc:1048] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.405011 29727 consensus_queue.cc:1048] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.405061 29494 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc2cd5e2643243eaa72ce365f08babb3"
dest_uuid: "054e8d248d304857abe43ff0932e80a9"
mode: GRACEFUL
new_leader_uuid: "d2959aed377e426c8b0c8813f9325882"
 from {username='slave'} at 127.0.0.1:54024
I20260709 13:22:27.405956 29494 raft_consensus.cc:606] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Received request to transfer leadership to TS d2959aed377e426c8b0c8813f9325882
I20260709 13:22:27.412029 29569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9caf458a253c43bfb793a09b7e3d1460"
dest_uuid: "da72947b063c44aab667947ea511f20e"
mode: GRACEFUL
new_leader_uuid: "d2959aed377e426c8b0c8813f9325882"
 from {username='slave'} at 127.0.0.1:35052
I20260709 13:22:27.412711 29569 raft_consensus.cc:606] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Received request to transfer leadership to TS d2959aed377e426c8b0c8813f9325882
I20260709 13:22:27.419195 29637 consensus_queue.cc:1048] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.419997 29569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a273d1f2c1e4e498b66768eec24cbb9"
dest_uuid: "da72947b063c44aab667947ea511f20e"
mode: GRACEFUL
new_leader_uuid: "d2959aed377e426c8b0c8813f9325882"
 from {username='slave'} at 127.0.0.1:35052
I20260709 13:22:27.424008 29569 raft_consensus.cc:606] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Received request to transfer leadership to TS d2959aed377e426c8b0c8813f9325882
I20260709 13:22:27.428648 29637 raft_consensus.cc:993] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e: : Instructing follower d2959aed377e426c8b0c8813f9325882 to start an election
I20260709 13:22:27.429243 29727 raft_consensus.cc:1081] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Signalling peer d2959aed377e426c8b0c8813f9325882 to start an election
I20260709 13:22:27.430995 29419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9caf458a253c43bfb793a09b7e3d1460"
dest_uuid: "d2959aed377e426c8b0c8813f9325882"
 from {username='slave'} at 127.0.0.1:58274
I20260709 13:22:27.431617 29419 raft_consensus.cc:493] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:27.432058 29419 raft_consensus.cc:3060] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.435243 29569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "267f51cd1b6e442288ecacb0f03a34cc"
dest_uuid: "da72947b063c44aab667947ea511f20e"
mode: GRACEFUL
new_leader_uuid: "054e8d248d304857abe43ff0932e80a9"
 from {username='slave'} at 127.0.0.1:35052
I20260709 13:22:27.435858 29569 raft_consensus.cc:606] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Received request to transfer leadership to TS 054e8d248d304857abe43ff0932e80a9
I20260709 13:22:27.440500 29419 raft_consensus.cc:515] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.442900 29419 leader_election.cc:290] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 2 election: Requested vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:27.444463 29569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caf458a253c43bfb793a09b7e3d1460" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:27.445075 29569 raft_consensus.cc:3055] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:27.444859 29568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "905a34cce1bc4198ac6625668f700e68"
dest_uuid: "da72947b063c44aab667947ea511f20e"
mode: GRACEFUL
new_leader_uuid: "054e8d248d304857abe43ff0932e80a9"
 from {username='slave'} at 127.0.0.1:35052
I20260709 13:22:27.445398 29569 raft_consensus.cc:740] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:27.445631 29568 raft_consensus.cc:606] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Received request to transfer leadership to TS 054e8d248d304857abe43ff0932e80a9
I20260709 13:22:27.446403 29569 consensus_queue.cc:260] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.447639 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caf458a253c43bfb793a09b7e3d1460" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:27.447947 29569 raft_consensus.cc:3060] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.448304 29494 raft_consensus.cc:3060] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.453088 29569 raft_consensus.cc:2468] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 2.
I20260709 13:22:27.454377 29385 leader_election.cc:304] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:27.455120 29494 raft_consensus.cc:2468] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 2.
I20260709 13:22:27.455366 29757 raft_consensus.cc:2804] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:27.456012 29757 raft_consensus.cc:697] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [term 2 LEADER]: Becoming Leader. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Running, Role: LEADER
I20260709 13:22:27.456008 29569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "568ec73b39774d83939ce165a44ae8dd"
dest_uuid: "da72947b063c44aab667947ea511f20e"
mode: GRACEFUL
new_leader_uuid: "054e8d248d304857abe43ff0932e80a9"
 from {username='slave'} at 127.0.0.1:35052
I20260709 13:22:27.456677 29569 raft_consensus.cc:606] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Received request to transfer leadership to TS 054e8d248d304857abe43ff0932e80a9
I20260709 13:22:27.457021 29757 consensus_queue.cc:237] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.461874 29494 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d358e9d6a5884b0c89a8f9cdbceea9ba"
dest_uuid: "054e8d248d304857abe43ff0932e80a9"
mode: GRACEFUL
new_leader_uuid: "da72947b063c44aab667947ea511f20e"
 from {username='slave'} at 127.0.0.1:54024
I20260709 13:22:27.462431 29494 raft_consensus.cc:606] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Received request to transfer leadership to TS da72947b063c44aab667947ea511f20e
I20260709 13:22:27.464298 29317 catalog_manager.cc:5697] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 reported cstate change: term changed from 1 to 2, leader changed from da72947b063c44aab667947ea511f20e (127.16.188.131) to d2959aed377e426c8b0c8813f9325882 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "d2959aed377e426c8b0c8813f9325882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.506533 29774 consensus_queue.cc:1048] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.515192 29658 raft_consensus.cc:993] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9: : Instructing follower da72947b063c44aab667947ea511f20e to start an election
I20260709 13:22:27.515573 29723 consensus_queue.cc:1048] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.515869 29750 raft_consensus.cc:1081] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Signalling peer da72947b063c44aab667947ea511f20e to start an election
I20260709 13:22:27.521723 29569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d358e9d6a5884b0c89a8f9cdbceea9ba"
dest_uuid: "da72947b063c44aab667947ea511f20e"
 from {username='slave'} at 127.0.0.1:51436
I20260709 13:22:27.523926 29569 raft_consensus.cc:493] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:27.524279 29569 raft_consensus.cc:3060] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.534339 29569 raft_consensus.cc:515] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.536798 29569 leader_election.cc:290] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 2 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:27.538240 29419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d358e9d6a5884b0c89a8f9cdbceea9ba" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:27.539032 29419 raft_consensus.cc:3060] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.539194 29494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d358e9d6a5884b0c89a8f9cdbceea9ba" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:27.539927 29494 raft_consensus.cc:3055] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:27.540194 29494 raft_consensus.cc:740] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:27.540979 29494 consensus_queue.cc:260] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.541898 29494 raft_consensus.cc:3060] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.547623 29494 raft_consensus.cc:2468] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 2.
I20260709 13:22:27.548038 29419 raft_consensus.cc:2468] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 2.
I20260709 13:22:27.548961 29534 leader_election.cc:304] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:27.549962 29727 raft_consensus.cc:2804] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:27.550366 29727 raft_consensus.cc:697] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [term 2 LEADER]: Becoming Leader. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:27.551070 29727 consensus_queue.cc:237] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.557464 29317 catalog_manager.cc:5697] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e reported cstate change: term changed from 1 to 2, leader changed from 054e8d248d304857abe43ff0932e80a9 (127.16.188.130) to da72947b063c44aab667947ea511f20e (127.16.188.131). New cstate: current_term: 2 leader_uuid: "da72947b063c44aab667947ea511f20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:27.610998 29419 raft_consensus.cc:1240] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Rejecting Update request from peer da72947b063c44aab667947ea511f20e for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:27.612426 29727 consensus_queue.cc:1059] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.613234 29637 raft_consensus.cc:3055] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:27.613516 29637 raft_consensus.cc:740] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:27.614199 29637 consensus_queue.cc:260] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.615094 29637 raft_consensus.cc:3060] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.633723 29569 raft_consensus.cc:1275] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Refusing update from remote peer 054e8d248d304857abe43ff0932e80a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:22:27.633936 29768 raft_consensus.cc:993] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e: : Instructing follower d2959aed377e426c8b0c8813f9325882 to start an election
I20260709 13:22:27.634117 29569 pending_rounds.cc:85] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e: Aborting all ops after (but not including) 0
I20260709 13:22:27.634775 29569 pending_rounds.cc:107] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:22:27.634845 29637 raft_consensus.cc:1081] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Signalling peer d2959aed377e426c8b0c8813f9325882 to start an election
I20260709 13:22:27.635111 29569 raft_consensus.cc:2889] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:22:27.636762 29419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a273d1f2c1e4e498b66768eec24cbb9"
dest_uuid: "d2959aed377e426c8b0c8813f9325882"
 from {username='slave'} at 127.0.0.1:58274
I20260709 13:22:27.636708 29774 consensus_queue.cc:1048] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:27.637571 29419 raft_consensus.cc:493] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:27.638051 29419 raft_consensus.cc:3060] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.645539 29419 raft_consensus.cc:515] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.648429 29493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a273d1f2c1e4e498b66768eec24cbb9" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:27.649053 29493 raft_consensus.cc:3060] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.652767 29418 raft_consensus.cc:1275] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Refusing update from remote peer 054e8d248d304857abe43ff0932e80a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:22:27.655601 29750 consensus_queue.cc:1048] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.656193 29723 raft_consensus.cc:993] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9: : Instructing follower d2959aed377e426c8b0c8813f9325882 to start an election
I20260709 13:22:27.656723 29723 raft_consensus.cc:1081] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Signalling peer d2959aed377e426c8b0c8813f9325882 to start an election
I20260709 13:22:27.657060 29493 raft_consensus.cc:2468] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 2.
I20260709 13:22:27.658344 29385 leader_election.cc:304] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:27.659192 29722 raft_consensus.cc:2804] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:27.660755 29417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc2cd5e2643243eaa72ce365f08babb3"
dest_uuid: "d2959aed377e426c8b0c8813f9325882"
 from {username='slave'} at 127.0.0.1:58260
I20260709 13:22:27.661463 29417 raft_consensus.cc:493] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:27.662484 29417 raft_consensus.cc:3060] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.664379 29569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a273d1f2c1e4e498b66768eec24cbb9" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:27.665915 29569 raft_consensus.cc:3055] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:27.666675 29569 raft_consensus.cc:740] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:27.667526 29569 consensus_queue.cc:260] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.668627 29722 raft_consensus.cc:697] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [term 2 LEADER]: Becoming Leader. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Running, Role: LEADER
I20260709 13:22:27.669627 29722 consensus_queue.cc:237] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.661444 29419 leader_election.cc:290] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 2 election: Requested vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:27.671880 29417 raft_consensus.cc:515] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.672717 29569 raft_consensus.cc:3060] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.676258 29493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2cd5e2643243eaa72ce365f08babb3" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:27.676923 29493 raft_consensus.cc:3055] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:27.677296 29493 raft_consensus.cc:740] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:27.678186 29417 leader_election.cc:290] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 2 election: Requested vote from peers 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:27.678072 29493 consensus_queue.cc:260] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.679243 29493 raft_consensus.cc:3060] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.680181 29569 raft_consensus.cc:2468] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 2.
I20260709 13:22:27.680578 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc2cd5e2643243eaa72ce365f08babb3" candidate_uuid: "d2959aed377e426c8b0c8813f9325882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:27.680065 29317 catalog_manager.cc:5697] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 reported cstate change: term changed from 1 to 2, leader changed from da72947b063c44aab667947ea511f20e (127.16.188.131) to d2959aed377e426c8b0c8813f9325882 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "d2959aed377e426c8b0c8813f9325882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.681185 29568 raft_consensus.cc:3060] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.688411 29493 raft_consensus.cc:2468] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 2.
I20260709 13:22:27.689148 29568 raft_consensus.cc:2468] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2959aed377e426c8b0c8813f9325882 in term 2.
I20260709 13:22:27.689561 29385 leader_election.cc:304] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:27.690403 29722 raft_consensus.cc:2804] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:27.690905 29722 raft_consensus.cc:697] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 2 LEADER]: Becoming Leader. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Running, Role: LEADER
I20260709 13:22:27.691803 29722 consensus_queue.cc:237] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.699311 29317 catalog_manager.cc:5697] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 reported cstate change: term changed from 1 to 2, leader changed from 054e8d248d304857abe43ff0932e80a9 (127.16.188.130) to d2959aed377e426c8b0c8813f9325882 (127.16.188.129). New cstate: current_term: 2 leader_uuid: "d2959aed377e426c8b0c8813f9325882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.722597 29637 raft_consensus.cc:993] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e: : Instructing follower 054e8d248d304857abe43ff0932e80a9 to start an election
I20260709 13:22:27.723102 29727 raft_consensus.cc:1081] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Signalling peer 054e8d248d304857abe43ff0932e80a9 to start an election
I20260709 13:22:27.724967 29493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "267f51cd1b6e442288ecacb0f03a34cc"
dest_uuid: "054e8d248d304857abe43ff0932e80a9"
 from {username='slave'} at 127.0.0.1:37958
I20260709 13:22:27.725500 29493 raft_consensus.cc:493] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:27.725808 29493 raft_consensus.cc:3060] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.731041 29493 raft_consensus.cc:515] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.732813 29493 leader_election.cc:290] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:27.733915 29417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267f51cd1b6e442288ecacb0f03a34cc" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:27.734091 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267f51cd1b6e442288ecacb0f03a34cc" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:27.734694 29417 raft_consensus.cc:3060] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.734802 29568 raft_consensus.cc:3055] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:27.735318 29568 raft_consensus.cc:740] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:27.736053 29568 consensus_queue.cc:260] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.737305 29568 raft_consensus.cc:3060] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.742120 29417 raft_consensus.cc:2468] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 2.
I20260709 13:22:27.742508 29568 raft_consensus.cc:2468] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 2.
I20260709 13:22:27.743521 29458 leader_election.cc:304] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:27.744333 29658 raft_consensus.cc:2804] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:27.744875 29658 raft_consensus.cc:697] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Becoming Leader. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:27.745576 29658 consensus_queue.cc:237] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.752189 29637 raft_consensus.cc:993] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e: : Instructing follower 054e8d248d304857abe43ff0932e80a9 to start an election
I20260709 13:22:27.752738 29727 raft_consensus.cc:1081] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Signalling peer 054e8d248d304857abe43ff0932e80a9 to start an election
I20260709 13:22:27.752236 29317 catalog_manager.cc:5697] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 reported cstate change: term changed from 1 to 2, leader changed from da72947b063c44aab667947ea511f20e (127.16.188.131) to 054e8d248d304857abe43ff0932e80a9 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "054e8d248d304857abe43ff0932e80a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.754312 29493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "905a34cce1bc4198ac6625668f700e68"
dest_uuid: "054e8d248d304857abe43ff0932e80a9"
 from {username='slave'} at 127.0.0.1:37958
I20260709 13:22:27.754832 29493 raft_consensus.cc:493] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:27.755208 29493 raft_consensus.cc:3060] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.760924 29493 raft_consensus.cc:515] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.762533 29493 leader_election.cc:290] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:27.763389 29417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905a34cce1bc4198ac6625668f700e68" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:27.763716 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "905a34cce1bc4198ac6625668f700e68" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:27.764032 29417 raft_consensus.cc:3060] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.764441 29568 raft_consensus.cc:3055] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:27.764815 29568 raft_consensus.cc:740] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:27.765604 29568 consensus_queue.cc:260] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.766695 29568 raft_consensus.cc:3060] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.769469 29417 raft_consensus.cc:2468] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 2.
I20260709 13:22:27.770529 29458 leader_election.cc:304] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:27.771301 29658 raft_consensus.cc:2804] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:27.771724 29658 raft_consensus.cc:697] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Becoming Leader. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:27.772480 29658 consensus_queue.cc:237] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.773826 29568 raft_consensus.cc:2468] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 2.
I20260709 13:22:27.779843 29317 catalog_manager.cc:5697] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 reported cstate change: term changed from 1 to 2, leader changed from da72947b063c44aab667947ea511f20e (127.16.188.131) to 054e8d248d304857abe43ff0932e80a9 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "054e8d248d304857abe43ff0932e80a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.842816 29637 raft_consensus.cc:993] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e: : Instructing follower 054e8d248d304857abe43ff0932e80a9 to start an election
I20260709 13:22:27.843291 29727 raft_consensus.cc:1081] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Signalling peer 054e8d248d304857abe43ff0932e80a9 to start an election
I20260709 13:22:27.844786 29493 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "568ec73b39774d83939ce165a44ae8dd"
dest_uuid: "054e8d248d304857abe43ff0932e80a9"
 from {username='slave'} at 127.0.0.1:37958
I20260709 13:22:27.845211 29493 raft_consensus.cc:493] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:27.845459 29493 raft_consensus.cc:3060] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.850311 29493 raft_consensus.cc:515] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.851801 29493 leader_election.cc:290] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), da72947b063c44aab667947ea511f20e (127.16.188.131:39371)
I20260709 13:22:27.852991 29417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "568ec73b39774d83939ce165a44ae8dd" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:27.852941 29568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "568ec73b39774d83939ce165a44ae8dd" candidate_uuid: "054e8d248d304857abe43ff0932e80a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da72947b063c44aab667947ea511f20e"
I20260709 13:22:27.854010 29417 raft_consensus.cc:3060] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.854058 29568 raft_consensus.cc:3055] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:27.854674 29568 raft_consensus.cc:740] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:27.855360 29568 consensus_queue.cc:260] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.856307 29568 raft_consensus.cc:3060] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.860605 29417 raft_consensus.cc:2468] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 2.
I20260709 13:22:27.861086 29568 raft_consensus.cc:2468] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 054e8d248d304857abe43ff0932e80a9 in term 2.
I20260709 13:22:27.861991 29458 leader_election.cc:304] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, d2959aed377e426c8b0c8813f9325882; no voters: 
I20260709 13:22:27.862895 29658 raft_consensus.cc:2804] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:27.863502 29658 raft_consensus.cc:697] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Becoming Leader. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:27.864289 29658 consensus_queue.cc:237] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:27.870718 29317 catalog_manager.cc:5697] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 reported cstate change: term changed from 1 to 2, leader changed from da72947b063c44aab667947ea511f20e (127.16.188.131) to 054e8d248d304857abe43ff0932e80a9 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "054e8d248d304857abe43ff0932e80a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.944502 29568 raft_consensus.cc:1275] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Refusing update from remote peer d2959aed377e426c8b0c8813f9325882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.945997 29722 consensus_queue.cc:1048] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:27.954831 29493 raft_consensus.cc:1275] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Refusing update from remote peer da72947b063c44aab667947ea511f20e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.955905 29495 raft_consensus.cc:1275] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Refusing update from remote peer d2959aed377e426c8b0c8813f9325882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.956991 29727 consensus_queue.cc:1048] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:27.957715 29757 consensus_queue.cc:1048] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:27.967437 29417 raft_consensus.cc:1275] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Refusing update from remote peer da72947b063c44aab667947ea511f20e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.969377 29727 consensus_queue.cc:1048] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:28.075053 29493 raft_consensus.cc:1275] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Refusing update from remote peer d2959aed377e426c8b0c8813f9325882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.076967 29757 consensus_queue.cc:1048] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:28.087548 29568 raft_consensus.cc:1275] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Refusing update from remote peer d2959aed377e426c8b0c8813f9325882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.089187 29757 consensus_queue.cc:1048] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:28.118268 29493 raft_consensus.cc:1275] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Refusing update from remote peer d2959aed377e426c8b0c8813f9325882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.119498 29782 consensus_queue.cc:1048] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:28.131750 29569 raft_consensus.cc:1275] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Refusing update from remote peer d2959aed377e426c8b0c8813f9325882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.133529 29782 consensus_queue.cc:1048] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:28.189227 29417 raft_consensus.cc:1275] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Refusing update from remote peer 054e8d248d304857abe43ff0932e80a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.190685 29658 consensus_queue.cc:1048] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:28.201095 29569 raft_consensus.cc:1275] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Refusing update from remote peer 054e8d248d304857abe43ff0932e80a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.204278 29785 consensus_queue.cc:1048] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:28.266285 29417 raft_consensus.cc:1275] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Refusing update from remote peer 054e8d248d304857abe43ff0932e80a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.267907 29658 consensus_queue.cc:1048] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:28.277853 29569 raft_consensus.cc:1275] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Refusing update from remote peer 054e8d248d304857abe43ff0932e80a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.279367 29785 consensus_queue.cc:1048] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:28.354501 29568 raft_consensus.cc:1275] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Refusing update from remote peer 054e8d248d304857abe43ff0932e80a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.355916 29785 consensus_queue.cc:1048] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:28.364689 29417 raft_consensus.cc:1275] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Refusing update from remote peer 054e8d248d304857abe43ff0932e80a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:28.366520 29658 consensus_queue.cc:1048] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:30.466550 29318 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33288:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:22:30.491461 29318 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33288:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:22:30.562654 17138 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:22:30.729347 29832 tablet.cc:1724] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:30.750860 29458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:40337, user_credentials={real_user=slave}} blocked reactor thread for 48574.1us
I20260709 13:22:30.851814 29844 tablet.cc:1724] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:30.875202 29446 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:353d27470b534d2ea0a1f09745a64fd7)
I20260709 13:22:30.892979 29832 tablet.cc:1724] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.955282 29848 tablet.cc:1724] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.956722 29853 tablet.cc:1724] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.961177 29851 tablet.cc:1724] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:30.958921 29850 log.cc:927] Time spent T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:22:30.963850 29493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "267f51cd1b6e442288ecacb0f03a34cc"
dest_uuid: "054e8d248d304857abe43ff0932e80a9"
mode: GRACEFUL
new_leader_uuid: "da72947b063c44aab667947ea511f20e"
 from {username='slave'} at 127.0.0.1:54032
I20260709 13:22:30.964793 29493 raft_consensus.cc:606] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Received request to transfer leadership to TS da72947b063c44aab667947ea511f20e
W20260709 13:22:30.983073 29846 log.cc:927] Time spent T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.004s
W20260709 13:22:30.984323 29446 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:353d27470b534d2ea0a1f09745a64fd7)
W20260709 13:22:30.985291 29446 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:353d27470b534d2ea0a1f09745a64fd7)
I20260709 13:22:30.997985 29855 tablet.cc:1724] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.998677 29832 tablet.cc:1724] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.021425 29859 tablet.cc:1724] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.026527 29856 tablet.cc:1724] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.034895 29858 tablet.cc:1724] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.037114 29864 tablet.cc:1724] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.055441 29844 tablet.cc:1724] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.073868 29860 tablet.cc:1724] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.076964 29861 tablet.cc:1724] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.066910 29856 tablet.cc:1724] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.084053 29855 tablet.cc:1724] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.090952 29860 tablet.cc:1724] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.097479 29864 tablet.cc:1724] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.107686 29419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "353d27470b534d2ea0a1f09745a64fd7"
dest_uuid: "d2959aed377e426c8b0c8813f9325882"
mode: GRACEFUL
new_leader_uuid: "da72947b063c44aab667947ea511f20e"
 from {username='slave'} at 127.0.0.1:33804
I20260709 13:22:31.113039 29419 raft_consensus.cc:606] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Received request to transfer leadership to TS da72947b063c44aab667947ea511f20e
I20260709 13:22:31.121321 29860 tablet.cc:1724] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.126659 29851 tablet.cc:1724] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.133508 29848 tablet.cc:1724] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.136813 29864 tablet.cc:1724] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.138245 17138 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:22:31.144318 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:31.157526 29419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d13221006ac4ca1b5b47dc6f8a13276"
dest_uuid: "d2959aed377e426c8b0c8813f9325882"
mode: GRACEFUL
new_leader_uuid: "da72947b063c44aab667947ea511f20e"
 from {username='slave'} at 127.0.0.1:33804
I20260709 13:22:31.158150 29419 raft_consensus.cc:606] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 2 LEADER]: Received request to transfer leadership to TS da72947b063c44aab667947ea511f20e
W20260709 13:22:31.168951 29458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:40337, user_credentials={real_user=slave}} blocked reactor thread for 380963us
I20260709 13:22:31.177520 29858 tablet.cc:1724] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.186391 29490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49f1115f7b8a4576b43f65ff2b245ac7"
dest_uuid: "054e8d248d304857abe43ff0932e80a9"
mode: GRACEFUL
new_leader_uuid: "da72947b063c44aab667947ea511f20e"
 from {username='slave'} at 127.0.0.1:54032
I20260709 13:22:31.187252 29490 raft_consensus.cc:606] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Received request to transfer leadership to TS da72947b063c44aab667947ea511f20e
I20260709 13:22:31.190419 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:31.191130 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:31.204694 29858 tablet.cc:1724] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.206569 29859 tablet.cc:1724] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.218267 29853 tablet.cc:1724] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:31.239372 29314 catalog_manager.cc:6242] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b: soft_deleted_table [id=b35afc364480408394d343e0d12aa296] alter complete (version 1)
I20260709 13:22:31.290863 29862 raft_consensus.cc:993] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9: : Instructing follower da72947b063c44aab667947ea511f20e to start an election
I20260709 13:22:31.291384 29785 raft_consensus.cc:1081] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Signalling peer da72947b063c44aab667947ea511f20e to start an election
I20260709 13:22:31.293308 29565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "267f51cd1b6e442288ecacb0f03a34cc"
dest_uuid: "da72947b063c44aab667947ea511f20e"
 from {username='slave'} at 127.0.0.1:51436
I20260709 13:22:31.293815 29565 raft_consensus.cc:493] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:31.294193 29565 raft_consensus.cc:3060] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:31.299559 29565 raft_consensus.cc:515] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:31.301201 29565 leader_election.cc:290] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 3 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:31.302313 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267f51cd1b6e442288ecacb0f03a34cc" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:31.302325 29418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267f51cd1b6e442288ecacb0f03a34cc" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:31.302968 29490 raft_consensus.cc:3055] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:31.303356 29418 raft_consensus.cc:3060] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:31.303388 29490 raft_consensus.cc:740] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:31.305209 29490 consensus_queue.cc:260] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:31.306595 29490 raft_consensus.cc:3060] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:31.313169 29490 raft_consensus.cc:2468] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 3.
I20260709 13:22:31.314327 29534 leader_election.cc:304] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:31.315146 29845 raft_consensus.cc:2804] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:31.315533 29418 raft_consensus.cc:2468] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 3.
I20260709 13:22:31.315577 29845 raft_consensus.cc:697] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 3 LEADER]: Becoming Leader. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:31.316921 29845 consensus_queue.cc:237] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:31.323448 29862 raft_consensus.cc:993] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9: : Instructing follower da72947b063c44aab667947ea511f20e to start an election
I20260709 13:22:31.323966 29785 raft_consensus.cc:1081] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Signalling peer da72947b063c44aab667947ea511f20e to start an election
I20260709 13:22:31.325816 29565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49f1115f7b8a4576b43f65ff2b245ac7"
dest_uuid: "da72947b063c44aab667947ea511f20e"
 from {username='slave'} at 127.0.0.1:51436
I20260709 13:22:31.325654 29318 catalog_manager.cc:5697] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e reported cstate change: term changed from 2 to 3, leader changed from 054e8d248d304857abe43ff0932e80a9 (127.16.188.130) to da72947b063c44aab667947ea511f20e (127.16.188.131). New cstate: current_term: 3 leader_uuid: "da72947b063c44aab667947ea511f20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:31.326431 29565 raft_consensus.cc:493] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:31.326941 29565 raft_consensus.cc:3060] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:31.332917 29565 raft_consensus.cc:515] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:31.337634 29418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f1115f7b8a4576b43f65ff2b245ac7" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:31.337801 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49f1115f7b8a4576b43f65ff2b245ac7" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:31.338241 29565 leader_election.cc:290] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 3 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:31.338490 29490 raft_consensus.cc:3055] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:31.339020 29490 raft_consensus.cc:740] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 054e8d248d304857abe43ff0932e80a9, State: Running, Role: LEADER
I20260709 13:22:31.339977 29490 consensus_queue.cc:260] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:31.340814 29418 raft_consensus.cc:3060] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:31.341576 29490 raft_consensus.cc:3060] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:31.345774 29418 raft_consensus.cc:2468] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 3.
I20260709 13:22:31.346935 29532 leader_election.cc:304] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d2959aed377e426c8b0c8813f9325882, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:31.347870 29845 raft_consensus.cc:2804] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:31.349066 29845 raft_consensus.cc:697] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [term 3 LEADER]: Becoming Leader. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:31.349960 29845 consensus_queue.cc:237] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:31.350685 29490 raft_consensus.cc:2468] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 3.
I20260709 13:22:31.360549 29318 catalog_manager.cc:5697] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e reported cstate change: term changed from 2 to 3, leader changed from 054e8d248d304857abe43ff0932e80a9 (127.16.188.130) to da72947b063c44aab667947ea511f20e (127.16.188.131). New cstate: current_term: 3 leader_uuid: "da72947b063c44aab667947ea511f20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:31.418772 29839 raft_consensus.cc:993] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882: : Instructing follower da72947b063c44aab667947ea511f20e to start an election
I20260709 13:22:31.419624 29816 raft_consensus.cc:1081] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Signalling peer da72947b063c44aab667947ea511f20e to start an election
I20260709 13:22:31.421391 29565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "353d27470b534d2ea0a1f09745a64fd7"
dest_uuid: "da72947b063c44aab667947ea511f20e"
 from {username='slave'} at 127.0.0.1:51452
I20260709 13:22:31.422027 29565 raft_consensus.cc:493] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:31.422443 29565 raft_consensus.cc:3060] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:31.431082 29565 raft_consensus.cc:515] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:31.433458 29565 leader_election.cc:290] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 2 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:31.434206 29418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353d27470b534d2ea0a1f09745a64fd7" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:31.434643 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353d27470b534d2ea0a1f09745a64fd7" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:31.435029 29418 raft_consensus.cc:3055] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:31.435302 29490 raft_consensus.cc:3060] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:31.435491 29418 raft_consensus.cc:740] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Running, Role: LEADER
I20260709 13:22:31.436507 29418 consensus_queue.cc:260] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:31.437747 29418 raft_consensus.cc:3060] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:31.444743 29490 raft_consensus.cc:2468] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 2.
I20260709 13:22:31.445561 29418 raft_consensus.cc:2468] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 2.
I20260709 13:22:31.446341 29534 leader_election.cc:304] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:31.447750 29845 raft_consensus.cc:2804] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:31.448343 29845 raft_consensus.cc:697] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [term 2 LEADER]: Becoming Leader. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:31.449473 29845 consensus_queue.cc:237] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:31.457520 29318 catalog_manager.cc:5697] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e reported cstate change: term changed from 1 to 2, leader changed from d2959aed377e426c8b0c8813f9325882 (127.16.188.129) to da72947b063c44aab667947ea511f20e (127.16.188.131). New cstate: current_term: 2 leader_uuid: "da72947b063c44aab667947ea511f20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:31.487578 29839 raft_consensus.cc:993] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882: : Instructing follower da72947b063c44aab667947ea511f20e to start an election
I20260709 13:22:31.488075 29816 raft_consensus.cc:1081] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 2 LEADER]: Signalling peer da72947b063c44aab667947ea511f20e to start an election
I20260709 13:22:31.489661 29565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d13221006ac4ca1b5b47dc6f8a13276"
dest_uuid: "da72947b063c44aab667947ea511f20e"
 from {username='slave'} at 127.0.0.1:51452
I20260709 13:22:31.490479 29565 raft_consensus.cc:493] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:31.490833 29565 raft_consensus.cc:3060] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:31.498687 29565 raft_consensus.cc:515] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:31.500447 29565 leader_election.cc:290] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 3 election: Requested vote from peers d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337), 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759)
I20260709 13:22:31.501734 29418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d13221006ac4ca1b5b47dc6f8a13276" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d2959aed377e426c8b0c8813f9325882"
I20260709 13:22:31.502509 29418 raft_consensus.cc:3055] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:31.502871 29418 raft_consensus.cc:740] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2959aed377e426c8b0c8813f9325882, State: Running, Role: LEADER
I20260709 13:22:31.502872 29490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d13221006ac4ca1b5b47dc6f8a13276" candidate_uuid: "da72947b063c44aab667947ea511f20e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "054e8d248d304857abe43ff0932e80a9"
I20260709 13:22:31.504060 29490 raft_consensus.cc:3060] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:31.504009 29418 consensus_queue.cc:260] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:31.505694 29418 raft_consensus.cc:3060] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:31.511404 29490 raft_consensus.cc:2468] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 3.
I20260709 13:22:31.511812 29418 raft_consensus.cc:2468] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da72947b063c44aab667947ea511f20e in term 3.
I20260709 13:22:31.512910 29534 leader_election.cc:304] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 054e8d248d304857abe43ff0932e80a9, da72947b063c44aab667947ea511f20e; no voters: 
I20260709 13:22:31.513870 29845 raft_consensus.cc:2804] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:31.514310 29845 raft_consensus.cc:697] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 3 LEADER]: Becoming Leader. State: Replica: da72947b063c44aab667947ea511f20e, State: Running, Role: LEADER
I20260709 13:22:31.515094 29845 consensus_queue.cc:237] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } }
I20260709 13:22:31.523808 29318 catalog_manager.cc:5697] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e reported cstate change: term changed from 2 to 3, leader changed from d2959aed377e426c8b0c8813f9325882 (127.16.188.129) to da72947b063c44aab667947ea511f20e (127.16.188.131). New cstate: current_term: 3 leader_uuid: "da72947b063c44aab667947ea511f20e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da72947b063c44aab667947ea511f20e" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 39371 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:31.765169 29418 raft_consensus.cc:1275] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [term 3 FOLLOWER]: Refusing update from remote peer da72947b063c44aab667947ea511f20e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:31.766549 29845 consensus_queue.cc:1048] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:31.779363 29490 raft_consensus.cc:1275] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 3 FOLLOWER]: Refusing update from remote peer da72947b063c44aab667947ea511f20e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:31.783123 29874 consensus_queue.cc:1048] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:31.807989 29490 raft_consensus.cc:1275] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 3 FOLLOWER]: Refusing update from remote peer da72947b063c44aab667947ea511f20e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:31.809343 29874 consensus_queue.cc:1048] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:31.818354 29418 raft_consensus.cc:1275] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 3 FOLLOWER]: Refusing update from remote peer da72947b063c44aab667947ea511f20e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:31.820019 29845 consensus_queue.cc:1048] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:31.942530 29490 raft_consensus.cc:1275] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Refusing update from remote peer da72947b063c44aab667947ea511f20e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:22:31.943940 29637 consensus_queue.cc:1048] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:31.952138 29418 raft_consensus.cc:1275] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Refusing update from remote peer da72947b063c44aab667947ea511f20e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:22:31.954772 29874 consensus_queue.cc:1048] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:32.037038 29490 raft_consensus.cc:1275] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9 [term 3 FOLLOWER]: Refusing update from remote peer da72947b063c44aab667947ea511f20e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:32.038532 29874 consensus_queue.cc:1048] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "054e8d248d304857abe43ff0932e80a9" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 43759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:32.048378 29418 raft_consensus.cc:1275] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 3 FOLLOWER]: Refusing update from remote peer da72947b063c44aab667947ea511f20e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:32.053171 29845 consensus_queue.cc:1048] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2959aed377e426c8b0c8813f9325882" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 40337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:32.255183 17138 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:22:32.261059 17138 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:22:32.261606 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:32.266995 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:22:32.267419 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:33.299731 17138 tablet_server.cc:179] TabletServer@127.16.188.129:0 shutting down...
I20260709 13:22:33.334334 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:33.335253 17138 tablet_replica.cc:333] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.336182 17138 raft_consensus.cc:2243] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.336834 17138 raft_consensus.cc:2272] T 568ec73b39774d83939ce165a44ae8dd P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.339381 17138 tablet_replica.cc:333] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.340035 17138 raft_consensus.cc:2243] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.340588 17138 raft_consensus.cc:2272] T 267f51cd1b6e442288ecacb0f03a34cc P d2959aed377e426c8b0c8813f9325882 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.342729 17138 tablet_replica.cc:333] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.343331 17138 raft_consensus.cc:2243] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.343782 17138 raft_consensus.cc:2272] T 9a46837a9b2f40dab5d88a3867ec15b7 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.345919 17138 tablet_replica.cc:333] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.346524 17138 raft_consensus.cc:2243] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.347349 17138 raft_consensus.cc:2272] T 9a273d1f2c1e4e498b66768eec24cbb9 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.349502 17138 tablet_replica.cc:333] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.350080 17138 raft_consensus.cc:2243] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.350585 17138 raft_consensus.cc:2272] T 49f1115f7b8a4576b43f65ff2b245ac7 P d2959aed377e426c8b0c8813f9325882 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.352727 17138 tablet_replica.cc:333] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.353377 17138 raft_consensus.cc:2243] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.354213 17138 raft_consensus.cc:2272] T fc2cd5e2643243eaa72ce365f08babb3 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.356459 17138 tablet_replica.cc:333] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.357285 17138 raft_consensus.cc:2243] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.358290 17138 raft_consensus.cc:2272] T 8098e9a2d109459cab32b498ae7a8b8d P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.360853 17138 tablet_replica.cc:333] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.361485 17138 raft_consensus.cc:2243] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.361941 17138 raft_consensus.cc:2272] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.364192 17138 tablet_replica.cc:333] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.364889 17138 raft_consensus.cc:2243] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.365331 17138 raft_consensus.cc:2272] T 0d13221006ac4ca1b5b47dc6f8a13276 P d2959aed377e426c8b0c8813f9325882 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.367475 17138 tablet_replica.cc:333] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.368093 17138 raft_consensus.cc:2243] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.369088 17138 raft_consensus.cc:2272] T c0c7581b429a4f698bf7f8f81c3f79cf P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.371520 17138 tablet_replica.cc:333] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.372154 17138 raft_consensus.cc:2243] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.372694 17138 raft_consensus.cc:2272] T 905a34cce1bc4198ac6625668f700e68 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.375000 17138 tablet_replica.cc:333] T 3b64947627d54c43ba226d91efb0ca75 P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.375605 17138 raft_consensus.cc:2243] T 3b64947627d54c43ba226d91efb0ca75 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.376067 17138 raft_consensus.cc:2272] T 3b64947627d54c43ba226d91efb0ca75 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.378607 17138 tablet_replica.cc:333] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.379338 17138 raft_consensus.cc:2243] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.380116 17138 raft_consensus.cc:2272] T 9caf458a253c43bfb793a09b7e3d1460 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.383162 17138 tablet_replica.cc:333] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.383909 17138 raft_consensus.cc:2243] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.384344 17138 raft_consensus.cc:2272] T 353d27470b534d2ea0a1f09745a64fd7 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.386615 17138 tablet_replica.cc:333] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.387280 17138 raft_consensus.cc:2243] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.387850 17138 raft_consensus.cc:2272] T 3026876f8e49428883ab8e897efdd2b1 P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.390960 17138 tablet_replica.cc:333] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.391696 17138 raft_consensus.cc:2243] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.392185 17138 raft_consensus.cc:2272] T daf394c61ea549acbb187857f205babd P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.395004 17138 tablet_replica.cc:333] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.395628 17138 raft_consensus.cc:2243] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.396090 17138 raft_consensus.cc:2272] T d358e9d6a5884b0c89a8f9cdbceea9ba P d2959aed377e426c8b0c8813f9325882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.398743 17138 tablet_replica.cc:333] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882: stopping tablet replica
I20260709 13:22:33.399278 17138 raft_consensus.cc:2243] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.400446 17138 raft_consensus.cc:2272] T c09cf65638344fc89ed3c6a445886ab4 P d2959aed377e426c8b0c8813f9325882 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:33.408317 29532 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 49 similar messages]
W20260709 13:22:33.411720 29532 consensus_peers.cc:597] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e -> Peer d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337): Couldn't send request to peer d2959aed377e426c8b0c8813f9325882. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:33.445819 17138 tablet_server.cc:196] TabletServer@127.16.188.129:0 shutdown complete.
I20260709 13:22:33.486894 17138 tablet_server.cc:179] TabletServer@127.16.188.130:0 shutting down...
W20260709 13:22:33.492657 29458 consensus_peers.cc:597] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 -> Peer d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337): Couldn't send request to peer d2959aed377e426c8b0c8813f9325882. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:40337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:33.508579 29458 consensus_peers.cc:597] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 -> Peer d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337): Couldn't send request to peer d2959aed377e426c8b0c8813f9325882. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:40337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:33.509106 29458 consensus_peers.cc:597] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 -> Peer d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337): Couldn't send request to peer d2959aed377e426c8b0c8813f9325882. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:40337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:33.526588 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:22:33.526754 29532 consensus_peers.cc:597] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e -> Peer d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337): Couldn't send request to peer d2959aed377e426c8b0c8813f9325882. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:40337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:33.527791 17138 tablet_replica.cc:333] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.528839 17138 raft_consensus.cc:2243] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.529431 17138 raft_consensus.cc:2272] T fc2cd5e2643243eaa72ce365f08babb3 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.531936 17138 tablet_replica.cc:333] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.532688 17138 raft_consensus.cc:2243] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.533574 17138 raft_consensus.cc:2272] T 9a46837a9b2f40dab5d88a3867ec15b7 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.535818 17138 tablet_replica.cc:333] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.536463 17138 raft_consensus.cc:2243] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.537009 17138 raft_consensus.cc:2272] T 9a273d1f2c1e4e498b66768eec24cbb9 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.539312 17138 tablet_replica.cc:333] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.539899 17138 raft_consensus.cc:2243] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.540350 17138 raft_consensus.cc:2272] T 49f1115f7b8a4576b43f65ff2b245ac7 P 054e8d248d304857abe43ff0932e80a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.542520 17138 tablet_replica.cc:333] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.543073 17138 raft_consensus.cc:2243] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.544003 17138 raft_consensus.cc:2272] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.546519 17138 tablet_replica.cc:333] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.547138 17138 raft_consensus.cc:2243] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.547616 17138 raft_consensus.cc:2272] T d358e9d6a5884b0c89a8f9cdbceea9ba P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.549755 17138 tablet_replica.cc:333] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.550405 17138 raft_consensus.cc:2243] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.550841 17138 raft_consensus.cc:2272] T c09cf65638344fc89ed3c6a445886ab4 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.553483 17138 tablet_replica.cc:333] T 8098e9a2d109459cab32b498ae7a8b8d P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.554195 17138 raft_consensus.cc:2243] T 8098e9a2d109459cab32b498ae7a8b8d P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.554785 17138 raft_consensus.cc:2272] T 8098e9a2d109459cab32b498ae7a8b8d P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.557900 17138 tablet_replica.cc:333] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
W20260709 13:22:33.558210 29532 consensus_peers.cc:597] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e -> Peer d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337): Couldn't send request to peer d2959aed377e426c8b0c8813f9325882. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:40337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:33.558679 17138 raft_consensus.cc:2243] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.559221 17138 raft_consensus.cc:2272] T 9caf458a253c43bfb793a09b7e3d1460 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.561415 17138 tablet_replica.cc:333] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.562009 17138 raft_consensus.cc:2243] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.562884 17138 raft_consensus.cc:2272] T 3026876f8e49428883ab8e897efdd2b1 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.565235 17138 tablet_replica.cc:333] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.565881 17138 raft_consensus.cc:2243] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.566464 17138 raft_consensus.cc:2272] T 353d27470b534d2ea0a1f09745a64fd7 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.569108 17138 tablet_replica.cc:333] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.569794 17138 raft_consensus.cc:2243] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.570783 17138 raft_consensus.cc:2272] T daf394c61ea549acbb187857f205babd P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:33.572382 29532 consensus_peers.cc:597] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e -> Peer d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337): Couldn't send request to peer d2959aed377e426c8b0c8813f9325882. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:40337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:33.573335 17138 tablet_replica.cc:333] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.574064 17138 raft_consensus.cc:2243] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.575042 17138 raft_consensus.cc:2272] T 568ec73b39774d83939ce165a44ae8dd P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.577227 17138 tablet_replica.cc:333] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.577806 17138 raft_consensus.cc:2243] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.578238 17138 raft_consensus.cc:2272] T 267f51cd1b6e442288ecacb0f03a34cc P 054e8d248d304857abe43ff0932e80a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.580473 17138 tablet_replica.cc:333] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.581178 17138 raft_consensus.cc:2243] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.581681 17138 raft_consensus.cc:2272] T 0d13221006ac4ca1b5b47dc6f8a13276 P 054e8d248d304857abe43ff0932e80a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.583992 17138 tablet_replica.cc:333] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.584717 17138 raft_consensus.cc:2243] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.585680 17138 raft_consensus.cc:2272] T 905a34cce1bc4198ac6625668f700e68 P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:33.587078 29534 consensus_peers.cc:597] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e -> Peer 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759): Couldn't send request to peer 054e8d248d304857abe43ff0932e80a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:33.588176 17138 tablet_replica.cc:333] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.589005 17138 raft_consensus.cc:2243] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.589517 17138 raft_consensus.cc:2272] T 3b64947627d54c43ba226d91efb0ca75 P 054e8d248d304857abe43ff0932e80a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.591943 17138 tablet_replica.cc:333] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9: stopping tablet replica
I20260709 13:22:33.592694 17138 raft_consensus.cc:2243] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.593165 17138 raft_consensus.cc:2272] T c0c7581b429a4f698bf7f8f81c3f79cf P 054e8d248d304857abe43ff0932e80a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.628857 17138 tablet_server.cc:196] TabletServer@127.16.188.130:0 shutdown complete.
W20260709 13:22:33.632445 29534 consensus_peers.cc:597] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e -> Peer 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759): Couldn't send request to peer 054e8d248d304857abe43ff0932e80a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:43759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:33.634269 29532 consensus_peers.cc:597] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e -> Peer d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337): Couldn't send request to peer d2959aed377e426c8b0c8813f9325882. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:40337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:33.634868 29532 consensus_peers.cc:597] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e -> Peer d2959aed377e426c8b0c8813f9325882 (127.16.188.129:40337): Couldn't send request to peer d2959aed377e426c8b0c8813f9325882. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:40337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:33.663908 17138 tablet_server.cc:179] TabletServer@127.16.188.131:0 shutting down...
W20260709 13:22:33.686414 29534 consensus_peers.cc:597] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e -> Peer 054e8d248d304857abe43ff0932e80a9 (127.16.188.130:43759): Couldn't send request to peer 054e8d248d304857abe43ff0932e80a9. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:43759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:33.711608 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:33.712597 17138 tablet_replica.cc:333] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.713248 17138 raft_consensus.cc:2243] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.713747 17138 raft_consensus.cc:2272] T fc2cd5e2643243eaa72ce365f08babb3 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.715682 17138 tablet_replica.cc:333] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.716269 17138 raft_consensus.cc:2243] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.716753 17138 raft_consensus.cc:2272] T 9a46837a9b2f40dab5d88a3867ec15b7 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.718575 17138 tablet_replica.cc:333] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.719097 17138 raft_consensus.cc:2243] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.719525 17138 raft_consensus.cc:2272] T 9a273d1f2c1e4e498b66768eec24cbb9 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.721457 17138 tablet_replica.cc:333] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.722000 17138 raft_consensus.cc:2243] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.722749 17138 raft_consensus.cc:2272] T 353d27470b534d2ea0a1f09745a64fd7 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.724645 17138 tablet_replica.cc:333] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.725175 17138 raft_consensus.cc:2243] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.725647 17138 raft_consensus.cc:2272] T 3026876f8e49428883ab8e897efdd2b1 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.727561 17138 tablet_replica.cc:333] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.728088 17138 raft_consensus.cc:2243] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.728503 17138 raft_consensus.cc:2272] T 9caf458a253c43bfb793a09b7e3d1460 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.730401 17138 tablet_replica.cc:333] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.730916 17138 raft_consensus.cc:2243] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.731654 17138 raft_consensus.cc:2272] T 49f1115f7b8a4576b43f65ff2b245ac7 P da72947b063c44aab667947ea511f20e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.733630 17138 tablet_replica.cc:333] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.734375 17138 raft_consensus.cc:2243] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.734874 17138 raft_consensus.cc:2272] T c0c7581b429a4f698bf7f8f81c3f79cf P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.736814 17138 tablet_replica.cc:333] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.737354 17138 raft_consensus.cc:2243] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.737792 17138 raft_consensus.cc:2272] T 905a34cce1bc4198ac6625668f700e68 P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.739584 17138 tablet_replica.cc:333] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.740083 17138 raft_consensus.cc:2243] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.740896 17138 raft_consensus.cc:2272] T 3b64947627d54c43ba226d91efb0ca75 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.742753 17138 tablet_replica.cc:333] T 8098e9a2d109459cab32b498ae7a8b8d P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.743269 17138 raft_consensus.cc:2243] T 8098e9a2d109459cab32b498ae7a8b8d P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.743695 17138 raft_consensus.cc:2272] T 8098e9a2d109459cab32b498ae7a8b8d P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.745569 17138 tablet_replica.cc:333] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.746068 17138 raft_consensus.cc:2243] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.746495 17138 raft_consensus.cc:2272] T 568ec73b39774d83939ce165a44ae8dd P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.748258 17138 tablet_replica.cc:333] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.748782 17138 raft_consensus.cc:2243] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.749521 17138 raft_consensus.cc:2272] T 267f51cd1b6e442288ecacb0f03a34cc P da72947b063c44aab667947ea511f20e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.751390 17138 tablet_replica.cc:333] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.751896 17138 raft_consensus.cc:2243] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.752664 17138 raft_consensus.cc:2272] T 0d13221006ac4ca1b5b47dc6f8a13276 P da72947b063c44aab667947ea511f20e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.754467 17138 tablet_replica.cc:333] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.754946 17138 raft_consensus.cc:2243] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.755388 17138 raft_consensus.cc:2272] T 9feb6b9b5ae14bb492a4df2c788cdbb7 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.757440 17138 tablet_replica.cc:333] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.757925 17138 raft_consensus.cc:2243] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.758350 17138 raft_consensus.cc:2272] T daf394c61ea549acbb187857f205babd P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.760222 17138 tablet_replica.cc:333] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.760921 17138 raft_consensus.cc:2243] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.761637 17138 raft_consensus.cc:2272] T d358e9d6a5884b0c89a8f9cdbceea9ba P da72947b063c44aab667947ea511f20e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.763384 17138 tablet_replica.cc:333] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e: stopping tablet replica
I20260709 13:22:33.763819 17138 raft_consensus.cc:2243] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:33.764237 17138 raft_consensus.cc:2272] T c09cf65638344fc89ed3c6a445886ab4 P da72947b063c44aab667947ea511f20e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.805981 17138 tablet_server.cc:196] TabletServer@127.16.188.131:0 shutdown complete.
I20260709 13:22:33.838829 17138 master.cc:562] Master@127.16.188.190:46177 shutting down...
I20260709 13:22:33.878669 17138 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:33.879252 17138 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:33.879585 17138 tablet_replica.cc:333] T 00000000000000000000000000000000 P d4f65238d610429b851aa9f74040dc9b: stopping tablet replica
I20260709 13:22:33.900219 17138 master.cc:584] Master@127.16.188.190:46177 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12917 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:22:33.959470 17138 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.188.190:45163
I20260709 13:22:33.961000 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:33.967731 29891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:33.967767 29889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:33.967736 29888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:33.969233 17138 server_base.cc:1061] running on GCE node
I20260709 13:22:33.970242 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:33.970449 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:33.970630 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603353970614 us; error 0 us; skew 500 ppm
I20260709 13:22:33.971251 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:33.973950 17138 webserver.cc:533] Webserver started at http://127.16.188.190:46665/ using document root <none> and password file <none>
I20260709 13:22:33.974510 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:33.974707 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:33.975018 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:33.976408 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/master-0-root/instance:
uuid: "5f3f49f73f1c4080bda28e17f0d74978"
format_stamp: "Formatted at 2026-07-09 13:22:33 on dist-test-slave-2hqk"
I20260709 13:22:33.981280 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:33.984802 29896 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:33.985592 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:22:33.985904 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/master-0-root
uuid: "5f3f49f73f1c4080bda28e17f0d74978"
format_stamp: "Formatted at 2026-07-09 13:22:33 on dist-test-slave-2hqk"
I20260709 13:22:33.986199 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:34.010504 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:34.011906 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:34.056164 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.190:45163
I20260709 13:22:34.056299 29947 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.190:45163 every 8 connection(s)
I20260709 13:22:34.060564 29948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.070760 29948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978: Bootstrap starting.
I20260709 13:22:34.075453 29948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:34.080502 29948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978: No bootstrap required, opened a new log
I20260709 13:22:34.082762 29948 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3f49f73f1c4080bda28e17f0d74978" member_type: VOTER }
I20260709 13:22:34.083300 29948 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:34.083544 29948 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3f49f73f1c4080bda28e17f0d74978, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.084206 29948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3f49f73f1c4080bda28e17f0d74978" member_type: VOTER }
I20260709 13:22:34.084698 29948 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:34.084941 29948 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:34.085266 29948 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:34.090129 29948 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3f49f73f1c4080bda28e17f0d74978" member_type: VOTER }
I20260709 13:22:34.090638 29948 leader_election.cc:304] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f3f49f73f1c4080bda28e17f0d74978; no voters: 
I20260709 13:22:34.091810 29948 leader_election.cc:290] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:34.092289 29951 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:34.094007 29951 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [term 1 LEADER]: Becoming Leader. State: Replica: 5f3f49f73f1c4080bda28e17f0d74978, State: Running, Role: LEADER
I20260709 13:22:34.094748 29948 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:34.094748 29951 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3f49f73f1c4080bda28e17f0d74978" member_type: VOTER }
I20260709 13:22:34.100870 29953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f3f49f73f1c4080bda28e17f0d74978. Latest consensus state: current_term: 1 leader_uuid: "5f3f49f73f1c4080bda28e17f0d74978" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3f49f73f1c4080bda28e17f0d74978" member_type: VOTER } }
I20260709 13:22:34.101692 29953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:34.103094 29952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f3f49f73f1c4080bda28e17f0d74978" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f3f49f73f1c4080bda28e17f0d74978" member_type: VOTER } }
I20260709 13:22:34.103857 29952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:34.111016 29959 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:34.118021 29959 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:34.119135 17138 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:34.127482 29959 catalog_manager.cc:1383] Generated new cluster ID: 20c3605289224b4c9d55bcec32eb232c
I20260709 13:22:34.127816 29959 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:34.159497 29959 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:34.160871 29959 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:34.175659 29959 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978: Generated new TSK 0
I20260709 13:22:34.176257 29959 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:34.186146 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:34.192905 29969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:34.193413 29970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:34.195086 29972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:34.195775 17138 server_base.cc:1061] running on GCE node
I20260709 13:22:34.196895 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:34.197127 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:34.197316 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603354197296 us; error 0 us; skew 500 ppm
I20260709 13:22:34.197913 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:34.200660 17138 webserver.cc:533] Webserver started at http://127.16.188.129:40089/ using document root <none> and password file <none>
I20260709 13:22:34.201226 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:34.201486 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:34.201800 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:34.203227 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/ts-0-root/instance:
uuid: "27c5f6809b3848c1b686954b77bae18a"
format_stamp: "Formatted at 2026-07-09 13:22:34 on dist-test-slave-2hqk"
I20260709 13:22:34.208138 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:22:34.211700 29977 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:34.212648 17138 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:34.212988 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/ts-0-root
uuid: "27c5f6809b3848c1b686954b77bae18a"
format_stamp: "Formatted at 2026-07-09 13:22:34 on dist-test-slave-2hqk"
I20260709 13:22:34.213290 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:34.246742 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:34.248173 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:34.249845 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:34.252293 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:34.252530 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:34.252817 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:34.253038 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:34.300467 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.129:39439
I20260709 13:22:34.300689 30039 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.129:39439 every 8 connection(s)
I20260709 13:22:34.307030 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:34.315537 30044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:34.316792 30045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:34.321451 30040 heartbeater.cc:344] Connected to a master server at 127.16.188.190:45163
I20260709 13:22:34.322014 30040 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:34.322371 17138 server_base.cc:1061] running on GCE node
I20260709 13:22:34.323189 30040 heartbeater.cc:507] Master 127.16.188.190:45163 requested a full tablet report, sending...
W20260709 13:22:34.323696 30047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:34.324959 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:34.325222 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:34.325430 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603354325412 us; error 0 us; skew 500 ppm
I20260709 13:22:34.325920 29913 ts_manager.cc:194] Registered new tserver with Master: 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439)
I20260709 13:22:34.326197 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:34.328536 29913 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43196
I20260709 13:22:34.329350 17138 webserver.cc:533] Webserver started at http://127.16.188.130:37401/ using document root <none> and password file <none>
I20260709 13:22:34.330054 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:34.330292 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:34.330607 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:34.331835 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/ts-1-root/instance:
uuid: "ef0f2dfd7a834b938cc24c740891b090"
format_stamp: "Formatted at 2026-07-09 13:22:34 on dist-test-slave-2hqk"
I20260709 13:22:34.336421 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:34.339934 30052 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:34.340916 17138 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:22:34.341229 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/ts-1-root
uuid: "ef0f2dfd7a834b938cc24c740891b090"
format_stamp: "Formatted at 2026-07-09 13:22:34 on dist-test-slave-2hqk"
I20260709 13:22:34.341513 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:34.361472 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:34.362613 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:34.364140 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:34.366420 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:34.366652 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:34.366890 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:34.367059 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:34.410354 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.130:38981
I20260709 13:22:34.410540 30114 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.130:38981 every 8 connection(s)
I20260709 13:22:34.415473 17138 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:34.423269 30118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:34.424886 30119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:34.427039 17138 server_base.cc:1061] running on GCE node
W20260709 13:22:34.427512 30121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:34.428721 17138 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:34.428967 17138 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:34.429201 17138 hybrid_clock.cc:648] HybridClock initialized: now 1783603354429181 us; error 0 us; skew 500 ppm
I20260709 13:22:34.429950 17138 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:34.430356 30115 heartbeater.cc:344] Connected to a master server at 127.16.188.190:45163
I20260709 13:22:34.430795 30115 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:34.431774 30115 heartbeater.cc:507] Master 127.16.188.190:45163 requested a full tablet report, sending...
I20260709 13:22:34.432787 17138 webserver.cc:533] Webserver started at http://127.16.188.131:37269/ using document root <none> and password file <none>
I20260709 13:22:34.433355 17138 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:34.433562 17138 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:34.433828 17138 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:34.434572 29913 ts_manager.cc:194] Registered new tserver with Master: ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:34.435382 17138 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/ts-2-root/instance:
uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
format_stamp: "Formatted at 2026-07-09 13:22:34 on dist-test-slave-2hqk"
I20260709 13:22:34.436417 29913 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43210
I20260709 13:22:34.441341 17138 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.005s
I20260709 13:22:34.445065 30126 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:34.445979 17138 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:22:34.446301 17138 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/ts-2-root
uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
format_stamp: "Formatted at 2026-07-09 13:22:34 on dist-test-slave-2hqk"
I20260709 13:22:34.446542 17138 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDf9Jk5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602984839783-17138-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:34.465611 17138 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:34.466785 17138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:34.468299 17138 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:34.470554 17138 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:34.470773 17138 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:34.471036 17138 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:34.471215 17138 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:34.518551 17138 rpc_server.cc:307] RPC server started. Bound to: 127.16.188.131:44053
I20260709 13:22:34.518761 30188 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.188.131:44053 every 8 connection(s)
I20260709 13:22:34.533977 30189 heartbeater.cc:344] Connected to a master server at 127.16.188.190:45163
I20260709 13:22:34.534557 30189 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:34.535347 30189 heartbeater.cc:507] Master 127.16.188.190:45163 requested a full tablet report, sending...
I20260709 13:22:34.537523 29913 ts_manager.cc:194] Registered new tserver with Master: 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:34.537973 17138 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015818314s
I20260709 13:22:34.539281 29913 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43222
I20260709 13:22:34.565774 29913 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43228:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:34.568410 29913 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:34.651383 30154 tablet_service.cc:1511] Processing CreateTablet for tablet a059b4edd4ff4998b950986501a48332 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:34.653188 30154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a059b4edd4ff4998b950986501a48332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.653293 30152 tablet_service.cc:1511] Processing CreateTablet for tablet 23606403df3a4de9861ee59ccd4e70c0 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:34.654731 30152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23606403df3a4de9861ee59ccd4e70c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.653350 30151 tablet_service.cc:1511] Processing CreateTablet for tablet 6b61fdb4016749468603ce382b085bee (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:34.658004 30151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b61fdb4016749468603ce382b085bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.661811 30150 tablet_service.cc:1511] Processing CreateTablet for tablet ff49f85f979c4df9bed315f95129e685 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:34.663241 30150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff49f85f979c4df9bed315f95129e685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.664250 30149 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb765e56b4f42d0a4f2527b9a467598 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:34.665872 30149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb765e56b4f42d0a4f2527b9a467598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.651491 30153 tablet_service.cc:1511] Processing CreateTablet for tablet e367938ddfd64760b6f758e1fdc05c02 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:34.668658 30148 tablet_service.cc:1511] Processing CreateTablet for tablet f7201028b7584d829863e1b74409c065 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:34.669494 30153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e367938ddfd64760b6f758e1fdc05c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.670372 30148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7201028b7584d829863e1b74409c065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.673807 30147 tablet_service.cc:1511] Processing CreateTablet for tablet e7b0ec114d034617b809288e3289b918 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:34.675228 30147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b0ec114d034617b809288e3289b918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.682888 30146 tablet_service.cc:1511] Processing CreateTablet for tablet 188dd58f1c8e4687b93f7e021ad4bf84 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:34.684839 30146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 188dd58f1c8e4687b93f7e021ad4bf84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.729681 30004 tablet_service.cc:1511] Processing CreateTablet for tablet e367938ddfd64760b6f758e1fdc05c02 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:34.731187 30004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e367938ddfd64760b6f758e1fdc05c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.732484 30001 tablet_service.cc:1511] Processing CreateTablet for tablet ff49f85f979c4df9bed315f95129e685 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:34.733481 30002 tablet_service.cc:1511] Processing CreateTablet for tablet 6b61fdb4016749468603ce382b085bee (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:34.734236 30001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff49f85f979c4df9bed315f95129e685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.734907 30002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b61fdb4016749468603ce382b085bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.737653 30003 tablet_service.cc:1511] Processing CreateTablet for tablet 23606403df3a4de9861ee59ccd4e70c0 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:34.739133 30003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23606403df3a4de9861ee59ccd4e70c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.742210 30005 tablet_service.cc:1511] Processing CreateTablet for tablet a059b4edd4ff4998b950986501a48332 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:34.743748 30005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a059b4edd4ff4998b950986501a48332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.746098 30000 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb765e56b4f42d0a4f2527b9a467598 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:34.748293 29999 tablet_service.cc:1511] Processing CreateTablet for tablet f7201028b7584d829863e1b74409c065 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:34.749745 29998 tablet_service.cc:1511] Processing CreateTablet for tablet e7b0ec114d034617b809288e3289b918 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:34.751130 30203 tablet_bootstrap.cc:492] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:34.752290 29997 tablet_service.cc:1511] Processing CreateTablet for tablet 188dd58f1c8e4687b93f7e021ad4bf84 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:34.757300 30080 tablet_service.cc:1511] Processing CreateTablet for tablet a059b4edd4ff4998b950986501a48332 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:34.758711 30080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a059b4edd4ff4998b950986501a48332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.761590 30079 tablet_service.cc:1511] Processing CreateTablet for tablet e367938ddfd64760b6f758e1fdc05c02 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:34.762887 30079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e367938ddfd64760b6f758e1fdc05c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.765597 30078 tablet_service.cc:1511] Processing CreateTablet for tablet 23606403df3a4de9861ee59ccd4e70c0 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:34.766922 30078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23606403df3a4de9861ee59ccd4e70c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.769683 30077 tablet_service.cc:1511] Processing CreateTablet for tablet 6b61fdb4016749468603ce382b085bee (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:34.771000 30077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b61fdb4016749468603ce382b085bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.773676 30074 tablet_service.cc:1511] Processing CreateTablet for tablet f7201028b7584d829863e1b74409c065 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:34.774984 30074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7201028b7584d829863e1b74409c065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.777686 30076 tablet_service.cc:1511] Processing CreateTablet for tablet ff49f85f979c4df9bed315f95129e685 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:34.778998 30076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff49f85f979c4df9bed315f95129e685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.757117 30075 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb765e56b4f42d0a4f2527b9a467598 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:34.783597 30075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb765e56b4f42d0a4f2527b9a467598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.782244 30073 tablet_service.cc:1511] Processing CreateTablet for tablet e7b0ec114d034617b809288e3289b918 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:34.785970 30000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb765e56b4f42d0a4f2527b9a467598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.786808 29997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 188dd58f1c8e4687b93f7e021ad4bf84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.786985 30072 tablet_service.cc:1511] Processing CreateTablet for tablet 188dd58f1c8e4687b93f7e021ad4bf84 (DEFAULT_TABLE table=test-workload [id=a6ec448070454f40a255c575f8c7b9b7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:34.788132 29999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7201028b7584d829863e1b74409c065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.787580 30203 tablet_bootstrap.cc:654] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:34.790370 29998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b0ec114d034617b809288e3289b918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.792550 30073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b0ec114d034617b809288e3289b918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.793293 30072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 188dd58f1c8e4687b93f7e021ad4bf84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:34.823778 30203 tablet_bootstrap.cc:492] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:34.824353 30203 ts_tablet_manager.cc:1403] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.015s
I20260709 13:22:34.826946 30203 raft_consensus.cc:359] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } } peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } }
I20260709 13:22:34.827557 30203 raft_consensus.cc:385] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:34.827885 30203 raft_consensus.cc:740] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.828902 30203 consensus_queue.cc:260] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } } peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } }
I20260709 13:22:34.833495 30204 tablet_bootstrap.cc:492] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:34.846235 30204 tablet_bootstrap.cc:654] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:34.875448 30207 tablet_bootstrap.cc:492] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:34.898254 30189 heartbeater.cc:499] Master 127.16.188.190:45163 was elected leader, sending a full tablet report...
I20260709 13:22:34.900214 30203 ts_tablet_manager.cc:1434] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.076s	user 0.022s	sys 0.020s
I20260709 13:22:34.901443 30203 tablet_bootstrap.cc:492] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:34.907869 30203 tablet_bootstrap.cc:654] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:34.898070 30206 raft_consensus.cc:493] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:34.909004 30206 raft_consensus.cc:515] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } } peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } }
I20260709 13:22:34.916755 30206 leader_election.cc:290] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:34.925887 30207 tablet_bootstrap.cc:654] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:34.953730 30204 tablet_bootstrap.cc:492] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:34.953665 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059b4edd4ff4998b950986501a48332" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:34.954620 30204 ts_tablet_manager.cc:1403] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.122s	user 0.012s	sys 0.015s
I20260709 13:22:34.955077 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059b4edd4ff4998b950986501a48332" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
W20260709 13:22:34.957021 30129 leader_election.cc:343] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:34.957767 30129 leader_election.cc:343] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:34.958087 30204 raft_consensus.cc:359] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:34.959002 30204 raft_consensus.cc:385] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:34.958184 30129 leader_election.cc:304] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:34.959420 30204 raft_consensus.cc:740] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.959064 30207 tablet_bootstrap.cc:492] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:34.960346 30208 raft_consensus.cc:2749] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:34.961027 30207 ts_tablet_manager.cc:1403] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.006s
I20260709 13:22:34.960443 30204 consensus_queue.cc:260] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:34.963075 30040 heartbeater.cc:499] Master 127.16.188.190:45163 was elected leader, sending a full tablet report...
I20260709 13:22:34.963626 30204 ts_tablet_manager.cc:1434] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:22:34.964840 30204 tablet_bootstrap.cc:492] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:34.964569 30207 raft_consensus.cc:359] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:34.965350 30207 raft_consensus.cc:385] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:34.965672 30207 raft_consensus.cc:740] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.967940 30207 consensus_queue.cc:260] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:34.971426 30207 ts_tablet_manager.cc:1434] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:22:34.972501 30204 tablet_bootstrap.cc:654] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:34.972846 30115 heartbeater.cc:499] Master 127.16.188.190:45163 was elected leader, sending a full tablet report...
I20260709 13:22:34.973315 30203 tablet_bootstrap.cc:492] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:34.973979 30203 ts_tablet_manager.cc:1403] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.073s	user 0.006s	sys 0.007s
I20260709 13:22:34.974282 30213 raft_consensus.cc:493] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:34.974797 30213 raft_consensus.cc:515] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:34.972566 30207 tablet_bootstrap.cc:492] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:34.977351 30203 raft_consensus.cc:359] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:34.979962 30213 leader_election.cc:290] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:34.986608 30207 tablet_bootstrap.cc:654] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:34.978161 30203 raft_consensus.cc:385] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:34.989199 30203 raft_consensus.cc:740] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:34.993553 30203 consensus_queue.cc:260] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:34.996394 30203 ts_tablet_manager.cc:1434] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 13:22:35.004936 30203 tablet_bootstrap.cc:492] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:35.014385 30203 tablet_bootstrap.cc:654] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.014463 30214 raft_consensus.cc:493] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.015120 30214 raft_consensus.cc:515] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.020263 30214 leader_election.cc:290] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:35.020190 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23606403df3a4de9861ee59ccd4e70c0" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
W20260709 13:22:35.025069 30190 tablet.cc:2406] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260709 13:22:35.032869 29979 leader_election.cc:343] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.034565 30204 tablet_bootstrap.cc:492] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:35.035388 30204 ts_tablet_manager.cc:1403] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.011s
I20260709 13:22:35.038118 30207 tablet_bootstrap.cc:492] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:35.038902 30207 ts_tablet_manager.cc:1403] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.013s
I20260709 13:22:35.043820 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23606403df3a4de9861ee59ccd4e70c0" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:35.043987 30204 raft_consensus.cc:359] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.044888 30204 raft_consensus.cc:385] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.045271 30204 raft_consensus.cc:740] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
W20260709 13:22:35.045472 29980 leader_election.cc:343] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.046007 29980 leader_election.cc:304] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a; no voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:35.045884 30207 raft_consensus.cc:359] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.047809 30213 raft_consensus.cc:2749] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:35.046309 30204 consensus_queue.cc:260] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.047142 30207 raft_consensus.cc:385] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.050575 30204 ts_tablet_manager.cc:1434] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:22:35.050701 30207 raft_consensus.cc:740] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.052103 30204 tablet_bootstrap.cc:492] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:35.057658 30207 consensus_queue.cc:260] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.059415 30203 tablet_bootstrap.cc:492] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:35.059846 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "188dd58f1c8e4687b93f7e021ad4bf84" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:35.060072 30203 ts_tablet_manager.cc:1403] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.013s
I20260709 13:22:35.060946 30207 ts_tablet_manager.cc:1434] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:22:35.062296 30207 tablet_bootstrap.cc:492] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
W20260709 13:22:35.062484 30054 leader_election.cc:343] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.064019 30204 tablet_bootstrap.cc:654] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.060212 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "188dd58f1c8e4687b93f7e021ad4bf84" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:35.064365 30203 raft_consensus.cc:359] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.065371 30203 raft_consensus.cc:385] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.065754 30203 raft_consensus.cc:740] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
W20260709 13:22:35.066632 30055 leader_election.cc:343] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.066787 30203 consensus_queue.cc:260] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.067265 30055 leader_election.cc:304] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0f2dfd7a834b938cc24c740891b090; no voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8
I20260709 13:22:35.068316 30214 raft_consensus.cc:2749] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:35.069317 30207 tablet_bootstrap.cc:654] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.072633 30203 ts_tablet_manager.cc:1434] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 13:22:35.074668 30203 tablet_bootstrap.cc:492] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:35.083961 30203 tablet_bootstrap.cc:654] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.086309 30207 tablet_bootstrap.cc:492] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:35.087044 30207 ts_tablet_manager.cc:1403] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.008s
I20260709 13:22:35.090457 30204 tablet_bootstrap.cc:492] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:35.091058 30204 ts_tablet_manager.cc:1403] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.006s
I20260709 13:22:35.091311 30203 tablet_bootstrap.cc:492] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:35.090807 30207 raft_consensus.cc:359] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.091984 30203 ts_tablet_manager.cc:1403] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.008s
I20260709 13:22:35.091905 30207 raft_consensus.cc:385] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.092595 30207 raft_consensus.cc:740] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.093456 30207 consensus_queue.cc:260] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.094321 30204 raft_consensus.cc:359] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.095062 30204 raft_consensus.cc:385] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.095389 30204 raft_consensus.cc:740] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.095700 30207 ts_tablet_manager.cc:1434] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:35.095247 30203 raft_consensus.cc:359] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.096442 30203 raft_consensus.cc:385] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.096792 30207 tablet_bootstrap.cc:492] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:35.096570 30204 consensus_queue.cc:260] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.096812 30203 raft_consensus.cc:740] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.098379 30203 consensus_queue.cc:260] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.100739 30203 ts_tablet_manager.cc:1434] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:35.101850 30203 tablet_bootstrap.cc:492] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:35.102068 30204 ts_tablet_manager.cc:1434] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:22:35.103142 30204 tablet_bootstrap.cc:492] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:35.103986 30207 tablet_bootstrap.cc:654] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.108896 30203 tablet_bootstrap.cc:654] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:35.111455 29961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:35.112296 30204 tablet_bootstrap.cc:654] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.126904 30204 tablet_bootstrap.cc:492] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:35.127616 30204 ts_tablet_manager.cc:1403] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.014s
I20260709 13:22:35.131400 30204 raft_consensus.cc:359] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } } peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } }
I20260709 13:22:35.132357 30204 raft_consensus.cc:385] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.132897 30204 raft_consensus.cc:740] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.134016 30204 consensus_queue.cc:260] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } } peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } }
I20260709 13:22:35.140763 30204 ts_tablet_manager.cc:1434] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:22:35.142033 30204 tablet_bootstrap.cc:492] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:35.144111 30208 raft_consensus.cc:493] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.145012 30208 raft_consensus.cc:515] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.149272 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "188dd58f1c8e4687b93f7e021ad4bf84" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:35.150928 30204 tablet_bootstrap.cc:654] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.152783 30208 leader_election.cc:290] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
W20260709 13:22:35.152163 30129 leader_election.cc:343] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.155479 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "188dd58f1c8e4687b93f7e021ad4bf84" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:35.156384 30090 raft_consensus.cc:2468] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 0.
I20260709 13:22:35.158236 30129 leader_election.cc:304] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090; no voters: 27c5f6809b3848c1b686954b77bae18a
I20260709 13:22:35.159518 30206 raft_consensus.cc:2804] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:35.159994 30206 raft_consensus.cc:493] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:35.161183 30213 raft_consensus.cc:493] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.161911 30213 raft_consensus.cc:515] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.164116 30204 tablet_bootstrap.cc:492] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:35.164887 30204 ts_tablet_manager.cc:1403] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.011s
I20260709 13:22:35.168649 30213 leader_election.cc:290] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:35.171869 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff49f85f979c4df9bed315f95129e685" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:35.168953 30204 raft_consensus.cc:359] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.173460 30204 raft_consensus.cc:385] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.173868 30204 raft_consensus.cc:740] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.170176 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff49f85f979c4df9bed315f95129e685" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:35.175035 30204 consensus_queue.cc:260] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.160420 30206 raft_consensus.cc:3060] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.178058 30204 ts_tablet_manager.cc:1434] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 13:22:35.179384 30204 tablet_bootstrap.cc:492] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
W20260709 13:22:35.174027 29980 leader_election.cc:343] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:35.181696 29979 leader_election.cc:343] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.185237 29979 leader_election.cc:304] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a; no voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:35.187182 30213 raft_consensus.cc:2749] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:35.188719 30208 raft_consensus.cc:493] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.189338 30204 tablet_bootstrap.cc:654] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.189584 30208 raft_consensus.cc:515] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.200033 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e367938ddfd64760b6f758e1fdc05c02" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:35.202526 30204 tablet_bootstrap.cc:492] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:35.203275 30204 ts_tablet_manager.cc:1403] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
W20260709 13:22:35.204918 30129 leader_election.cc:343] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.207320 30204 raft_consensus.cc:359] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.208356 30204 raft_consensus.cc:385] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.208674 30214 raft_consensus.cc:493] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.208760 30204 raft_consensus.cc:740] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.209488 30214 raft_consensus.cc:515] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.210345 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e367938ddfd64760b6f758e1fdc05c02" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:35.211050 30090 raft_consensus.cc:2468] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 0.
I20260709 13:22:35.210474 30204 consensus_queue.cc:260] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.213132 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e367938ddfd64760b6f758e1fdc05c02" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:35.213920 30164 raft_consensus.cc:2468] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 0.
I20260709 13:22:35.214133 30204 ts_tablet_manager.cc:1434] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 13:22:35.215734 30204 tablet_bootstrap.cc:492] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:35.216748 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e367938ddfd64760b6f758e1fdc05c02" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:35.213231 30214 leader_election.cc:290] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:35.215514 30129 leader_election.cc:304] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090; no voters: 27c5f6809b3848c1b686954b77bae18a
W20260709 13:22:35.218480 30055 leader_election.cc:343] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.220016 30054 leader_election.cc:304] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090; no voters: 27c5f6809b3848c1b686954b77bae18a
I20260709 13:22:35.221268 30214 raft_consensus.cc:2804] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:35.221629 30214 raft_consensus.cc:493] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:35.221982 30214 raft_consensus.cc:3060] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.225270 30204 tablet_bootstrap.cc:654] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.222033 30208 leader_election.cc:290] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:35.230769 30214 raft_consensus.cc:515] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.236861 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e367938ddfd64760b6f758e1fdc05c02" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
W20260709 13:22:35.238456 30055 leader_election.cc:343] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.231746 30231 raft_consensus.cc:2804] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:22:35.238832 29979 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44053, user_credentials={real_user=slave}} blocked reactor thread for 62840.2us
I20260709 13:22:35.239058 30204 tablet_bootstrap.cc:492] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:35.239373 30231 raft_consensus.cc:493] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:35.240075 30231 raft_consensus.cc:3060] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.240295 30204 ts_tablet_manager.cc:1403] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.005s
I20260709 13:22:35.244570 30204 raft_consensus.cc:359] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.245548 30204 raft_consensus.cc:385] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.245930 30204 raft_consensus.cc:740] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.246590 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e367938ddfd64760b6f758e1fdc05c02" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:35.247063 30204 consensus_queue.cc:260] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.248625 30214 leader_election.cc:290] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:35.249696 30204 ts_tablet_manager.cc:1434] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:22:35.250828 30204 tablet_bootstrap.cc:492] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:35.252445 30231 raft_consensus.cc:515] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.237186 30206 raft_consensus.cc:515] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.253950 30164 raft_consensus.cc:2393] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0f2dfd7a834b938cc24c740891b090 in current term 1: Already voted for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in this term.
I20260709 13:22:35.254951 30231 leader_election.cc:290] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:35.255426 30206 leader_election.cc:290] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:35.256834 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e367938ddfd64760b6f758e1fdc05c02" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:35.257555 30015 raft_consensus.cc:3060] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.258101 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e367938ddfd64760b6f758e1fdc05c02" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:35.258821 30203 tablet_bootstrap.cc:492] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:35.258984 30090 raft_consensus.cc:2393] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 87770ebb4d4d45938b280d6f1b21e6f8 in current term 1: Already voted for candidate ef0f2dfd7a834b938cc24c740891b090 in this term.
I20260709 13:22:35.259461 30203 ts_tablet_manager.cc:1403] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.158s	user 0.055s	sys 0.055s
I20260709 13:22:35.259508 30207 tablet_bootstrap.cc:492] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:35.260295 30207 ts_tablet_manager.cc:1403] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.164s	user 0.071s	sys 0.083s
I20260709 13:22:35.261683 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "188dd58f1c8e4687b93f7e021ad4bf84" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:35.260159 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "188dd58f1c8e4687b93f7e021ad4bf84" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:35.263108 30203 raft_consensus.cc:359] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.263640 30089 raft_consensus.cc:3060] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.263922 30203 raft_consensus.cc:385] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.264698 30203 raft_consensus.cc:740] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.263777 30207 raft_consensus.cc:359] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.265275 30207 raft_consensus.cc:385] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.265182 30015 raft_consensus.cc:2468] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 1.
I20260709 13:22:35.265708 30207 raft_consensus.cc:740] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.256811 30204 tablet_bootstrap.cc:654] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.265571 30203 consensus_queue.cc:260] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.267023 30207 consensus_queue.cc:260] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.269196 30203 ts_tablet_manager.cc:1434] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.002s
I20260709 13:22:35.269793 30207 ts_tablet_manager.cc:1434] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:22:35.270346 30203 tablet_bootstrap.cc:492] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:35.271380 30207 tablet_bootstrap.cc:492] T a059b4edd4ff4998b950986501a48332 P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:35.278304 30203 tablet_bootstrap.cc:654] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.281138 30207 tablet_bootstrap.cc:654] T a059b4edd4ff4998b950986501a48332 P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.294972 30207 tablet_bootstrap.cc:492] T a059b4edd4ff4998b950986501a48332 P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:35.295461 30207 ts_tablet_manager.cc:1403] T a059b4edd4ff4998b950986501a48332 P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.006s
I20260709 13:22:35.298381 30207 raft_consensus.cc:359] T a059b4edd4ff4998b950986501a48332 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } } peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } }
I20260709 13:22:35.299103 30207 raft_consensus.cc:385] T a059b4edd4ff4998b950986501a48332 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.299396 30207 raft_consensus.cc:740] T a059b4edd4ff4998b950986501a48332 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.299623 30054 leader_election.cc:304] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0f2dfd7a834b938cc24c740891b090; no voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8
I20260709 13:22:35.300925 30214 raft_consensus.cc:2749] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:22:35.302667 30129 leader_election.cc:343] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.300143 30207 consensus_queue.cc:260] T a059b4edd4ff4998b950986501a48332 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } } peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } }
I20260709 13:22:35.305832 30207 ts_tablet_manager.cc:1434] T a059b4edd4ff4998b950986501a48332 P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:22:35.306882 30207 tablet_bootstrap.cc:492] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:35.311707 30089 raft_consensus.cc:2468] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 1.
I20260709 13:22:35.312382 30229 raft_consensus.cc:493] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.315341 30229 raft_consensus.cc:515] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.318320 30229 leader_election.cc:290] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:35.303663 30129 leader_election.cc:304] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:35.319455 30206 raft_consensus.cc:2804] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:35.320055 30206 raft_consensus.cc:697] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Becoming Leader. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Running, Role: LEADER
I20260709 13:22:35.320230 30129 leader_election.cc:304] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090; no voters: 27c5f6809b3848c1b686954b77bae18a
I20260709 13:22:35.320693 30231 raft_consensus.cc:493] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.320617 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7201028b7584d829863e1b74409c065" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:35.321367 30231 raft_consensus.cc:515] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
W20260709 13:22:35.323256 29979 leader_election.cc:343] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.323598 30231 leader_election.cc:290] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:35.325717 30206 consensus_queue.cc:237] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.326690 30207 tablet_bootstrap.cc:654] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.324321 30231 raft_consensus.cc:2804] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:35.328930 30231 raft_consensus.cc:697] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Becoming Leader. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Running, Role: LEADER
I20260709 13:22:35.331171 30231 consensus_queue.cc:237] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.331769 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7201028b7584d829863e1b74409c065" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
W20260709 13:22:35.333352 29980 leader_election.cc:343] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.333554 30204 tablet_bootstrap.cc:492] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:35.333858 29980 leader_election.cc:304] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a; no voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:35.334337 30204 ts_tablet_manager.cc:1403] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.084s	user 0.015s	sys 0.037s
I20260709 13:22:35.335436 30229 raft_consensus.cc:2749] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:35.337739 30204 raft_consensus.cc:359] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.338745 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb765e56b4f42d0a4f2527b9a467598" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:35.339496 30015 raft_consensus.cc:2468] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 0.
I20260709 13:22:35.339538 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb765e56b4f42d0a4f2527b9a467598" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:35.339824 30203 tablet_bootstrap.cc:492] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:35.340677 30203 ts_tablet_manager.cc:1403] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.071s	user 0.033s	sys 0.019s
I20260709 13:22:35.340715 30204 raft_consensus.cc:385] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:22:35.341043 30129 leader_election.cc:343] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.341615 30204 raft_consensus.cc:740] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.341944 30129 leader_election.cc:304] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:35.342545 30204 consensus_queue.cc:260] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.342991 30236 raft_consensus.cc:2804] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:35.343503 30236 raft_consensus.cc:493] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:35.343915 30236 raft_consensus.cc:3060] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.345337 30203 raft_consensus.cc:359] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.346311 30203 raft_consensus.cc:385] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.346665 30203 raft_consensus.cc:740] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.346740 30229 raft_consensus.cc:493] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.347522 30229 raft_consensus.cc:515] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.347695 30203 consensus_queue.cc:260] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.350211 30203 ts_tablet_manager.cc:1434] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:22:35.351301 30203 tablet_bootstrap.cc:492] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:35.351181 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b61fdb4016749468603ce382b085bee" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:35.351970 30229 leader_election.cc:290] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:35.351981 30089 raft_consensus.cc:2468] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 0.
I20260709 13:22:35.353575 29980 leader_election.cc:304] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:35.354310 30229 raft_consensus.cc:2804] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:35.354846 30229 raft_consensus.cc:493] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:35.355605 30229 raft_consensus.cc:3060] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.355991 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b61fdb4016749468603ce382b085bee" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:35.356786 30164 raft_consensus.cc:2468] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 0.
I20260709 13:22:35.354799 29910 catalog_manager.cc:5697] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:35.363001 30203 tablet_bootstrap.cc:654] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.379439 30204 ts_tablet_manager.cc:1434] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.001s
I20260709 13:22:35.380146 30213 raft_consensus.cc:493] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.380636 30204 tablet_bootstrap.cc:492] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:35.371901 30236 raft_consensus.cc:515] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.381129 30213 raft_consensus.cc:515] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } } peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } }
I20260709 13:22:35.383594 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb765e56b4f42d0a4f2527b9a467598" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:35.384187 30015 raft_consensus.cc:3060] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.384274 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb765e56b4f42d0a4f2527b9a467598" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
W20260709 13:22:35.385708 30129 leader_election.cc:343] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.385583 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059b4edd4ff4998b950986501a48332" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:35.386656 30236 leader_election.cc:290] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:35.386952 30164 raft_consensus.cc:2468] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 0.
I20260709 13:22:35.380744 30229 raft_consensus.cc:515] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.389140 29979 leader_election.cc:304] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 
I20260709 13:22:35.390097 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b61fdb4016749468603ce382b085bee" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:35.390705 30089 raft_consensus.cc:3060] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.391520 30015 raft_consensus.cc:2468] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 1.
I20260709 13:22:35.392771 30129 leader_election.cc:304] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:35.392940 30213 leader_election.cc:290] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:35.393195 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059b4edd4ff4998b950986501a48332" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:35.393584 30213 raft_consensus.cc:2804] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:35.393936 30090 raft_consensus.cc:2468] T a059b4edd4ff4998b950986501a48332 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 0.
I20260709 13:22:35.394089 30213 raft_consensus.cc:493] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:35.395963 30213 raft_consensus.cc:3060] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.396747 30236 raft_consensus.cc:2804] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:35.397428 30236 raft_consensus.cc:697] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Becoming Leader. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Running, Role: LEADER
I20260709 13:22:35.398442 30229 leader_election.cc:290] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 election: Requested vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:35.397558 30089 raft_consensus.cc:2468] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 1.
I20260709 13:22:35.399938 29980 leader_election.cc:304] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:35.400840 30204 tablet_bootstrap.cc:654] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.400952 30229 raft_consensus.cc:2804] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:35.403477 30207 tablet_bootstrap.cc:492] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:35.403843 30229 raft_consensus.cc:697] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Becoming Leader. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Running, Role: LEADER
I20260709 13:22:35.404016 30207 ts_tablet_manager.cc:1403] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.097s	user 0.030s	sys 0.015s
I20260709 13:22:35.401381 30236 consensus_queue.cc:237] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.406497 30229 consensus_queue.cc:237] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.407306 30207 raft_consensus.cc:359] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.408360 30207 raft_consensus.cc:385] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.408771 30207 raft_consensus.cc:740] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.409726 30207 consensus_queue.cc:260] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.415832 30207 ts_tablet_manager.cc:1434] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:22:35.418098 30207 tablet_bootstrap.cc:492] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:35.426769 30207 tablet_bootstrap.cc:654] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:35.453070 29979 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.131:44053, user_credentials={real_user=slave}} blocked reactor thread for 64081.6us
I20260709 13:22:35.455127 30204 tablet_bootstrap.cc:492] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:35.455775 30204 ts_tablet_manager.cc:1403] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.075s	user 0.022s	sys 0.009s
I20260709 13:22:35.455878 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b61fdb4016749468603ce382b085bee" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:35.456791 30164 raft_consensus.cc:3060] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.407274 30213 raft_consensus.cc:515] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } } peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } }
I20260709 13:22:35.459649 30204 raft_consensus.cc:359] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.460554 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059b4edd4ff4998b950986501a48332" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:35.460618 30204 raft_consensus.cc:385] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.461231 30089 raft_consensus.cc:3060] T a059b4edd4ff4998b950986501a48332 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.461419 30204 raft_consensus.cc:740] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.462440 30204 consensus_queue.cc:260] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.465139 30204 ts_tablet_manager.cc:1434] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:22:35.465521 30164 raft_consensus.cc:2468] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 1.
I20260709 13:22:35.467419 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059b4edd4ff4998b950986501a48332" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:35.468348 30163 raft_consensus.cc:3060] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.469961 30203 tablet_bootstrap.cc:492] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:35.470539 30203 ts_tablet_manager.cc:1403] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.119s	user 0.019s	sys 0.026s
I20260709 13:22:35.470619 30207 tablet_bootstrap.cc:492] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:35.471151 30207 ts_tablet_manager.cc:1403] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.003s
I20260709 13:22:35.471482 30089 raft_consensus.cc:2468] T a059b4edd4ff4998b950986501a48332 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 1.
I20260709 13:22:35.472875 29980 leader_election.cc:304] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:35.473876 30229 raft_consensus.cc:2804] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:35.473556 30203 raft_consensus.cc:359] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.474048 30207 raft_consensus.cc:359] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.474658 30229 raft_consensus.cc:697] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Becoming Leader. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Running, Role: LEADER
I20260709 13:22:35.474821 30203 raft_consensus.cc:385] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.475401 30203 raft_consensus.cc:740] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.475680 30229 consensus_queue.cc:237] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } } peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } }
I20260709 13:22:35.477015 30163 raft_consensus.cc:2468] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 1.
I20260709 13:22:35.474840 30207 raft_consensus.cc:385] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.478065 30207 raft_consensus.cc:740] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.479352 30207 consensus_queue.cc:260] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.480178 30213 leader_election.cc:290] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 election: Requested vote from peers 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:35.485205 30207 ts_tablet_manager.cc:1434] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:22:35.486310 30207 tablet_bootstrap.cc:492] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:35.476423 30203 consensus_queue.cc:260] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.489787 30203 ts_tablet_manager.cc:1434] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:22:35.490968 30203 tablet_bootstrap.cc:492] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:35.492558 30207 tablet_bootstrap.cc:654] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.495287 29911 catalog_manager.cc:5697] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:35.482779 29913 catalog_manager.cc:5697] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27c5f6809b3848c1b686954b77bae18a (127.16.188.129). New cstate: current_term: 1 leader_uuid: "27c5f6809b3848c1b686954b77bae18a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:35.498226 30203 tablet_bootstrap.cc:654] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.497570 29911 catalog_manager.cc:5697] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:35.504618 30207 tablet_bootstrap.cc:492] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:35.504873 30203 tablet_bootstrap.cc:492] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:35.505290 30207 ts_tablet_manager.cc:1403] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.005s
I20260709 13:22:35.505407 30203 ts_tablet_manager.cc:1403] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.002s
I20260709 13:22:35.508855 30214 raft_consensus.cc:493] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.509410 30214 raft_consensus.cc:515] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.510272 30203 raft_consensus.cc:359] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.511061 30203 raft_consensus.cc:385] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.511482 30203 raft_consensus.cc:740] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.511507 30214 leader_election.cc:290] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:35.512496 30203 consensus_queue.cc:260] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.513667 30214 raft_consensus.cc:493] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.514335 30214 raft_consensus.cc:515] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.515055 30203 ts_tablet_manager.cc:1434] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:22:35.515235 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b0ec114d034617b809288e3289b918" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:35.515486 30207 raft_consensus.cc:359] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.515930 30015 raft_consensus.cc:2468] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 0.
I20260709 13:22:35.516209 30207 raft_consensus.cc:385] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.516299 30203 tablet_bootstrap.cc:492] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:35.516718 30207 raft_consensus.cc:740] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.516973 30214 leader_election.cc:290] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:35.517580 30207 consensus_queue.cc:260] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.519830 30207 ts_tablet_manager.cc:1434] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:22:35.522042 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23606403df3a4de9861ee59ccd4e70c0" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:35.513577 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b0ec114d034617b809288e3289b918" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:35.523586 30164 raft_consensus.cc:2468] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 0.
W20260709 13:22:35.525068 30054 leader_election.cc:343] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.529140 30055 leader_election.cc:304] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:35.530212 30207 tablet_bootstrap.cc:492] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:35.531881 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23606403df3a4de9861ee59ccd4e70c0" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:35.532577 30014 raft_consensus.cc:2468] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 0.
I20260709 13:22:35.533821 30055 leader_election.cc:304] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 87770ebb4d4d45938b280d6f1b21e6f8
I20260709 13:22:35.520146 29911 catalog_manager.cc:5697] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27c5f6809b3848c1b686954b77bae18a (127.16.188.129). New cstate: current_term: 1 leader_uuid: "27c5f6809b3848c1b686954b77bae18a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:35.537498 30207 tablet_bootstrap.cc:654] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.543341 30214 raft_consensus.cc:2804] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:35.543795 30214 raft_consensus.cc:493] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:35.544142 30214 raft_consensus.cc:3060] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.544269 30203 tablet_bootstrap.cc:654] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:35.545732 30236 raft_consensus.cc:493] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.546487 30236 raft_consensus.cc:515] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.549520 30236 leader_election.cc:290] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:35.551467 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff49f85f979c4df9bed315f95129e685" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:35.551887 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff49f85f979c4df9bed315f95129e685" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:35.552313 30014 raft_consensus.cc:2468] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 0.
I20260709 13:22:35.554122 30129 leader_election.cc:304] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 
I20260709 13:22:35.554817 30252 raft_consensus.cc:2804] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:35.555310 30252 raft_consensus.cc:493] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:22:35.555465 30129 leader_election.cc:343] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.555639 30252 raft_consensus.cc:3060] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.556891 30236 raft_consensus.cc:2804] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:35.558370 30236 raft_consensus.cc:493] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:35.559242 30236 raft_consensus.cc:3060] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.563676 30252 raft_consensus.cc:515] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.568673 30252 leader_election.cc:290] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:35.568881 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23606403df3a4de9861ee59ccd4e70c0" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
W20260709 13:22:35.570261 30054 leader_election.cc:343] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:35.571211 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23606403df3a4de9861ee59ccd4e70c0" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:35.571805 30014 raft_consensus.cc:3060] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.573283 30214 raft_consensus.cc:515] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.574200 30207 tablet_bootstrap.cc:492] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:35.574914 30207 ts_tablet_manager.cc:1403] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.025s
I20260709 13:22:35.576208 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b0ec114d034617b809288e3289b918" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:35.576922 30015 raft_consensus.cc:3060] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.578439 30203 tablet_bootstrap.cc:492] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:35.579003 30203 ts_tablet_manager.cc:1403] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.000s
I20260709 13:22:35.579361 30014 raft_consensus.cc:2468] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 1.
I20260709 13:22:35.578941 30207 raft_consensus.cc:359] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.579979 30207 raft_consensus.cc:385] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.580291 30207 raft_consensus.cc:740] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.580438 30055 leader_election.cc:304] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 87770ebb4d4d45938b280d6f1b21e6f8
I20260709 13:22:35.581319 30207 consensus_queue.cc:260] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.582177 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b0ec114d034617b809288e3289b918" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:35.582824 30164 raft_consensus.cc:3060] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.582434 30203 raft_consensus.cc:359] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.583479 30203 raft_consensus.cc:385] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:35.583879 30203 raft_consensus.cc:740] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:35.582973 30252 raft_consensus.cc:2804] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:35.585127 30203 consensus_queue.cc:260] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.586619 30015 raft_consensus.cc:2468] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 1.
I20260709 13:22:35.588049 30055 leader_election.cc:304] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:35.589864 30214 leader_election.cc:290] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:35.593773 30214 raft_consensus.cc:2804] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:35.594297 30214 raft_consensus.cc:697] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Becoming Leader. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Running, Role: LEADER
I20260709 13:22:35.575990 30236 raft_consensus.cc:515] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.595372 30164 raft_consensus.cc:2468] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 1.
I20260709 13:22:35.596362 30214 consensus_queue.cc:237] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.599876 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff49f85f979c4df9bed315f95129e685" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:35.601205 30014 raft_consensus.cc:3060] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.611830 30203 ts_tablet_manager.cc:1434] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.001s
I20260709 13:22:35.615185 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff49f85f979c4df9bed315f95129e685" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:35.616144 30089 raft_consensus.cc:3060] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.621351 30236 leader_election.cc:290] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:35.622553 30252 raft_consensus.cc:697] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Becoming Leader. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Running, Role: LEADER
I20260709 13:22:35.625977 30252 consensus_queue.cc:237] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.629017 30014 raft_consensus.cc:2468] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 1.
I20260709 13:22:35.629458 30207 ts_tablet_manager.cc:1434] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.054s	user 0.014s	sys 0.037s
I20260709 13:22:35.630331 30129 leader_election.cc:304] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 
I20260709 13:22:35.631088 30236 raft_consensus.cc:2804] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:35.631517 30236 raft_consensus.cc:697] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Becoming Leader. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Running, Role: LEADER
I20260709 13:22:35.632349 30236 consensus_queue.cc:237] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.633132 30089 raft_consensus.cc:2468] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 1.
I20260709 13:22:35.642940 29911 catalog_manager.cc:5697] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "ef0f2dfd7a834b938cc24c740891b090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:35.643195 29912 catalog_manager.cc:5697] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:35.659328 29911 catalog_manager.cc:5697] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "ef0f2dfd7a834b938cc24c740891b090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:35.687400 30236 raft_consensus.cc:493] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.688202 30236 raft_consensus.cc:515] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.690220 30236 leader_election.cc:290] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:35.691151 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7201028b7584d829863e1b74409c065" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:35.691291 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7201028b7584d829863e1b74409c065" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:35.691906 30014 raft_consensus.cc:2468] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 0.
I20260709 13:22:35.691994 30089 raft_consensus.cc:2468] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 0.
I20260709 13:22:35.693189 30129 leader_election.cc:304] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:35.693922 30236 raft_consensus.cc:2804] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:35.694352 30236 raft_consensus.cc:493] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:35.694674 30236 raft_consensus.cc:3060] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.700801 30236 raft_consensus.cc:515] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.702620 30236 leader_election.cc:290] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:35.703467 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7201028b7584d829863e1b74409c065" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:35.703732 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7201028b7584d829863e1b74409c065" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:35.704075 30014 raft_consensus.cc:3060] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.704509 30089 raft_consensus.cc:3060] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.709396 30014 raft_consensus.cc:2468] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 1.
I20260709 13:22:35.710278 30089 raft_consensus.cc:2468] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 1.
I20260709 13:22:35.710583 30129 leader_election.cc:304] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 
I20260709 13:22:35.711566 30236 raft_consensus.cc:2804] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:35.712082 30236 raft_consensus.cc:697] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Becoming Leader. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Running, Role: LEADER
I20260709 13:22:35.712838 30236 consensus_queue.cc:237] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.721444 29911 catalog_manager.cc:5697] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:35.758281 30213 raft_consensus.cc:493] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.759023 30213 raft_consensus.cc:515] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.761739 30213 leader_election.cc:290] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:35.763154 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "188dd58f1c8e4687b93f7e021ad4bf84" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:35.761868 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "188dd58f1c8e4687b93f7e021ad4bf84" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:35.764076 30252 raft_consensus.cc:493] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:35.764915 30089 raft_consensus.cc:2393] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27c5f6809b3848c1b686954b77bae18a in current term 1: Already voted for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in this term.
I20260709 13:22:35.764807 30252 raft_consensus.cc:515] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.766161 29980 leader_election.cc:304] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a; no voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:35.767306 30213 raft_consensus.cc:3060] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.768503 30252 leader_election.cc:290] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:35.768411 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb765e56b4f42d0a4f2527b9a467598" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:35.768337 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb765e56b4f42d0a4f2527b9a467598" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:35.770424 30014 raft_consensus.cc:2393] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0f2dfd7a834b938cc24c740891b090 in current term 1: Already voted for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in this term.
I20260709 13:22:35.771458 30055 leader_election.cc:304] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0f2dfd7a834b938cc24c740891b090; no voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8
I20260709 13:22:35.772804 30252 raft_consensus.cc:3060] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:35.775079 30213 raft_consensus.cc:2749] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:35.775537 30164 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e367938ddfd64760b6f758e1fdc05c02"
dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
mode: GRACEFUL
new_leader_uuid: "27c5f6809b3848c1b686954b77bae18a"
 from {username='slave'} at 127.0.0.1:35706
I20260709 13:22:35.776126 30164 raft_consensus.cc:606] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Received request to transfer leadership to TS 27c5f6809b3848c1b686954b77bae18a
I20260709 13:22:35.780120 30252 raft_consensus.cc:2749] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:35.790987 30089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23606403df3a4de9861ee59ccd4e70c0"
dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
mode: GRACEFUL
new_leader_uuid: "27c5f6809b3848c1b686954b77bae18a"
 from {username='slave'} at 127.0.0.1:34224
I20260709 13:22:35.791585 30089 raft_consensus.cc:606] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Received request to transfer leadership to TS 27c5f6809b3848c1b686954b77bae18a
I20260709 13:22:35.799721 30164 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff49f85f979c4df9bed315f95129e685"
dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
mode: GRACEFUL
new_leader_uuid: "ef0f2dfd7a834b938cc24c740891b090"
 from {username='slave'} at 127.0.0.1:35706
I20260709 13:22:35.800239 30164 raft_consensus.cc:606] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Received request to transfer leadership to TS ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:35.805361 30164 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1eb765e56b4f42d0a4f2527b9a467598"
dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
mode: GRACEFUL
new_leader_uuid: "ef0f2dfd7a834b938cc24c740891b090"
 from {username='slave'} at 127.0.0.1:35706
I20260709 13:22:35.805833 30164 raft_consensus.cc:606] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Received request to transfer leadership to TS ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:35.810529 30164 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7201028b7584d829863e1b74409c065"
dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
mode: GRACEFUL
new_leader_uuid: "ef0f2dfd7a834b938cc24c740891b090"
 from {username='slave'} at 127.0.0.1:35706
I20260709 13:22:35.811043 30164 raft_consensus.cc:606] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Received request to transfer leadership to TS ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:35.835654 30236 consensus_queue.cc:1048] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:35.840072 30236 consensus_queue.cc:1048] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:35.848330 30213 consensus_queue.cc:1048] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:35.857271 30236 raft_consensus.cc:993] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8: : Instructing follower 27c5f6809b3848c1b686954b77bae18a to start an election
I20260709 13:22:35.857880 30206 raft_consensus.cc:1081] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Signalling peer 27c5f6809b3848c1b686954b77bae18a to start an election
I20260709 13:22:35.859889 30015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e367938ddfd64760b6f758e1fdc05c02"
dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:22:35.869627 30015 raft_consensus.cc:493] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:35.870054 30015 raft_consensus.cc:3060] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.877684 30015 raft_consensus.cc:515] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.878866 30231 consensus_queue.cc:1048] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:35.875977 30213 consensus_queue.cc:1048] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:35.881748 30015 leader_election.cc:290] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 2 election: Requested vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:35.882331 30231 consensus_queue.cc:1048] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:35.883075 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e367938ddfd64760b6f758e1fdc05c02" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:35.884999 30163 raft_consensus.cc:3055] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:35.885335 30163 raft_consensus.cc:740] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Running, Role: LEADER
I20260709 13:22:35.886165 30163 consensus_queue.cc:260] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.887460 30163 raft_consensus.cc:3060] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.891556 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e367938ddfd64760b6f758e1fdc05c02" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:35.892189 30090 raft_consensus.cc:3060] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.895361 30163 raft_consensus.cc:2468] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 2.
I20260709 13:22:35.896797 29979 leader_election.cc:304] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 
I20260709 13:22:35.897854 30229 raft_consensus.cc:2804] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:35.898324 30229 raft_consensus.cc:697] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [term 2 LEADER]: Becoming Leader. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Running, Role: LEADER
I20260709 13:22:35.899153 30229 consensus_queue.cc:237] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.905525 30090 raft_consensus.cc:2468] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 2.
I20260709 13:22:35.908931 30243 consensus_queue.cc:1048] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:35.920034 30231 consensus_queue.cc:1048] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:35.923429 29909 catalog_manager.cc:5697] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a reported cstate change: term changed from 1 to 2, leader changed from 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131) to 27c5f6809b3848c1b686954b77bae18a (127.16.188.129). New cstate: current_term: 2 leader_uuid: "27c5f6809b3848c1b686954b77bae18a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:35.931957 30213 consensus_queue.cc:1048] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:35.935315 30231 consensus_queue.cc:1048] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:35.942778 30236 raft_consensus.cc:993] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8: : Instructing follower ef0f2dfd7a834b938cc24c740891b090 to start an election
I20260709 13:22:35.943290 30236 raft_consensus.cc:1081] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Signalling peer ef0f2dfd7a834b938cc24c740891b090 to start an election
I20260709 13:22:35.946973 30089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1eb765e56b4f42d0a4f2527b9a467598"
dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
 from {username='slave'} at 127.0.0.1:34212
I20260709 13:22:35.949379 30089 raft_consensus.cc:493] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:35.949913 30089 raft_consensus.cc:3060] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.967749 30089 raft_consensus.cc:515] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.971468 30089 leader_election.cc:290] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 2 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:35.972878 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb765e56b4f42d0a4f2527b9a467598" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:35.973596 30163 raft_consensus.cc:3055] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:35.973907 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb765e56b4f42d0a4f2527b9a467598" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:35.973948 30163 raft_consensus.cc:740] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Running, Role: LEADER
I20260709 13:22:35.974598 30015 raft_consensus.cc:3060] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.975090 30163 consensus_queue.cc:260] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.976569 30163 raft_consensus.cc:3060] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:35.984587 30163 raft_consensus.cc:2468] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 2.
I20260709 13:22:35.984665 30015 raft_consensus.cc:2468] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 2.
I20260709 13:22:35.985705 30054 leader_election.cc:304] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:35.986656 30252 raft_consensus.cc:2804] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:35.987200 30252 raft_consensus.cc:697] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [term 2 LEADER]: Becoming Leader. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Running, Role: LEADER
I20260709 13:22:35.988178 30252 consensus_queue.cc:237] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:35.995186 29909 catalog_manager.cc:5697] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 reported cstate change: term changed from 1 to 2, leader changed from 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131) to ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "ef0f2dfd7a834b938cc24c740891b090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:36.042629 30252 consensus_queue.cc:1048] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:36.051043 30279 raft_consensus.cc:493] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:36.051714 30279 raft_consensus.cc:515] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:36.054296 30279 leader_election.cc:290] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:36.054600 30256 consensus_queue.cc:1048] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:36.055588 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23606403df3a4de9861ee59ccd4e70c0" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:36.059002 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23606403df3a4de9861ee59ccd4e70c0" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:36.059844 30015 raft_consensus.cc:2393] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87770ebb4d4d45938b280d6f1b21e6f8 in current term 1: Already voted for candidate ef0f2dfd7a834b938cc24c740891b090 in this term.
I20260709 13:22:36.061081 30129 leader_election.cc:304] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:36.062290 30279 raft_consensus.cc:3060] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:36.072156 30279 raft_consensus.cc:2749] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:36.077330 30252 consensus_queue.cc:1048] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:36.090265 30252 consensus_queue.cc:1048] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:36.098230 30255 raft_consensus.cc:993] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090: : Instructing follower 27c5f6809b3848c1b686954b77bae18a to start an election
I20260709 13:22:36.098822 30252 raft_consensus.cc:1081] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Signalling peer 27c5f6809b3848c1b686954b77bae18a to start an election
I20260709 13:22:36.100440 30014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23606403df3a4de9861ee59ccd4e70c0"
dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
 from {username='slave'} at 127.0.0.1:47238
I20260709 13:22:36.101090 30014 raft_consensus.cc:493] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:36.101508 30014 raft_consensus.cc:3060] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.106439 30279 consensus_queue.cc:1048] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:36.110405 30014 raft_consensus.cc:515] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:36.115489 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23606403df3a4de9861ee59ccd4e70c0" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:36.116171 30088 raft_consensus.cc:3055] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:36.116534 30088 raft_consensus.cc:740] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Running, Role: LEADER
I20260709 13:22:36.117448 30088 consensus_queue.cc:260] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:36.118683 30088 raft_consensus.cc:3060] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.123268 30236 raft_consensus.cc:993] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8: : Instructing follower ef0f2dfd7a834b938cc24c740891b090 to start an election
I20260709 13:22:36.123921 30231 raft_consensus.cc:1081] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Signalling peer ef0f2dfd7a834b938cc24c740891b090 to start an election
I20260709 13:22:36.126948 30090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff49f85f979c4df9bed315f95129e685"
dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
 from {username='slave'} at 127.0.0.1:34212
I20260709 13:22:36.128150 30090 raft_consensus.cc:493] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:36.128185 30088 raft_consensus.cc:2468] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 2.
I20260709 13:22:36.128630 30090 raft_consensus.cc:3060] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.131004 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23606403df3a4de9861ee59ccd4e70c0" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:36.131702 30163 raft_consensus.cc:3060] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.133728 30236 consensus_queue.cc:1048] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:36.136895 30236 consensus_queue.cc:1048] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:36.139871 30163 raft_consensus.cc:2468] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 2.
I20260709 13:22:36.141345 29979 leader_election.cc:304] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 
I20260709 13:22:36.142401 30213 raft_consensus.cc:2804] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:36.142935 30213 raft_consensus.cc:697] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 2 LEADER]: Becoming Leader. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Running, Role: LEADER
I20260709 13:22:36.143868 30213 consensus_queue.cc:237] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:36.148651 30090 raft_consensus.cc:515] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:36.148867 30236 consensus_queue.cc:1048] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:36.149646 30014 leader_election.cc:290] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 2 election: Requested vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:36.155853 29909 catalog_manager.cc:5697] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a reported cstate change: term changed from 1 to 2, leader changed from ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130) to 27c5f6809b3848c1b686954b77bae18a (127.16.188.129). New cstate: current_term: 2 leader_uuid: "27c5f6809b3848c1b686954b77bae18a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:36.162508 30090 leader_election.cc:290] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 2 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:36.167428 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff49f85f979c4df9bed315f95129e685" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:36.168157 30013 raft_consensus.cc:3060] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.162706 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff49f85f979c4df9bed315f95129e685" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:36.171401 30163 raft_consensus.cc:3055] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:36.171787 30163 raft_consensus.cc:740] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Running, Role: LEADER
I20260709 13:22:36.172761 30163 consensus_queue.cc:260] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:36.174074 30163 raft_consensus.cc:3060] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.174428 30231 raft_consensus.cc:993] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8: : Instructing follower ef0f2dfd7a834b938cc24c740891b090 to start an election
I20260709 13:22:36.174959 30231 raft_consensus.cc:1081] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Signalling peer ef0f2dfd7a834b938cc24c740891b090 to start an election
I20260709 13:22:36.176731 30090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7201028b7584d829863e1b74409c065"
dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
 from {username='slave'} at 127.0.0.1:34212
I20260709 13:22:36.177387 30090 raft_consensus.cc:493] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:36.177677 30013 raft_consensus.cc:2468] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 2.
I20260709 13:22:36.177811 30090 raft_consensus.cc:3060] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.179183 30055 leader_election.cc:304] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:36.180208 30252 raft_consensus.cc:2804] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:36.180778 30252 raft_consensus.cc:697] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [term 2 LEADER]: Becoming Leader. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Running, Role: LEADER
I20260709 13:22:36.181680 30252 consensus_queue.cc:237] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:36.182175 30163 raft_consensus.cc:2468] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 2.
I20260709 13:22:36.188114 30090 raft_consensus.cc:515] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:36.189965 30089 raft_consensus.cc:1240] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Rejecting Update request from peer 87770ebb4d4d45938b280d6f1b21e6f8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:36.190770 30090 leader_election.cc:290] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 2 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:36.193120 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7201028b7584d829863e1b74409c065" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:36.193550 30236 consensus_queue.cc:1059] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:36.194000 30013 raft_consensus.cc:3060] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.194583 30279 raft_consensus.cc:3055] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:36.193382 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7201028b7584d829863e1b74409c065" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:36.195363 30279 raft_consensus.cc:740] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Running, Role: LEADER
I20260709 13:22:36.196696 29911 catalog_manager.cc:5697] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 reported cstate change: term changed from 1 to 2, leader changed from 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131) to ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "ef0f2dfd7a834b938cc24c740891b090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:36.196805 30279 consensus_queue.cc:260] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:36.198422 30279 raft_consensus.cc:3060] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:36.202893 30013 raft_consensus.cc:2468] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 2.
I20260709 13:22:36.204398 30055 leader_election.cc:304] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:36.205474 30252 raft_consensus.cc:2804] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:36.205978 30252 raft_consensus.cc:697] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [term 2 LEADER]: Becoming Leader. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Running, Role: LEADER
I20260709 13:22:36.206873 30252 consensus_queue.cc:237] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:36.213608 30163 raft_consensus.cc:2468] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 2.
I20260709 13:22:36.214305 29911 catalog_manager.cc:5697] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 reported cstate change: term changed from 1 to 2, leader changed from 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131) to ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "ef0f2dfd7a834b938cc24c740891b090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:36.372805 30163 raft_consensus.cc:1275] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Refusing update from remote peer ef0f2dfd7a834b938cc24c740891b090: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.374221 30252 consensus_queue.cc:1048] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:36.382269 30013 raft_consensus.cc:1275] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Refusing update from remote peer ef0f2dfd7a834b938cc24c740891b090: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.383957 30256 consensus_queue.cc:1048] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:36.413676 30163 raft_consensus.cc:1275] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Refusing update from remote peer 27c5f6809b3848c1b686954b77bae18a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.415246 30213 consensus_queue.cc:1048] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:36.423913 30089 raft_consensus.cc:1275] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Refusing update from remote peer 27c5f6809b3848c1b686954b77bae18a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.425702 30288 consensus_queue.cc:1048] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:36.601073 30013 raft_consensus.cc:1275] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Refusing update from remote peer ef0f2dfd7a834b938cc24c740891b090: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.602571 30256 consensus_queue.cc:1048] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:36.616107 30163 raft_consensus.cc:1275] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Refusing update from remote peer ef0f2dfd7a834b938cc24c740891b090: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.617727 30289 consensus_queue.cc:1048] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:36.640884 30163 raft_consensus.cc:1275] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Refusing update from remote peer 27c5f6809b3848c1b686954b77bae18a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.642344 30288 consensus_queue.cc:1048] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:36.651660 30089 raft_consensus.cc:1275] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Refusing update from remote peer 27c5f6809b3848c1b686954b77bae18a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.653669 30243 consensus_queue.cc:1048] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:36.747499 30163 raft_consensus.cc:1275] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Refusing update from remote peer ef0f2dfd7a834b938cc24c740891b090: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.748975 30289 consensus_queue.cc:1048] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:36.757030 30013 raft_consensus.cc:1275] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Refusing update from remote peer ef0f2dfd7a834b938cc24c740891b090: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:36.758390 30252 consensus_queue.cc:1048] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:38.852648 29911 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43234:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:38.856459 29911 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:38.919977 29997 tablet_service.cc:1511] Processing CreateTablet for tablet 0270b3a4121640f88c0636bff5d639cc (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:38.920578 30076 tablet_service.cc:1511] Processing CreateTablet for tablet 0270b3a4121640f88c0636bff5d639cc (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:38.922406 30076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0270b3a4121640f88c0636bff5d639cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:38.923365 30152 tablet_service.cc:1511] Processing CreateTablet for tablet 0270b3a4121640f88c0636bff5d639cc (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:38.925236 30152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0270b3a4121640f88c0636bff5d639cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:38.925352 29998 tablet_service.cc:1511] Processing CreateTablet for tablet aec69c40433047528516ae3143641ea8 (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:38.925464 30075 tablet_service.cc:1511] Processing CreateTablet for tablet aec69c40433047528516ae3143641ea8 (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:38.928660 30075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec69c40433047528516ae3143641ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:38.930261 30147 tablet_service.cc:1511] Processing CreateTablet for tablet aec69c40433047528516ae3143641ea8 (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:38.931699 30147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec69c40433047528516ae3143641ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:38.933014 29999 tablet_service.cc:1511] Processing CreateTablet for tablet 9cc5fc5e790a4fbc8b04208992d93869 (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:38.922231 29997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0270b3a4121640f88c0636bff5d639cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:38.934090 30078 tablet_service.cc:1511] Processing CreateTablet for tablet 9cc5fc5e790a4fbc8b04208992d93869 (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:38.935742 30078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cc5fc5e790a4fbc8b04208992d93869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:38.939617 29999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cc5fc5e790a4fbc8b04208992d93869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:38.942611 29998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec69c40433047528516ae3143641ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:38.950891 30150 tablet_service.cc:1511] Processing CreateTablet for tablet 9cc5fc5e790a4fbc8b04208992d93869 (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:38.952529 30150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cc5fc5e790a4fbc8b04208992d93869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:38.955353 30004 tablet_service.cc:1511] Processing CreateTablet for tablet a02cac03e22f49bebce475241fe5052d (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:38.956804 30004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a02cac03e22f49bebce475241fe5052d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:38.967326 30074 tablet_service.cc:1511] Processing CreateTablet for tablet a02cac03e22f49bebce475241fe5052d (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:38.969988 30148 tablet_service.cc:1511] Processing CreateTablet for tablet a02cac03e22f49bebce475241fe5052d (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:38.971377 30074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a02cac03e22f49bebce475241fe5052d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:38.971627 30148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a02cac03e22f49bebce475241fe5052d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:38.978652 30005 tablet_service.cc:1511] Processing CreateTablet for tablet dc7af5e12ff94cdb8af001206c75ace0 (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:38.980285 30005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7af5e12ff94cdb8af001206c75ace0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:38.996487 30080 tablet_service.cc:1511] Processing CreateTablet for tablet dc7af5e12ff94cdb8af001206c75ace0 (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:38.998090 30080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7af5e12ff94cdb8af001206c75ace0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:39.003144 30151 tablet_service.cc:1511] Processing CreateTablet for tablet dc7af5e12ff94cdb8af001206c75ace0 (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:39.004702 30151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7af5e12ff94cdb8af001206c75ace0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:39.005776 30000 tablet_service.cc:1511] Processing CreateTablet for tablet 650db2f2b2c04e2ca1b44b60375e5742 (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:39.007330 30000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 650db2f2b2c04e2ca1b44b60375e5742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:39.031685 30076 tablet_service.cc:1511] Processing CreateTablet for tablet 650db2f2b2c04e2ca1b44b60375e5742 (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:39.034579 30076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 650db2f2b2c04e2ca1b44b60375e5742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:39.053951 30301 tablet_bootstrap.cc:492] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:39.063381 30302 tablet_bootstrap.cc:492] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:39.066777 30301 tablet_bootstrap.cc:654] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.068876 30152 tablet_service.cc:1511] Processing CreateTablet for tablet 650db2f2b2c04e2ca1b44b60375e5742 (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:39.070677 30152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 650db2f2b2c04e2ca1b44b60375e5742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:39.072548 30303 tablet_bootstrap.cc:492] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:39.075006 29998 tablet_service.cc:1511] Processing CreateTablet for tablet 3efcfa4d196a46dcac96ee2a4000afaf (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:39.076478 29998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efcfa4d196a46dcac96ee2a4000afaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:39.078270 30075 tablet_service.cc:1511] Processing CreateTablet for tablet 3efcfa4d196a46dcac96ee2a4000afaf (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:39.084566 30075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efcfa4d196a46dcac96ee2a4000afaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:39.087610 30301 tablet_bootstrap.cc:492] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:39.088251 30301 ts_tablet_manager.cc:1403] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.007s
I20260709 13:22:39.091719 30005 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6746fb40aa423caeb7bd124b80938e (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:39.084705 30303 tablet_bootstrap.cc:654] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.093323 30005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6746fb40aa423caeb7bd124b80938e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:39.091924 30301 raft_consensus.cc:359] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.086668 30151 tablet_service.cc:1511] Processing CreateTablet for tablet 3efcfa4d196a46dcac96ee2a4000afaf (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:39.096402 30301 raft_consensus.cc:385] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.096786 30301 raft_consensus.cc:740] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.097424 30151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efcfa4d196a46dcac96ee2a4000afaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:39.098730 30078 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6746fb40aa423caeb7bd124b80938e (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:39.100092 30078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6746fb40aa423caeb7bd124b80938e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:39.102283 30302 tablet_bootstrap.cc:654] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.102528 30147 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6746fb40aa423caeb7bd124b80938e (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:39.103919 30147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6746fb40aa423caeb7bd124b80938e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:39.111274 30301 consensus_queue.cc:260] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.114542 30301 ts_tablet_manager.cc:1434] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:22:39.115751 30301 tablet_bootstrap.cc:492] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:39.133351 30000 tablet_service.cc:1511] Processing CreateTablet for tablet 7e51e428264343a3a7302bf2b28bede4 (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:39.134690 30000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e51e428264343a3a7302bf2b28bede4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:39.139879 30301 tablet_bootstrap.cc:654] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.141633 30078 tablet_service.cc:1511] Processing CreateTablet for tablet 7e51e428264343a3a7302bf2b28bede4 (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:39.142970 30078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e51e428264343a3a7302bf2b28bede4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:39.151223 30303 tablet_bootstrap.cc:492] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:39.151859 30303 ts_tablet_manager.cc:1403] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.006s
I20260709 13:22:39.152634 30150 tablet_service.cc:1511] Processing CreateTablet for tablet 7e51e428264343a3a7302bf2b28bede4 (DEFAULT_TABLE table=soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:39.154098 30150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e51e428264343a3a7302bf2b28bede4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:39.155040 30303 raft_consensus.cc:359] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.155833 30303 raft_consensus.cc:385] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.156116 30303 raft_consensus.cc:740] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.165119 30303 consensus_queue.cc:260] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.185034 30303 ts_tablet_manager.cc:1434] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.005s
W20260709 13:22:39.187127 29961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:39.188637 30303 tablet_bootstrap.cc:492] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:39.191565 30301 tablet_bootstrap.cc:492] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:39.196018 30303 tablet_bootstrap.cc:654] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.200956 30301 ts_tablet_manager.cc:1403] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.011s
I20260709 13:22:39.199452 30302 tablet_bootstrap.cc:492] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:39.203754 30302 ts_tablet_manager.cc:1403] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.141s	user 0.031s	sys 0.049s
I20260709 13:22:39.204231 30301 raft_consensus.cc:359] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.205057 30301 raft_consensus.cc:385] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.205384 30301 raft_consensus.cc:740] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.206128 30301 consensus_queue.cc:260] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.209425 30301 ts_tablet_manager.cc:1434] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:22:39.210420 30301 tablet_bootstrap.cc:492] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:39.213689 30302 raft_consensus.cc:359] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.214735 30302 raft_consensus.cc:385] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.215128 30302 raft_consensus.cc:740] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.216176 30302 consensus_queue.cc:260] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.217693 30303 tablet_bootstrap.cc:492] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:39.218289 30303 ts_tablet_manager.cc:1403] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.005s
I20260709 13:22:39.220558 30301 tablet_bootstrap.cc:654] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.221421 30303 raft_consensus.cc:359] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.222227 30303 raft_consensus.cc:385] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.222524 30303 raft_consensus.cc:740] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.223459 30303 consensus_queue.cc:260] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.225759 30303 ts_tablet_manager.cc:1434] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:22:39.227958 30303 tablet_bootstrap.cc:492] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:39.230289 30302 ts_tablet_manager.cc:1434] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:22:39.233741 30302 tablet_bootstrap.cc:492] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:39.235273 30303 tablet_bootstrap.cc:654] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.239853 30279 raft_consensus.cc:493] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:39.240505 30279 raft_consensus.cc:515] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.241050 30302 tablet_bootstrap.cc:654] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.243243 30279 leader_election.cc:290] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:39.245360 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02cac03e22f49bebce475241fe5052d" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:39.247360 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02cac03e22f49bebce475241fe5052d" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
W20260709 13:22:39.249312 30129 leader_election.cc:343] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:39.251448 30129 leader_election.cc:343] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:39.251878 30129 leader_election.cc:304] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:39.253221 30279 raft_consensus.cc:2749] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:39.253077 30301 tablet_bootstrap.cc:492] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:39.258359 30301 ts_tablet_manager.cc:1403] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.018s
I20260709 13:22:39.259374 30302 tablet_bootstrap.cc:492] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:39.259932 30302 ts_tablet_manager.cc:1403] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.000s
I20260709 13:22:39.260229 30303 tablet_bootstrap.cc:492] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:39.260885 30303 ts_tablet_manager.cc:1403] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.020s
I20260709 13:22:39.261976 30301 raft_consensus.cc:359] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.262796 30301 raft_consensus.cc:385] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.262709 30302 raft_consensus.cc:359] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.263337 30301 raft_consensus.cc:740] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.263688 30302 raft_consensus.cc:385] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.264030 30302 raft_consensus.cc:740] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.264257 30303 raft_consensus.cc:359] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.264894 30279 raft_consensus.cc:493] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:39.266207 30303 raft_consensus.cc:385] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.264389 30301 consensus_queue.cc:260] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.266535 30303 raft_consensus.cc:740] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.264950 30302 consensus_queue.cc:260] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.266430 30279 raft_consensus.cc:515] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.270113 30302 ts_tablet_manager.cc:1434] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:22:39.267731 30303 consensus_queue.cc:260] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.272200 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0270b3a4121640f88c0636bff5d639cc" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:39.273188 30013 raft_consensus.cc:2468] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 0.
I20260709 13:22:39.274745 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0270b3a4121640f88c0636bff5d639cc" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:39.275661 30089 raft_consensus.cc:2468] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 0.
I20260709 13:22:39.278224 30129 leader_election.cc:304] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 
I20260709 13:22:39.267807 30243 raft_consensus.cc:493] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:39.280771 30243 raft_consensus.cc:515] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.285037 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc5fc5e790a4fbc8b04208992d93869" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:39.285904 30089 raft_consensus.cc:2468] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 0.
I20260709 13:22:39.287536 30302 tablet_bootstrap.cc:492] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:39.287544 29980 leader_election.cc:304] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:39.270159 30279 leader_election.cc:290] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:39.297995 30302 tablet_bootstrap.cc:654] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.301529 30312 raft_consensus.cc:2804] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:39.302006 30312 raft_consensus.cc:493] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:39.302371 30312 raft_consensus.cc:3060] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.302634 30301 ts_tablet_manager.cc:1434] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.044s	user 0.025s	sys 0.017s
I20260709 13:22:39.303716 30301 tablet_bootstrap.cc:492] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:39.305639 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc5fc5e790a4fbc8b04208992d93869" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:39.306751 30163 raft_consensus.cc:2468] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 0.
I20260709 13:22:39.308573 30243 leader_election.cc:290] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:39.310199 30301 tablet_bootstrap.cc:654] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.310885 30243 raft_consensus.cc:2804] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:39.311415 30243 raft_consensus.cc:493] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:39.310644 30312 raft_consensus.cc:515] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.315459 30243 raft_consensus.cc:3060] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.317184 30312 leader_election.cc:290] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:39.322402 30302 tablet_bootstrap.cc:492] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:39.323153 30302 ts_tablet_manager.cc:1403] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.003s
I20260709 13:22:39.327392 30302 raft_consensus.cc:359] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.328356 30302 raft_consensus.cc:385] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.329430 30302 raft_consensus.cc:740] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.330302 30302 consensus_queue.cc:260] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.331724 30301 tablet_bootstrap.cc:492] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:39.332280 30301 ts_tablet_manager.cc:1403] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.007s
I20260709 13:22:39.332732 30302 ts_tablet_manager.cc:1434] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.002s
I20260709 13:22:39.333912 30302 tablet_bootstrap.cc:492] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:39.335282 30301 raft_consensus.cc:359] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.341087 30302 tablet_bootstrap.cc:654] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.341310 30301 raft_consensus.cc:385] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.341665 30301 raft_consensus.cc:740] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.342465 30301 consensus_queue.cc:260] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.345603 30301 ts_tablet_manager.cc:1434] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:22:39.346951 30301 tablet_bootstrap.cc:492] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:39.357694 30301 tablet_bootstrap.cc:654] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:39.378728 29980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.130:38981, user_credentials={real_user=slave}} blocked reactor thread for 91478.9us
I20260709 13:22:39.391028 30302 tablet_bootstrap.cc:492] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:39.391939 30302 ts_tablet_manager.cc:1403] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.058s	user 0.027s	sys 0.022s
I20260709 13:22:39.393846 30303 ts_tablet_manager.cc:1434] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.133s	user 0.043s	sys 0.057s
I20260709 13:22:39.395149 30303 tablet_bootstrap.cc:492] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:39.396181 30302 raft_consensus.cc:359] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.397339 30302 raft_consensus.cc:385] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.396049 30243 raft_consensus.cc:515] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.397753 30302 raft_consensus.cc:740] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.399516 30302 consensus_queue.cc:260] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.401309 30301 tablet_bootstrap.cc:492] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:39.401868 30301 ts_tablet_manager.cc:1403] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.055s	user 0.024s	sys 0.029s
I20260709 13:22:39.402304 30243 leader_election.cc:290] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 election: Requested vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:39.405283 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc5fc5e790a4fbc8b04208992d93869" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:39.405553 30303 tablet_bootstrap.cc:654] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.405470 30301 raft_consensus.cc:359] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.406525 30301 raft_consensus.cc:385] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.406894 30301 raft_consensus.cc:740] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.407611 30301 consensus_queue.cc:260] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.410607 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cc5fc5e790a4fbc8b04208992d93869" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
W20260709 13:22:39.410986 30129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.188.129:39439, user_credentials={real_user=slave}} blocked reactor thread for 132914us
I20260709 13:22:39.411466 30089 raft_consensus.cc:3060] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.413196 30301 ts_tablet_manager.cc:1434] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:22:39.414249 30301 tablet_bootstrap.cc:492] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:39.419760 30302 ts_tablet_manager.cc:1434] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.006s
I20260709 13:22:39.420887 30302 tablet_bootstrap.cc:492] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:39.422974 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0270b3a4121640f88c0636bff5d639cc" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:39.423326 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0270b3a4121640f88c0636bff5d639cc" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:39.423774 30013 raft_consensus.cc:3060] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.423952 30090 raft_consensus.cc:3060] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.427861 30302 tablet_bootstrap.cc:654] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.430581 30301 tablet_bootstrap.cc:654] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.417893 30163 raft_consensus.cc:3060] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.442979 30090 raft_consensus.cc:2468] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 1.
I20260709 13:22:39.445650 30013 raft_consensus.cc:2468] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 1.
I20260709 13:22:39.448654 30163 raft_consensus.cc:2468] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 1.
I20260709 13:22:39.451484 30303 tablet_bootstrap.cc:492] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:39.452103 30303 ts_tablet_manager.cc:1403] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.005s
I20260709 13:22:39.453524 30243 raft_consensus.cc:493] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:39.454247 30243 raft_consensus.cc:515] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.455458 30303 raft_consensus.cc:359] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.456252 30303 raft_consensus.cc:385] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.456609 30303 raft_consensus.cc:740] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.457013 29979 leader_election.cc:304] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 
I20260709 13:22:39.457406 30303 consensus_queue.cc:260] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.458353 30313 raft_consensus.cc:2804] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:39.460088 30303 ts_tablet_manager.cc:1434] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:22:39.470486 30313 raft_consensus.cc:697] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Becoming Leader. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Running, Role: LEADER
I20260709 13:22:39.468117 30089 raft_consensus.cc:2468] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 1.
I20260709 13:22:39.474195 30313 consensus_queue.cc:237] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.475687 30243 leader_election.cc:290] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:39.480839 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7af5e12ff94cdb8af001206c75ace0" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:39.481766 30090 raft_consensus.cc:2468] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 0.
I20260709 13:22:39.485728 30129 leader_election.cc:304] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:39.486397 29980 leader_election.cc:304] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:39.491340 30312 raft_consensus.cc:2804] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:39.492970 30243 raft_consensus.cc:2804] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:39.493333 30243 raft_consensus.cc:493] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:39.493645 30243 raft_consensus.cc:3060] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.492040 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7af5e12ff94cdb8af001206c75ace0" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:39.494642 30164 raft_consensus.cc:2468] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 0.
I20260709 13:22:39.495153 30303 tablet_bootstrap.cc:492] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:39.495476 30312 raft_consensus.cc:697] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Becoming Leader. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Running, Role: LEADER
I20260709 13:22:39.496461 30312 consensus_queue.cc:237] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.506610 30303 tablet_bootstrap.cc:654] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.509161 30243 raft_consensus.cc:515] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.519423 30302 tablet_bootstrap.cc:492] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:39.520385 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7af5e12ff94cdb8af001206c75ace0" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:39.522257 30090 raft_consensus.cc:3060] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.521673 30302 ts_tablet_manager.cc:1403] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.101s	user 0.037s	sys 0.014s
I20260709 13:22:39.524029 30301 tablet_bootstrap.cc:492] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
W20260709 13:22:39.522324 30055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:39439, user_credentials={real_user=slave}} blocked reactor thread for 53546.6us
I20260709 13:22:39.527410 30301 ts_tablet_manager.cc:1403] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.113s	user 0.017s	sys 0.023s
I20260709 13:22:39.530983 30301 raft_consensus.cc:359] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.531795 30301 raft_consensus.cc:385] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.532330 30301 raft_consensus.cc:740] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.533412 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7af5e12ff94cdb8af001206c75ace0" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:39.534137 30164 raft_consensus.cc:3060] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.533574 30301 consensus_queue.cc:260] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.543643 30302 raft_consensus.cc:359] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.544814 30302 raft_consensus.cc:385] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.545217 30302 raft_consensus.cc:740] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.546172 30302 consensus_queue.cc:260] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.548990 30303 tablet_bootstrap.cc:492] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:39.549376 30301 ts_tablet_manager.cc:1434] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 13:22:39.549683 30303 ts_tablet_manager.cc:1403] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.064s	user 0.021s	sys 0.000s
I20260709 13:22:39.550680 30301 tablet_bootstrap.cc:492] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:39.553822 30325 raft_consensus.cc:493] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:39.554455 30325 raft_consensus.cc:515] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.556424 30302 ts_tablet_manager.cc:1434] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 13:22:39.558184 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02cac03e22f49bebce475241fe5052d" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:39.561579 30164 raft_consensus.cc:2468] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 1.
I20260709 13:22:39.562704 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02cac03e22f49bebce475241fe5052d" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:39.563546 30163 raft_consensus.cc:2468] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 0.
I20260709 13:22:39.564054 29979 leader_election.cc:304] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 
I20260709 13:22:39.565135 30054 leader_election.cc:304] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:39.565362 30315 raft_consensus.cc:2804] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:39.566133 30315 raft_consensus.cc:697] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Becoming Leader. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Running, Role: LEADER
I20260709 13:22:39.566553 30301 tablet_bootstrap.cc:654] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.566344 30326 raft_consensus.cc:2804] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:39.567271 30326 raft_consensus.cc:493] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:39.567654 30326 raft_consensus.cc:3060] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.554035 29909 catalog_manager.cc:5697] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27c5f6809b3848c1b686954b77bae18a (127.16.188.129). New cstate: current_term: 1 leader_uuid: "27c5f6809b3848c1b686954b77bae18a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:39.567128 30315 consensus_queue.cc:237] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.565289 30302 tablet_bootstrap.cc:492] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:39.566267 30325 leader_election.cc:290] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:39.572333 30243 leader_election.cc:290] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 election: Requested vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:39.569922 30303 raft_consensus.cc:359] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.574936 30303 raft_consensus.cc:385] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.575340 30303 raft_consensus.cc:740] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.576366 30303 consensus_queue.cc:260] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.578016 30013 raft_consensus.cc:2468] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 0.
I20260709 13:22:39.580919 30303 ts_tablet_manager.cc:1434] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:22:39.582556 30090 raft_consensus.cc:2468] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 1.
I20260709 13:22:39.584574 30303 tablet_bootstrap.cc:492] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:39.589713 30302 tablet_bootstrap.cc:654] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.589824 29912 catalog_manager.cc:5697] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131). New cstate: current_term: 1 leader_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:39.595115 30326 raft_consensus.cc:515] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.607828 30312 raft_consensus.cc:493] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:39.608475 30312 raft_consensus.cc:515] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.610891 30312 leader_election.cc:290] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:39.612787 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efcfa4d196a46dcac96ee2a4000afaf" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:39.613303 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efcfa4d196a46dcac96ee2a4000afaf" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
W20260709 13:22:39.614531 30129 leader_election.cc:343] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:39.613224 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02cac03e22f49bebce475241fe5052d" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
W20260709 13:22:39.615437 30129 leader_election.cc:343] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:39.615618 30301 tablet_bootstrap.cc:492] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:39.616142 30129 leader_election.cc:304] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:39.616467 30301 ts_tablet_manager.cc:1403] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.014s
I20260709 13:22:39.616154 30014 raft_consensus.cc:3060] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.617740 30326 leader_election.cc:290] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:39.619084 30312 raft_consensus.cc:2749] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:39.621671 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02cac03e22f49bebce475241fe5052d" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:39.622442 30164 raft_consensus.cc:3060] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.625278 30302 tablet_bootstrap.cc:492] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:39.626030 30302 ts_tablet_manager.cc:1403] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.004s
I20260709 13:22:39.626364 30301 raft_consensus.cc:359] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.627327 30301 raft_consensus.cc:385] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.627677 30301 raft_consensus.cc:740] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.627825 30014 raft_consensus.cc:2468] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 1.
I20260709 13:22:39.628803 30301 consensus_queue.cc:260] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.630576 30055 leader_election.cc:304] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:39.630805 30302 raft_consensus.cc:359] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.631551 30326 raft_consensus.cc:2804] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:39.633010 30326 raft_consensus.cc:697] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Becoming Leader. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Running, Role: LEADER
I20260709 13:22:39.633492 30302 raft_consensus.cc:385] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.634483 30326 consensus_queue.cc:237] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.640411 30301 ts_tablet_manager.cc:1434] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:22:39.634048 30302 raft_consensus.cc:740] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.641732 30301 tablet_bootstrap.cc:492] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:39.641655 30302 consensus_queue.cc:260] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.642493 30164 raft_consensus.cc:2468] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 1.
I20260709 13:22:39.646415 30302 ts_tablet_manager.cc:1434] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 13:22:39.647670 30302 tablet_bootstrap.cc:492] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:39.657292 30303 tablet_bootstrap.cc:654] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.660776 30301 tablet_bootstrap.cc:654] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.667573 30302 tablet_bootstrap.cc:654] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.673595 30303 tablet_bootstrap.cc:492] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:39.674762 30303 ts_tablet_manager.cc:1403] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.091s	user 0.021s	sys 0.000s
I20260709 13:22:39.693955 30301 tablet_bootstrap.cc:492] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:39.694641 30301 ts_tablet_manager.cc:1403] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.003s
I20260709 13:22:39.702502 30303 raft_consensus.cc:359] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.703374 30303 raft_consensus.cc:385] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.703675 30303 raft_consensus.cc:740] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.704381 30303 consensus_queue.cc:260] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.706576 30303 ts_tablet_manager.cc:1434] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:22:39.706516 29912 catalog_manager.cc:5697] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27c5f6809b3848c1b686954b77bae18a (127.16.188.129). New cstate: current_term: 1 leader_uuid: "27c5f6809b3848c1b686954b77bae18a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:39.707827 30302 tablet_bootstrap.cc:492] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:39.707988 30303 tablet_bootstrap.cc:492] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:39.708542 30302 ts_tablet_manager.cc:1403] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.013s
I20260709 13:22:39.716634 30303 tablet_bootstrap.cc:654] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.717124 30302 raft_consensus.cc:359] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.718518 30302 raft_consensus.cc:385] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.718914 30302 raft_consensus.cc:740] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.715001 30301 raft_consensus.cc:359] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.719831 30301 raft_consensus.cc:385] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.720173 30301 raft_consensus.cc:740] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.721005 30301 consensus_queue.cc:260] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.721665 30302 consensus_queue.cc:260] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.724274 30302 ts_tablet_manager.cc:1434] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:22:39.724334 30301 ts_tablet_manager.cc:1434] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:22:39.725415 30302 tablet_bootstrap.cc:492] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:39.725497 30301 tablet_bootstrap.cc:492] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8: Bootstrap starting.
I20260709 13:22:39.734531 29911 catalog_manager.cc:5697] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "ef0f2dfd7a834b938cc24c740891b090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:39.739154 30301 tablet_bootstrap.cc:654] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.744874 30302 tablet_bootstrap.cc:654] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.762845 30301 tablet_bootstrap.cc:492] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8: No bootstrap required, opened a new log
I20260709 13:22:39.763433 30301 ts_tablet_manager.cc:1403] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.002s
I20260709 13:22:39.763577 30303 tablet_bootstrap.cc:492] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:39.764662 30303 ts_tablet_manager.cc:1403] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.008s
I20260709 13:22:39.766320 30301 raft_consensus.cc:359] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.767181 30301 raft_consensus.cc:385] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.767468 30301 raft_consensus.cc:740] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.768375 30301 consensus_queue.cc:260] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.770835 30301 ts_tablet_manager.cc:1434] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:22:39.771898 30326 raft_consensus.cc:493] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:39.772650 30326 raft_consensus.cc:515] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.774128 30302 tablet_bootstrap.cc:492] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:39.774708 30302 ts_tablet_manager.cc:1403] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.016s
I20260709 13:22:39.776417 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6746fb40aa423caeb7bd124b80938e" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:39.777166 30164 raft_consensus.cc:2468] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 0.
I20260709 13:22:39.777734 30302 raft_consensus.cc:359] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.778477 30302 raft_consensus.cc:385] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.778512 30054 leader_election.cc:304] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:39.778877 30302 raft_consensus.cc:740] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.779495 30325 raft_consensus.cc:2804] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:39.779903 30325 raft_consensus.cc:493] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:39.779623 30302 consensus_queue.cc:260] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.780242 30325 raft_consensus.cc:3060] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.781404 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6746fb40aa423caeb7bd124b80938e" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
W20260709 13:22:39.782963 30055 leader_election.cc:343] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:39.783715 30326 leader_election.cc:290] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:39.784663 30243 raft_consensus.cc:493] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:39.772104 30303 raft_consensus.cc:359] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.785473 30303 raft_consensus.cc:385] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.785259 30243 raft_consensus.cc:515] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.785822 30303 raft_consensus.cc:740] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.786689 30303 consensus_queue.cc:260] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.781426 30302 ts_tablet_manager.cc:1434] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:22:39.788993 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec69c40433047528516ae3143641ea8" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:39.789806 30302 tablet_bootstrap.cc:492] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090: Bootstrap starting.
I20260709 13:22:39.789804 30090 raft_consensus.cc:2468] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 0.
I20260709 13:22:39.791852 29980 leader_election.cc:304] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:39.792938 30315 raft_consensus.cc:2804] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:39.793344 30315 raft_consensus.cc:493] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:39.793701 30315 raft_consensus.cc:3060] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.797750 30302 tablet_bootstrap.cc:654] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.800488 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec69c40433047528516ae3143641ea8" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:39.801367 30164 raft_consensus.cc:2468] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 0.
I20260709 13:22:39.807937 30243 leader_election.cc:290] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:39.815773 30315 raft_consensus.cc:515] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.819591 30325 raft_consensus.cc:515] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.823024 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec69c40433047528516ae3143641ea8" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:39.824656 30090 raft_consensus.cc:3060] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.826949 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec69c40433047528516ae3143641ea8" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:39.827714 30164 raft_consensus.cc:3060] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.834015 30090 raft_consensus.cc:2468] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 1.
I20260709 13:22:39.789286 30303 ts_tablet_manager.cc:1434] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:22:39.837731 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6746fb40aa423caeb7bd124b80938e" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:39.836329 30164 raft_consensus.cc:2468] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 1.
I20260709 13:22:39.838155 30315 leader_election.cc:290] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 election: Requested vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:39.839706 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6746fb40aa423caeb7bd124b80938e" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:39.840626 30163 raft_consensus.cc:3060] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.841872 30303 tablet_bootstrap.cc:492] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:39.842963 30302 tablet_bootstrap.cc:492] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090: No bootstrap required, opened a new log
I20260709 13:22:39.843526 30302 ts_tablet_manager.cc:1403] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.027s
I20260709 13:22:39.839740 29979 leader_election.cc:304] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 
W20260709 13:22:39.846750 30055 leader_election.cc:343] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:39.846489 30302 raft_consensus.cc:359] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.847389 30302 raft_consensus.cc:385] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.847494 30315 raft_consensus.cc:2804] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:39.847733 30302 raft_consensus.cc:740] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.847877 30326 raft_consensus.cc:493] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:39.848559 30302 consensus_queue.cc:260] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.848735 30326 raft_consensus.cc:515] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.850713 30302 ts_tablet_manager.cc:1434] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:22:39.851753 30163 raft_consensus.cc:2468] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 1.
I20260709 13:22:39.852381 30164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e51e428264343a3a7302bf2b28bede4" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:39.837733 30325 leader_election.cc:290] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:39.852938 30054 leader_election.cc:304] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090; no voters: 27c5f6809b3848c1b686954b77bae18a
I20260709 13:22:39.853150 30164 raft_consensus.cc:2468] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 0.
I20260709 13:22:39.854516 30322 raft_consensus.cc:2804] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:39.854586 30054 leader_election.cc:304] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:39.855145 30322 raft_consensus.cc:697] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Becoming Leader. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Running, Role: LEADER
I20260709 13:22:39.856081 30322 consensus_queue.cc:237] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.852483 30326 leader_election.cc:290] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:39.858011 30255 raft_consensus.cc:2804] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:39.858932 30255 raft_consensus.cc:493] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:39.859253 30255 raft_consensus.cc:3060] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.858220 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e51e428264343a3a7302bf2b28bede4" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:39.860427 30014 raft_consensus.cc:2468] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 0.
I20260709 13:22:39.848062 30315 raft_consensus.cc:697] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Becoming Leader. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Running, Role: LEADER
I20260709 13:22:39.862056 30315 consensus_queue.cc:237] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.867026 30255 raft_consensus.cc:515] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.870393 30255 leader_election.cc:290] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:39.870582 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e51e428264343a3a7302bf2b28bede4" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:39.870404 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e51e428264343a3a7302bf2b28bede4" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:39.871512 30163 raft_consensus.cc:3060] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.871572 30014 raft_consensus.cc:3060] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.873508 30303 tablet_bootstrap.cc:654] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.878579 30163 raft_consensus.cc:2468] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 1.
I20260709 13:22:39.879930 30054 leader_election.cc:304] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:39.878986 30014 raft_consensus.cc:2468] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 1.
I20260709 13:22:39.881633 30255 raft_consensus.cc:2804] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:39.882162 30255 raft_consensus.cc:697] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Becoming Leader. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Running, Role: LEADER
I20260709 13:22:39.882974 30255 consensus_queue.cc:237] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.883253 29912 catalog_manager.cc:5697] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "ef0f2dfd7a834b938cc24c740891b090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:39.885082 30322 raft_consensus.cc:493] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:39.890141 30322 raft_consensus.cc:515] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.893818 30322 leader_election.cc:290] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:39.894956 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650db2f2b2c04e2ca1b44b60375e5742" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:39.895604 30163 raft_consensus.cc:2468] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 0.
I20260709 13:22:39.895996 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650db2f2b2c04e2ca1b44b60375e5742" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a" is_pre_election: true
I20260709 13:22:39.896698 30014 raft_consensus.cc:2468] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 0.
I20260709 13:22:39.898121 30054 leader_election.cc:304] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:39.905009 29911 catalog_manager.cc:5697] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27c5f6809b3848c1b686954b77bae18a (127.16.188.129). New cstate: current_term: 1 leader_uuid: "27c5f6809b3848c1b686954b77bae18a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:39.914459 30322 raft_consensus.cc:2804] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:39.915043 30322 raft_consensus.cc:493] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:39.915477 30322 raft_consensus.cc:3060] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.925014 30322 raft_consensus.cc:515] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.928144 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650db2f2b2c04e2ca1b44b60375e5742" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:39.928761 30014 raft_consensus.cc:3060] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.936040 30014 raft_consensus.cc:2468] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 1.
I20260709 13:22:39.935175 29912 catalog_manager.cc:5697] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "ef0f2dfd7a834b938cc24c740891b090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:39.937633 30055 leader_election.cc:304] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:39.938676 30255 raft_consensus.cc:2804] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:39.939188 30255 raft_consensus.cc:697] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Becoming Leader. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Running, Role: LEADER
I20260709 13:22:39.939749 30303 tablet_bootstrap.cc:492] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:39.940420 30303 ts_tablet_manager.cc:1403] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.099s	user 0.039s	sys 0.017s
I20260709 13:22:39.939997 30255 consensus_queue.cc:237] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.943313 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650db2f2b2c04e2ca1b44b60375e5742" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:39.943926 30163 raft_consensus.cc:3060] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:39.945170 30303 raft_consensus.cc:359] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.946035 30303 raft_consensus.cc:385] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:39.946353 30303 raft_consensus.cc:740] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:39.947172 30303 consensus_queue.cc:260] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:39.949554 30303 ts_tablet_manager.cc:1434] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:39.954800 30163 raft_consensus.cc:2468] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 1.
I20260709 13:22:39.955791 30303 tablet_bootstrap.cc:492] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a: Bootstrap starting.
I20260709 13:22:39.958063 30312 consensus_queue.cc:1048] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:39.958732 30243 consensus_queue.cc:1048] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:39.962524 30322 leader_election.cc:290] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 1 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:39.967883 30303 tablet_bootstrap.cc:654] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:39.995854 30315 consensus_queue.cc:1048] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:40.031776 30312 consensus_queue.cc:1048] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:40.040812 29912 catalog_manager.cc:5697] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130). New cstate: current_term: 1 leader_uuid: "ef0f2dfd7a834b938cc24c740891b090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:40.044273 30313 raft_consensus.cc:493] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:40.044955 30313 raft_consensus.cc:515] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.047057 30313 leader_election.cc:290] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:40.053472 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efcfa4d196a46dcac96ee2a4000afaf" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:40.054347 30088 raft_consensus.cc:2468] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 0.
I20260709 13:22:40.057586 29980 leader_election.cc:304] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:40.058444 30243 raft_consensus.cc:2804] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:40.058887 30243 raft_consensus.cc:493] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:40.059242 30243 raft_consensus.cc:3060] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:40.066123 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efcfa4d196a46dcac96ee2a4000afaf" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:40.066813 30162 raft_consensus.cc:2468] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 0.
I20260709 13:22:40.066793 30322 consensus_queue.cc:1048] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:40.068110 30303 tablet_bootstrap.cc:492] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a: No bootstrap required, opened a new log
I20260709 13:22:40.069087 30303 ts_tablet_manager.cc:1403] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a: Time spent bootstrapping tablet: real 0.114s	user 0.029s	sys 0.043s
I20260709 13:22:40.072871 30303 raft_consensus.cc:359] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.073782 30303 raft_consensus.cc:385] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:40.074123 30303 raft_consensus.cc:740] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Initialized, Role: FOLLOWER
I20260709 13:22:40.074980 30303 consensus_queue.cc:260] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.068998 30243 raft_consensus.cc:515] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.077777 30303 ts_tablet_manager.cc:1434] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:40.079485 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efcfa4d196a46dcac96ee2a4000afaf" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:40.080179 30090 raft_consensus.cc:3060] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:40.080430 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efcfa4d196a46dcac96ee2a4000afaf" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:40.081089 30163 raft_consensus.cc:3060] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:40.088434 30090 raft_consensus.cc:2468] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 1.
I20260709 13:22:40.088618 30243 leader_election.cc:290] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 election: Requested vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:40.089931 29980 leader_election.cc:304] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:40.090896 30243 raft_consensus.cc:2804] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:40.091559 30163 raft_consensus.cc:2468] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 1.
I20260709 13:22:40.092195 30243 raft_consensus.cc:697] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Becoming Leader. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Running, Role: LEADER
I20260709 13:22:40.093264 30243 consensus_queue.cc:237] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.100687 30325 consensus_queue.cc:1048] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:40.125135 30315 consensus_queue.cc:1048] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:40.132884 29911 catalog_manager.cc:5697] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a reported cstate change: term changed from 0 to 1, leader changed from <none> to 27c5f6809b3848c1b686954b77bae18a (127.16.188.129). New cstate: current_term: 1 leader_uuid: "27c5f6809b3848c1b686954b77bae18a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:40.139703 30315 consensus_queue.cc:1048] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:40.290423 30322 consensus_queue.cc:1048] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:40.303699 30325 consensus_queue.cc:1048] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:40.333772 30315 raft_consensus.cc:493] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:40.334263 30315 raft_consensus.cc:515] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.335889 30315 leader_election.cc:290] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:40.336977 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6746fb40aa423caeb7bd124b80938e" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" is_pre_election: true
I20260709 13:22:40.336907 30090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6746fb40aa423caeb7bd124b80938e" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0f2dfd7a834b938cc24c740891b090" is_pre_election: true
I20260709 13:22:40.337867 30163 raft_consensus.cc:2393] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27c5f6809b3848c1b686954b77bae18a in current term 1: Already voted for candidate ef0f2dfd7a834b938cc24c740891b090 in this term.
I20260709 13:22:40.338953 29979 leader_election.cc:304] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a; no voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:40.339787 30315 raft_consensus.cc:3060] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:40.345434 30315 raft_consensus.cc:2749] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:40.362998 30315 consensus_queue.cc:1048] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:40.374383 30162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0270b3a4121640f88c0636bff5d639cc"
dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
mode: GRACEFUL
new_leader_uuid: "27c5f6809b3848c1b686954b77bae18a"
 from {username='slave'} at 127.0.0.1:35706
I20260709 13:22:40.375061 30313 consensus_queue.cc:1048] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:40.375140 30162 raft_consensus.cc:606] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Received request to transfer leadership to TS 27c5f6809b3848c1b686954b77bae18a
I20260709 13:22:40.378958 30325 consensus_queue.cc:1048] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:40.394469 30088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a02cac03e22f49bebce475241fe5052d"
dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
mode: GRACEFUL
new_leader_uuid: "27c5f6809b3848c1b686954b77bae18a"
 from {username='slave'} at 127.0.0.1:34224
I20260709 13:22:40.395147 30088 raft_consensus.cc:606] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Received request to transfer leadership to TS 27c5f6809b3848c1b686954b77bae18a
I20260709 13:22:40.395321 30325 consensus_queue.cc:1048] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:40.411347 30325 consensus_queue.cc:1048] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:40.432098 30013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc7af5e12ff94cdb8af001206c75ace0"
dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
mode: GRACEFUL
new_leader_uuid: "ef0f2dfd7a834b938cc24c740891b090"
 from {username='slave'} at 127.0.0.1:47242
I20260709 13:22:40.432751 30013 raft_consensus.cc:606] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Received request to transfer leadership to TS ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:40.436789 30326 consensus_queue.cc:1048] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:40.448637 30013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3efcfa4d196a46dcac96ee2a4000afaf"
dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
mode: GRACEFUL
new_leader_uuid: "ef0f2dfd7a834b938cc24c740891b090"
 from {username='slave'} at 127.0.0.1:47242
I20260709 13:22:40.449175 30013 raft_consensus.cc:606] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Received request to transfer leadership to TS ef0f2dfd7a834b938cc24c740891b090
I20260709 13:22:40.458109 30088 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e51e428264343a3a7302bf2b28bede4"
dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
mode: GRACEFUL
new_leader_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
 from {username='slave'} at 127.0.0.1:34224
I20260709 13:22:40.458747 30088 raft_consensus.cc:606] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Received request to transfer leadership to TS 87770ebb4d4d45938b280d6f1b21e6f8
I20260709 13:22:40.525853 30243 consensus_queue.cc:1048] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:40.533967 30315 raft_consensus.cc:993] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a: : Instructing follower ef0f2dfd7a834b938cc24c740891b090 to start an election
I20260709 13:22:40.534584 30313 raft_consensus.cc:1081] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Signalling peer ef0f2dfd7a834b938cc24c740891b090 to start an election
I20260709 13:22:40.536545 30088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3efcfa4d196a46dcac96ee2a4000afaf"
dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
 from {username='slave'} at 127.0.0.1:34222
I20260709 13:22:40.545235 30243 consensus_queue.cc:1048] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:40.545527 30088 raft_consensus.cc:493] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:40.546451 30088 raft_consensus.cc:3060] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.553555 30088 raft_consensus.cc:515] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.555977 30088 leader_election.cc:290] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 2 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:40.557109 30013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efcfa4d196a46dcac96ee2a4000afaf" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:40.557960 30013 raft_consensus.cc:3055] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:40.558173 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3efcfa4d196a46dcac96ee2a4000afaf" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:40.558353 30013 raft_consensus.cc:740] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Running, Role: LEADER
I20260709 13:22:40.561834 30013 consensus_queue.cc:260] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.563112 30013 raft_consensus.cc:3060] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.571053 30013 raft_consensus.cc:2468] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 2.
I20260709 13:22:40.572301 30055 leader_election.cc:304] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 87770ebb4d4d45938b280d6f1b21e6f8
I20260709 13:22:40.573869 30326 raft_consensus.cc:2804] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:40.574383 30326 raft_consensus.cc:697] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [term 2 LEADER]: Becoming Leader. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Running, Role: LEADER
I20260709 13:22:40.575253 30326 consensus_queue.cc:237] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.575750 30312 raft_consensus.cc:993] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8: : Instructing follower 27c5f6809b3848c1b686954b77bae18a to start an election
I20260709 13:22:40.576412 30312 raft_consensus.cc:1081] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Signalling peer 27c5f6809b3848c1b686954b77bae18a to start an election
I20260709 13:22:40.578226 30013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0270b3a4121640f88c0636bff5d639cc"
dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
 from {username='slave'} at 127.0.0.1:47226
I20260709 13:22:40.578871 30013 raft_consensus.cc:493] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:40.579317 30013 raft_consensus.cc:3060] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.585052 30325 raft_consensus.cc:993] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090: : Instructing follower 27c5f6809b3848c1b686954b77bae18a to start an election
I20260709 13:22:40.585701 30325 raft_consensus.cc:1081] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Signalling peer 27c5f6809b3848c1b686954b77bae18a to start an election
I20260709 13:22:40.585867 30013 raft_consensus.cc:515] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.585541 29913 catalog_manager.cc:5697] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 reported cstate change: term changed from 1 to 2, leader changed from 27c5f6809b3848c1b686954b77bae18a (127.16.188.129) to ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "ef0f2dfd7a834b938cc24c740891b090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:40.587656 30014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a02cac03e22f49bebce475241fe5052d"
dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
 from {username='slave'} at 127.0.0.1:47238
I20260709 13:22:40.588274 30014 raft_consensus.cc:493] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:40.588635 30013 leader_election.cc:290] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 2 election: Requested vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:40.588845 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0270b3a4121640f88c0636bff5d639cc" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:40.589255 30163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0270b3a4121640f88c0636bff5d639cc" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:40.589429 30088 raft_consensus.cc:3060] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.588672 30014 raft_consensus.cc:3060] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.590406 30163 raft_consensus.cc:3055] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:40.590705 30163 raft_consensus.cc:740] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Running, Role: LEADER
I20260709 13:22:40.591480 30163 consensus_queue.cc:260] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.592363 30163 raft_consensus.cc:3060] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.597302 30014 raft_consensus.cc:515] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.599186 30088 raft_consensus.cc:2468] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 2.
I20260709 13:22:40.600549 30014 leader_election.cc:290] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 2 election: Requested vote from peers ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:40.600695 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02cac03e22f49bebce475241fe5052d" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:40.601609 30162 raft_consensus.cc:3060] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.600438 29980 leader_election.cc:304] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:40.600386 30163 raft_consensus.cc:2468] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 2.
I20260709 13:22:40.603183 30243 raft_consensus.cc:2804] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:40.604418 30089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a02cac03e22f49bebce475241fe5052d" candidate_uuid: "27c5f6809b3848c1b686954b77bae18a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:40.604414 30243 raft_consensus.cc:697] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [term 2 LEADER]: Becoming Leader. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Running, Role: LEADER
I20260709 13:22:40.605314 30089 raft_consensus.cc:3055] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:40.605669 30089 raft_consensus.cc:740] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Running, Role: LEADER
I20260709 13:22:40.605767 30243 consensus_queue.cc:237] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.606617 30089 consensus_queue.cc:260] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.608139 30089 raft_consensus.cc:3060] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.611158 30162 raft_consensus.cc:2468] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 2.
I20260709 13:22:40.612453 29979 leader_election.cc:304] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 
I20260709 13:22:40.613209 29912 catalog_manager.cc:5697] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a reported cstate change: term changed from 1 to 2, leader changed from 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131) to 27c5f6809b3848c1b686954b77bae18a (127.16.188.129). New cstate: current_term: 2 leader_uuid: "27c5f6809b3848c1b686954b77bae18a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:40.617569 30243 raft_consensus.cc:2804] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:40.618839 30089 raft_consensus.cc:2468] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27c5f6809b3848c1b686954b77bae18a in term 2.
I20260709 13:22:40.621546 30243 raft_consensus.cc:697] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [term 2 LEADER]: Becoming Leader. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Running, Role: LEADER
I20260709 13:22:40.622601 30243 consensus_queue.cc:237] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.627769 30313 raft_consensus.cc:993] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a: : Instructing follower ef0f2dfd7a834b938cc24c740891b090 to start an election
I20260709 13:22:40.628337 30379 raft_consensus.cc:1081] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Signalling peer ef0f2dfd7a834b938cc24c740891b090 to start an election
I20260709 13:22:40.630270 30088 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc7af5e12ff94cdb8af001206c75ace0"
dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
 from {username='slave'} at 127.0.0.1:34222
I20260709 13:22:40.630864 30088 raft_consensus.cc:493] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:40.631166 30088 raft_consensus.cc:3060] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.632740 29913 catalog_manager.cc:5697] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a reported cstate change: term changed from 1 to 2, leader changed from ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130) to 27c5f6809b3848c1b686954b77bae18a (127.16.188.129). New cstate: current_term: 2 leader_uuid: "27c5f6809b3848c1b686954b77bae18a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:40.637006 30088 raft_consensus.cc:515] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.640411 30088 leader_election.cc:290] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 2 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131:44053)
I20260709 13:22:40.641579 30162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7af5e12ff94cdb8af001206c75ace0" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
I20260709 13:22:40.641855 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc7af5e12ff94cdb8af001206c75ace0" candidate_uuid: "ef0f2dfd7a834b938cc24c740891b090" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:40.642303 30162 raft_consensus.cc:3060] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.642417 30014 raft_consensus.cc:3055] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:40.642830 30014 raft_consensus.cc:740] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Running, Role: LEADER
I20260709 13:22:40.643747 30014 consensus_queue.cc:260] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.645130 30014 raft_consensus.cc:3060] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.650295 30162 raft_consensus.cc:2468] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 2.
I20260709 13:22:40.651623 30054 leader_election.cc:304] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:40.652473 30325 raft_consensus.cc:2804] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:40.653048 30014 raft_consensus.cc:2468] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0f2dfd7a834b938cc24c740891b090 in term 2.
I20260709 13:22:40.653090 30325 raft_consensus.cc:697] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [term 2 LEADER]: Becoming Leader. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Running, Role: LEADER
I20260709 13:22:40.654196 30325 consensus_queue.cc:237] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.661615 29913 catalog_manager.cc:5697] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 reported cstate change: term changed from 1 to 2, leader changed from 27c5f6809b3848c1b686954b77bae18a (127.16.188.129) to ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130). New cstate: current_term: 2 leader_uuid: "ef0f2dfd7a834b938cc24c740891b090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:40.703967 30326 raft_consensus.cc:993] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090: : Instructing follower 87770ebb4d4d45938b280d6f1b21e6f8 to start an election
I20260709 13:22:40.704655 30325 raft_consensus.cc:1081] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Signalling peer 87770ebb4d4d45938b280d6f1b21e6f8 to start an election
I20260709 13:22:40.706396 30162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e51e428264343a3a7302bf2b28bede4"
dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
 from {username='slave'} at 127.0.0.1:35700
I20260709 13:22:40.706947 30162 raft_consensus.cc:493] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:40.707329 30162 raft_consensus.cc:3060] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.712846 30162 raft_consensus.cc:515] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.714514 30162 leader_election.cc:290] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 2 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:40.715569 30088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e51e428264343a3a7302bf2b28bede4" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:40.715503 30014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e51e428264343a3a7302bf2b28bede4" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:40.716416 30088 raft_consensus.cc:3055] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:40.716583 30014 raft_consensus.cc:3060] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.716820 30088 raft_consensus.cc:740] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Running, Role: LEADER
I20260709 13:22:40.717729 30088 consensus_queue.cc:260] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.718709 30088 raft_consensus.cc:3060] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.722900 30014 raft_consensus.cc:2468] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 2.
I20260709 13:22:40.723764 30088 raft_consensus.cc:2468] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 2.
I20260709 13:22:40.724442 30129 leader_election.cc:304] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 
I20260709 13:22:40.725436 30312 raft_consensus.cc:2804] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:40.725924 30312 raft_consensus.cc:697] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 LEADER]: Becoming Leader. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Running, Role: LEADER
I20260709 13:22:40.726642 30312 consensus_queue.cc:237] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:40.733095 29913 catalog_manager.cc:5697] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 reported cstate change: term changed from 1 to 2, leader changed from ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130) to 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:40.958444 30163 raft_consensus.cc:3060] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:40.963670 30163 raft_consensus.cc:1275] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Refusing update from remote peer ef0f2dfd7a834b938cc24c740891b090: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:40.964877 30322 consensus_queue.cc:1048] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:40.973503 30014 raft_consensus.cc:1275] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Refusing update from remote peer ef0f2dfd7a834b938cc24c740891b090: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:40.976120 30322 consensus_queue.cc:1048] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:41.021411 30088 raft_consensus.cc:1275] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Refusing update from remote peer 27c5f6809b3848c1b686954b77bae18a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:41.023093 30379 consensus_queue.cc:1048] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:41.031374 30163 raft_consensus.cc:1275] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Refusing update from remote peer 27c5f6809b3848c1b686954b77bae18a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:41.032876 30379 consensus_queue.cc:1048] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:41.054343 30163 raft_consensus.cc:1275] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Refusing update from remote peer ef0f2dfd7a834b938cc24c740891b090: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:41.055666 30322 consensus_queue.cc:1048] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:41.064841 30014 raft_consensus.cc:1275] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Refusing update from remote peer ef0f2dfd7a834b938cc24c740891b090: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:41.068218 30322 consensus_queue.cc:1048] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:41.069345 30088 raft_consensus.cc:1275] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Refusing update from remote peer 27c5f6809b3848c1b686954b77bae18a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:41.071121 30379 consensus_queue.cc:1048] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:41.070770 30163 raft_consensus.cc:1275] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Refusing update from remote peer 27c5f6809b3848c1b686954b77bae18a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:41.086088 30243 consensus_queue.cc:1048] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:41.136991 30014 raft_consensus.cc:1275] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Refusing update from remote peer 87770ebb4d4d45938b280d6f1b21e6f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:41.138248 30312 consensus_queue.cc:1048] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:41.146111 30088 raft_consensus.cc:1275] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Refusing update from remote peer 87770ebb4d4d45938b280d6f1b21e6f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:41.147904 30383 consensus_queue.cc:1048] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:43.462344 29913 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43234:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:22:43.483529 29913 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43234:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:22:43.534922 17138 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:22:43.657270 29979 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.131:44053, user_credentials={real_user=slave}} blocked reactor thread for 47926.8us
W20260709 13:22:43.689181 30401 log.cc:927] Time spent T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:22:43.705256 30406 log.cc:927] Time spent T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:22:43.709283 30426 tablet.cc:1724] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:43.745473 30414 log.cc:927] Time spent T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:22:43.831997 30427 log.cc:927] Time spent T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:22:43.816087 30436 tablet.cc:1724] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:43.835651 30429 log.cc:927] Time spent T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:22:43.856379 30439 tablet.cc:1724] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:43.770289 30431 tablet.cc:1724] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:43.901655 30435 tablet.cc:1724] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:43.911530 30055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.188.129:39439, user_credentials={real_user=slave}} blocked reactor thread for 82633.8us
I20260709 13:22:43.894982 30440 tablet.cc:1724] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:43.912501 30446 tablet.cc:1724] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:43.942061 30449 tablet.cc:1724] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:43.964493 30447 tablet.cc:1724] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:43.979403 30011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b61fdb4016749468603ce382b085bee"
dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
mode: GRACEFUL
new_leader_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
 from {username='slave'} at 127.0.0.1:38198
I20260709 13:22:43.980139 30011 raft_consensus.cc:606] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Received request to transfer leadership to TS 87770ebb4d4d45938b280d6f1b21e6f8
W20260709 13:22:43.991168 30443 log.cc:927] Time spent T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090: Append to log took a long time: real 0.061s	user 0.000s	sys 0.002s
I20260709 13:22:43.998948 30439 tablet.cc:1724] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.010466 30440 tablet.cc:1724] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.025190 30451 tablet.cc:1724] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.025454 30453 tablet.cc:1724] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.037978 30436 tablet.cc:1724] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.040777 30452 tablet.cc:1724] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.056131 30439 tablet.cc:1724] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.044782 30426 tablet.cc:1724] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.083959 30446 tablet.cc:1724] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.058255 30431 tablet.cc:1724] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.097978 30431 tablet.cc:1724] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.099309 30449 tablet.cc:1724] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.118875 30446 tablet.cc:1724] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.128118 30086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7b0ec114d034617b809288e3289b918"
dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
mode: GRACEFUL
new_leader_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
 from {username='slave'} at 127.0.0.1:55704
I20260709 13:22:44.128973 30086 raft_consensus.cc:606] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Received request to transfer leadership to TS 87770ebb4d4d45938b280d6f1b21e6f8
I20260709 13:22:44.128561 30447 tablet.cc:1724] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.131762 17138 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:44.132763 17138 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:44.078043 30435 tablet.cc:1724] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.131306 30449 tablet.cc:1724] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.151110 30435 tablet.cc:1724] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.152437 30440 tablet.cc:1724] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:44.188572 30243 raft_consensus.cc:993] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a: : Instructing follower 87770ebb4d4d45938b280d6f1b21e6f8 to start an election
I20260709 13:22:44.189251 30243 raft_consensus.cc:1081] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Signalling peer 87770ebb4d4d45938b280d6f1b21e6f8 to start an election
I20260709 13:22:44.191550 30160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b61fdb4016749468603ce382b085bee"
dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
 from {username='slave'} at 127.0.0.1:35694
I20260709 13:22:44.192221 30160 raft_consensus.cc:493] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:44.192662 30160 raft_consensus.cc:3060] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:44.195911 29912 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978: soft_deleted_table [id=72dc7f1b840149d29eef7eb381735c01] alter complete (version 1)
I20260709 13:22:44.205603 30160 raft_consensus.cc:515] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:44.208492 30160 leader_election.cc:290] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 2 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:44.209555 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b61fdb4016749468603ce382b085bee" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:44.210368 30015 raft_consensus.cc:3055] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:44.210711 30015 raft_consensus.cc:740] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27c5f6809b3848c1b686954b77bae18a, State: Running, Role: LEADER
I20260709 13:22:44.211681 30015 consensus_queue.cc:260] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:44.213488 30015 raft_consensus.cc:3060] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:44.213652 30086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b61fdb4016749468603ce382b085bee" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:44.215102 30086 raft_consensus.cc:3060] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:44.221690 30086 raft_consensus.cc:2468] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 2.
I20260709 13:22:44.223042 30015 raft_consensus.cc:2468] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 2.
I20260709 13:22:44.223356 30129 leader_election.cc:304] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87770ebb4d4d45938b280d6f1b21e6f8, ef0f2dfd7a834b938cc24c740891b090; no voters: 
I20260709 13:22:44.224674 30450 raft_consensus.cc:2804] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:44.225190 30450 raft_consensus.cc:697] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 LEADER]: Becoming Leader. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Running, Role: LEADER
I20260709 13:22:44.226214 30450 consensus_queue.cc:237] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:44.235987 29912 catalog_manager.cc:5697] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 reported cstate change: term changed from 1 to 2, leader changed from 27c5f6809b3848c1b686954b77bae18a (127.16.188.129) to 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:44.381743 30448 raft_consensus.cc:993] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090: : Instructing follower 87770ebb4d4d45938b280d6f1b21e6f8 to start an election
I20260709 13:22:44.382469 30405 raft_consensus.cc:1081] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Signalling peer 87770ebb4d4d45938b280d6f1b21e6f8 to start an election
I20260709 13:22:44.384502 30159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7b0ec114d034617b809288e3289b918"
dest_uuid: "87770ebb4d4d45938b280d6f1b21e6f8"
 from {username='slave'} at 127.0.0.1:35700
I20260709 13:22:44.385108 30159 raft_consensus.cc:493] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:44.385460 30159 raft_consensus.cc:3060] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:44.391825 30159 raft_consensus.cc:515] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:44.393707 30159 leader_election.cc:290] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 2 election: Requested vote from peers 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439), ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981)
I20260709 13:22:44.394344 30015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b0ec114d034617b809288e3289b918" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27c5f6809b3848c1b686954b77bae18a"
I20260709 13:22:44.394776 30086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b0ec114d034617b809288e3289b918" candidate_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0f2dfd7a834b938cc24c740891b090"
I20260709 13:22:44.395076 30015 raft_consensus.cc:3060] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:44.395378 30086 raft_consensus.cc:3055] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:44.395740 30086 raft_consensus.cc:740] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0f2dfd7a834b938cc24c740891b090, State: Running, Role: LEADER
I20260709 13:22:44.396663 30086 consensus_queue.cc:260] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:44.397989 30086 raft_consensus.cc:3060] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:44.402663 30015 raft_consensus.cc:2468] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 2.
I20260709 13:22:44.404183 30129 leader_election.cc:304] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27c5f6809b3848c1b686954b77bae18a, 87770ebb4d4d45938b280d6f1b21e6f8; no voters: 
I20260709 13:22:44.404773 30086 raft_consensus.cc:2468] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87770ebb4d4d45938b280d6f1b21e6f8 in term 2.
I20260709 13:22:44.405067 30450 raft_consensus.cc:2804] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:44.405614 30450 raft_consensus.cc:697] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 LEADER]: Becoming Leader. State: Replica: 87770ebb4d4d45938b280d6f1b21e6f8, State: Running, Role: LEADER
I20260709 13:22:44.406468 30450 consensus_queue.cc:237] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } }
I20260709 13:22:44.414613 29912 catalog_manager.cc:5697] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 reported cstate change: term changed from 1 to 2, leader changed from ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130) to 87770ebb4d4d45938b280d6f1b21e6f8 (127.16.188.131). New cstate: current_term: 2 leader_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87770ebb4d4d45938b280d6f1b21e6f8" member_type: VOTER last_known_addr { host: "127.16.188.131" port: 44053 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:44.748734 30015 raft_consensus.cc:1275] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Refusing update from remote peer 87770ebb4d4d45938b280d6f1b21e6f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:44.750000 30450 consensus_queue.cc:1048] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:44.761652 30086 raft_consensus.cc:1275] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Refusing update from remote peer 87770ebb4d4d45938b280d6f1b21e6f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:44.763969 30450 consensus_queue.cc:1048] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:44.884354 30086 raft_consensus.cc:1275] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Refusing update from remote peer 87770ebb4d4d45938b280d6f1b21e6f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:44.885620 30450 consensus_queue.cc:1048] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0f2dfd7a834b938cc24c740891b090" member_type: VOTER last_known_addr { host: "127.16.188.130" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:44.904012 30015 raft_consensus.cc:1275] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Refusing update from remote peer 87770ebb4d4d45938b280d6f1b21e6f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:44.905686 30468 consensus_queue.cc:1048] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27c5f6809b3848c1b686954b77bae18a" member_type: VOTER last_known_addr { host: "127.16.188.129" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:45.192013 17138 tablet_server.cc:179] TabletServer@127.16.188.129:0 shutting down...
I20260709 13:22:45.223620 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:45.224431 17138 tablet_replica.cc:333] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.225152 17138 raft_consensus.cc:2243] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.225653 17138 raft_consensus.cc:2272] T 2a6746fb40aa423caeb7bd124b80938e P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.227614 17138 tablet_replica.cc:333] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.228190 17138 raft_consensus.cc:2243] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.229003 17138 raft_consensus.cc:2272] T aec69c40433047528516ae3143641ea8 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.230821 17138 tablet_replica.cc:333] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.231393 17138 raft_consensus.cc:2243] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.231796 17138 raft_consensus.cc:2272] T 6b61fdb4016749468603ce382b085bee P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.234637 17138 tablet_replica.cc:333] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.235213 17138 raft_consensus.cc:2243] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.236203 17138 raft_consensus.cc:2272] T e367938ddfd64760b6f758e1fdc05c02 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:45.237804 30129 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
I20260709 13:22:45.238708 17138 tablet_replica.cc:333] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.239409 17138 raft_consensus.cc:2243] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.240156 17138 raft_consensus.cc:2272] T 9cc5fc5e790a4fbc8b04208992d93869 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:45.241544 30129 consensus_peers.cc:597] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 -> Peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Couldn't send request to peer 27c5f6809b3848c1b686954b77bae18a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:45.242318 17138 tablet_replica.cc:333] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.242951 17138 raft_consensus.cc:2243] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.243374 17138 raft_consensus.cc:2272] T 650db2f2b2c04e2ca1b44b60375e5742 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.245260 17138 tablet_replica.cc:333] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.245802 17138 raft_consensus.cc:2243] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.246219 17138 raft_consensus.cc:2272] T dc7af5e12ff94cdb8af001206c75ace0 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.247988 17138 tablet_replica.cc:333] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.248724 17138 raft_consensus.cc:2243] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.249145 17138 raft_consensus.cc:2272] T f7201028b7584d829863e1b74409c065 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.251704 17138 tablet_replica.cc:333] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.252364 17138 raft_consensus.cc:2243] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.252889 17138 raft_consensus.cc:2272] T 3efcfa4d196a46dcac96ee2a4000afaf P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.255231 17138 tablet_replica.cc:333] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.255960 17138 raft_consensus.cc:2243] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.256461 17138 raft_consensus.cc:2272] T 188dd58f1c8e4687b93f7e021ad4bf84 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.259270 17138 tablet_replica.cc:333] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.259821 17138 raft_consensus.cc:2243] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.260246 17138 raft_consensus.cc:2272] T 7e51e428264343a3a7302bf2b28bede4 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.262012 17138 tablet_replica.cc:333] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.262620 17138 raft_consensus.cc:2243] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.263466 17138 raft_consensus.cc:2272] T 0270b3a4121640f88c0636bff5d639cc P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.265604 17138 tablet_replica.cc:333] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.266347 17138 raft_consensus.cc:2243] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.267347 17138 raft_consensus.cc:2272] T 23606403df3a4de9861ee59ccd4e70c0 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:45.267436 30129 consensus_peers.cc:597] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 -> Peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Couldn't send request to peer 27c5f6809b3848c1b686954b77bae18a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:45.269907 17138 tablet_replica.cc:333] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.270500 17138 raft_consensus.cc:2243] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.270879 17138 raft_consensus.cc:2272] T 1eb765e56b4f42d0a4f2527b9a467598 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.272925 17138 tablet_replica.cc:333] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.273398 17138 raft_consensus.cc:2243] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.273818 17138 raft_consensus.cc:2272] T e7b0ec114d034617b809288e3289b918 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.276268 17138 tablet_replica.cc:333] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.276762 17138 raft_consensus.cc:2243] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.277422 17138 raft_consensus.cc:2272] T a02cac03e22f49bebce475241fe5052d P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.279094 17138 tablet_replica.cc:333] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.279577 17138 raft_consensus.cc:2243] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.280381 17138 raft_consensus.cc:2272] T a059b4edd4ff4998b950986501a48332 P 27c5f6809b3848c1b686954b77bae18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.282461 17138 tablet_replica.cc:333] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a: stopping tablet replica
I20260709 13:22:45.283064 17138 raft_consensus.cc:2243] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.283509 17138 raft_consensus.cc:2272] T ff49f85f979c4df9bed315f95129e685 P 27c5f6809b3848c1b686954b77bae18a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.325621 17138 tablet_server.cc:196] TabletServer@127.16.188.129:0 shutdown complete.
W20260709 13:22:45.346462 30055 consensus_peers.cc:597] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 -> Peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Couldn't send request to peer 27c5f6809b3848c1b686954b77bae18a. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:39439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:45.367499 17138 tablet_server.cc:179] TabletServer@127.16.188.130:0 shutting down...
I20260709 13:22:45.404613 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:45.405504 17138 tablet_replica.cc:333] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.406179 17138 raft_consensus.cc:2243] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.407071 17138 raft_consensus.cc:2272] T 2a6746fb40aa423caeb7bd124b80938e P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.409304 17138 tablet_replica.cc:333] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.409869 17138 raft_consensus.cc:2243] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.410295 17138 raft_consensus.cc:2272] T aec69c40433047528516ae3143641ea8 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.412868 17138 tablet_replica.cc:333] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.413650 17138 raft_consensus.cc:2243] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:22:45.414700 30129 consensus_peers.cc:597] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 -> Peer ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981): Couldn't send request to peer ef0f2dfd7a834b938cc24c740891b090. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:45.414700 17138 raft_consensus.cc:2272] T 650db2f2b2c04e2ca1b44b60375e5742 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.417482 17138 tablet_replica.cc:333] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.418152 17138 raft_consensus.cc:2243] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.418941 17138 raft_consensus.cc:2272] T dc7af5e12ff94cdb8af001206c75ace0 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.420837 17138 tablet_replica.cc:333] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.421392 17138 raft_consensus.cc:2243] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.421916 17138 raft_consensus.cc:2272] T 7e51e428264343a3a7302bf2b28bede4 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.423851 17138 tablet_replica.cc:333] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.424427 17138 raft_consensus.cc:2243] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.424947 17138 raft_consensus.cc:2272] T 23606403df3a4de9861ee59ccd4e70c0 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.426944 17138 tablet_replica.cc:333] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.427464 17138 raft_consensus.cc:2243] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.427910 17138 raft_consensus.cc:2272] T 0270b3a4121640f88c0636bff5d639cc P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.429690 17138 tablet_replica.cc:333] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.430244 17138 raft_consensus.cc:2243] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.430682 17138 raft_consensus.cc:2272] T e367938ddfd64760b6f758e1fdc05c02 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.432687 17138 tablet_replica.cc:333] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.433234 17138 raft_consensus.cc:2243] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.433642 17138 raft_consensus.cc:2272] T 6b61fdb4016749468603ce382b085bee P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.436779 17138 tablet_replica.cc:333] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.437494 17138 raft_consensus.cc:2243] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.438052 17138 raft_consensus.cc:2272] T 9cc5fc5e790a4fbc8b04208992d93869 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.440822 17138 tablet_replica.cc:333] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.441531 17138 raft_consensus.cc:2243] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.442447 17138 raft_consensus.cc:2272] T ff49f85f979c4df9bed315f95129e685 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.445261 17138 tablet_replica.cc:333] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.445988 17138 raft_consensus.cc:2243] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.446798 17138 raft_consensus.cc:2272] T f7201028b7584d829863e1b74409c065 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:45.447307 30129 consensus_peers.cc:597] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 -> Peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Couldn't send request to peer 27c5f6809b3848c1b686954b77bae18a. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:39439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:45.449150 17138 tablet_replica.cc:333] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.449780 17138 raft_consensus.cc:2243] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.450193 17138 raft_consensus.cc:2272] T e7b0ec114d034617b809288e3289b918 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.452687 17138 tablet_replica.cc:333] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.453236 17138 raft_consensus.cc:2243] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.453671 17138 raft_consensus.cc:2272] T a02cac03e22f49bebce475241fe5052d P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.455320 17138 tablet_replica.cc:333] T a059b4edd4ff4998b950986501a48332 P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.455832 17138 raft_consensus.cc:2243] T a059b4edd4ff4998b950986501a48332 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.456241 17138 raft_consensus.cc:2272] T a059b4edd4ff4998b950986501a48332 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.458139 17138 tablet_replica.cc:333] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.458647 17138 raft_consensus.cc:2243] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.459403 17138 raft_consensus.cc:2272] T 1eb765e56b4f42d0a4f2527b9a467598 P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.461472 17138 tablet_replica.cc:333] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.461956 17138 raft_consensus.cc:2243] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.462675 17138 raft_consensus.cc:2272] T 3efcfa4d196a46dcac96ee2a4000afaf P ef0f2dfd7a834b938cc24c740891b090 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.464358 17138 tablet_replica.cc:333] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090: stopping tablet replica
I20260709 13:22:45.464870 17138 raft_consensus.cc:2243] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.465276 17138 raft_consensus.cc:2272] T 188dd58f1c8e4687b93f7e021ad4bf84 P ef0f2dfd7a834b938cc24c740891b090 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.504192 17138 tablet_server.cc:196] TabletServer@127.16.188.130:0 shutdown complete.
W20260709 13:22:45.506978 30129 consensus_peers.cc:597] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 -> Peer ef0f2dfd7a834b938cc24c740891b090 (127.16.188.130:38981): Couldn't send request to peer ef0f2dfd7a834b938cc24c740891b090. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.130:38981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:45.538687 17138 tablet_server.cc:179] TabletServer@127.16.188.131:0 shutting down...
I20260709 13:22:45.578480 17138 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:45.579231 17138 tablet_replica.cc:333] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.579836 17138 raft_consensus.cc:2243] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.580360 17138 raft_consensus.cc:2272] T 2a6746fb40aa423caeb7bd124b80938e P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.582369 17138 tablet_replica.cc:333] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.582923 17138 raft_consensus.cc:2243] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.583349 17138 raft_consensus.cc:2272] T 650db2f2b2c04e2ca1b44b60375e5742 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.585166 17138 tablet_replica.cc:333] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.585724 17138 raft_consensus.cc:2243] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.586151 17138 raft_consensus.cc:2272] T dc7af5e12ff94cdb8af001206c75ace0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.587932 17138 tablet_replica.cc:333] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.588603 17138 raft_consensus.cc:2243] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.589020 17138 raft_consensus.cc:2272] T aec69c40433047528516ae3143641ea8 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.590857 17138 tablet_replica.cc:333] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.591584 17138 raft_consensus.cc:2243] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.592046 17138 raft_consensus.cc:2272] T a059b4edd4ff4998b950986501a48332 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.594756 17138 tablet_replica.cc:333] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
W20260709 13:22:45.594689 30129 consensus_peers.cc:597] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 -> Peer 27c5f6809b3848c1b686954b77bae18a (127.16.188.129:39439): Couldn't send request to peer 27c5f6809b3848c1b686954b77bae18a. Status: Network error: Client connection negotiation failed: client connection to 127.16.188.129:39439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:45.595608 17138 raft_consensus.cc:2243] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.596022 17138 raft_consensus.cc:2272] T a02cac03e22f49bebce475241fe5052d P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.597896 17138 tablet_replica.cc:333] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.598404 17138 raft_consensus.cc:2243] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.599099 17138 raft_consensus.cc:2272] T 7e51e428264343a3a7302bf2b28bede4 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.600934 17138 tablet_replica.cc:333] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.601403 17138 raft_consensus.cc:2243] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.601768 17138 raft_consensus.cc:2272] T 23606403df3a4de9861ee59ccd4e70c0 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.603541 17138 tablet_replica.cc:333] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.603989 17138 raft_consensus.cc:2243] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.604358 17138 raft_consensus.cc:2272] T 0270b3a4121640f88c0636bff5d639cc P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.606093 17138 tablet_replica.cc:333] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.606637 17138 raft_consensus.cc:2243] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.607076 17138 raft_consensus.cc:2272] T ff49f85f979c4df9bed315f95129e685 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.609021 17138 tablet_replica.cc:333] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.609534 17138 raft_consensus.cc:2243] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.609972 17138 raft_consensus.cc:2272] T f7201028b7584d829863e1b74409c065 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.611968 17138 tablet_replica.cc:333] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.612474 17138 raft_consensus.cc:2243] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.612972 17138 raft_consensus.cc:2272] T 9cc5fc5e790a4fbc8b04208992d93869 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.614646 17138 tablet_replica.cc:333] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.615159 17138 raft_consensus.cc:2243] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.615617 17138 raft_consensus.cc:2272] T e367938ddfd64760b6f758e1fdc05c02 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.617512 17138 tablet_replica.cc:333] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.618007 17138 raft_consensus.cc:2243] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.618760 17138 raft_consensus.cc:2272] T 6b61fdb4016749468603ce382b085bee P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.621234 17138 tablet_replica.cc:333] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.621769 17138 raft_consensus.cc:2243] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.622231 17138 raft_consensus.cc:2272] T 1eb765e56b4f42d0a4f2527b9a467598 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.624257 17138 tablet_replica.cc:333] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.624764 17138 raft_consensus.cc:2243] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:45.625188 17138 raft_consensus.cc:2272] T 3efcfa4d196a46dcac96ee2a4000afaf P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.626916 17138 tablet_replica.cc:333] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.627477 17138 raft_consensus.cc:2243] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.628252 17138 raft_consensus.cc:2272] T 188dd58f1c8e4687b93f7e021ad4bf84 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.630110 17138 tablet_replica.cc:333] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8: stopping tablet replica
I20260709 13:22:45.630573 17138 raft_consensus.cc:2243] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.631338 17138 raft_consensus.cc:2272] T e7b0ec114d034617b809288e3289b918 P 87770ebb4d4d45938b280d6f1b21e6f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.671236 17138 tablet_server.cc:196] TabletServer@127.16.188.131:0 shutdown complete.
I20260709 13:22:45.701421 17138 master.cc:562] Master@127.16.188.190:45163 shutting down...
I20260709 13:22:45.729363 17138 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:45.729889 17138 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:45.730191 17138 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5f3f49f73f1c4080bda28e17f0d74978: stopping tablet replica
I20260709 13:22:45.750169 17138 master.cc:584] Master@127.16.188.190:45163 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11851 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24769 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (380807 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:22:45.813961 17138 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 409 messages since previous log ~14 seconds ago
I20260709 13:22:45.814248 17138 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 408 messages since previous log ~14 seconds ago
I20260709 13:22:45.814450 17138 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 405 messages since previous log ~14 seconds ago
I20260709 13:22:45.814682 17138 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:22:45.814893 17138 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:22:45.815081 17138 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~83 seconds ago
I20260709 13:22:45.815332 17138 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 3 messages since previous log ~146 seconds ago
I20260709 13:22:45.815564 17138 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~140 seconds ago
I20260709 13:22:45.815871 17138 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 13:22:45.816191 17138 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
